At Metro Labs Pvt Ltd, I implemented data validation, profiling, and transformation frameworks using Python and SQL to improve data quality, accuracy, and integrity.
I developed scalable ETL/ELT pipelines with PySpark, Databricks, Pandas, and Python to process and transform datasets, and designed workflows to ingest data from relational databases, REST APIs, and flat files.
I built data models, warehouse schemas, and optimized data marts for analytics and reporting. I also orchestrated pipelines with Apache Airflow and developed dbt transformation models.
I supported migration of legacy on-premises data platforms to Snowflake and BigQuery, and worked with AWS and GCP data architectures. I implemented pipeline monitoring and automated deployments using GitLab CI/CD.
