Open to opportunities

Amol Gade

@amolgade

Message

Data Engineer building scalable AWS/Azure pipelines and analytics-ready datasets.

India

Message

What I'm looking for

I’m looking for a Data Engineering role where I can own cloud-native ETL/ELT pipelines on AWS/Azure, strengthen data quality and governance with validation frameworks, and deliver reliable analytics-ready datasets that support BI and ML.

I’m a Data Engineer with 4.6–4.8 years of experience designing, developing, and optimizing scalable data pipelines and distributed processing systems using cloud and big data technologies. I’ve built end-to-end data solutions across AWS and Azure, reducing data latency by 30% and improving pipeline reliability to 99.5%+.

I focus on Medallion Architecture and lakehouse patterns (Bronze → Silver → Curated/Gold) to deliver analytics-ready datasets for BI and machine learning use cases. From event-driven ETL pipelines with PySpark and Deequ validation to orchestrating workflows with Airflow/ADF, I ensure data quality, governance, and performance while shipping 10+ production-grade ETL pipelines.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

E-Zest Solutions Pvt Ltd

Oct 2024 - Present (1 year 8 months)

Built a cloud-native Healthcare Benchmarking Platform on AWS using an event-driven ETL pipeline that ingests multiple sources, validates data with Amazon Deequ, and delivers analytics-ready datasets via Medallion Architecture. Implemented Airflow (MWAA) DAG orchestration and enabled real-time analytics through Amazon Athena.

AWS Glue AWS S3 Amazon Athena Pyspark Apache Spark Deequ EventBridge AWS Lambda

Data Engineer

E-Zest Solutions Pvt Ltd

Apr 2023 - Sep 2024 (1 year 5 months)

Developed an end-to-end Customer Retention Analytics Platform on Azure to analyze engagement patterns and support proactive churn detection. Designed Medallion Lakehouse (Bronze→Silver→Gold) pipelines with Azure Data Factory and Azure Databricks (PySpark), and delivered curated datasets for Power BI dashboards and ML use cases.

Azure Data Factory Azure Databricks Pyspark Apache Spark Delta Lake Power BI Jenkins

Data Engineer

E-Zest Solutions Pvt Ltd

Jan 2021 - Mar 2023 (2 years 2 months)

Built a cloud-based Clinical Study Data Platform on AWS to centralize and process clinical research data from multiple sources (CDM systems, SQL Server, CSV uploads). Implemented Medallion Architecture with Spark on AWS EMR, automated ingestion to S3, and added data quality validation using Amazon Deequ with reporting consumption via Redshift/Aurora PostgreSQL.

Pyspark Apache Spark AWS Glue Amazon S3 Deequ Amazon Redshift Parquet