Open to opportunities

Himanshu Gautam

@himanshugautam2

Message

I build AWS-based ETL pipelines and CDC ingestion for analytics in Redshift and S3.

India

Message

What I'm looking for

I’m looking for a role where I can own AWS-based data pipelines end to end—ETL/CDC, orchestration, and reporting—so teams get timely, reliable analytics with secure, scalable design.

I’ve built end-to-end AWS Glue ETL pipelines that extract from MySQL, stage in S3, and load into Redshift for downstream analytics, including bulk + incremental strategies and upsert/append patterns. At PB Fintech, I designed scalable ingestion pipelines across MongoDB, Kafka, and internal databases, then used AWS DMS CDC with SHA256 PII hashing, retention policies, and schema management for compliant analytics.

I also orchestrate reliable workflows with production-grade Apache Airflow DAGs and AWS Step Functions, including a metadata-driven framework using control tables to dynamically manage ingestion across multiple datasets. Earlier, I helped move an org data warehouse toward a cloud data lake on AWS and improved query performance with Athena while automating reporting with PySpark and SQL.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Mar 2026 - Present (5 months)

Built an end-to-end AWS Glue based ETL pipeline to extract data from MySQL, stage it in S3, and load it into Redshift for downstream analytics. Developed a metadata-driven framework using control tables to dynamically manage ingestion workflows.

Python PySpark SQL AWS S3 Glue Redshift MySQL

Data Engineer

PB Fintech

Apr 2025 - Mar 2026 (11 months)

Designed and executed scalable ETL pipelines to ingest and process data from various sources including MongoDB, Kafka, and internal databases in AWS S3. Deployed a Delta Lake architecture-based AWS-DMS CDC ingestion pipeline with PII data hashing and retention policies.

Python PySpark SQL AWS S3 Glue Redshift DMS MongoDB Kafka Delta Lake Airflow QuickSight Power BI

Data Engineer

Care Insurance

Jun 2022 - Aug 2023 (1 year 2 months)

Assisted in transitioning the organizational data warehouse to a cloud-based Data Lake architecture using AWS. Engineered SQL-based analytics with AWS Athena, enhancing query performance by 25%.

Python SQL AWS S3 Glue Athena PySpark Airflow

Data Analyst Intern

INeuron

Nov 2020 - Mar 2021 (4 months)

Crafted an ETL pipeline using Python (Pandas) that replaced 3 hours of daily manual data comparison, increasing efficiency and enabling faster data validation.

Python Pandas ETL