Adit Chauhan
@aditchauhan
Senior data engineer specializing in AWS pipelines, orchestration, and generative AI for fintech-scale analytics.
IndiaWhat I'm looking for
I’m an enthusiastic data engineer with 6+ years of consulting experience, specializing in cloud computing, big data management, pipeline orchestration, and generative AI. I’ve contributed to data engineering work across clients including LinkedIn and Visa, and I’m currently leading Data Engineering for Visa Fintech.
I build and scale end-to-end pipelines using Apache Spark (Scala), PySpark, and Apache Airflow on AWS (EMR, S3, EC2), with a strong focus on data quality, performance, and auditability. From migrating production pipelines to Databricks (Delta Lake with CDC via MERGE INTO, schema evolution, time travel) to cutting runtime by 40% through Spark optimization, I consistently deliver faster, more reliable data flows. I also work on generative AI—developing vector embeddings and training datasets with OpenAI (and building chatbot experiences on GCP)—to turn data into actionable insights.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
Paytm
Sep 2025 - Present (9 months)
Built and maintained 10+ end-to-end reporting pipelines using Apache Spark (Scala) and Apache Airflow on AWS EMR, processing millions of loan records daily for business intelligence and compliance reporting. Developed dynamic, runtime-filtered reporting with reference tracking and API integration, reducing manual SQL changes and improving stakeholder self-service.
Senior Data Engineer
Blend360 Data Warehouse
Jan 2022 - Jan 2025 (3 years)
Led a data engineering team for Visa Fintech and delivered Spark/Python transaction analytics pipelines, achieving a 40% runtime reduction through Spark optimization and orchestration improvements. Migrated a product dashboard scorecard pipeline to Databricks Delta Lake with CDC (MERGE INTO), improving reliability and update speed with optimizations such as Z-Ordering/OPTIMIZE and secure governanc
Associate Consultant
CoreCompete
Jan 2019 - Jan 2022 (3 years)
Designed and built AWS-based ETL pipelines and analytics for Advance Auto Parts demand prediction and assortment optimization, using S3/Lambda/EC2 and Amazon Redshift for large-scale modeling support. Developed automated data lineage/data catalog extraction by parsing SQL and ETL transformations, and built serverless workflows for real-time schema change detection and on-time data updates.
Education
Degrees, certifications, and relevant coursework
MLR INSTITUTE OF TECHNOLOGY
2015 - 2019
Grade: CGPA: 8.5
Built and maintained 10+ end-to-end reporting pipelines using Apache Spark (Scala) and Apache Airflow on AWS EMR, and earned a CGPA of 8.5.
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Adit?
You can contact Adit and 90k+ other talented remote workers on Himalayas.
Message AditFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
