Looking for a job

Atharva Deshmukh

@atharvadeshmukh2

Message

Data Engineer at LTM building AWS Glue ETL pipelines for 54M+ provider records, with batch processing made 14x faster.

India

Message

At LTM, I built AWS Glue ETL pipelines for a healthcare client's Provider Tiering Data Platform, ingesting 54M+ provider records from Amazon RDS into S3 datasets. I implemented partner-level parallel processing that made batch processing 14x faster.

I also implemented CDC-based incremental loads and developed metadata-driven SQL templates that let new partners onboard through configuration alone. I added data quality checks, execution logging, SNS alerts, and S3-hosted reports to support reliable downstream use.

On my Data Lakehouse Analytics Platform project, I built metadata-driven PySpark pipelines and a Bronze/Silver/Gold architecture on Delta Lake, with schema drift tracking and SCD Type 2. I’m a Databricks Certified Data Engineer Associate and an AWS Certified Cloud Practitioner.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

LTM (formerly LTIMindtree)

Dec 2023 - Present (2 years 10 months)

Built AWS Glue ETL pipelines ingesting 54M+ provider records from Amazon RDS into S3 datasets. Implemented CDC-based incremental loads and metadata-driven SQL templates, achieving 14x faster batch processing.

AWS Glue Python SQL PySpark PostgreSQL S3 Athena CDC Data Quality Terraform GitLab CI CD Cloudwatch SNS IAM

Digital Developer

LTM (formerly LTIMindtree)

Aug 2023 - Dec 2023 (4 months)

Completed structured training in Python, PySpark, and SQL under senior developer mentorship. Assisted in developing and testing features across data pipeline modules with exposure to AWS cloud fundamentals.

Python PySpark SQL AWS