AWS Data engineer, Databricks data engineer, python, sql, spark, pyspark

Shivam Nahar
@shivamnahar
Senior Data Engineer at EPAM building replayable AWS pipelines and migrating S3 datasets to Delta Lake.
What I'm looking for
At EPAM, I refactored the ETL onboarding platform from single-tenant to multi-tenant for 15+ enterprise customers. I also engineered idempotent batch replay and recovery with SQS-backed concurrency control and EventBridge scheduling.
I designed a Customer Feedback Ecosystem pipeline and migrated Amazon S3 datasets into a redesigned Delta Lake medallion architecture. Previously at Accenture, I delivered production batch ETL pipelines for the public sector, including governed S3 data layers, quality checks, and recovery workflows.
Experience
Work history, roles, and key accomplishments
Refactored onboarding pipeline to multi-tenant, supporting 15+ enterprise customers and 2 downstream systems. Built dependency inventory, idempotent replay logic, and observability layer with AWS Timestream.
Led end-to-end delivery of production batch ETL pipelines for the public sector using AWS Glue and Step Functions. Built medallion data layers, implemented SCD and data quality checks, and owned CI/CD with CloudFormation and Terraform.
Education
Degrees, certifications, and relevant coursework
Madhav Institute of Technology & Science
Bachelor of Engineering, Electronics & Communication
2015 - 2019
Grade: 7.62 CGPA
Pursued a Bachelor of Engineering in Electronics & Communication, achieving a CGPA of 7.62.
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Shivam?
You can contact Shivam and 90k+ other talented remote workers on Himalayas.
Message ShivamGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
