Abhinav Dhiman
@abhinavdhiman1
Senior Data Engineer with expertise in scalable data solutions.
What I'm looking for
I am a Senior Data Engineer with 6 years of experience specializing in building scalable data pipelines and analytics solutions. My expertise lies in cloud architecture, data modeling, and big data frameworks, particularly in AWS and Azure environments. I have a proven track record of implementing efficient ELT pipelines and designing Lakehouse architectures that enhance data processing capabilities.
At Capgemini Invent, I successfully reduced data latency by 35% through the implementation of scalable ELT pipelines using AWS Glue and S3. My role involved automating metadata-driven transformations with dbt, which significantly improved data quality and reusability. I also integrated CI/CD pipelines using GitHub Actions, which accelerated deployment cycles and ensured robust version control.
Previously, at T-Systems ICT India, I developed data pipelines using Apache Airflow and AWS Lambda, processing large datasets efficiently. My collaborative work in Agile/Scrum environments enforced strong data governance and documentation standards. I am passionate about leveraging data to drive insights and support decision-making processes.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer (Consultant)
Capgemini Invent
Nov 2021 - Present (3 years 9 months)
Implemented scalable ELT pipelines using AWS Glue, S3, and Step Functions, reducing data latency by 35%. Designed and deployed a Lakehouse architecture in Azure Databricks following the Medallion model, enabling unified processing of batch and streaming data at scale.
Data Engineer (Associate Consultant)
T-Systems ICT India Pvt Ltd
Dec 2018 - Nov 2021 (2 years 11 months)
Developed robust data pipelines with Apache Airflow and AWS Lambda for both batch and real-time ingestion. Modeled enterprise data warehouse structures using star and snowflake schemas, reducing report generation time. Processed and transformed datasets exceeding 5+ TB using Redshift and PostgreSQL with optimized SQL queries and indexing strategies.
Education
Degrees, certifications, and relevant coursework
Chandigarh Engineering College
Bachelor of Technology, Computer Science & Engineering
2015 - 2019
Completed a Bachelor of Technology in Computer Science & Engineering. Gained foundational knowledge in computer science principles and engineering practices.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Abhinav?
You can contact Abhinav and 90k+ other talented remote workers on Himalayas.
Message AbhinavFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
