Open to opportunities

shivam kapoor

@shivamkapoor1

Message

Data Engineer with expertise in data pipelines and quality management.

India

Message

What I'm looking for

I am looking for a role that fosters innovation and offers opportunities for professional growth, ideally in a collaborative environment.

I am a dedicated Data Engineer currently working at Deloitte Consulting, where I specialize in the telecommunication and insurance sectors. My role involves leading a team of four members, where I assign daily tasks and assist with technical issues to ensure timely deliverables to our clients. I have successfully analyzed code bases and documented technical and functional details, which has significantly reduced developer onboarding time by 70%.

One of my key achievements includes developing and implementing a Data Quality Management (DQM) framework in our data pipelines, which has improved data delivery efficiency and reduced the failure rate in production by 80%. I also led the optimization of our CI/CD pipeline, which aggregated data from multiple sources, reducing runtime from 18 hours to just 5 hours and saving the company approximately $20,000 per week. My experience with tools like Databricks, AWS, and Snowflake has enabled me to create end-to-end data pipelines and automate validation processes, ultimately saving our clients significant costs.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer (Telecommunication & Insurance)

Current

Deloitte Consulting

Sep 2021 - Present (3 years 10 months)

Led a team of four data engineers, overseeing daily tasks and ensuring timely client deliverables. Developed and implemented a Data Quality Management framework, significantly reducing production failure rates by 80%, and optimized CI/CD pipelines to cut data runtime from 18 to 5 hours, saving USD 20K weekly. Additionally, created end-to-end data pipelines for Databricks data lake processing and a

AWS Python Databricks Snowflake Apache Airflow SQL DBT Tableau

Education

Degrees, certifications, and relevant coursework

Kurukshetra University

Bachelor of Science, Computer Science

Grade: 7.5/10 CGPA

Activities and societies: NCCC Certificate (Under Officer overstudied 70 cadets in NCC 14 HR battalion); Member of Tech KnowGeek Club organised and participated in 50+ events; Played inter College Football and won prizes in Bhangra Dance; Organised sessions for Personality Grooming and Public Speaking in tandem with juniors.

Studied core concepts of computer science, including programming, data structures, and algorithms. Gained foundational knowledge in software development and system design.