Piyush Patil
@piyushpatil2
Data Engineer with 3+ years building high-reliability ETL and real-time streaming pipelines.
IndiaWhat I'm looking for
I’m a Data Engineer with 3+ years of experience designing and optimizing large-scale ETL pipelines, real-time data platforms, and cloud-based analytics solutions in the banking domain.
At Axis Bank, I architected automated master-data synchronization workflows using Quickworks, eliminating recurring production sync failures and saving 4–5 hours of manual effort daily. I also optimized SQL and redesigned data models to reduce dashboard response time by 40%, while improving reporting efficiency.
I build and operate AWS-based data solutions with Apache Spark on EMR, orchestrated through Apache Airflow, and I emphasize reliability through observability across Kafka, S3, and reporting systems. I’ve driven measurable outcomes like improving pipeline performance by 40%, achieving 99.9% platform reliability, and integrating Jacoco testing into CI/CD pipelines to reduce production defects.
Experience
Work history, roles, and key accomplishments
Deputy Manager
Axis Bank
Apr 2023 - Present (3 years 2 months)
Architected automated master-data synchronization workflows with Quickworks, eliminating recurring production sync failures and saving 4–5 hours of manual effort daily. Optimized AWS EMR Spark ETL orchestrated via Airflow, cut dashboard response time 40%, improved CI/CD with JaCoCo coverage (90–95%), and maintained 99.9% platform uptime using Kafka/S3 observability and proactive incident managemen
Assistant Manager
Axis Bank
Jul 2022 - Mar 2023 (8 months)
Resolved critical data pipeline failures through root-cause analysis and corrective actions to keep analytics operations uninterrupted. Built Kafka-based ETL and observability pipelines, implemented data validation and engineering standards to improve data quality and reduce release defects, and coordinated with product, QA, and infrastructure teams across business domains.
Education
Degrees, certifications, and relevant coursework
CDAC Bangalore
Post Graduate Diploma in Big Data Analytics, Big Data Analytics
2021 - 2022
Completed a Post Graduate Diploma in Big Data Analytics, focusing on large-scale data analytics and processing.
Mumbai Educational Trust (MET League of Colleges)
Bachelor of Engineering, Electronics and Telecommunication Engineering
2017 - 2020
Completed a Bachelor of Engineering in Electronics and Telecommunication Engineering.
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Piyush?
You can contact Piyush and 90k+ other talented remote workers on Himalayas.
Message PiyushFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
