Durgesh Pedgaonkar
@durgeshpedgaonkar
Senior Data Engineer with expertise in Azure and data solutions.
IndiaWhat I'm looking for
As a Senior Data Engineer with over 10 years of professional experience, I am passionate about leveraging my expertise in data engineering and cloud solutions to drive product innovation and analytics. My career highlights include significant contributions to projects that enhance customer insights and optimize data processes.
One of my key achievements was driving the Hadoop-to-Azure Fabric migration, which enabled a 30% cost savings and enhanced uptime for critical analytics services. Additionally, I automated manual Excel reporting by developing a Power BI Dashboard, saving 10 hours of manual work each month. My experience also includes building and orchestrating ADF pipelines to ingest, transform, and feed data into Azure ML for model training and inference.
Experience
Work history, roles, and key accomplishments
ADSenior Data Engineer
Amnet Digital
Oct 2021 - Oct 2021 (0 months)
Drove Hadoop-to-Azure Fabric migration, enabling 30% cost savings and enhanced uptime for critical analytics services. Automated manual Excel reporting by developing a Power BI Dashboard Integrating Azure fabric tables saving 10 Hours monthly manual work. Built and orchestrated ADF pipelines to ingest, transform, and feed data into Azure ML for model training and inference.
ITData Engineer
IDC Technologies
Apr 2021 - Aug 2021 (4 months)
Tuned Hive queries for enhanced performance on large-scale datasets and converted logs into Hive tables. Optimized SQL database queries, reducing load times by 20% and enhancing user experience.
COSenior Associate
Cognizant
Aug 2018 - Jun 2019 (10 months)
Implemented features that helped end-user clients gain insights into spending habits. Created customized entities in NiFi with Groovy script for data transformation and built a pipeline from scratch in NiFi for a financial data dashboard.
ZTBig Data Developer
Zensar Technologies
May 2012 - Mar 2018 (5 years 10 months)
Worked on distributed system development for the manufacturing domain. Transformed data in batch processing to gain user personal information for marketing products and handled independent components of data processing tasks.
Education
Degrees, certifications, and relevant coursework
Savitribai Phule Pune University
Master's, Geoinformatics
2009 - 2011
Completed a Master's degree in Geoinformatics. Focused on advanced topics within the field.
Savitribai Phule Pune University
Bachelor of Computer Science, Computer Science
2005 - 2009
Obtained a Bachelor's degree in Computer Science. Gained foundational knowledge in computer science principles.
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Durgesh?
You can contact Durgesh and 90k+ other talented remote workers on Himalayas.
Message DurgeshFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
