Kalyani Jagdale
@kalyanijagdale
Senior Data Engineer with 11+ years building reliable batch and streaming data pipelines.
What I'm looking for
I’m a Senior Data Engineer with 11+ years of hands-on experience across the Big Data and Analytics ecosystem, delivering solutions across banking and telecom industries. I bring end-to-end ownership across the full data lifecycle, from requirement gathering and data analysis to data modeling, development, testing, deployment, and maintenance.
My technical expertise spans Spark, Scala, Python, Google Cloud and its services, DBT, Dagster, and Airflow—alongside BigQuery, Data Vault, Oracle, SQL, Delta Lake, Kafka, ETL, Hive, Impala, Oozie, and Linux. I focus on performance optimization and reliability in both batch and streaming data pipelines.
In my roles, I’ve worked on operational excellence and stability: troubleshooting, deployment support, and maintenance of large-scale applications. I’ve also performed batch mark testing for query optimization and batch performance improvement.
I’m collaborative and agile-minded, with a proven ability to build business-oriented, high-performance solutions in agile environments. I’m committed to fostering a positive, efficient, high-performing work culture and I’m passionate about working with data to uncover insights through analysis and exploration.
Experience
Work history, roles, and key accomplishments
Develops and maintains batch and streaming data pipelines across the data lifecycle, focusing on performance optimization and reliability using Spark, Python, and Google Cloud. Applies data modeling and end-to-end pipeline development practices in agile environments.
Senior Project Engineer at Wipro Limited.
Hadoop Ecosystems: Hive, Scala, Spark, Impala, Oozie, CDH, Yarn,
Other : Unix Shell Scripting, Autosys, TWS,DR
• Performed batch mark testing for Query Optimazation and Batch performance improvement.
• Developed and automated various cluster health check, usage, capacity related reports using Hive, Scala, Spark and UNIX shell scripting.
• Developed wrapper script to invoke all the batch jobs run
Assistant System Engineer Trainee at Tata Consultancy Services.
Education
Degrees, certifications, and relevant coursework
Sinhgad College of Engineering
Bachelor of Engineering
2010 - 2014
Earned a Bachelor of Engineering (BE) from Sinhgad College of Engineering from 2010 to 2014.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Kalyani?
You can contact Kalyani and 90k+ other talented remote workers on Himalayas.
Message KalyaniGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
