PMPiyush Mujavadiya
@piyushmujavadiya
Lead Data Engineer with expertise in scalable data platforms.
ZimbabweWhat I'm looking for
I am a Lead Data Engineer with over 8 years of experience in designing and implementing scalable, cloud-native data platforms and streaming pipelines. My expertise lies in Apache Spark, Kafka, Airflow, and cloud ecosystems like AWS and GCP. I have a proven track record of reducing infrastructure costs and boosting ML deployment speed while leading cross-functional teams.
Throughout my career, I have successfully architected and deployed data solutions that support hundreds of data analysts and engineers. My work includes developing an event ingestion platform that handles over 10 billion events daily and implementing automated MLOps pipelines that accelerated model deployment from two days to just 30 minutes. I am passionate about building high-performance data systems and contributing to open-source projects.
Experience
Work history, roles, and key accomplishments
Lead Data Engineer
Apnatime Tech
May 2022 - Present (3 years 1 month)
Led end-to-end architecture of a data platform supporting over 100 data analysts, software engineers, and data scientists. Designed and deployed an event ingestion platform handling 10B+ events daily, leveraging Spring Boot Reactive Framework to significantly improve data pipeline throughput and reduce latency. Accelerated ML model deployment from 2 days to 30 minutes by implementing automated MLO
Senior Data Engineer
To The New
Jul 2021 - Apr 2022 (9 months)
Helped create and manage a Central Data Lake with multiple integrations for different business verticals. Led the development of a real-time pipeline using Confluent Kafka, Spark Structured Streaming, and Confluent Kafka Connectors for customer transaction data at a large scale (60M+/day). Optimized Spark jobs, reducing resource utilization by 50% while maintaining performance.
Senior Data Engineer
Innoeye Technologies
May 2020 - Jul 2021 (1 year 2 months)
Collaborated with multiple teams and management to understand requirements and design products for advanced telecom analytics. Optimized and re-architected Spark Jobs to cut resources by 80%. Built streaming services for real-time processing of 10M users using Java and Kafka.
Education
Degrees, certifications, and relevant coursework
IPS Academy, Indore
Bachelor of Computer Science Engineering, Computer Science Engineering
Studied Computer Science Engineering at IPS Academy, Indore. The curriculum covered various aspects of computer science and engineering principles.
Tech stack
Software and tools used professionally
Availability
Location
ZimbabweAuthorized to work in
Job categories
Interested in hiring Piyush?
You can contact Piyush and 90k+ other talented remote workers on Himalayas.
Message PiyushFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
