Praveen Kumar
@praveen-yadav
Data engineer specializing in scalable pipelines, Databricks, and high-volume streaming systems.
IndiaWhat I'm looking for
I am a data engineer with hands-on experience designing and scaling large-scale ETL and streaming pipelines, migrating analytics platforms, and optimizing data storage and query performance. I have delivered production systems that process hundreds of millions of records per day, improved dashboard performance, and implemented robust monitoring and data quality checks.
My background includes Databricks Delta Lake, Spark/PySpark, Neo4j graph ingestion, and migrations from BigQuery, plus experience with observability (Grafana, Prometheus) and containerized services. I hold a B.Tech in Biotechnology and certifications including Databricks Certified Data Engineer Associate, and I consistently apply engineering rigor to improve performance, reliability, and predictive outcomes.
Experience
Work history, roles, and key accomplishments
Data Engineer II
Aidetic Software Private Limited
Feb 2025 - Present (1 year 5 months)
Led end-to-end Apache Superset migration for Myntra and implemented monitoring with Grafana/Prometheus, improving system performance by 20% and enabling reliable processing of over 400M records/day.
Architected genealogy data models and scalable OLAP SparkSQL solutions on Databricks, ingesting and scaling graph data to 100M+ nodes/edges and improving ML predictive accuracy by 11%.
Data Engineer I
Vanguard Supply Chain Solutions
Jan 2023 - Nov 2023 (10 months)
Built Databricks dashboards and analytics for distribution centers, improving truck time efficiency by 30% and implementing proactive alerts to ensure animal route compliance.
Education
Degrees, certifications, and relevant coursework
Motilal Nehru National Institute of Technology
Bachelor of Technology, Biotechnology
2019 - 2023
Grade: CGPA: 7.38
Completed a Bachelor of Technology in Biotechnology with a cumulative CGPA of 7.38, focusing on interdisciplinary technical coursework and practical projects.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Portfolio
mr-airflow.github.io/portfolioSocial media
Job categories
Skills
Interested in hiring Praveen?
You can contact Praveen and 90k+ other talented remote workers on Himalayas.
Message PraveenGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
