Kalash Jindal
@kalashjindal
Senior data engineer building scalable AWS/Databricks ETL pipelines with reliable SLAs.
IndiaWhat I'm looking for
I’m a Senior Data Engineer with 4+ years of experience building scalable, distributed data platforms in AWS and Databricks. At NASDAQ, I architected and scaled distributed data systems using AWS, PySpark, and Databricks, supporting 200+ datasets across multiple ingestion pipelines.
I specialize in ETL/ELT workflows and pipeline optimization—implementing PySpark and Delta Live Tables to process large-scale batch and streaming workloads handling millions of records daily. I migrated 20+ legacy Airflow DAGs to Databricks workflows and standardized ingestion frameworks across 50+ datasets to improve consistency and onboarding speed.
I focus on data reliability and operational excellence: I managed and monitored hundreds of ingestion pipelines with consistent SLA adherence, implemented automated validation checks to reduce manual effort, and improved observability through logging and monitoring. Previously at Knowledge Foundry Business Solutions, I optimized ETL pipelines achieving 4x cost reduction, and I started with API-based ingestion pipeline development as a Data Engineer Intern.
Experience
Work history, roles, and key accomplishments
Architected distributed data platform on AWS and Databricks, supporting 200+ datasets. Implemented ETL workflows with PySpark and Delta Live Tables for large-scale batch and streaming workloads. Migrated 20+ Airflow DAGs to Databricks, managed 100s of pipelines with SLA adherence. Orchestrated CI/CD using Jenkins and GitHub Actions.
Data Consultant
Knowledge Foundry
Oct 2021 - Nov 2023 (2 years 1 month)
Optimized ETL pipelines achieving 4x cost reduction. Built distributed data processing systems using PySpark and AWS for large-scale structured and unstructured datasets. Designed cloud workflows leveraging S3, EC2, and Airflow for batch processing. Automated ML workflows including preprocessing, feature engineering, and model tuning pipelines.
Data Engineer Intern
Zepanalytics
May 2021 - Oct 2021 (5 months)
Developed API-based ingestion pipelines integrating 5+ external data sources for downstream analytics. Built web scraping frameworks for high-volume structured and semi-structured datasets and improved MySQL query performance to reduce execution time for frequently used queries.
Education
Degrees, certifications, and relevant coursework
Feroze Gandhi Institute of Engineering and Technology
Bachelor of Technology, Computer Science and Engineering
2017 - 2021
Completed a B.Tech in Computer Science and Engineering at Feroze Gandhi Institute of Engineering and Technology from 2017 to 2021.
Availability
Location
IndiaAuthorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Kalash?
You can contact Kalash and 90k+ other talented remote workers on Himalayas.
Message KalashFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
