Karan Kamat
@karankamat
Data engineer with 3+ years building scalable ETL/ELT, real-time streaming, and governed lakehouse pipelines in the cloud.
IndiaWhat I'm looking for
I’m a Data Engineer with 3+ years designing and optimizing production-grade ETL/ELT pipelines, real-time streaming systems, and cloud data platforms. I work end-to-end across Apache Spark/PySpark, Kafka, and Airflow on AWS, with CI/CD delivery via Azure DevOps.
I’ve built a full Lakehouse on Databricks using Medallion Architecture, Delta Lake ACID transactions, and Unity Catalog governance—backed by data lineage and audit logging. I bring strong data modeling (Kimball Star Schema, SCD Type 1 & 2), automated data quality frameworks, and close partnership with BI/analytics teams to ship reliable pipelines on time.
Experience
Work history, roles, and key accomplishments
Designed and deployed distributed ETL/ELT pipelines with Apache Spark/PySpark, improving runtime by 35–40% and batch processing time by 60% through SQL optimization, partitioning, and join/shuffle tuning. Built real-time Kafka streaming pipelines and orchestrated batch/streaming jobs with Airflow, embedding data quality checks to improve downstream dataset trust.
Software Engineering Intern
Yardi Software India
Jan 2022 - Jun 2022 (5 months)
Refactored and performance-tuned high-frequency SQL queries by removing redundant subqueries and adding targeted indexes, reducing data retrieval time by 25%. Authored SQL scripts to resolve client-reported data issues, cutting average resolution time by 30% and improving query performance.
Education
Degrees, certifications, and relevant coursework
MIT School of Engineering
Bachelor of Technology, Computer Science and Engineering
2019 - 2022
Grade: CGPA: 7.82
Earned a B.Tech in Computer Science and Engineering at MIT School of Engineering from 2019 to 2022, graduating with a CGPA of 7.82.
Cusrow Wadia Institute of Technology
Diploma in Computer Engineering, Computer Engineering
2016 - 2019
Grade: 76.56%
Completed a Diploma in Computer Engineering from Cusrow Wadia Institute of Technology between 2016 and 2019, achieving 76.56%.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Portfolio
github.com/KaranKamat0506Salary expectations
Social media
Job categories
Skills
Interested in hiring Karan?
You can contact Karan and 90k+ other talented remote workers on Himalayas.
Message KaranGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
