Looking for a job

Yash Khanna

@yashkhanna1

Data Engineer at Tata Technologies who cut batch runtimes by approximately 75% with incremental processing and Spark tuning.

India

Message

At Tata Technologies, I engineer production batch and incremental EV/PV pipelines using Databricks, PySpark, SparkSQL, and Delta Lake. I migrated Spark and Parquet workloads to Delta Lake, reducing batch runtimes by approximately 75% through incremental processing and Spark tuning.

At BusinessNext, I executed CRM and STP initiatives for BFSI and asset-management clients, translating business requirements into integrations and functional specifications. I also delivered more than 1,300 enhancements and change requests, supporting SQL validation, SIT/UAT, defect resolution, and production releases.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Tata Technologies

Feb 2025 - Present (1 year 7 months)

Engineer production batch and incremental EV/PV pipelines using Databricks, PySpark, SparkSQL, Delta Lake, Amazon EMR, and S3. Migrated Spark/Parquet workloads to Delta Lake, reducing batch runtimes by approximately 75% through incremental processing and Spark tuning.

Databricks PySpark SparkSQL Delta Lake Amazon EMR S3 Airflow Git Elasticsearch Kibana Hive OLAP Azure Blob Storage SFTP APIs

Business Analyst - Data Engineering & Integration

BusinessNext

Apr 2021 - Jan 2025 (3 years 9 months)

Executed CRM and STP initiatives for 5 BFSI and asset-management clients across sales, onboarding, servicing, and digital lending. Translated business requirements into API/ETL integrations, data mappings, transformation rules, validation logic, and functional specifications.