Sushil Kumar
@sushilkumar8
Senior data engineering leader building Azure lakehouse and medallion pipelines with Delta Live Tables.
IndiaWhat I'm looking for
I architect lakehouse and data warehouse platforms on Azure, with a focus on Medallion architecture, Delta Lake, and incremental-loading pipelines using Delta Live Tables and PySpark.
At NAB, I’m building resilient Bronze-to-Silver pipelines with source-system data profiling and automated checkpointing/failure recovery to keep long-running jobs trustworthy. Before that, at DXC I migrated IBM DataStage and PL/1 estates to Azure Databricks and ADF, re-engineering Python/PySpark logic and improving nightly batch runtime from 5 hours to 2—while also implementing CDC logic to keep target tables current.
Experience
Work history, roles, and key accomplishments
AVP – Data Engineering
NAB
Feb 2026 - Present (6 months)
Architected Medallion-based data architectures and engineered high-performance PySpark/DLT pipelines with automated checkpointing and failure-handling.
• Designed and implemented end-to-end ETL/ELT pipelines using Azure Databricks, ADF, and PySpark.
• Led the migration of legacy PL1 programs to optimized Python/PySpark, enhancing data processing efficiency.
• Developed robust CI/CD pipelines with GitHub and Azure DevOps, improving deployment speed .
Associate Manager – Data Engineering
DXC
Dec 2022 - Jan 2026 (3 years 1 month)
Designed end-to-end data ingestion and transformation using Azure Databricks and ADF, migrated legacy ETL jobs, and built modular Python/PySpark frameworks with checkpointing.
Lead Associate
WNS
Dec 2019 - Dec 2022 (3 years)
Modelled a vaccines analytics data warehouse on star schema and migrated legacy SAS/Oracle estate onto Databricks with SCD Type 2 loads.
• Structured enterprise Data Warehouses using optimized Star Schema methodologies to enhance data lifecycle management.
• Developed and tuned Python scripts and complex SQL queries in Databricks, improving query performance by 30%.
• Implemented Slowly Changing Dimension Type 2 (SCD2) principles to maintain historical accuracy in core DWH tables.
IT Analyst
TCS
Jun 2016 - Nov 2019 (3 years 5 months)
Automated data extraction and validation using SAS Macros and performed data profiling with SAS procedures.
• Conducted comprehensive data exploration and validation, analyzing data structures, missing values, and outliers.
• Automated legacy data extraction and refinement processes through reusable SAS Macros and optimized PROC SQL scripts.
• Executed data cleaning and imputation strategies to ensure analytics readiness, enhancing data quality for downstream processes.
Systems Engineer
TCS
Jun 2012 - Jun 2016 (4 years)
Translated customer requirements into Java and Oracle SQL changes with unit testing and Git version control.
Education
Degrees, certifications, and relevant coursework
NIT Jalandhar
Bachelor of Technology - BTech, ECE
2008 - 2012
Dr. B. R. Ambedkar National Institute of Technology Jalandhar
Bachelor of Technology, Electronics & Communication Engineering
2008 - 2012
Bachelor of Technology in Electronics & Communication Engineering from NIT Jalandhar from 2008 to 2012.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Sushil?
You can contact Sushil and 90k+ other talented remote workers on Himalayas.
Message SushilGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
