Vinay Wadhwa
@vinaywadhwa
Azure Data Engineer specializing in Databricks, PySpark, Delta Lake, and scalable cloud-native ETL pipelines.
What I'm looking for
I am an Azure Data Engineer with 3.5+ years building and operating cloud-native ETL/ELT pipelines and Lakehouse architectures on Microsoft Azure.
I designed and implemented Medallion (Bronze/Silver/Gold) Lakehouse patterns on Azure Databricks and Delta Lake, re-platformed legacy jobs to scalable Spark pipelines, and optimized transformations to reduce load windows and execution times.
I have hands-on expertise in Azure Data Factory, Databricks (PySpark/SparkSQL), Delta Lake, ADLS, and Azure Key Vault, and I drive CI/CD integration, data quality checks, and production support while mentoring junior engineers.
I deliver documented, production-grade Python/PySpark modules, enforce Delta best practices, and collaborate with stakeholders to ensure reliable analytics-ready datasets and measurable operational improvements.
Experience
Work history, roles, and key accomplishments
Data Engineer
Cencora
Aug 2024 - Present (1 year 7 months)
Designed and implemented a Medallion Lakehouse on Azure Databricks and Delta Lake, migrated legacy jobs to scalable Spark pipelines, and reduced daily load windows by ~2 hours while improving pipeline reliability and operational efficiency.
Data Science Intern
SCRI
Jul 2021 - Sep 2021 (2 months)
Cleaned agricultural datasets and trained ML models (SVM, Random Forest, Naive Bayes), improving results through feature engineering and model evaluation for an agricultural guidance system.
Education
Degrees, certifications, and relevant coursework
Symbiosis International University
Master of Science, Data Science and Spatial Analytics
Grade: 7.04 GPA
Completed an M.Sc. in Data Science and Spatial Analytics focusing on data analysis, modelling, and spatial analytics methodologies.
University of Mumbai
Bachelor of Science, Information Technology
Grade: 7.9 GPI
Completed a B.Sc. in Information Technology with coursework in programming, databases, and systems relevant to data engineering.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Vinay ?
You can contact Vinay and 90k+ other talented remote workers on Himalayas.
Message VinayFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
