Ankush Verma
@ankushverma2
Senior Data Engineer specializing in Azure, Databricks, PySpark, and ETL pipelines.
What I'm looking for
I am a Senior Data Engineer and Cloud Specialist with 15+ years of experience designing, migrating, and optimizing large-scale data pipelines and cloud architectures. I have led end-to-end Azure and Databricks migrations (50TB+), achieved 35% cost savings, reduced ETL runtimes by 40%, and implemented automation that cut manual effort by 60%.
I architect scalable solutions using PySpark, Delta Lake, Spark Structured Streaming, and SparkSQL, and I mentor cross-functional teams to deliver timely, high-quality outcomes. My work emphasizes data integrity, performance tuning, and cost optimization to enable faster, more reliable analytics and ML workflows.
Experience
Work history, roles, and key accomplishments
Architected and implemented a raw data layer of 1000+ tables, reducing query complexity and improving data accessibility by 40%; engineered joins across 500M+ rows, enhancing downstream report accuracy by 35%.
Senior Data Engineer
EXL
Apr 2023 - Jul 2024 (1 year 3 months)
Led migration of 50TB to Azure Cloud, reducing ML training time by 40% and achieving 35% licensing cost savings; engineered robust joins for marts and ensured 100% data integrity through rigorous validation.
Senior Consultant
Exusia
Oct 2022 - Feb 2023 (4 months)
Directed Azure migration POCs and transitioned ETL workflows to Databricks, increasing processing efficiency by 30% and tuning ETL pipelines to cut runtime by 40%.
Senior Data Engineer
Optum Global Solutions
Jan 2018 - Jan 2022 (4 years)
Spearheaded Azure migration initiatives and delivered Phase 1 Azure Databricks staging loads in-house, improving query efficiency and analytics usability while mentoring 5 team members.
IT Analyst
TCS
Nov 2014 - Jan 2018 (3 years 2 months)
Automated mission-critical processes reducing manual effort by 60% and developed production job monitoring tools to decrease dependency on SRE teams and accelerate issue resolution.
Software Engineer
Accenture
Jun 2010 - Jun 2014 (4 years)
Designed and implemented ETL workflows that improved system reliability by 30% and reduced onboarding time for new developers by 25% through standardized pipeline patterns.
Education
Degrees, certifications, and relevant coursework
Swami Vivekanand Institute of Engineering and Technology
Bachelor of Technology, Computer Science
2005 - 2009
Completed Bachelor of Technology in Computer Science, focusing on core computer science subjects and engineering fundamentals.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Ankush?
You can contact Ankush and 90k+ other talented remote workers on Himalayas.
Message AnkushFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
