Lavanya V
@lavanyav1
Data Engineer specializing in Lakehouse pipelines, data validation, and reliability—modernizing legacy systems for trusted analytics.
IndiaWhat I'm looking for
I’m a Data Engineer with 5+ years of experience across insurance and healthcare, specializing in Lakehouse pipeline design and data reliability engineering. I’ve built end-to-end ETL ingestion pipelines, designed Bronze/Silver/Gold Delta Lake models, and focused on disciplined data validation and reconciliation to deliver trusted, analytics-ready datasets.
Across modernization and operations, I migrated SAS programs into PySpark and Delta Lake pipelines, tuned Spark and Delta workloads using partitioning, Z-Ordering, and OPTIMIZE/VACUUM, and implemented sensitive-data handling for compliance. I’m now looking to extend my foundation toward broader platform ownership and cross-functional impact, with strong orchestration, infrastructure-as-code, and SLA-focused delivery.
Experience
Work history, roles, and key accomplishments
Data Engineer
Tata Consultancy Services
Jan 2024 - Present (2 years 6 months)
Built end-to-end ETL ingestion pipelines for multiple insurance partners using Delta Lake lakehouse models. Managed Databricks infrastructure-as-code, handled PII with encryption/access controls, and optimized Spark/Delta performance to improve query times and reliability.
Databricks Developer
Tata Consultancy Services
Jan 2022 - Jan 2024 (2 years)
Migrated a large SAS program portfolio into PySpark and Delta Lake pipelines as part of a lakehouse modernization effort. Validated migration accuracy through SAS-to-PySpark output reconciliation to support UAT sign-off and reduce rework.
SAS Developer & Automation Engineer
Tata Consultancy Services
Jan 2021 - Jan 2022 (1 year)
Optimized SAS EG programs for enterprise reporting and dashboards by addressing recurring data inconsistencies. Automated monitoring and alerting and managed batch scheduling dependencies to ensure dependable data delivery.
IT Operations Analyst
Accenture
Jan 2019 - Jan 2020 (1 year)
Monitored application health and batch executions to uphold data pipeline reliability and SLA compliance. Investigated and resolved job/server failures, coordinating root-cause analysis with infrastructure and database teams through ServiceNow.
Education
Degrees, certifications, and relevant coursework
ACE Engineering College
Bachelor of Technology (B.Tech), Electronics & Communication Engineering
2015 - 2019
Earned a B.Tech in Electronics & Communication Engineering at ACE Engineering College under JNTUH from 2015 to 2019.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Lavanya?
You can contact Lavanya and 90k+ other talented remote workers on Himalayas.
Message LavanyaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
