vamsi krishna
@vamsikrishna8
Data Engineer specializing in Azure lakehouse platforms, metadata-driven pipelines, and real-time ingestion.
IndiaWhat I'm looking for
I’m a results-driven Data Engineer with 5.8+ years of experience designing, building, and operating Azure-based Lakehouse platforms for enterprise batch and streaming workloads. I bring deep expertise across Azure Data Factory, Azure Databricks, PySpark, Delta Lake, and Unity Catalog, focused on production-ready reliability and business impact.
I’ve delivered metadata-driven ingestion frameworks, incremental and CDC pipelines, and Delta-based analytical layers that enable trustworthy analytics for enterprise consumers. In my work, I build scalable ingestion using Auto Loader, add schema evolution support, and implement data quality checks with audit logging and reconciliation controls.
On governance and operations, I’ve implemented fine-grained access and lineage visibility through Unity Catalog, and I continuously improve performance and cost through OPTIMIZE, Z-ORDER, Liquid Clustering, and partition strategies. I’m especially proud of designing standardized error-handling and retry mechanisms that improve pipeline stability, SLA adherence, and day-to-day operational confidence.
Experience
Work history, roles, and key accomplishments
Data Engineer
Datarise Solutions
May 2025 - Present (1 year 1 month)
Led design and implementation of an Azure Lakehouse for Barnes & Noble, building metadata-driven ingestion in Azure Data Factory and PySpark/Delta transformations for curated Delta Gold tables used by Power BI and Synapse consumers. Implemented Unity Catalog governance, SCD Type 1/2 with Delta MERGE, data-quality auditing, and performance optimization (OPTIMIZE, Z-ORDER, Liquid Clustering) to impr
Associate Data Engineer
Oct 2021 - Mar 2024 (2 years 5 months)
Designed and built Azure Data Factory and Azure Databricks pipelines for a banking client, extracting from SFTP into Azure and transforming data into staging and curated Delta Lake layers using PySpark and SQL. Developed reusable SCD Type 1/2 and fact-table frameworks, scheduled ADF triggers, delivered analytics-ready datasets for Power BI, and supported root-cause analysis to reduce pipeline down
Created SQL Server database objects including tables, simple views, and sequences based on business requirements, using DDL, DML, TCL, and DRL statements. Implemented staging loads with global temporary tables and external tables, created backup tables via CTAS, improved performance with indexes, handled NULLs with NVL/NVL2/COALESCE, and supported SDLC activities including code impact analysis.
ETL Testing
Infosol Technosol
May 2019 - May 2021 (2 years)
Validated ETL processes by analyzing source-to-target mappings and ETL design specifications for a pharmaceutical project (Regeneron). Developed and executed ETL test cases and SQL validations to perform reconciliation, integrity checks, and verify transformations across batch, incremental loads, CDC, and real-time/streaming pipelines.
Education
Degrees, certifications, and relevant coursework
Jawaharlal Nehru Technological University, Anantapur
Bachelor of Technology (B.Tech)
Completed a Bachelor of Technology (B.Tech) at Jawaharlal Nehru Technological University, Anantapur in 2017.
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring vamsi?
You can contact vamsi and 90k+ other talented remote workers on Himalayas.
Message vamsiFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
