Open to opportunities

Vamsi Sai Garapati

@vamsisaigarapati

Message

Senior data engineer building scalable Spark/Databricks pipelines and AI/ML vector RAG systems across AWS and Azure.

United States

Message

What I'm looking for

I’m looking for a role where I can own cloud-scale data platforms—building reliable pipelines with strong SLAs, measurable cost savings, and production-grade AI/ML data workflows for RAG and analytics.

I’m a senior data engineer with 5+ years building Big Data platforms and end-to-end data scalable pipelines on Spark, Databricks, and Snowflake across AWS and Azure. I’ve delivered $650K in cloud savings, maintained 99% SLA on 200M+ records/day, and led a Teradata-to-Delta Lake migration to modernize enterprise analytics.

I also engineer AI/ML data pipelines for production RAG systems—chunking, embedding, and persisting into vector databases for low-latency semantic retrieval—while orchestrating retraining and re-embedding workflows with Airflow and CI/CD-deployed pipelines. Across my roles, I’ve owned streaming and batch ingestion, built data-quality frameworks (bronze/silver/gold with alerting and lineage), operationalized 120+ Airflow/Databricks workloads, and automated releases with Jenkins on Kubernetes for faster cycles and fewer incidents.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer (RAG Pipelines)

Current

Saayam for All

Feb 2026 - Present (4 months)

Built and streamlined end-to-end data pipelines for production RAG systems, ingesting PostgreSQL and Snowflake sources and persisting embeddings to ChromaDB for low-latency semantic retrieval. Orchestrated retraining and re-embedding workflows with Airflow, using CI/CD-deployed, versioned pipelines to enable weekly vector index updates.

Apache Airflow Databricks Workflows ChromaDB Sentence Transformers Vector Databases Data Pipelines CI CD Snowflake PostgreSQL

Data Engineer

Media Sales Plus

Aug 2025 - Dec 2025 (4 months)

Designed a metadata-driven Azure Data Factory ingestion framework onboarding 14 finance clients to ADLS Gen2, cutting manual onboarding effort by 90%. Built Snowflake gold-layer data products and implemented RBAC/masking and warehouse cost controls to power Azure ML ad-revenue forecasting end-to-end for 14 portfolios.

Azure Data Factory Azure ADLS Gen2 Snowflake Data Modeling Snowflake RBAC Data Masking SQL Azure Synapse ETL ELT

Data Engineer

Infosys

Nov 2020 - Aug 2024 (3 years 9 months)

Owned two enterprise data programs for Nike NA and China, delivering self-serve insights across 15+ ETL/ELT pipelines and sustaining 99% SLA on 200M+ records/day. Migrated legacy Teradata workloads to a Databricks Delta Lake medallion architecture with CDC, dbt models, and column-level security, accelerating delivery timelines by 30%, while cutting annual cloud spend by $650K and reducing operatio