Looking for a job

Yash Rupani

@yashrupani

Data engineer focused on scalable ETL and real-time architectures, building AI-driven RAG systems and cutting latency costs.

United States

Message

What I'm looking for

I’m looking for a role where I can build scalable ETL and real-time pipelines, integrate RAG/vector search with production systems, and continuously improve latency and infrastructure cost through data engineering best practices.

I’m a Master’s graduate with 2+ years of enterprise experience building scalable ETL pipelines and real-time data architectures across AWS, GCP, and Microsoft Fabric. I focus on transforming complex data into reliable, low-latency systems—especially with Apache Spark, Kafka, and AI-driven data workflows like RAG and vector search.

In my recent roles, I engineered end-to-end autonomous ETL for unstructured multimedia data, eliminating 40% of manual prep and improving retrieval latency by 25%. At Infosys, I modernized enterprise data quality pipelines, automating 10+ hours/week of manual effort and cutting Spark ETL runtime by 40%, while building dashboards from semi-structured logs to enable automated monitoring.

Experience

Work history, roles, and key accomplishments

Research Assistant (Data)

Oregon State University

Oct 2025 - Dec 2025 (2 months)

Engineered an end-to-end autonomous ETL pipeline for unstructured multimedia data, reducing manual data preparation by 40% for agentic AI workflows. Improved AI agent retrieval by reducing retrieval latency 25% and ensured 100% data integrity with validation frameworks for terabyte-scale ingestion.

Python ETL AI Agents RAG Data Validation Indexing Strategies Agentic AI

AI Agent RAG Intern

GrantAide

Jul 2025 - Sep 2025 (2 months)

Architected scalable backend systems with Flask and Google Firestore, restructuring data access to cut API latency by 30% during peak usage. Built FAISS-based vector search pipelines to improve semantic retrieval relevance by 40% versus keyword matching and managed multi-cloud deployments achieving 99.9% uptime.

Flask Firestore Faiss Vector Search AWS GCP

Sr. Systems Engineer

Infosys

Jun 2021 - Jun 2023 (2 years)

Modernized enterprise data quality pipelines by automating workflows and eliminating 10+ hours per week of manual intervention. Designed high-performance Apache Spark ETL processing large-scale monitoring data, reducing runtime by 40% per cycle, and built automated dashboards from semi-structured logs.

Apache Spark ETL Processes Data Pipelines Workflow Automation Log Analytics Dashboard Development Semi Structured Data Data monitoring