# Ayush Upadhyay

Ayush Upadhyay is a remote worker on Himalayas, Data Engineer at Brembo, based in United States.

Source: https://himalayas.app/@ayushupadhyay2

```text
Data Engineer at Brembo building real-time vehicle IoT pipelines and production RAG and Text2SQL systems.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 180k+ USD |
| Job categories | Data Engineer, Marketing Data Analyst, IQS Analyst |
| Skills | Data Engineering, ETL, Real Time Data Streaming, Data Pipelines, Lakehouse Architecture, Medallion Architecture, Data Warehouse, Data Modeling, Data Governance, Data Quality, Machine Learning, RAG, Text To SQL, Natural Language Processing, LLM Based Document Processing |
| LinkedIn | https://https://www.linkedin.com/in/upadhyayayush/ |
| GitHub | https://https://github.com/ayushupadhyay22 |

## About

```text
At Brembo, I design and maintain data pipelines processing vehicle IoT data, and built real-time streaming pipelines for sub-second data availability. I also developed a RAG solution that retrieves information from 300 vehicle manuals and deployed it globally.

I built a production Text2SQL system that translates natural-language questions into SQL, reducing ad-hoc data request turnaround from hours to seconds. I also created an LLM-based document extraction pipeline that reduced manual processing effort by 80%.

At Kaiser Permanente, I migrated legacy Oracle ETL pipelines to a Hadoop ecosystem and developed data pipelines for healthcare analytics. Earlier, at LinkedIn, I worked on marketing analytics, Hadoop workflows, and Tableau reporting.
```

## Experience

### Data Engineer (current)

Brembo. Jan 2023 - Present

```text
Designed and maintained scalable ETL data pipelines processing over 10M+ vehicle IoT data daily using AWS Lambda. Built real-time streaming pipelines and deployed production ML models, reducing manual processing effort by 80% and cutting processing time from 6+ hours to under 30 minutes.
```

Skills: AWS-Lambda, AWS-IoT-Core, Kinesis, Databricks, MLFlow, RAG, Azure-Data-Factory, PySpark, Unity-Catalog, DevOps, FinOps, Data-Governance, Text2SQL, NLP, LLM

### Data Engineer

[Kaiser Permanente](https://himalayas.app/companies/mid-atlantic-permanente-medical-group). Dec 2018 - Dec 2022

```text
Led migration of legacy Oracle ETL pipelines to Hadoop-based ecosystem and engineered production-grade ETL pipelines for kp.org clickstream data. Built automated data quality monitoring and Python-based NLP pipelines, maintaining 99.9% pipeline uptime.
```

Skills: Hadoop, Hive, Azure-Data-Factory, Python, NLP, Tableau, Airflow, Data-Quality, ETL, Data-Warehouse

### Marketing Data Analyst

LinkedIn. Feb 2018 - Dec 2018

```text
Analyzed trends and monitored factors impacting subscription customer acquisition and retention. Engineered optimized Hive queries and developed R models to score customer responses, supporting A/B testing and GDPR compliance.
```

Skills: Hive, HDFS, Teradata, Hadoop, R, Tableau, Presto, Azkaban, A-B-Testing, GDPR

### IQS Analyst

Kia Motors. Aug 2017 - Dec 2017

```text
Used R programming to automate data cleaning and transformation. Created executive dashboards providing product performance and key insights using Tableau.
```

Skills: R, data-transformation, Tableau, Data-Visualization

## Education

### California State University, Fullerton

Master of Science, Information Systems and Decision Sciences

```text
Master of Science in Information Systems and Decision Sciences from California State University, Fullerton, graduated in December 2017.
```

## Tech stack

- Presto
- Tableau
- GitHub
- PySpark
- PostgreSQL
- Databricks
- Jira
- Python
- MLflow
- AWS Lambda
- pytest
- SQL
- ServiceNow
- Azkaban
- Retrieval-Augmented Generation (RAG)
- AWS

To contact Ayush, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Ryan User](https://himalayas.app/@ryanuser7): Senior Data Engineer, Prime Healthcare
- [Sangay Tenzin](https://himalayas.app/@sangaytenzin): Data Engineer, Change Healthcare
- [Shasha Reid](https://himalayas.app/@shashareid): Lead Data Engineer, GEICO
- [Akriti Luitel](https://himalayas.app/@akritiluitel): Senior Data Engineer, Merck
- [Pratiksha KC](https://himalayas.app/@pratikshakc): Senior Data Engineer, Cigna
- [Sushma Rijal](https://himalayas.app/@sushmarijal): Senior Data Engineer, Mayo Clinic
- [Kshitij Lanjewar](https://himalayas.app/@kshitijlanjewar): Principal Data & RAG Engineer, IT Pros
- [Abaidullah Khokhar](https://himalayas.app/@abaidullahkhokhar): Lead Data & Machine Learning Engineer, Digimark
- [Abhishek Gawali](https://himalayas.app/@abhishekgawali): Data Engineer, Community Dreams Foundations
- [Ritik User](https://himalayas.app/@ritikuser5): Senior Data Engineer, Amazon
