# Dipanshu Yadav

Dipanshu Yadav is a remote worker on Himalayas, Software Engineer (BA4) at Barclays, based in India.

Source: https://himalayas.app/@dipanshuyadav

```text
I build production AI, RAG, and cloud data pipelines for risk, analytics, and document workflows.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Machine Learning Engineer, Software Engineer, Data Engineer, Data Scientist, Business Intelligence Analyst, Business Analyst, AI Engineer, Backend Engineer, Machine Learning Engineer, Product Manager |
| Skills | Python, SQL, PySpark, TypeScript, BASH, PyTorch, TensorFlow, scikit learn, Pandas, NumPy, Retrieval Augmented Generation (RAG) Systems, OpenAI API, Azure Document Intelligence, Lang Chain, Prompt Engineering, Semantic Search, Hybrid Retrieval Systems, Pgvector, fastAPI, SQLAlchemy, Alembic, SQLite, React, Vite, DBT, Apache Spark, ETL, Great Expectations, Snowflake, Teradata, Hadoop, Fivetran, AWS, AWS Sagemaker, Amazon Redshift, Amazon SQS, Azure AI, Supabase, Railway, Computer Vision, Recommendation Systems, predictive modeling, Anomaly Detection, SOX, GDPR, SOC, ISO 27001, Alteryx Designer, Salesforce, GitHub, Modal, Effect |
| Portfolio | https://github.com/gitcomplex |
| LinkedIn | https://https://www.linkedin.com/in/yadavdipanshu/ |
| GitHub | https://https://github.com/Gitcomplex |

## What I'm looking for

```text
I'm looking to build production AI and data products where I can own end-to-end systems, from reliable pipelines and governance to human-facing ML applications.
```

## About

```text
At Barclays, I lead five engineers building AWS and dbt pipelines for enterprise analytics and credit-risk modelling, processing 32M+ records monthly. I migrated legacy Ab Initio workflows to dbt, cutting execution time by 40%.

I've also built RAG document Q&A, multilingual invoice review, driver-risk scoring, emissions forecasting, and recommender systems using Python, OpenAI, Azure Document Intelligence, pgvector, PySpark, and React.
```

## Experience

### Software Engineer (BA4) (current)

[Barclays](https://himalayas.app/companies/barclays-com). Mar 2026 - Present

```text
Lead a team of 5 engineers designing and delivering cloud-native dbt transformation pipelines on AWS, powering scalable and high-performance enterprise analytics. Architected end-to-end ETL workflows producing Analytical Ready Datasets and Model Ready Datasets for credit risk modelling.
```

Skills: DBT, AWS, PySpark, SQL, ETL, Data-Pipelines, Great-Expectations, Data-Governance, SOX-Compliance, Spark, Hadoop

### Business Analyst

Roqit Greenfleet Digital Solutions Private Limited. Feb 2025 - Apr 2025

```text
Architected an ML-based risk assessment framework for the Roadzen (insurtech) partnership, improving fraud detection accuracy by 35% and reducing claims processing time by 25%.
```

Skills: Machine-Learning, Risk-Assessment, Fraud-Detection, Claims-Processing

### Business Intelligence Analyst

Aion-Tech Solutions Limited. Apr 2023 - Feb 2025

```text
Engineered a driver risk scoring algorithm integrating vehicle telemetry, weather APIs, traffic conditions, and computer-vision analysis of dashcam footage, reducing insurance risk assessment errors by 30% across 1,000+ commercial fleet vehicles. Designed a carbon emissions monitoring system using supervised learning to predict Scope 1 and Scope 2 emissions.
```

Skills: Python, Pandas, TabPy, Machine-Learning, Computer-Vision, ESG-Reporting, Sonar-Data

### Data Science Intern

[IBM](https://himalayas.app/companies/ibm-com). Jun 2022 - Aug 2022

```text
Developed a hybrid recommender engine addressing the long-tail effect using collaborative and content-based filtering, applying diversity-promoting re-ranking and popularity-bias regularisation to improve recommendation diversity by 25% and user satisfaction by 15% across a 10,000+ user validation cohort.
```

Skills: Recommenders, Collaborative-Filtering, Content-Based-Filtering, Diversity-Promotion, Popularity-Bias-Regularisation, Python

## Education

### University of Petroleum and Energy Studies

Bachelor of Technology, Computer Science and Engineering. 2019 - 2023. Grade: CGPA: 3.28 / 4.0

Activities and societies: Relevant Coursework: Linear Algebra, Probability & Statistics, Machine Learning, Pattern and Anomaly Detection, Advanced Data Structures, Design and Analysis of Algorithms, Design Thinking, Venture Ideation

```text
Bachelor of Technology in Computer Science and Engineering from the University of Petroleum and Energy Studies, Dehradun, India, from 2019 to 2023.
```

## Tech stack

- Fivetran
- Apache Spark
- GitHub
- Salesforce
- NumPy
- Pandas
- PySpark
- dbt
- SQLite
- Hadoop
- TensorFlow
- PyTorch
- scikit-learn
- FastAPI
- SQLAlchemy
- SQL
- Alteryx Designer
- Supabase
- LangChain
- Railway
- OpenAI API
- Great Expectations
- Vite
- Bash
- pgvector
- Modal
- Effect

To contact Dipanshu, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Gayatri R](https://himalayas.app/@gayatrir): Data Scientist, Krasaan Tech
- [Sushant Sur](https://himalayas.app/@sushantsur): Chief Manager II, Shriram Finance
- [Pratik Abnave](https://himalayas.app/@pratikabnave): AI Engineer, Doodleblue Innovations
- [Aditi Raizada](https://himalayas.app/@aditiraizada): Senior Member of Technical Staff, Oracle
- [Zalak Karnik](https://himalayas.app/@zalakkarnik): Associate Data Scientist (Gen AI), Casepoint
- [Gowtham User](https://himalayas.app/@gowthamuser3): AI/ML Engineer, Self Employed
- [Rakesh Prasad](https://himalayas.app/@rakeshprasad): Lead Data Engineer, Teradata
- [Kaushik User](https://himalayas.app/@kaushik47): AI Data Engineer, Intellirev
- [Singer Sinha](https://himalayas.app/@singersinha): Associate Manager – AI & ML, Accenture
- [Sanket Kadam](https://himalayas.app/@sanketkadam1): Data Engineer, Barclays
