HimalayasHimalayas logo
Bipin Dileep YadavBY
Open to opportunities

Bipin Dileep Yadav

@bipindileepyadav

Data Engineer with 3+ years in Python, building scalable pipelines, real-time data systems, and data ingestion via APIs, web scraping, and files.

India
Message

What I'm looking for

I’m looking for a FinTech team where I can own event-driven CDC pipelines and build fault-tolerant API gateways, improve latency and cost on AWS, and collaborate on security to ship reliable production systems.

I’m a Software Engineer focused on data & backend systems for FinTech, with 3+ years of experience architecting high-concurrency distributed systems and scalable backend APIs. I build event-driven pipelines that process 500k+ daily events and design fault-tolerant API gateways that keep production systems stable under load.

In my current role, I architected a CDC pipeline using Kafka and Debezium to ingest 500k+ daily events with zero data loss, and I optimize throughput with PySpark Structured Streaming to reach sub-second latency. I’ve tuned Spark performance and reduced cloud costs by 30% while improving processing speed by 60%.

I also lead reliability and security work—developing a high-availability API Gateway for loan origination (10k+ daily requests) with rate limiting, caching, and 99.9% uptime targets. I’ve driven security refactoring by resolving 1k+ SonarQube vulnerabilities and implementing robust JWT-based authorization, while building BI automation with Apache Superset for 500+ users.

Experience

Work history, roles, and key accomplishments

VL
Current

Data & Backend Engineer

Veefin Solutions Pvt. Ltd.

Mar 2023 - Present (3 years 1 month)

Architected an event-driven CDC pipeline with Kafka and Debezium ingesting 500k+ daily events with zero data loss, and delivered PySpark Structured Streaming with sub-second latency, achieving 60% faster processing and 30% AWS cost reduction. Developed a high-availability Flask/FastAPI API Gateway for a loan origination system (10k+ daily requests, 99.9% uptime) and led security refactoring, fixin

Education

Degrees, certifications, and relevant coursework

BC

Bharat College of Arts & Commerce

Bachelor of Information Technology (BSc.IT), Information Technology

2022 -

Bachelor of Information Technology (BSc.IT) program at Bharat College of Arts & Commerce (started 2022).

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan