Bipin Dileep Yadav
@bipindileepyadav
Data Engineer with 3+ years in Python, building scalable pipelines, real-time data systems, and data ingestion via APIs, web scraping, and files.
IndiaWhat I'm looking for
I’m a Software Engineer focused on data & backend systems for FinTech, with 3+ years of experience architecting high-concurrency distributed systems and scalable backend APIs. I build event-driven pipelines that process 500k+ daily events and design fault-tolerant API gateways that keep production systems stable under load.
In my current role, I architected a CDC pipeline using Kafka and Debezium to ingest 500k+ daily events with zero data loss, and I optimize throughput with PySpark Structured Streaming to reach sub-second latency. I’ve tuned Spark performance and reduced cloud costs by 30% while improving processing speed by 60%.
I also lead reliability and security work—developing a high-availability API Gateway for loan origination (10k+ daily requests) with rate limiting, caching, and 99.9% uptime targets. I’ve driven security refactoring by resolving 1k+ SonarQube vulnerabilities and implementing robust JWT-based authorization, while building BI automation with Apache Superset for 500+ users.
Experience
Work history, roles, and key accomplishments
Data & Backend Engineer
Veefin Solutions Pvt. Ltd.
Mar 2023 - Present (3 years 3 months)
Architected an event-driven CDC pipeline with Kafka and Debezium ingesting 500k+ daily events with zero data loss, and delivered PySpark Structured Streaming with sub-second latency, achieving 60% faster processing and 30% AWS cost reduction. Developed a high-availability Flask/FastAPI API Gateway for a loan origination system (10k+ daily requests, 99.9% uptime) and led security refactoring, fixin
Python Developer
Bharat Krushi Seva Pvt. Ltd.
Apr 2022 - Feb 2023 (10 months)
Built scalable RESTful APIs with Django Rest Framework supporting 50,000+ users by optimizing database queries and indexing. Integrated 3rd-party payment gateways and managed secure transaction flows for 1,000+ daily transactions.
Education
Degrees, certifications, and relevant coursework
Bharat College of Arts & Commerce
Bachelor of Information Technology (BSc.IT), Information Technology
2022 -
Bachelor of Information Technology (BSc.IT) program at Bharat College of Arts & Commerce (started 2022).
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Social media
Job categories
Skills
Interested in hiring Bipin Dileep?
You can contact Bipin Dileep and 90k+ other talented remote workers on Himalayas.
Message Bipin DileepFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
