Open to opportunities

Rushi User

@rushiuser

Message

Senior Data Engineer specializing in scalable web scraping, ETL, and cloud infrastructure.

India

Message

What I'm looking for

I seek a hands-on engineering role where I can build scalable data systems, lead technical improvements, work with cloud infrastructure, and deliver measurable business impact in a collaborative culture.

I am a Senior Data Engineer with 5+ years building scalable web scraping systems and high-throughput ETL pipelines that process millions of records daily.

I have architected production crawling frameworks and RESTful APIs, reduced operational costs by 80%, and improved pipeline performance by 300% while maintaining high uptime and low latency.

I lead teams and modernize data infrastructure—modernizing databases, implementing CI/CD, and introducing monitoring and alerting to reduce incident response times and improve data quality.

I integrate advanced techniques including anti-detection scraping, distributed systems, and LLMs to automate extraction and entity resolution, delivering measurable business impact and reliable data products.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Deep.ad

May 2021 - Present (4 years 9 months)

Architected and deployed a production web crawling framework processing 500+ sites daily with 99.5% uptime, reduced data collection latency by 60%, and optimized ETL to cut processing time from 8 to 2 hours while improving query performance 300%.

Python Playwright Airflow MongoDB AWS EC2 S3 Lambda REST APIs ETL Distributed Systems

Founding Data Engineer

Aisle 3

Sep 2020 - May 2021 (8 months)

Joined as first engineering hire and built distributed crawling infrastructure scaling to 500+ websites and handling 2M+ product updates daily, implemented fault-tolerant ETL and CI/CD reducing deployment time from 2 hours to 15 minutes.

Python Airflow AWS Lambda Docker CI CD Prometheus Grafana

Data Engineer

DataWeave

Jan 2019 - Sep 2020 (1 year 8 months)

Developed monitoring dashboard for 250+ crawlers and maintained high-throughput pipelines processing 50M+ records daily, improving pipeline reliability to 99.2% and enabling data-driven decisions that informed $5M+ in business impact.

Python Vue.Js MongoDB Selenium REST APIs Data Pipelines Data Quality

Program Manager Intern

Imbudesk Ens Pvt Ltd

Nov 2017 - Dec 2018 (1 year 1 month)

Delivered machine learning and data science curriculum to 80+ students with 100% satisfaction, managed 4 teaching assistants, and created projects that increased student engagement by 40%.

Curriculum Development Teaching Python Machine Learning Team Management

Education

Degrees, certifications, and relevant coursework

BML Munjal University

Bachelor of Technology, Computer Science and Engineering

Completed Bachelor of Technology in Computer Science and Engineering with coursework and projects focused on software engineering, data systems, and machine learning.