Preetham Reddy

I’m a data engineer with 2.5+ years building large-scale, production web scraping systems. I focus on reliability at scale—designing concurrent pipelines that handle millions of requests without breaking downstream workflows.

I’ve built anti-bot evasion approaches that work in the real world, including Cloudflare JS challenges, session/TLS fingerprinting, CAPTCHA handling, and stealthy browser automation. In freelancing for Spiritual Data, I delivered multi-threaded scraping across 30+ platforms with 95%+ data capture rates and reduced blocks by ~80%.

To keep pipelines running continuously, I maintain rotating proxy infrastructure across high-volume traffic and optimize ETL pipelines that turn unstructured text into structured datasets. I’ve stored and managed scraped data in MongoDB and AWS S3, designing schemas for integrity and downstream query speed.

I also bring downstream intelligence: I run LLM-powered enrichment jobs via GCP Batch Inference, reducing manual annotation effort by ~60%. Previously at KLA Tencor, I built an LLM-powered natural language to SQL tool, migrated datasets from Splunk to Snowflake (improving query speed ~3×), and automated SQL ETL alerting to cut data latency from hours to minutes.