At Developers 360, I develop and maintain Scrapy scrapers that extract structured data from JavaScript-rendered and anti-bot protected websites, then persist it to databases. I adapt parsers when layouts change and help recover failed spiders.
I improve production scraping reliability with retries, logging, and job monitoring. I also parse and clean messy HTML into validated datasets with Python and pandas, using DevTools to inspect network requests and page structure.
At Social Swirl, I built e-commerce scrapers with BeautifulSoup and Scrapy and stored product data in PostgreSQL. I also developed REST APIs with Django REST Framework and SQLite, and implemented SMTP email automation with templates and error handling.
