Open to opportunities

Vishwa Ranaweera

@vishwaranaweera

Message

Data Engineer specializing in Python web scraping, automation, and scalable data pipelines for eCommerce extraction.

Sri Lanka

Message

What I'm looking for

I’m open to remote Data Engineering and Web Scraping opportunities where I can build scalable, maintainable scraping pipelines, handle anti-bot challenges, and deliver clean data via APIs for analytics and downstream systems.

I’m a results-driven Data Engineer focused on Python-based web scraping, data extraction, and automation. I build scalable scraping pipelines that turn complex eCommerce pages into structured datasets.

Using Selenium, Playwright, and BeautifulSoup, I extract product data (titles, prices, ratings, reviews, availability, and seller details) from Amazon, eBay, and Shopify-based stores. I also handle proxies, anti-bot mechanisms, CAPTCHA handling, and headless browser workflows to keep large-scale collection reliable.

I transform and store data using SQL and NoSQL (MySQL/PostgreSQL/SQL Server and MongoDB), then export clean CSV/JSON/Excel outputs for analytics and reporting. I’ve built Flask APIs to serve scraped and processed data, optimizing scraping speed through asynchronous and multi-threaded approaches.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer (Web Scraping)

Current

AkvaSoft (Pvt) Ltd

Jan 2020 - Present (6 years 2 months)

Developed scalable scraping pipelines for Amazon, eBay, and Shopify-based eCommerce platforms, extracting product and seller data and storing results in SQL and MongoDB. Built Flask APIs and optimized scraping speed/reliability to process 10,000+ records per run and reduce client-side retrieval time by 50% via caching and pagination.

Python Selenium Playwright BeautifulSoup Web Scraping SQL MongoDB Flask API