HimalayasHimalayas logo
VR
Open to opportunities

Vishwa Ranaweera

@vishwaranaweera

Data Engineer specializing in Python web scraping, automation, and scalable data pipelines for eCommerce extraction.

Sri Lanka
Message

What I'm looking for

I’m open to remote Data Engineering and Web Scraping opportunities where I can build scalable, maintainable scraping pipelines, handle anti-bot challenges, and deliver clean data via APIs for analytics and downstream systems.

I’m a results-driven Data Engineer focused on Python-based web scraping, data extraction, and automation. I build scalable scraping pipelines that turn complex eCommerce pages into structured datasets.

Using Selenium, Playwright, and BeautifulSoup, I extract product data (titles, prices, ratings, reviews, availability, and seller details) from Amazon, eBay, and Shopify-based stores. I also handle proxies, anti-bot mechanisms, CAPTCHA handling, and headless browser workflows to keep large-scale collection reliable.

I transform and store data using SQL and NoSQL (MySQL/PostgreSQL/SQL Server and MongoDB), then export clean CSV/JSON/Excel outputs for analytics and reporting. I’ve built Flask APIs to serve scraped and processed data, optimizing scraping speed through asynchronous and multi-threaded approaches.

Experience

Work history, roles, and key accomplishments

AL
Current

Data Engineer (Web Scraping)

AkvaSoft (Pvt) Ltd

Jan 2020 - Present (6 years 2 months)

Developed scalable scraping pipelines for Amazon, eBay, and Shopify-based eCommerce platforms, extracting product and seller data and storing results in SQL and MongoDB. Built Flask APIs and optimized scraping speed/reliability to process 10,000+ records per run and reduce client-side retrieval time by 50% via caching and pagination.

Education

Degrees, certifications, and relevant coursework

Sabaragamuwa University of Sri Lanka logoSL

Sabaragamuwa University of Sri Lanka

Bachelor of Science (Special), Computing and Information Systems

2015 - 2019

Bachelor of Science (Special) degree in Computing and Information Systems at Sabaragamuwa University of Sri Lanka from 2015 to 2019.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan