Open to opportunities

Pankaj Kalania

@pankajkalania

Backend developer specializing in Python, large-scale web scraping, and REST APIs—building reliable, monitored microservices.

Zimbabwe

Message

What I'm looking for

I’m looking for a backend/Python role where I can build high-scale data services—web scraping or risk/ML systems—while owning production monitoring, DevOps practices, and reliable REST APIs.

I’m a backend-focused software developer who builds Python services that turn messy, high-volume web data into dependable APIs. In my current role, I drive end-to-end feature development in an IC capacity, engineer scraping systems that handle 100+ complex websites at scale, and add resilient anti-detection measures like proxy pool management and large-scale Google reCAPTCHA v3 solutions.

Previously, I built and maintained highly available Python/Flask web applications and optimized scraping services to cut response time by 60% while acquiring public data from 60+ platforms. I also design production-grade microservices with Docker and AKS/Helm, instrument performance with Prometheus + Grafana, and deploy machine learning services inside the microservices architecture. Earlier in my career as a Data Scientist and Data Engineer, I shipped real-time analytics and credit risk scorecards using AWS (S3, EC2, API Gateway, Lambda) and built Scrapy-based pipelines for large-scale public data, including GST-registered businesses in India.

Experience

Work history, roles, and key accomplishments

Current

Software Developer II

Current

Ownwell Inc

Aug 2024 - Present (1 year 9 months)

Drove end-to-end feature development for web scraping and Python backend, engineering high-volume scraping for 100+ complex websites at scale. Implemented anti-detection using proxy pool management and large-scale Google reCAPTCHA v3, and established microservice monitoring with Grafana/Prometheus/Loki.

Python Web Scraping Scrapy ReCAPTCHA V3 Automation Grafana Prometheus Loki Kubernetes Docker

Back End Developer

Sign3labs

Jan 2023 - Aug 2024 (1 year 7 months)

Developed and maintained highly available Python/Flask web applications with robust RESTful APIs. Architected and optimized scraping services to cut response time by 60%, collected data from 60+ platforms, and built microservices DevOps using Docker/AKS/Helm with Prometheus/Grafana monitoring plus production ML services.

Python Flask REST APIs Web Scraping Docker Helm Prometheus Grafana Machine Learning

Senior Data Scientist

Agrim Wholesale

Jan 2022 - Jan 2023 (1 year)

Engineered and deployed AWS data pipelines for real-time prediction and business analytics using S3, EC2, API Gateway, and Lambda. Built a credit risk scorecard for the SME segment from scratch and executed Scrapy-based scraping of GST-registered businesses to support underwriting and growth strategies.

AWS S3 AWS EC2 AWS Lambda API Gateway Data Pipelines Machine Learning Credit Risk Scrapy Real Time Analytics

Data Scientist

Avail Finance

Dec 2019 - Jan 2022 (2 years 1 month)

Developed a feature engine using alternate data sources to produce comprehensive financial and social risk profiles for customers. Built a LightGBM-based credit risk scorecard for the New to Credit (NTC) population, classifying customers into high- and low-risk groups.

Feature Engineering Alternative Data Credit Risk LightGBM Machine Learning

Data Engineer Intern

Charmboard

May 2019 - Jun 2019 (1 month)

Built a Scrapy-based scraping engine to extract product information from e-commerce platforms including Amazon, Flipkart, and Shoppers-Stop. Designed the system to simplify onboarding new platforms through configuration changes.

Python Scrapy Web Scraping Data Extraction Configurable Crawlers E commerce integration Automation