At Arbisoft, I design and scale web and mobile app scraping systems, with hundreds of crawlers operating daily. I focus on reliability, performance, data quality, and mitigating anti-bot protections.
I developed a Celery-based scheduler in Django and REST APIs that trigger parsers and return structured data on demand. I also created an AI-powered crawler monitoring dashboard that tracks crawler health and data quality and automatically creates Kanban tickets for failures.
I developed custom AI-powered Claude Skills to streamline crawler implementation and maintenance, and implemented CI/CD pipelines. As Technical Lead for the data mining department, I mentor developers and coordinate technical delivery.
Earlier, I developed large-scale data-mining solutions at Arbisoft and Android and iOS applications at Rolustech. My project work includes modular video-processing and person re-identification pipelines, as well as a multidimensional analytics solution with ETL workflows.
