At QUO Digital/Niko Energy, I re-engineered the data engine and its microservices with Airflow as the orchestrator. The pipeline success rate increased by 68%, while its scope expanded by 150% with batch processing and additional stages.
I also implemented web crawlers to collect semi-structured and unstructured data for NoSQL stores and data lakes. Replacing a scraping server with a crawler increased data retrieval speed by 97% and reduced cloud infrastructure costs by 98.5%.
At B-MORE, I migrated physical servers to Microsoft Azure and helped replace a monolithic on-premise server with decoupled services. The change improved scalability by 45%, and I resolved infrastructure-level incidents through operational support and properly configured auto-scaling.
