At Zuellig Pharma, I migrated Python data pipelines from virtual machines to Google Kubernetes Engine, scheduled with Airflow on Google Composer and containerised with Docker. I used Polars and code refactoring to reduce a pipeline's completion time from 2 hours to 30 minutes.
I added data quality checks to pipelines and migrated legacy workflows to Google Cloud Platform, using Dataform for ETL pipelines in BigQuery. I also created two web-scraping pipelines to bring external data into tables for downstream analysis.
At Tencent, I mined game data from three providers with Python scripts and ensured the latest data was available in ClickHouse. I also created a Flask website to showcase predictive models developed by the Natural Language Processing team.
At Checkout.com, I developed scripts that reduced the completion time of manual tasks from 30 minutes to 4 seconds. Earlier, as an Operations Support Intern at Adyen, I assisted merchants with platform integration and implemented an Adyen payments integration using Flask.
