Looking for a job

Johannes Smit

@hasnep

Message

I'm a data engineer based in Taiwan.

Taiwan

Message

Experienced data engineer in Taiwan with a background in data science and mathematics.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Mobagel

Nov 2023 - Present (2 years 7 months)

Optimised raw-data loading pipeline to reduce costs by 90%, enabling onboarding a new client with 10 times more data than all previous clients.
Lead the design and development of a new data pipeline and client-facing dashboard to bring insights about traffic sources to clients, while working closely with product team to iterate quickly on features.

Airflow Apache Airflow BigQuery Google BigQuery Google Cloud BigQuery GCP Big Query GCP Google Cloud Google Cloud Platform Google Cloud Platform (GCP)Gitlab Gitlab CI

Data Engineer

Sainsbury's

Oct 2021 - Nov 2022 (1 year 1 month)

- Maintained and developed ELT pipelines processing structured and semi-structured data from a variety of data sources including Kafka, SFTP and S3. (Airflow, Snowflake, AWS, S3)
- Collaborated in a small team to develop the department's new standard tool for creating and scheduling SQL transforms. (DBT, GitHub Actions, Python, Airflow)
- Designed and built a robust application to download and pro

Snowflake S3 Python Airflow Amazon ECS

Strategic Consultant (Data Engineering)

Amey Strategic Consulting

Jul 2019 - Oct 2021 (2 years 3 months)

- Lead data engineer of a GIS (Geographic Information System) dashboard creating insights into operations and tracking KPIs for a local county council. (AWS, Kubernetes, Airflow)
- Created ETL pipelines to load data from IoT devices, online APIs and daily reports into a central database. (Python, Airflow, Postgres)
- Identified an inefficiency in the client's work allocation and developed a pr

Python Postgres Airflow R