Willian Kenji Hiraoka

Designed and built the company's data platform from the ground up on GCP, defining architecture, infrastructure, ingestion patterns, storage, and data consumption layers. Implemented CDC ingestion pipelines, Apache Iceberg tables, and OpenMetadata for data cataloging.

Played a key role in shaping the data platform vision for Banco John Deere, combining hands-on engineering with architectural leadership. Advocated for data contracts (ODCS) and led performance improvements in the ingestion framework, achieving ~90% runtime reduction.

Designed and implemented a lightweight, reusable framework to ingest structured data into the Data Lake. Led the migration of Databricks infrastructure to Unity Catalog and mentored fellow engineers in Spark, Delta Lake, and cloud data infrastructure.

Designed and implemented the company's first data pipeline and Data Lake architecture from the ground up. Defined key ingestion workflows and monitored cloud infrastructure costs, optimizing usage across AWS services.

Developed and maintained data infrastructure supporting analytical and data science workloads. Built streaming micro-ETLs and contributed to a data platform on Kubernetes integrating Spark, Trino, and Hive Metastore.

Built and refactored ETLs used as input for machine learning models. Built a Data Lake using AWS infrastructure and maintained Data Science's Apache Airflow.

Data Engineer Intern at BeBlue's Data Science team. Built and refactored ETLs for machine learning models and maintained Apache Airflow.

Handled customer service across multiple platforms, recording complaints, feedback, and tips to improve the app and relaying them to the IT team.

Completed a Tecnólogo degree in Análise e Desenvolvimento de Sistemas from 2016 to 2019.