Open to opportunities

Guilherme Nisiyama

@guilhermenisiyama

Message

Senior Data Engineer specializing in cloud data platforms, lakehouse, and real-time pipelines.

Brazil

Message

What I'm looking for

I'm seeking senior roles focused on cloud data platform engineering, real-time pipeline ownership, strong data governance, collaborative Agile teams, and opportunities to mentor and improve data quality and observability.

I'm a Senior Data Engineer with 11 years in IT and 9 years focused on data engineering and analytics, helping organizations turn data into actionable insights.

I design and build scalable data processes, having gathered and cleaned over 15 terabytes of data and engineered near-real-time pipelines that deliver updates every ten minutes.

I led a Databricks Unity Catalog migration, moving 20% of over 10,000 tables and pipelines to improve lineage and governance, and I built monitoring dashboards using Log Analytics and Grafana to observe pipeline executions.

I work across cloud platforms and architectures — Azure Data Factory, Azure Synapse, Databricks, Airflow, Medallion and dimensional/datavault modeling — and I prioritize data quality using Great Expectations and robust ingestion from databases, Kafka, APIs and files.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

XP Inc.

Nov 2021 - Present (3 years 10 months)

Built and maintained Azure-based data platform, ingesting and cleaning 15+ TB spanning 5 years; spearheaded Databricks Unity Catalog migration for ~20% of 10,000+ tables to improve lineage and governance. Implemented near-real-time 10-minute ingestion from Oracle, SQL Server and Kafka and created monitoring dashboards to track ADF pipeline executions.

Azure Data Factory Databricks Kafka Data Ingestion Monitoring Grafana Delta Lake

Data Engineer

QARTI

Jul 2019 - Oct 2021 (2 years 3 months)

Developed Databricks notebooks and pipelines for cloud migration, transforming raw data into augmented linked-data layers and creating ingestion pipelines into Azure Synapse Analytics Dedicated SQL Pool. Supported CI/CD and cluster/worker configuration for production workloads.

Databricks Azure Data Factory Azure Synapse CI CD Python Cloud Migration

SQL / ETL Developer

QARTI

Sep 2016 - Jul 2019 (2 years 10 months)

Extracted critical data from Oracle Exadata producing 20+ monthly reports for executives; implemented and scheduled ETLs using SSIS, PDW and Databricks and built complex queries in Oracle, SQL Server and PDW to support reporting needs.