Looking for a job

Luca Luz

@lucaluz

Message

Data Engineer with experience in building and optimizing large-scale data pipelines in cloud environments.

Brazil

Message

What I'm looking for

I’m looking for a cloud-first data engineering role where I can build scalable streaming/batch pipelines (CDP-ready), strengthen data quality, and collaborate with teams that value clear, business-friendly communication.

I’m a Data Engineer focused on building and optimizing large-scale data pipelines in cloud environments, with a specialization in Customer Data Platform (CDP) architectures. I’ve developed streaming and batch systems on Azure, including Medallion architecture (Bronze/Silver/Gold) and solutions for consumer identity resolution.

In my work, I process millions of consumer records daily and strengthen data reliability through data quality checks, health monitoring, and validation queries. I’ve integrated consumer and transaction data across Azure Synapse Analytics, operational databases, and marketing automation platforms to support end-to-end engagement workflows.

I also bring a strong geospatial data engineering background—building ETL for Sentinel-2 mosaics and time series analysis, developing QGIS tooling, and creating dashboards in Power BI and Streamlit. Earlier, I automated geospatial processing with Python (Pandas/GeoPandas/ArcPy/NumPy), reducing manual processing time by up to 70%.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

KIS Solutions UK

Aug 2025 - Present (10 months)

Built and maintained Customer Data Platform (CDP) batch and streaming pipelines ingesting consumer data from Kafka, SFTP, and APIs using Azure Databricks, Delta Lake, and Azure Data Factory in a Medallion architecture. Implemented identity resolution (Match & Merge) and end-to-end data quality/health monitoring while integrating Synapse Analytics, MySQL, and Braze for marketing activation.

Azure Databricks Delta Lake Azure Data Factory Kafka Medallion Architecture Identity Resolution Azure Synapse MySQL Braze Data Quality

Jr Data Engineer

VEGA Monitoramento

Dec 2024 - Aug 2025 (8 months)

Optimized AWS Databricks ETL pipelines for Sentinel-2 image mosaics and agroclimatic time-series analysis, processing large geospatial datasets in S3 and PostgreSQL/PostGIS. Developed a QGIS plugin, interactive dashboards (Power BI, Streamlit), and automated ETL workflows to support rural credit decisioning through integrated geospatial analysis and API-driven processing.

Databricks Amazon S3 PostGIS QGIS Power BI Streamlit API Integration Sentinel 2 Processing Time Series Analysis

Data Analyst

VEGA Monitoramento

Jul 2024 - Dec 2024 (5 months)

Automated geospatial data preparation using Python (Pandas, GeoPandas, ArcPy, NumPy), reducing manual processing time by up to 70% through API-driven extraction and transformation. Built geospatial ETL pipelines and Power BI dashboards modeling crop evolution across 20M+ hectares with dimensional relationships and unique keys for data compliance.

Python Pandas Geopandas ArcPy NumPy Geospatial Data Processing Power BI Data Modeling Dashboards

Jr Data Analyst

VEGA Monitoramento

Nov 2022 - Jul 2024 (1 year 8 months)

Acquired, processed, and managed geospatial datasets across Brazil, Argentina, and Paraguay to support agricultural technical analysis. Used ArcGIS Pro and QGIS to edit geodatabases, build geoprocessing models, and produce thematic maps while providing technical guidance to meet customer demands.

ArcGIS Pro QGIS Geodatabases Geoprocessing Models Thematic Maps Geospatial analysis Spatial Data QA