Looking for a job

Luca Luz

@lucaluz

Message

Data Engineer with experience in building and optimizing large-scale data pipelines in cloud environments.

Brazil

Message

What I'm looking for

I’m looking for a cloud-first data engineering role where I can build scalable streaming/batch pipelines (CDP-ready), strengthen data quality, and collaborate with teams that value clear, business-friendly communication.

I'm a Data Engineer with 4+ years of experience working with data, specializing in cloud data pipelines on Azure (Databricks, Data Factory, Synapse) and AWS. Currently at KIS Solutions, I work on two fronts: building a Customer Data Platform for a multinational cosmetics company in the UK market, processing millions of consumer records weekly through batch and streaming pipelines (Kafka, Delta Lake, Medallion architecture), and developing an AI-powered analytics platform on AWS, orchestrated with Apache Airflow.

Tech I work with daily: Python, PySpark, SQL, Azure Databricks, Azure Data Factory, Synapse Analytics, Delta Lake, Kafka, Apache Airflow, AWS (S3, Redshift, ECS/Fargate, RDS), PostgreSQL, Power BI. I also use Claude and Cursor as AI copilots in my development workflow.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Kis Solutions

Jul 2025 - Present (11 months)

Develop and maintain batch and streaming CDP data pipelines ingesting consumer data from 8 source systems across 10+ brands. Built Azure Databricks/Delta Lake and Azure Data Factory Medallion (Bronze/Silver/Gold) pipelines processing 2.2M+ consumers, 1.3M+ transactions, and 315M+ marketing events per quarter, including identity match & merge and data quality monitoring.

Azure Databricks Delta Lake Azure Data Factory Kafka Medallion Architecture Apache Airflow Data Quality MySQL

Junior Data Engineer

Vega Monitoramento

Dec 2024 - Aug 2025 (8 months)

Optimized AWS Databricks ETL pipelines for generating Sentinel-2 image mosaics and time series analysis, handling large datasets in S3 and PostgreSQL/PostGIS. Built geospatial visualization tools (QGIS plugin) and interactive dashboards (Power BI, Streamlit), plus automated ETL and API integrations supporting rural credit decisions.

Databricks Amazon S3 PostgreSQL PostGIS Sentinel 2 Processing QGIS Power BI Streamlit API Integration

Data Analyst

VEGA Monitoramento

Jul 2024 - Dec 2024 (5 months)

Automated geospatial data preparation using Python (Pandas, GeoPandas, ArcPy, NumPy), reducing manual processing time by up to 70% through API-driven extraction and transformation. Built geospatial ETL pipelines and Power BI dashboards modeling crop evolution across 20M+ hectares with dimensional relationships and unique keys for data compliance.

Python Pandas Geopandas ArcPy NumPy Geospatial Data Processing Power BI Data Modeling Dashboards

Junior Data Analyst

Vega Monitoramento

Oct 2022 - Jun 2024 (1 year 8 months)

Acquired, processed, and managed geospatial agricultural datasets collected from Brazil, Argentina, and Paraguay. Used ArcGIS Pro and QGIS to edit geodatabases, build geoprocessing models, and produce thematic maps, providing technical GIS support to customer needs.

ArcGIS Pro QGIS Geodatabases Geoprocessing Models Thematic Maps Geographic Data Analysis