matheus aragão

I’m a Data Engineer with 5+ years of experience building scalable data pipelines and Lakehouse architectures across Databricks, Azure, and AWS. I use PySpark, Python, and SQL to deliver large-scale data transformation and reliable data products.

In my current role, I designed Lakehouse architectures using Medallion-style processing and exposed curated Gold Delta tables through Microsoft Fabric’s SQL Analytics Endpoint and OneLake, reducing data delivery latency by 35% for real-time municipal updates. I also implemented Delta Lake and Unity Catalog for governance and regulatory compliance, applying RLS, column-level permissions, and data anonymization/masking with auditability via audit logging and time travel.

I optimize performance through Databricks cluster tuning and Spark job improvements (including Z-Order clustering and Parquet-to-Delta migration), achieving a 40% reduction in processing time and faster downstream Power BI responses via DirectQuery. I’ve also built RAG pipelines on Delta Lake for natural-language querying and delivered analytics dashboards with star-schema semantic models and DAX time intelligence.