Alan Almeida

I’m a Data Engineer focused on designing and building end-to-end ETL/ELT data pipelines on Azure and Microsoft Fabric. I combine PySpark and Apache Spark with Microsoft lakehouse patterns to turn raw sources into reliable, query-ready data.

In my projects, I implemented Medallion Architecture (Bronze, Silver, Gold) with practical ingestion, transformation, and modeling. On Azure, I built a metadata-driven ADF pipeline to ingest multiple heterogeneous datasets into ADLS Gen2, then transformed and enriched data in Azure Databricks before serving Gold with Synapse Analytics external tables.

I also develop lakehouse solutions on Microsoft Fabric, leveraging OneLake, Delta Lake, Fabric Data Factory, and Direct Lake. I created incremental merge-based loading using Delta Lake MERGE and built a star-schema Semantic Model so Power BI can query Delta tables directly from OneLake with no import or scheduled refresh.

I’m hands-on about securing data access and operational readiness, including OAuth2 and service principal-based authorization for Databricks-to-ADLS connectivity. Beyond building pipelines, I pursued multiple cloud certifications—including Microsoft Certified Fabric Data Engineer Associate (DP-700)—and I’m continuously improving my engineering and quality mindset through structured training.