At Authority Partners, Iām currently a Lead Data Engineer on the Essex engagement. Previously, on the IWG engagement, I built and optimized an Azure Databricks medallion Delta Lakehouse that turns Dynamics 365 Finance & Operations data into curated finance tables, improving data processing efficiency by 60%.
I also designed pipelines across Azure Databricks, Microsoft Fabric and Azure Data Factory to unify CRM, analytics and e-commerce data. I extended a PySpark REST API ingestion framework for Elasticsearch and fixed a CROSS JOIN defect that generated about 40 million excess rows.
At Systems Limited, I architected data platforms across Azure, AWS and Microsoft Fabric and led optimization of financial data pipelines, cutting runtimes by more than 50%. I also designed OneLake, lakehouse and data mart architectures, and delivered Snowflake warehousing and Power BI reporting.
At Global Rescue LLC, I developed data ingestion pipelines and built customer data models and Power BI dashboards. I also built and tested the independent Microsoft Fabric Optimization Toolkit, pairing custom code with a Power BI report that details Fabric artifacts that can be optimized.
