At Brain Vision Technology, I develop and maintain end-to-end ETL/ELT pipelines for the NJ Insurance Claims & Policy Platform, bringing policy, customer, premium, payment, and claims data from on-premises SQL Server into Azure. I process and validate data with PySpark in Azure Databricks and organize it into Bronze, Silver, and Gold layers in ADLS Gen2.
I also worked on Yorkshire WaterAnalytics, moving data from MS SQL systems to the cloud with Azure Data Factory and transforming it in Azure Databricks. Across these projects, I implemented SCD Type 1/2 processing and Delta Lake MERGE operations, and prepared curated datasets for Power BI reporting.
