At Accenture, I design and implement Azure Data Factory pipelines that move and transform data across Azure Data Lake, Azure Blob Storage, and Azure SQL Database.
I build Databricks applications with PySpark and Spark SQL, using the Bronze, Silver, and Gold layers to prepare analytics-ready datasets. I also tune SQL queries and add pipeline tests to check data quality.
In an earlier Accenture role, I helped migrate data from on-premise SQL to an Azure SQL data warehouse. I also used Azure Key Vault to secure pipeline credentials and configured Blob Storage tiers and lifecycle policies to reduce storage costs.
