At Astegic Info, I design and maintain Azure Data Factory pipelines for enterprise data ingestion and transformation. By automating recurring workflows, I reduced manual effort by ~40%.
I develop PySpark and Spark SQL jobs in Azure Databricks, using Delta Lake and Medallion Architecture for batch and streaming data. I also implemented Kafka-based event ingestion and incremental and CDC processing.
I built Microsoft Fabric Lakehouse solutions and supported analytics publishing through Azure Synapse and Power BI. I optimized Spark jobs and SQL queries, reducing execution time by ~55%.
