At Cognizant, I developed data ingestion pipelines for the PepsiCo project using Azure Databricks and Apache Spark, bringing data from multiple source systems into Azure Data Lake.
I also developed Microsoft Fabric Lakehouse pipelines with OneLake and implemented orchestration workflows using Fabric Data Factory and Data Pipelines. My work supported Medallion Architecture across ingestion, transformation, and curated data layers.
At Protiviti India Member Private Limited, I developed Azure Data Factory pipelines for batch and incremental ingestion on the Texas Capital Bank project. I built PySpark transformation workflows in Azure Databricks and integrated data into Azure Data Lake and Azure Synapse Analytics.
At London Stock Exchange Group, I developed real-time ingestion pipelines using Apache Kafka and distributed data processing with Apache Hive. I also worked on Azure Data Factory and Databricks pipelines, Delta Lake storage, and data models in Azure Synapse.
