At Artech Infosystems Pvt Ltd, where I currently work with client Deloitte, I develop and maintain Azure Data Factory and Azure Synapse pipelines for tax-related data and employee information. I also support data integration between source systems, Azure storage, and target databases.
At Boven Technologies Pvt Ltd, I led the migration of critical business datasets from on-premise MySQL Server to Azure Data Lake Storage Gen2. I developed Azure Data Factory ETL pipelines and migrated millions of records to Azure Blob Storage using ADF and Databricks.
At Kumaran Systems, I designed and implemented an end-to-end pipeline using ADF and Azure Databricks, following Medallion Architecture. I also developed PySpark scripts for data cleansing and transformation and optimized Apache Spark performance.
