At LTIMindtree, I develop and maintain data pipelines that move data from on-premises systems to cloud platforms. I use Azure Data Factory and Databricks for ETL, with cleansing and validation to support reliable analytics.
I also monitor existing workflows and work with cross-functional teams to gather requirements and define data models. I identify performance bottlenecks and resolve them to improve workflow efficiency.
In my Automated Data Pipeline with Analytics project, I built a pipeline using ADLS Gen2 and Azure Databricks to process customer sales data. I used PySpark and the Medallion Architecture, then created Power BI dashboards for business insights and performance reporting.
