R Harshavardhan

I am an Azure Data Engineer with a strong background in designing scalable cloud solutions using Azure Data Factory and Databricks. My expertise lies in building ETL pipelines, real-time processing with Spark Streaming, and executing large-scale data transformations using PySpark and Spark SQL. I have successfully implemented Unity Catalog for centralized governance, security, and metadata management, ensuring high-quality data for downstream processes.

In my recent role at PVH, I designed and implemented data pipelines that optimized ETL processes and improved performance significantly. I utilized Databricks Autoloader for scalable data ingestion and reduced pipeline failures by 50% through the deployment of Delta Live Tables. My experience also includes developing machine learning models using MLflow, training them on large datasets, and managing their lifecycle effectively. I am passionate about leveraging data to drive business insights and enhance decision-making.