Open to opportunities

Naveen Raghavan Palani

@naveenraghavanpalani

Message

Azure Data Engineer building scalable Azure ETL/ELT pipelines for analytics and ML.

Canada

Message

What I'm looking for

I’m looking for a role where I can build reliable Azure data platforms—ETL/ELT, streaming, and governance—using best practices in Lakehouse architectures. I want to collaborate cross-functionally and improve performance, cost efficiency, and observability.

I’m an Azure Data Engineer with 3 years of experience specializing in building scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse Analytics. I focus on turning structured and semi-structured data (CSV, JSON, Parquet) into reliable, production-ready data products for analytics and downstream AI/ML workloads.

In my current role, I design and maintain cloud-native analytics platforms with Azure Synapse Analytics, Azure SQL Database, Delta Lake, and Databricks to deliver high-performance data models and curated datasets. I integrate enterprise sources from APIs (OAuth 2.0), relational databases, and streaming systems using Event Hubs and Azure Stream Analytics, supporting batch and near real-time processing.

I also prioritize data security, governance, and observability using Azure Active Directory, RBAC, Key Vault, Microsoft Purview, and Azure Monitor, so teams get controlled access, auditability, and proactive monitoring. Previously, I developed Spark-based ETL/ELT pipelines with Python, SQL, and Airflow-style orchestration, and I’ve worked closely with data scientists and stakeholders to translate requirements into technical deliverables with strong documentation and operational support.

Experience

Work history, roles, and key accomplishments

Current

Azure Data Engineer

Current

TGT Solutions

Mar 2024 - Present (2 years 4 months)

Designed, developed, and maintained scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, PySpark, and SQL to ingest and transform CSV, JSON, and Parquet into Azure Data Lake Storage Gen2 using Lakehouse/Medallion architecture. Built cloud-native analytics and security/governance capabilities using Azure Synapse, Delta Lake, Power BI, and Microsoft Purview, and implemented monitor

Azure Data Engineer

Cognizant Solutions

Nov 2021 - Mar 2023 (1 year 4 months)

Developed scalable ETL/ELT pipelines using Apache Spark, Python, SQL, and Airflow-style orchestration to process structured and semi-structured datasets for enterprise analytics and reporting. Implemented data ingestion/validation workflows, tuned Spark SQL jobs for performance, and supported real-time streaming solutions using Azure Event Hubs and Azure Stream Analytics.