Harini Siddharthan

I am a Senior Data Engineer with over 7 years of experience building and optimizing end-to-end ETL/ELT solutions and enterprise data warehouses across the Azure ecosystem.

I design scalable data workflows using Azure Data Factory, Synapse Analytics, Microsoft Fabric, Data Lake, and Databricks, and I build real-time streaming pipelines with Kafka, Event Hubs, and Spark Streaming for near-real-time ingestion.

I have improved pipeline reliability and performance through techniques like partitioning, caching, DBT transformations, Delta Lake for ACID compliance, and CI/CD with Azure DevOps and Terraform, delivering measurable reductions in latency and compute costs.

I prioritize data security and governance—implementing Azure AD, RBAC, Key Vault, and compliance controls for HIPAA, GDPR, PCI-DSS, and ISO 27001—while mentoring junior engineers and delivering business insights via Power BI and Tableau.