Subhasini Kanagaraj
@subhasinikanagaraj
Senior Azure Data Engineer specializing in batch and streaming pipelines.
United StatesWhat I'm looking for
I’m a Senior Azure Data Engineer with 7+ years of full SDLC expertise in Data Warehousing and Business Intelligence, specializing in Azure Data Factory (ADF), Databricks (PySpark), and Azure Functions for batch and streaming pipelines.
I build and optimize scalable ETL/ELT pipelines that transform data from Azure Data Lake Storage (ADLS Gen2) into analytics-ready formats like CSV, JSON, Parquet, Avro, and ORC, leveraging Spark SQL, DataFrame, and Dataset APIs in Azure Databricks.
In my recent role, I designed medallion architecture (bronze/silver/gold) and implemented Delta Live Tables (DLT) for continuously updated pipelines. I also migrated on-prem workloads to Azure Data Lake and Databricks, resolving performance bottlenecks and troubleshooting ingestion and transformation failures.
I focus heavily on reliability and governance—implementing real-time monitoring, CI/CD with Terraform/Jenkins/Azure DevOps, and healthcare security controls (Azure Key Vault, encryption, and RBAC) aligned to HIPAA requirements. I collaborate cross-functionally to deliver production-ready data products, including dashboards with Power BI and Tableau.
Experience
Work history, roles, and key accomplishments
Designed and implemented scalable ETL/ELT pipelines with Azure Databricks and Azure Data Lake for healthcare and state government data platforms. Implemented Delta Live Tables, medallion architecture, near-real-time ingestion, and HIPAA-oriented security controls using Azure Key Vault.
Built end-to-end ETL/ELT pipelines on Azure to ingest structured and semi-structured data into ADLS Gen2. Migrated on-prem SQL Server workloads to Azure SQL Database and ADLS Gen2, developed Databricks PySpark transformations, and supported near-real-time analytics in Synapse and reporting in Power BI.
ETL Developer
Time Warner Cable
Aug 2013 - Oct 2015 (2 years 2 months)
Replicated Salesforce data into IBM Netezza EDS using optimized ETL workflows to support enterprise analytics and BI reporting. Orchestrated jobs with Tidal Scheduler, implemented data validation and reconciliation, and managed ETL deployments and production support.
Education
Degrees, certifications, and relevant coursework
Anna University
Bachelor of Engineering (B.E.), Engineering
Earned a Bachelor of Engineering (B.E.) from Anna University in Chennai, India.
Tech stack
Software and tools used professionally
Azure HDInsight
Azure Synapse
Apache Spark
GitHub
Kubernetes
Jenkins
Salesforce
Jupyter
PySpark
DB
Sqoop
Hadoop
Gmail
Databricks
Terraform
Visual Studio
Azure DevOps
Jira
JSON
Azure Monitor
Linux
Windows
Avro
Azure Functions
Azure SQL Database
Visual Studio Code
Time Analytics
Root Cause
SQL
Azure Blob Storage
ServiceNow
Delta Lake
Azure Logic Apps
Cosmos
Transform
Enhance
Polybase
Microsoft Fabric
Dynamic
Factory
Jan
Availability
Location
United StatesAuthorized to work in
Job categories
Skills
Interested in hiring Subhasini?
You can contact Subhasini and 90k+ other talented remote workers on Himalayas.
Message SubhasiniGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
