Unnathi Shetty
@unnathishetty
Azure Data Engineer building secure, scalable batch and real-time data platforms on Microsoft Azure.
CanadaWhat I'm looking for
I’m an Azure Data Engineer with 5+ years designing, building, and optimizing enterprise data platforms on Microsoft Azure—using Azure Data Factory, Databricks, and Synapse Analytics—to enable data-driven decision-making. I architect scalable ETL/ELT pipelines for large-scale integration, transformation, and migration from on-premise systems to the cloud.
I build reliable transformation logic with data mapping, validation, and exception-handling to protect data quality for enterprise compliance and reporting. I also implement data governance and security through RBAC, encryption at rest and in transit, Azure Key Vault, Delta Lake, and centralized governance with Unity Catalog.
In real-time architectures, I’ve enabled near real-time ingestion and analytics using Azure Event Hubs and Stream Analytics, and I use Python, SQL, and PySpark to deliver end-to-end pipelines. Most recently at Capgemini (Canada), I designed secure, enterprise-grade batch and real-time platforms, optimized performance and costs, and modernized legacy ETL into Azure-native solutions; previously at Accenture (India), I led cloud-based pipeline development, orchestration with Apache Airflow (Astronomer), and governance aligned to standards like GDPR and HIPAA.
Experience
Work history, roles, and key accomplishments
Designed scalable Azure data platforms and built ETL/ELT pipelines using Python, SQL, and PySpark to support batch and real-time analytics. Implemented governance and security controls (RBAC, encryption, Azure Key Vault) and orchestrated streaming architectures with Event Hubs and Stream Analytics.
Led design and development of Azure-based data pipelines to extract, transform, and load data from multiple sources into Azure data platforms. Improved pipeline performance and enforced governance using RBAC, encryption, and Azure Purview while automating workflows with DBT and Git-based version control.
Built Azure data ingestion, transformation, and delivery pipelines to support enterprise analytics and digital transformation initiatives. Implemented governance and security controls and migrated/ consolidated legacy data into modern Azure platforms, documenting data lineage and transformation specifications.
Education
Degrees, certifications, and relevant coursework
NMAMIT University
Bachelor of Engineering (B.E.), Information Science
2016 - 2020
Bachelor of Engineering (B.E.) in Information Science at NMAMIT University from Aug 2016 to Oct 2020.
Availability
Location
CanadaAuthorized to work in
Job categories
Skills
Interested in hiring Unnathi?
You can contact Unnathi and 90k+ other talented remote workers on Himalayas.
Message UnnathiGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
