supriya User
@supriyauser1
Senior Data Engineer specializing in Azure cloud, ETL/ELT pipelines, and real-time data solutions.
What I'm looking for
I am a Senior Data Engineer with 12+ years building end-to-end ETL/ELT pipelines, data lakes, and enterprise data warehouses primarily on Microsoft Azure.
I design scalable batch and streaming workflows using Azure Data Factory, Synapse, Databricks, Event Hubs, Kafka, and Spark to deliver reliable analytics and real-time data access for business stakeholders.
I drive performance and cost optimization through partitioning, caching, Delta Lake, and query tuning, and I have integrated Snowflake, DBT, and CI/CD practices using Azure DevOps, Terraform, and Docker/Kubernetes.
I prioritize security and compliance (HIPAA, GDPR, PCI-DSS, ISO 27001), mentor junior engineers, and collaborate with data science teams to enable ML and Generative AI capabilities including Azure ML and OpenAI integrations.
Experience
Work history, roles, and key accomplishments
Senior Azure Data Engineer
Cigna Healthcare
Mar 2023 - Present (2 years 7 months)
Designed and implemented end-to-end Azure data integration and streaming pipelines for healthcare data, improving data availability by 35% and achieving 40% faster delivery while reducing compute costs by 25%.
Data Engineer
City Union Bank
May 2018 - Jul 2022 (4 years 2 months)
Migrated on-prem ETL to Spark/Hadoop, built reusable PySpark templates and optimized jobs to reduce processing time by 30–40% while implementing monitoring and data quality validations.
Designed and maintained batch pipelines for large-scale financial datasets, automating multi-source integrations and reducing manual processing time by ~30% to support reporting and regulatory compliance.
Education
Degrees, certifications, and relevant coursework
Anna University
Bachelor of Engineering, Computer Science & Engineering
Bachelor of Engineering in Computer Science and Engineering from Anna University.
Tech stack
Software and tools used professionally
Postman
Azure HDInsight
Azure Synapse
SAS
Microsoft Azure
GitHub
GitLab
Kubernetes
Azure Kubernetes Service
Jenkins
GitHub Actions
GitLab CI
NumPy
Pandas
PySpark
MySQL WorkBench
dbt
DB
Sqoop
MySQL
MongoDB
Cassandra
Hadoop
HBase
Gmail
Yarn
Databricks
Azure Stack
Terraform
Visual Studio
PyCharm
Spyder
Azure DevOps
Jira
Gradle
JSON
XML
MLflow
scikit-learn
Kafka
Grafana
Prometheus
Zookeeper
Azure Active Directory
Avro
Azure Functions
Azure SQL Database
Airflow
Apache Oozie
Time Analytics
SQL
Google Colab
Azure Cosmos DB
Azure Blob Storage
SciPy
Delta Lake
Azure Logic Apps
dbt Cloud
Cosmos
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring supriya?
You can contact supriya and 90k+ other talented remote workers on Himalayas.
Message supriyaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
