bidya hire
@bidyahire
Senior Data Engineer specializing in cloud-native, secure, scalable data platforms and analytics.
What I'm looking for
I am a Senior Data Engineer with over six years building cloud-native, secure, and scalable data solutions across healthcare and finance. I design resilient data pipelines, lakehouse architectures, and real-time analytics frameworks that drive reliable business insights.
I have deep multi-cloud experience (AWS, Azure, GCP) and have implemented Delta Lake Medallion patterns, star/snowflake schemas, and optimized warehousing in Synapse, Redshift, and Snowflake. I automate infrastructure with Terraform/ARM/CloudFormation and CI/CD with Azure DevOps and GitHub.
My work emphasizes governance, security, and compliance — registering assets in Purview/Glue Catalog, enforcing RBAC/KMS/Key Vault, and aligning pipelines to HIPAA, SOC2, and GDPR requirements. I also integrate streaming solutions with Event Hubs, Kafka, Kinesis, and Spark Structured Streaming for low-latency analytics.
I collaborate closely with analysts, actuaries, and data scientists to deliver analytics-ready layers and ML/NLP integrations (Hugging Face, LangChain, MLlib) for unstructured healthcare and financial data, while mentoring junior engineers and leading small engineering teams.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
Signify Health
Aug 2023 - Present (2 years 1 month)
Built layered Delta Lake architectures on ADLS Gen2 and engineered scalable PySpark/Databricks ETL pipelines to support actuarial and healthcare analytics, improving data reuse and compliance readiness; automated infrastructure and CI/CD with Terraform and Azure DevOps.
Data Engineer
JPMorgan Chase
Sep 2020 - Jul 2023 (2 years 10 months)
Designed secure, reusable ADF and Databricks pipelines and a Medallion architecture on ADLS Gen2, implemented CI/CD and monitoring to achieve >98% availability and enabled data lineage and governance via Azure Purview.
Analytics Engineer
The Cigna Group
Jan 2019 - Jul 2020 (1 year 6 months)
Developed and maintained SSIS ETL workflows, T-SQL transformations, and Power BI/SSRS reporting for claims and enrollment data to support actuarial and care management analyses, and participated in on-prem to cloud migration planning.
Education
Degrees, certifications, and relevant coursework
University of South Dakota
Master of Business Analytics, Business Analytics
Completed a Master in Business Analytics program focusing on data analytics, statistical modeling, and business-oriented machine learning applications.
Tech stack
Software and tools used professionally
Amazon Redshift
Matillion
Azure Synapse
Apache Spark
AWS Glue
Talend
Amazon Quicksight
Amazon CloudWatch
AWS Step Functions
GitHub
GitLab
Kubernetes
AWS Fargate
Jenkins
GitLab CI
AWS CodeBuild
NumPy
Pandas
PySpark
dbt
Sqoop
MySQL
PostgreSQL
MongoDB
Cassandra
Hadoop
HBase
Gmail
Databricks
Terraform
Azure DevOps
Jira
Java
JSON
PowerShell
XML
TensorFlow
scikit-learn
Kafka
Azure Monitor
Windows
Windows Server
Airflow
Time Analytics
Root Cause
SQL
Azure Blob Storage
Hugging Face
LangChain
Delta Lake
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring bidya?
You can contact bidya and 90k+ other talented remote workers on Himalayas.
Message bidyaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
