Looking for a job

Samridha Rana

@samridharana

Message

Data Engineer at MO Department of Mental Health who processes 2 TB of data daily and cut Snowflake costs by 30%.

United States

Message

At MO Department of Mental Health, I build AWS ETL/ELT pipelines processing over 2 TB of data daily for analytics and fraud detection. I also developed a secure data anonymization framework and reduced Snowflake costs by 30% through performance tuning.

At Progressive Insurance Groups, I migrated legacy analytics workloads to Databricks on Azure and built real-time pipelines for health alerts and prescription events. At Centene Corp, I worked on Hadoop-based data processing and led a migration of data ingestion workflows to the Hadoop ecosystem.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

MO Department of Mental Health

Oct 2023 - Present (2 years 11 months)

Built and optimized scalable ETL/ELT pipelines on AWS Glue and Lambda, processing over 2 TB of data daily. Designed data lake architecture and orchestrated workflows with Airflow, reducing costs by 30%.

AWS Glue S3 Databricks Snowflake Airflow Lambda Kinesis Lake Formation PySpark Terraform QuickSight Great Expectations Azure DevOps Docker Fargate BigQuery Dataproc Informatica Delta Lake

Data Engineer

Centene Corp

Mar 2023 - Sep 2024 (1 year 6 months)

Implemented distributed data processing pipelines using Hadoop ecosystem for petabyte-scale financial data. Led migration of ETL workflows and optimized data warehouse performance.

Hadoop MapReduce Hive Pig Sqoop Kafka Flumes HBase Oozie Oracle PostgreSQL Shell Scripting Perl Python Java Spring Framework Talend Informatica Erwin ZooKeeper Cloudera Vertica Apache Atlas Splunk

Data Engineer

Progressive Insurance Groups

Apr 2020 - Jan 2023 (2 years 9 months)

Designed and deployed scalable ETL frameworks using Azure Data Factory and Synapse, orchestrating over 150 workflows. Led migration to Databricks and implemented data governance with Purview.