Open to opportunities

Manasa Reddy

@manasareddy

Message

Senior Data Engineer specializing in scalable Big Data, Spark, and cloud-native data pipelines.

United States

Message

What I'm looking for

I seek senior data engineering roles building scalable, production data platforms and real-time pipelines in collaborative, cloud-first teams with opportunities to mentor and innovate.

I am a Senior Data Engineer with about 12 years of experience designing, developing, testing, and deploying Big Data, Spark, and Hadoop solutions across cloud and on-premises environments. I build production-ready Spark applications on Databricks and EMR, leverage Delta Lake for ACID-compliant lakehouses, and design scalable ETL and streaming pipelines for analytics and ML consumption.

My background includes end-to-end implementation of enterprise data lakes and lakehouses using AWS services (S3, Glue, EMR, Athena, Redshift, Lambda, Kinesis) and Snowflake, plus orchestration with Airflow, Step Functions, and CI/CD automation. I have a strong track record optimizing Spark jobs (broadcasting, caching, shuffle tuning), implementing CDC with Snowflake Streams & Tasks, and integrating real-time pipelines with Kafka and Kinesis.

I am an innovative self-starter and collaborative team player who mentors junior engineers, drives reusable frameworks, and partners with stakeholders to translate business needs into reliable, cost-efficient data solutions. I focus on data quality, observability, and performance tuning to meet SLAs and accelerate data-driven decision making.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

HEB

Apr 2024 - Present (1 year 5 months)

Designed and implemented an enterprise data lake on AWS and built scalable ETL and real-time Spark pipelines, improving data availability and query performance for analytics and reporting.

Apache Spark AWS S3 EMR Glue Redshift Airflow Python Tableau

Cloud Data Engineer

PNC Bank

Sep 2020 - Mar 2024 (3 years 6 months)

Built AWS data lake integrating Snowflake as the core warehouse and developed PySpark ETL and CDC pipelines to enable near real-time analytics and reduce query latency.

Snowflake Pyspark AWS Glue S3 Kinesis Apache Airflow Terraform Kafka SQL

Data Engineer / Data Analyst

American Express

May 2018 - Aug 2020 (2 years 3 months)

Developed Spark-based streaming and batch pipelines on AWS EMR and Kinesis, redesigned legacy workflows, and delivered analytics-ready datasets and visualizations to stakeholders.

Spark Pyspark EMR Kinesis Lambda Redshift Python Tableau CI CD

Big Data Engineer

State of New York

Jul 2015 - Apr 2018 (2 years 9 months)

Managed Cloudera/Hortonworks clusters and built Spark and Hive ETL pipelines with Kafka integration to support large-scale batch and streaming analytics.

Hadoop Spark Hive Kafka HDFS Pyspark Avro HBase Tableau

Hadoop Developer

Deloitte

Aug 2011 - Jul 2013 (1 year 11 months)

Implemented Hadoop MapReduce, Hive, Pig, and Sqoop-based ETL workflows, automated Oozie job orchestration, and supported cluster setup and performance tuning.

Hadoop MapReduce Hive Pig Sqoop Oozie HBase Shell Scripting Kafka

Education

Degrees, certifications, and relevant coursework

Wright State University

Master of Science, Computer Science

2013 - 2015

Completed a Master of Science in Computer Science focusing on advanced topics in distributed systems and data engineering from August 2013 to June 2015.