# Suhas varma Rudraraju

Suhas varma Rudraraju is a remote worker on Himalayas, Senior Data Engineer at National Institute Of Mental Health, based in United States.

Source: https://himalayas.app/@suhasvarmarudraraju

```text
Senior data engineer building scalable, governed data pipelines on cloud platforms.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | Senior Data Engineer, Cloud Data Engineer, Big Data Engineer, Data Engineer, Senior Data Engineering, Senior Data Analytics Engineer, Senior Data Management Engineer |
| Skills | BigQuery, Data Warehouse, Python, SQL, Scala, Java, C++, Apache Spark, PySpark, AWS, Terraform, Prefect, Dagster, AWS Glue, Amazon EMR, Snowflake, Amazon Redshift, Azure Data Factory, Data Lake, Databricks, Docker, Kubernetes, Jenkins, CI CD, Data Modeling, ETL ELT Data Pipelines, Data Governance, Data Quality, Data Lineage, AWS Lambda, Airflow, Ansible, Apache Beam, Apache Flink, Apache NiFi, Apache Pulsar, Apache Storm, Avro, Azure Functions, Azure Kubernetes Service, Azure Synapse, Beam, Cassandra, Clickhouse, D3.Js, S3, Data Studio, Factory, Google Cloud Platform, Google Cloud Pub Sub, Hadoop, IBM DB2, JSON, JavaScript, Kafka, Luigi, Microsoft SQL Server, MongoDB, MySQL, NATS, PostgreSQL, RabbitMQ, Redis, SQLite, Superset, XML, Excel, Azure |

## What I'm looking for

```text
I’m looking to build reliable, observable data platforms on AWS, improving governance and pipeline performance with measurable impact. I want a collaborative team where I can mentor engineers and deliver incremental, high-quality improvements fast.
```

## About

```text
I’m a Senior Data Engineer with 6+ years of experience designing and scaling data pipelines, platforms, and infrastructure to support business objectives. I build reliable, observable, and scalable data architectures using AWS and open-source tools like Spark and Kafka to improve data accessibility and performance.

In my current role, I spearheaded a scalable AWS-based data platform, mentored junior engineers, and implemented ETL/ELT pipelines with Apache Spark and AWS Glue—reducing latency by 30%. I also established data governance protocols for compliance, used Apache Airflow to orchestrate complex workflows, and improved processing speed by 25% through performance tuning.

Previously, as a Cloud Data Engineer, I engineered real-time streaming pipelines with AWS and Apache Kafka, improved data quality and reduced processing times by 40%, and modernized architectures using Azure Data Factory and Amazon Redshift. Earlier big-data and data engineering experience with Hadoop, Hive, and Spark strengthened my focus on data quality, migration, and workflow optimization.
```

## Experience

### Senior Data Engineer (current)

National Institute Of Mental Health. Feb 2024 - Present

```text
Designed and built a scalable AWS-based data platform to improve data accessibility and reliability across departments. Reduced data processing latency by 30% using Apache Spark and AWS Glue, improved processing speed by 25%, and implemented data governance and Terraform-based infrastructure-as-code for compliant, reliable operations.
```

Skills: Airflow, AWS, Apache-Spark, AWS-Glue, Data-Governance, Terraform, ETL-ELT, Data-Modeling, Data-Quality

### Cloud Data Engineer

[American Express](https://himalayas.app/companies/american-express-company). Jan 2022 - Aug 2023

```text
Engineered AWS- and Kafka-based pipelines for real-time data streaming and processing for critical business applications. Improved data quality and reduced processing times by 40% using SQL and Spark, modernized analytics with Azure Data Factory and Amazon Redshift, and increased operational efficiency by 20% while reducing data storage costs.
```

Skills: Kafka, AWS, SQL, Apache-Spark, Azure-Data-Factory, Amazon-Redshift, Data-Quality, Docker, CI-CD

### Big Data Engineer

Goldman Sach. Jul 2020 - Dec 2021

```text
Developed and maintained Hadoop and Hive solutions to enable efficient storage and retrieval of large datasets for analytics. Reduced data retrieval times by 35% through workflow optimization, implemented data quality checks, and improved scalability and performance via migrations to modern data architectures.
```

Skills: Hadoop, Hive, Apache-Spark, SQL, Data-Quality, Data-Governance, Data-Modeling, Performance-Optimization, Data-Warehouse

### Data Engineer

[Kroger](https://himalayas.app/companies/kroger). Jun 2019 - Jun 2020

```text
Built ETL processes in Python and SQL to extract, transform, and load data into data warehouses for business intelligence. Improved reporting accuracy by implementing data quality controls and increased processing efficiency by 15% through workflow optimization, while supporting cloud migration and Tableau dashboard/report development.
```

Skills: Python, SQL, ETL, Data-Quality, Data-Modeling, Tableau, CI-CD, Git, Docker, Data-Warehouse

## Education

### Indiana Wesleyan University

Master of Information Technology, Information Technology. Grade: 3.8 GPA

```text
Earned a Master's degree in Information Technology from Indiana Wesleyan University, achieving a 3.8 GPA.
```

## Tech stack

- Amazon Redshift
- Azure Synapse
- Apache Spark
- AWS Glue
- Apache Flink
- Superset
- Data Studio
- D3.js
- Microsoft Azure
- Google Cloud Platform
- Amazon S3
- Kubernetes
- Azure Kubernetes Service
- Jenkins
- PySpark
- MySQL
- PostgreSQL
- MongoDB
- Microsoft SQL Server
- SQLite
- Cassandra
- Hadoop
- IBM DB2
- Gmail
- Databricks
- Redis
- Terraform
- JavaScript
- Java
- JSON
- XML
- Kafka
- RabbitMQ
- Apache NiFi
- Apache Pulsar
- NATS
- Google Cloud Pub/Sub
- Avro
- Ansible
- AWS Lambda
- Azure Functions
- Microsoft Excel
- Apache Storm
- Airflow
- Apache Beam
- Google BigQuery
- Luigi
- SQL
- Clickhouse
- Dagster
- Transform
- Enhance
- Increase
- Factory
- Beam
- Jan

To contact Suhas varma, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Nrupali Patel](https://himalayas.app/@nrupalipatel): Sr. Data Engineer, SunPower Corporation Inc
- [James Malik](https://himalayas.app/@jamesmalik): Senior Data Engineer, Google Cloud
- [Anjan Regmi](https://himalayas.app/@anjanregmi): Senior Data Engineer, Truist Financial
- [AAYUSH PANDEY](https://himalayas.app/@aayushpandey3): Senior Data Engineer, Cigna
- [Samip Sedhain](https://himalayas.app/@samipsedhain): Senior Data Engineer, Signify Health
- [Shriju Maharjan](https://himalayas.app/@shrijumaharjan): Senior Data Engineer, Elevance Health
- [Nishan Maharjan](https://himalayas.app/@nishanmaharjan): Senior Data Engineer, Change Healthcare
- [Prasuna Bista](https://himalayas.app/@prasunabista): Senior Data Engineer, Johnson & Johnson
- [Farooq Alee](https://himalayas.app/@aleehafeez1337): Senior Data Engineer, CorroHealth
- [Mehmood Ghojaria](https://himalayas.app/@mehmoodghojaria): Senior Data Engineer, Capital One
