# Jagadish Reddy

Jagadish Reddy is a remote worker on Himalayas, Senior Data Engineer at JP Morgan Chase, based in India.

Source: https://himalayas.app/@jagadishreddy

```text
Senior Data Engineer with extensive experience in Big Data technologies.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Senior Data Engineer, Data Architect, ETL Developer |
| Skills | Hadoop, Big Data, Apache Spark, Azure Data Factory, AWS, SQL, Python, Scala, ETL, Azure HDInsight, AWS Glue, Apache Hive, Talend, Azure Storage, Azure Repos, Jenkins, Pandas, PySpark, Sqoop, MySQL, MongoDB, Cassandra, HBase, Yarn, Azure DevOps, Jira, Java, JSON, XML, Amazon SQS, ZooKeeper, Azure Active Directory, The Hive, Avro, Azure Functions, Azure SQL Database, Apache Ranger, Data Warehouse, AWS Lambda, Rundeck, ADP, AWK, Kafka, Linux, Amazon RDS, Airflow, Azure Synapse, AWS Sagemaker |

## What I'm looking for

```text
I seek a challenging role in a dynamic environment that fosters innovation and collaboration.
```

## About

```text
I am a Senior Data Engineer with over 9 years of experience in Information Technology, specializing in Hadoop and Big Data processing. My expertise lies in implementing complex Big Data projects using technologies such as Apache Hadoop, Spark, and various Azure services. I have successfully migrated SQL databases to Azure Data Lake and developed data engineering pipelines that enhance data accessibility and usability.

Throughout my career, I have worked with industry leaders like JP Morgan Chase and Alaska Airlines, where I designed and implemented data solutions that improved system uptime and data processing efficiency. My hands-on experience with AWS and Azure cloud infrastructures, combined with my proficiency in data modeling and performance tuning, allows me to deliver high-quality results in fast-paced environments. I am passionate about leveraging data to drive business insights and support strategic decision-making.
```

## Experience

### Senior Data Engineer (current)

[JP Morgan Chase](https://himalayas.app/companies/jpmorgan-chase-co). Sep 2022 - Present

```text
Designed technical solutions aligning with business and IT strategies, developing applications for data transformation across enterprise analytics platforms. Built an ETL framework for data migration to Azure cloud and created a new data quality check framework in Python.
```

Skills: Azure-Data-Factory, Snowflake, Python, Apache-Spark, PySpark, Hive, Airflow

### Data Engineer

Alaska Airlines. Apr 2020 - Aug 2022

```text
Developed Scala Spark pipelines to transform raw data into parquet files and load data from Hive to Amazon RDS. Worked extensively with AWS services like S3, Glue, EMR, and Lambda to process data for downstream customers. Created CI/CD pipelines using Jenkins and Rundeck for job scheduling.
```

Skills: Spark, Scala, Hadoop, Hive, Sqoop, AWS-Glue, Amazon-EMR, Snowflake, Jenkins, Rundeck, Amazon-SQS, S3, Airflow

### Data Engineer

[ADP](https://himalayas.app/companies/adp). Aug 2018 - Apr 2020

```text
Designed Hadoop architecture and set up a multi-node cluster, performing performance tuning on Azure Data Factory pipelines. Extracted data from various sources using Sqoop and built a Data Discovery Platform using Azure HDInsight components. Developed ETL operations using Pig Latin scripts and Python, and created workflows on Talend.
```

Skills: Hadoop, Hive, Pig, Sqoop, Azure-Data-Factory, Azure-HDInsight, Talend, HBase, Python, Tableau, Snowflake, Power-BI

### Junior Software Developer

Geospatial Solutions. Jun 2014 - Jun 2015

```text
Imported data from various formats to HDFS and ingested data from RDBMS sources using Sqoop. Developed real-time data ingestion and analysis using Kafka and Spark Streaming. Managed and scheduled jobs on a Hadoop cluster using Oozie and built NiFi dataflows.
```

Skills: Spark, Scala, Kafka, Hadoop, HDFS, Hive, Oozie, Pig, NiFi, Sqoop, HBase, Tableau, S3

## Education

### Northwestern University

Master of Science, Information Systems. 2015 - 2017

```text
Pursued a Master of Science degree focusing on Information Systems. Studied advanced topics in data management, system analysis, and IT strategy.
```

### Jawaharlal Nehru Technological University (JNTU)

Bachelor of Science, Computer Science. 2010 - 2014

```text
Completed a Bachelor of Science program in Computer Science. Gained foundational knowledge in programming languages, data structures, and algorithms.
```

## Tech stack

- Azure HDInsight
- Azure Synapse
- Apache Spark
- AWS Glue
- Apache Hive
- Talend
- Azure Storage
- Azure Repos
- Jenkins
- Pandas
- PySpark
- DB
- Sqoop
- MySQL
- MongoDB
- Cassandra
- Hadoop
- HBase
- Gmail
- Yarn
- Azure DevOps
- Jira
- Java
- JSON
- AWK
- XML
- Kafka
- Amazon SQS
- Zookeeper
- Linux
- Azure Active Directory
- The Hive
- Avro
- AWS Lambda
- Azure Functions
- Amazon RDS
- Azure SQL Database
- Airflow
- Apache Ranger
- Amazon Web Services (AWS)
- SQL
- Amazon SageMaker
- Rundeck
- ADP

To contact Jagadish, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Ansuman Mahapatra](https://himalayas.app/@ansumanmahapatra): Senior Data Engineer, Ernst and Young India
- [Rajeev Kumar](https://himalayas.app/@rajeevkumar5): Senior Data Engineer, Chegg
- [Krishna Sanagapalli](https://himalayas.app/@krishnasanagapalli): Azure Data Engineer, American Airlines
- [pavan User](https://himalayas.app/@pavanuser2): Sr. Data Engineer, T Mobile
- [Amrita Kumari](https://himalayas.app/@amritakumari): Senior Data Engineer, IBM
- [Sai ram](https://himalayas.app/@sairam2): Senior Data Engineer, Wells Fargo India
- [Mohan k](https://himalayas.app/@mohank): Senior Data Engineer, Fugetron IT
- [varanasi Rohit](https://himalayas.app/@varanasirohit): Senior Data Engineer, Lithia Motors
- [Subhashini Damu](https://himalayas.app/@subhashinidamu): Senior Big Data Engineer, Comcast
- [Vijay Parmar](https://himalayas.app/@vijayparmar): Senior Data Engineer, Saama Technologies
