# Pranay Shridhar

Pranay Shridhar is a remote worker on Himalayas, Product Data Engineer at Barclays, based in India.

Source: https://himalayas.app/@pranayshridhar

```text
Product Data Engineer with 3+ years building cloud-native AWS Big Data pipelines and automated modernization for regulated finance.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Product Data Engineering, Data Engineer, Big Data Engineer, ETL Engineer, Cloud Data Engineer, Product Data Analyst, Product Data Specialist, Senior Product Data Analyst, Data Products Engineering |
| Skills | Python, Java, SQL, Scala, C, PySpark, Apache Spark, Apache Hive, HDFS, Impala, AWS Glue, DynamoDB, Cloudwatch, CloudFormation, Azure Data Factory, Databricks, Docker, CI CD, Jenkins, Oracle, MariaDB, Teradata, NoSQL, Data Architecture, Data Modeling, Data Ingestion, Data Quality, Data Analysis, ETL, APIs, REST, Git, Linux, Shell Scripting, NumPy, Pandas, NLTK, NLP, Agile, Scrum, Jira, Tableu, Power BI, Pytest, Airflow, Factory, Hadoop, JSON, Kafka, Postman, ServiceNow, Dat |

## What I'm looking for

```text
I’m looking for a team where I can build and optimize cloud-native AWS data platforms, automate pipelines end-to-end, and modernize legacy systems—especially in data-heavy, regulated environments that reward measurable performance improvements.
```

## About

```text
I’m a Product Data Engineer with 3+ years of progressive experience at Barclays, where I build cloud-native, high-performance data platforms for highly regulated financial services. I’m known for turning complex data problems into reliable, measurable outcomes—focused on performance optimization, intelligent automation, and operational simplicity.

At Barclays, I led the migration of a legacy ERA process to AWS using Airflow DAG orchestration, improving system uptime by 25% and reducing latency by 40%. I also engineered a customer income selection and filtration system that processes 19M records, cutting data processing time and operational workload by 47%.

I automate pipelines end-to-end, including Dockerized AWS Cloud-Formation templates for PySpark and AWS Glue ETL workflows—reducing setup time by over 70%. I’ve optimized memory-intensive Spark workloads (500K+ records within a strict 2 GB limit) and streamlined DynamoDB ingestion of 8M records by tuning AWS Glue and partitioning, reducing runtime from 12 hours to 33 minutes.

I bring engineering depth to downstream integration by developing custom Spark and Java modules for a Decision Engine, reducing manual file generation tasks by 90%. Before my current role, I redesigned high-performance Big Data pipelines across 15+ Hadoop sources (throughput +30%) and built reusable Python/Shell automation that reduced manual ETL effort by 80%, while modernizing Ab Initio mainframes with Airflow-driven workflows.
```

## Experience

### Product Data Engineer (current)

[Barclays](https://himalayas.app/companies/barclays). Apr 2025 - Present

```text
Led migration of a legacy ERA process to a cloud-native AWS architecture using Airflow DAG orchestration, improving system uptime by 25% and reducing latency by 40%. Built and optimized data pipelines for real-time ingestion, including 19M-record processing and an 8M-record DynamoDB ingestion that cut runtime from 12 hours to 33 minutes.
```

Skills: AWS, PySpark, Apache-Spark, AWS-Glue, DynamoDB, Docker, Spark-Optimization, Java, Airflow, CloudFormation

### Product Data Engineer

[Barclays](https://himalayas.app/companies/barclays). Aug 2022 - Mar 2025

```text
Developed data automation and risk analytics, including a risk assessment algorithm for loans, cards, and mortgages serving 8M+ customers. Redesigned high-performance Big Data pipelines across 15+ Hadoop sources and integrated legacy Ab Initio mainframes with Spark/Java/Python to reduce manual ETL effort by 80% and save 30+ hours per week.
```

Skills: Python, Apache-Hive, Parquet, Shell-Scripting, PySpark, Java, Ab-Initio, Data-Pipelines, Hadoop

## Education

### Vishwakarma Institute of Technology

Bachelor of Technology, Computer Engineering. 2018 - 2022

```text
Earned a Bachelor of Technology in Computer Engineering from Vishwakarma Institute of Technology in Pune (2018–2022).
```

## Tech stack

- Postman
- Apache Spark
- AWS Glue
- Apache Hive
- Jenkins
- NumPy
- Pandas
- PySpark
- dat
- MariaDB
- Hadoop
- Gmail
- Databricks
- Jira
- Java
- JSON
- NLTK
- Kafka
- Linux
- pytest
- Airflow
- dockerized
- SQL
- ServiceNow
- Dynamic
- Factory

To contact Pranay, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Vipul Lalwani](https://himalayas.app/@lalwanivipul): Senior Data Engineer, DataGrokr Analytics Pvt. Ltd.
- [deepak koundel](https://himalayas.app/@deepakkoundel): Data Engineer, Deutsche Bank
- [Dipankar Kalita](https://himalayas.app/@dipankarkalita): Data Engineer, Smartbeings Software Innovation
- [Hansbala B](https://himalayas.app/@hansbalab): Senior Data Engineer, Visa
- [Neha User](https://himalayas.app/@nehauser8): Data Engineer, Principal Global Services
- [Nilesh User](https://himalayas.app/@nileshuser3): Data Engineer, IBM
- [Roro Zoro](https://himalayas.app/@rorozoro): Data Engineer, Barclays
- [Afroj Shaikh](https://himalayas.app/@afrojshaikh): Data Engineer, Barclays
- [Tribhuwan Ssingh Rawat User](https://himalayas.app/@tribhuwanssinghrawat): Lead Data Engineer (Assistant Manager), Macquarie Global Solutions
- [Sanket Kadam](https://himalayas.app/@sanketkadam1): Data Engineer, Barclays
