# shivakumar User

shivakumar User is a remote worker on Himalayas, Data Engineer at JPMC, based in United States.

Source: https://himalayas.app/@shivakumaruser1

```text
Data Engineer at JPMC building payment data pipelines and fraud-detection feature pipelines.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 90k+ USD |
| Job categories | Data Engineer |
| Skills | ETL ELT, Data Engineering, Batch Processing, Incremental Processing, Near Real Time Processing, Data Ingestion, data transformation, Data Quality, Data Reconciliation, Payments Data, Fraud Detection, Feature Pipelines, Data Governance, Data Lineage, PII Masking |

## About

```text
At JPMC, I develop batch and near-real-time data pipelines for payment and account records, supporting transaction monitoring, reconciliation, and reporting. I also created incremental Databricks transformations that reduced a daily transaction-monitoring workload from about four hours to under three.

At Carnival Cruises, I developed production pipelines for reservation, itinerary, onboard-sales, and ship-operations data. I prepared reporting datasets and improved recurring pipeline runtime by about 25% through incremental-loading logic.
```

## Experience

### Data Engineer (current)

JPMC. Apr 2025 - Present

```text
Developed and supported batch and near-real-time ETL/ELT pipelines using Python, SQL, PySpark, Apache Kafka, and Databricks on AWS, processing approximately 8 million payment and account records daily for transaction monitoring, reconciliation, and operational reporting. Built reusable AWS ingestion workflows and implemented data-quality checks, security controls, and CI/CD processes.
```

Skills: Python, SQL, PySpark, Kafka, Databricks, S3, SNS, Amazon-SQS, AWS-Glue, Lambda, Glue-Data-Catalog, IAM, KMS, Cloudwatch, Snowflake, Delta-Lake, DBT, Git, Jenkins, CI-CD, MLFlow, Generative-AI, RAG

### Data Engineer

Carnival Cruises. Jun 2021 - Nov 2023

```text
Developed and supported more than 15 production batch and incremental ETL pipelines using Azure Data Factory, loading data from SQL Server, REST APIs, and files into Azure Data Lake Storage Gen2. Prepared reliable datasets for reporting, reducing manual data preparation by about 30% and improving pipeline runtime by approximately 25%.
```

Skills: Azure-Data-Factory, ADLS-Gen2, Azure-SQL, Python, PySpark, Azure-Databricks, SQL, Git, Azure-DevOps, Agile

## Education

### University of North Texas

Master's, Data Science

```text
Pursued a Master's degree in Data Science at the University of North Texas.
```

## Tech stack

- Snowflake
- AWS Glue
- AWS IAM
- Amazon CloudWatch
- Amazon S3
- Jenkins
- PySpark
- dbt
- Databricks
- Azure DevOps
- Python
- JSON
- XML
- MLflow
- Amazon SQS
- Amazon SNS
- AWS Lambda
- Git
- SQL
- AWS KMS
- Delta Lake
- Apache Kafka
- AWS
- REST APIs
- Azure

To contact shivakumar, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Jay Bergen](https://himalayas.app/@jaybergen): Senior Data Engineer (ML focus), CitiusTech
- [Sara Wood](https://himalayas.app/@sarawood1): Lead Data Engineer, Databricks
- [Akriti Luitel](https://himalayas.app/@akritiluitel): Senior Data Engineer, Merck
- [Pratiksha KC](https://himalayas.app/@pratikshakc): Senior Data Engineer, Cigna
- [Jitendra User](https://himalayas.app/@jitendrauser): Cloud Data Engineer, Royal Caribbean
- [latu putu](https://himalayas.app/@latuputu): Lead Data Engineer, J.Crew
- [srivallihrushitha ongole](https://himalayas.app/@srivallihrushithaong): Data Engineer, Visa
- [Prasanna Velagala](https://himalayas.app/@prasannavelagala): Data Platform Engineer – Azure, J.B. Hunt
- [sindhuja addula](https://himalayas.app/@sindhujaaddula): SR DATA ENGINEER, Carnival Cruise Line
- [Thomas Wardell](https://himalayas.app/@thomaswardell): Senior Data Engineer, SoFi
