# Pooja Suvarna

Pooja Suvarna is a remote worker on Himalayas, Data Engineer at Carelon Global Solutions, based in India.

Source: https://himalayas.app/@poojasuvarna

```text
I’m a Senior Data Engineer building scalable ETL/ELT pipelines and cloud data platforms for performance, reliability, and cost efficiency.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Data Engineer, Big Data Engineer, ETL Engineer, Data Warehouse Engineer, Cloud Data Engineer, Data Migration Engineer, Data Engineer Jobs, Data Engineering, Data Engineering Specialist, Data Engineering Jobs, AI Data Engineer, Data Engineering Positions |
| Skills | Hadoop, HDFS, Hive, Sqoop, Apache Spark, PySpark, Python, Amazon EMR, EC2, S3, AWS Glue, Glue Data Catalog, AWS Step Functions, Snowflake, SQL Server, MySQL, SQL, Data Modeling, Schema Design, And Schema Evolution, MapReduce, Airflow, Data Pipelines, ETL, ELT, Batch Processing, Data Ingestion, Data Warehouse, Data Migration, JSON, Avro, Parquet, ORC, CSV, Git, Linux, Windows, Performance Optimization, Query Optimization, Visual Studio, Column |

## What I'm looking for

```text
I’m looking for a data engineering role where I can build and optimize scalable AWS-based ETL/ELT pipelines, improve distributed Spark/Hive performance, and deliver reliable warehouse and migration solutions with a strong focus on cost and quality.
```

## About

```text
I’m a Data Engineer with 6 years of experience in Big Data Engineering, ETL/ELT pipeline development, and cloud data platform design. I focus on building scalable data pipelines, data warehousing solutions, and data migration workflows that perform well under real-world load.

In my recent work at Carelon Global Solutions, I designed and developed batch processing data pipelines on Amazon EMR using Apache Spark and Python. I built AWS Glue ETL jobs with PySpark to move data from Amazon S3 into curated datasets, leveraging the AWS Glue Data Catalog for metadata and schema discovery.

I’ve also strengthened reliability and speed by optimizing distributed processing—tuning Spark configurations, partitioning strategies, shuffle behavior, and memory allocation to resolve bottlenecks. I’ve implemented Snowflake bulk-loading with data validation, access control, and performance tuning, and automated ingestion and orchestration with robust error handling, logging, and reusable modules.

Earlier, at LKQ India Private Limited and Bullfinch Software, I worked across end-to-end integration and migration, using Sqoop for large-scale migrations to Hadoop clusters and Hive/Spark for efficient querying and warehousing. I’ve consistently applied performance tuning techniques and workflow orchestration (including AWS Step Functions and Airflow) to reduce overhead and deliver measurable cost savings.
```

## Experience

### Data Engineer (current)

Carelon Global Solutions. Oct 2025 - Present

```text
Designed and developed batch processing ETL/ELT data pipelines on AWS EMR using Apache Spark and Python, including AWS Glue jobs and data loading into Snowflake. Optimized Spark performance and automated data ingestion, reporting, and workflow orchestration with monitoring and alerting.
```

Skills: Apache-Spark, PySpark, Python, AWS-Glue, AWS-Step-Functions, Snowflake, SQL, HDFS, ETL-ELT, Data-Pipelines, Data-Validation, Workflow-Orchestration, Error-Handling, Logging

### Data Engineer

LKQ India Private Limited. Nov 2023 - Oct 2025

```text
Built PySpark and Python data pipelines on AWS EMR for processing S3 data and orchestrated parallel job execution using AWS Step Functions. Implemented end-to-end data integration and migration using Sqoop and optimized querying with Hive features and schema evolution.
```

Skills: Apache-Spark, PySpark, Python, S3, AWS-Step-Functions, HDFS, Hive, Sqoop, SQL, AWS, Snowflake, Airflow, Data-Migration, Data-Integration, Bucketing, Indexing, Caching, Avro, And-Schema-Evolution, Serialization

### Big Data Developer

Bullfinch Software Private Limited. Aug 2020 - Nov 2023

```text
Performed large-scale data processing on AWS EMR using PySpark and AWS Hive, orchestrating data pipeline workflows with AWS Step Functions. Optimized Spark RDDs and Hive queries, and configured Sqoop for complex data migrations and integrations.
```

Skills: Apache-Spark, PySpark, HDFS, Hive, AWS, Sqoop, SQL, AWS-Step-Functions, RDD-Optimization, Shuffle-Tuning, Predicate-Pushdown

## Education

### KVGCE, Sullia

Bachelor of Engineering, Computer Science and Engineering. 2016 - 2020. Grade: CGPA: 8.21

```text
Bachelor of Engineering in Computer Science and Engineering from KVGCE, Sullia (2016 to 2020).
```

## Tech stack

- Apache Spark
- AWS Glue
- Amazon S3
- AWS Step Functions
- PySpark
- Sqoop
- MySQL
- Hadoop
- Visual Studio
- JSON
- Linux
- Windows
- Avro
- Airflow
- Amazon EMR
- SQL
- Column

To contact Pooja, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Dipankar Kalita](https://himalayas.app/@dipankarkalita): Data Engineer, Smartbeings Software Innovation
- [varanasi Rohit](https://himalayas.app/@varanasirohit): Senior Data Engineer, Lithia Motors
- [Elisetty Arunasri](https://himalayas.app/@elisettyarunasri): Data Engineer, Softtek India Pvt. Ltd
- [Satish User](https://himalayas.app/@satishuser2): AWS Data Engineer, Boven Technologies
- [Shradha Dubey](https://himalayas.app/@shradhadubey): AWS Data Engineer, Melius Infotech
- [Ashish Sapate](https://himalayas.app/@ashishsapate): Data Engineer, Tech Mahindra
- [chetan kumar reddy](https://himalayas.app/@chetankumarreddy): Data Engineer, Minfy Technologies
- [Adyasha Pattanayak](https://himalayas.app/@adyashapattanayak): Senior Data Engineer, KFin Technologies Ltd
- [Ankush Banik](https://himalayas.app/@ankushbanik): Data Engineer, Deloitte USI
- [Srinu Vasu](https://himalayas.app/@srinuvasu): Big Data Engineer, Carelon Global Solutions
