# neha sharma

neha sharma is a remote worker on Himalayas, Azure Data Engineer at Accenture, based in United Kingdom.

Source: https://himalayas.app/@nehasharma9

```text
Senior Data Engineer with expertise in Big Data technologies.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United Kingdom |
| Authorized to work in | United Kingdom |
| Job categories | Data Engineer, Big Data Engineer, Cloud Data Engineer, ETL Developer, Data Architect, Data Engineering, DataOps Engineer, Data Platform Engineer, Data Engineer, Analytics Engineer |
| Skills | Databricks, PySpark, Scala, Apache Spark, Azure SQL, ADFS, Hive, HBase, Hadoop, Denodo, Denodo Data Virtualization, PHP, Talend, Sqoop, Java, Kotlin, JSON, GitHub, SQL, Kafka, Azure Synapse, Azure Cosmos DB |

## What I'm looking for

```text
I am looking for a challenging role in a collaborative environment that fosters innovation and growth.
```

## About

```text
I am a Senior Data Engineer with over 8 years of experience specializing in Big Data technologies such as Spark, Databricks, and Hadoop. My expertise lies in designing and developing data ingestion, curation, and consumption layers in data lakes. I have a proven track record of optimizing data pipelines and delivering insights that drive business decisions.

Throughout my career, I have successfully developed over 25 data pipelines using Spark, Scala, Python, and Hive in various projects, including HCSC. I have led significant initiatives such as migrating legacy data lakes to Azure Cloud and implementing robust ETL pipelines using Azure Data Factory. My technical leadership has resulted in improved data quality and performance, achieving a 25% reduction in execution time for critical reports.

I am passionate about mentoring junior team members and continuously seeking innovative solutions to enhance data processing efficiency. My goal is to leverage my skills in a dynamic environment where I can contribute to impactful data-driven projects.
```

## Experience

### Azure Data Engineer (current)

[Accenture](https://himalayas.app/companies/accenture). Mar 2024 - Present

```text
Developed data ingestion pipelines from various source systems to target systems using Databricks medallion architecture. Led the design for the migration of Java/Gemfire Application to Databricks/Azure, handling 20M records of historical data and 10M+ daily delta data.
```

Skills: Databricks, PySpark, Azure, Azure-SQL, ADLS, Data-Ingestion, Data-Migration, Data-Pipelines

### Data Engineer

[Accenture](https://himalayas.app/companies/accenture). Jan 2023 - Mar 2024

```text
Led the end-to-end development migrating On-Prem Cloudera Data Lake to Azure Cloud. Migrated data ingestion pipelines to a Streaming Framework leveraging Confluent Kafka and Spark Streaming.
```

Skills: Cloudera, Confluent, Databricks, Delta-Lake, Azure-Synapse, ETL, Azure

### Data Engineer

[Accenture](https://himalayas.app/companies/accenture). Jun 2021 - Mar 2024

```text
Developed multiple zones – Raw/Curated/Gold and Consumption in the datalake where multiple analytical reports are generated. Enhanced the Generic Spark Scala program to process complex nested Claims JSON Files.
```

Skills: Spark, Scala, Hive, Talend, Data-Pipelines, Data-Quality, Performance-Optimization, JSON

### Hadoop Developer

Sensiple Software Solutions. Apr 2017 - May 2018

```text
Created and worked with Sqoop jobs with incremental load. Implemented Partitioning, Dynamic partitioning and Bucketing in Hive using internal and external table for more efficient data.
```

Skills: Sqoop, Hive, Partitioning, Bucketing, Zena, Software-Testing

### Web Developer

Red Ballons Advertiser. Aug 2013 - Aug 2016

```text
Developed and deployed new features to facilitate related procedures and tools. Provided immediate fixation on issues and actively involved in development activities.
```

Skills: Web-Development

## Education

### Unknown University

Bachelor of Technology, Computer Science and Engineering

```text
Completed a Bachelor of Technology in Computer Science and Engineering. This program provided a strong foundation in computer science principles and practices.
```

## Tech stack

- Azure Synapse
- Apache Spark
- Talend
- GitHub
- PySpark
- DB
- Sqoop
- Hadoop
- HBase
- Gmail
- Databricks
- Java
- PHP
- Kotlin
- JSON
- Kafka
- SQL
- Azure Cosmos DB

To contact neha, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Dani YK](https://himalayas.app/@daniyk): Lead Data Engineer, Virtusa London
- [Tharun Thotapalli](https://himalayas.app/@tharunthotapalli): Customer 360 Degree Analytics Solution, Optum UHG
- [vasavi pralaya](https://himalayas.app/@vasavipralaya): Senior Data Engineer, Ascent Digital Services UK Limited
- [JEFFREY MAENETJA](https://himalayas.app/@jeffreymaenetja): Data Engineer, United Learning
- [shelly sharma](https://himalayas.app/@shellysharma): Software Engineer (Data Engineer), Impetus Technologies India Pvt. Ltd
- [anoop v](https://himalayas.app/@anoopv): Senior Data Engineer, University of Liverpool
- [Vijaya Godasu](https://himalayas.app/@vijayagodasu): Azure Data Engineer, Asda
- [Yasir Yusuf](https://himalayas.app/@yasiryusuf): Data Engineer, British Petroleum
- [DHANASHREE Gambhir](https://himalayas.app/@dhanashreegambhir): Quantexa Data Engineer, Barclays
- [Ali Raza](https://himalayas.app/@aliraza59): Senior Data Engineer, MicroDev Solutions
