# Deepak Singh

Deepak Singh is a remote worker on Himalayas, Senior Consultant at Deloitte, based in India.

Source: https://himalayas.app/@deepaksingh15

```text
Senior Data Engineer & Solution Architect | AI ML Enthusiast | Gen AI | Cloud (AZURE|GCP) I Databricks
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | India |
| Job categories | Data Engineer, Data Engineer, Senior Consultant, Software Engineer II, IT Analyst, Associate Software Engineer |
| Skills | Data Engineering, Azure, GCP, Apache Spark, SparkSQL, PySpark, Databricks, IOMETE, ETL ELT, Azure Data Lake Store, Azure Data Factory, Azure Synapse, BigQuery, Minio, Kafka, Kafka Connect API, Apache Druid, Apache Superset, ELK Stack, Kibana, New Relic, RAG Data Pipelines, GenAI, LLM, Transformers, PyTorch, Prompt Engineering, Model TraningTokenization, Python, Scala, fastAPI, React, MySQL, SQL Server, Snowflake, SingleStore, Control M, Git, SVN, Shell Scripting, Hadoop, Hive, Pig, Sqoop, HDP, HDFS, MapReduce, Apache Hive, Apache Druid Ingestion Specs, Airflow, Druid, Factory, IntelliJ IDEA, JSON, MemSQL, PyCharm, SQL, Superset, Time Analytics, S3, Data Warehouse |

## What I'm looking for

```text
I’m looking to solve business problems with tailored data—building scalable pipelines and dashboards, applying GenAI/RAG where it fits, and communicating complex ideas clearly to non-technical stakeholders through uninterrupted hard work and intense focus.
```

## About

```text
Sr. Data & AI Engineer Professional with 10+ years of hands on

experience in the IT industry, who enjoys connecting the DOTS:be i t ideas

from different disciplines, people from different teams or applications

form different industries. I have strong technical skill and specialized in

Data Engineering, Azure, GCP, spark, ETL/ELT, Data Warehousing ,

Visualization ions , RAG Pipelines, GenAI & LLMs.

My Passion lies in solving business problems with tailored data, applying

right approach & communicating complex ideas to non - technical

stakeholders.

I believe in uninterrupted hard work & intense focus.
```

## Experience

### Senior Consultant (current)

[Deloitte](https://himalayas.app/companies/deloitte-ireland). Nov 2022 - Present

```text
Senior Data & AI ENgineer
```

Skills: Data-Pipelines, Batch-Processing, Distributed-Data-Processing, Fault-Tolerance, Event-Driven-Architecture, Dashboard-Development, Apache-Spark, Kafka, SingleStore, Data-Lake, Real-Time-Analytics, Data-Ingestion, data-transformation

### Software Engineer III

[Oracle Cerner](https://himalayas.app/companies/oracle). Apr 2022 - Oct 2022

```text
Designed ETL pipelines using Azure Data Factory and implemented data export/import workflows into Azure Data Lake Storage with Azure DataBricks. Loaded and transformed data into Snowflake and built dashboards in New Relic for logs analysis, visualization, monitoring, and performance monitoring for Snowflake stored procedures.
```

Skills: Azure-Storage, Dashboarding, Log-Analysis, Azure-Data-Factory, Azure-Data-Lake-Store, Azure-Databricks, Snowflake, New-Relic, ETL, Data-Imports

### I.T Analyst

[Tata Consultancy Services](https://himalayas.app/companies/tata-consultancy-services). Mar 2017 - Mar 2022

```text
Designed Spark batch ETL pipelines and built a data quality scorecard to help business teams understand and improve insights from data. Implemented data export/import workflows using minIO (Python, Boto3) and Druid (Python, PyDruid), and created dashboards in Kibana (ELK) and Apache Superset for logs analysis and reporting.
```

Skills: Druid, Ingestion-Specs, data-transformation, JSON-CSV-Processing, Apache-Spark, Minio, Python, Apache-Druid, ETL, Kibana, ELK-Stack, Apache-Superset, Data-Imports, Dashboarding

### Associate Software Engineer

[Herbalife International India Pvt. Ltd.](https://himalayas.app/companies/herbalife). Sep 2014 - Mar 2017

```text
Worked on a Hadoop cluster (15 nodes, ~500 TB) and delivered data processing using Hadoop ecosystem tools such as Hive, Pig, and Sqoop with Cloudera Manager and HDP. Designed Hive external/internal tables using partitioning and bucketing concepts, built data loading workflows into the data warehouse, and wrote MapReduce jobs and HiveQL for data cleaning and preprocessing.
```

Skills: Bucketing, Hive-External-Internal-Tables, Data-Ingestion, SDLC, Hadoop, HDFS, Hive, Pig, Sqoop, HDP, Hive-Bucketing, MapReduce, Data-Loading

## Education

### Sai Ram College of Engineering

Bachelor of Engineering, Computer Science & Engineering. Grade: 63%

```text
Earned a B.E. in Computer Science & Engineering from Sai Ram College of Engineering, Bengaluru (VTU) with a 63% score.
```

### K.V Ranchi

Higher Secondary Certificate (CBSE), Higher Secondary Education. Grade: 63%

```text
Completed XII (CBSE) from K.V Ranchi with a 63% score.
```

### K.V Imphal

Secondary School Certificate (CBSE), Secondary Education. Grade: 83%

```text
Completed X (CBSE) from K.V Imphal with an 83% score.
```

### Visvesvaraya Technological University

B.E, Computer Science & Engineering. Grade: 63

## Tech stack

- Snowflake
- Azure Synapse
- Apache Spark
- AWS Glue
- Apache Hive
- Druid
- Superset
- Microsoft Azure
- Amazon S3
- GitHub
- GitLab
- Cloudflare
- Jupyter
- PySpark
- DB
- Sqoop
- MySQL
- PostgreSQL
- Hadoop
- Django
- Databricks
- MemSQL
- IntelliJ IDEA
- PyCharm
- Azure DevOps
- Apache Maven
- React
- JavaScript
- Python
- JSON
- Scala
- ELK
- PyTorch
- Kafka
- FastAPI
- Grafana
- Kibana
- Ubuntu
- New Relic
- Azure SQL Database
- Git
- Tailscale
- NGINX
- Airflow
- Time Analytics
- Google BigQuery
- SQL
- Azure Blob Storage
- Apache Iceberg
- MinIO
- Confluent Platform
- SingleStore
- Dynatrace
- Transform
- Make
- Windsurf
- Task
- Factory

To contact Deepak, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Krishna Sanagapalli](https://himalayas.app/@krishnasanagapalli): Azure Data Engineer, American Airlines
- [Mohan k](https://himalayas.app/@mohank): Senior Data Engineer, Fugetron IT
- [shrutee shree](https://himalayas.app/@shruteeshree): Data Engineer L4, Elevate K 12
- [Amit Singh Negi](https://himalayas.app/@amitsinghnegi): Data Engineer 2, MAQ Software
- [Chandru DP](https://himalayas.app/@chandrudp): Senior Data & AI Engineer, Fractal Analytics Pvt Ltd
- [Devendra Mukati](https://himalayas.app/@devendramukati): AI Data Engineer AI Product D&A, AICoE, 3M Global Technology Centre
- [Vivek Gupta](https://himalayas.app/@vivekgupta6): Senior AI & Data Engineer, Experis (AT&T)
- [nidhi nagori](https://himalayas.app/@nidhinagori): Senior Data Engineer, A.P. Moller Maersk
- [Shariqa naz User](https://himalayas.app/@shariqanazuser): Technical Lead, Wipro
- [Ankit Pandey](https://himalayas.app/@ankitpandey15): Senior Associate Consultant Data Engineer, Infosys Limited
