Open to opportunities

Deepak Singh

@deepaksingh15

Message

Senior Data Engineer & Solution Architect | AI ML Enthusiast | Gen AI | Cloud (AZURE|GCP) I Databricks

India

Message

What I'm looking for

I’m looking to solve business problems with tailored data—building scalable pipelines and dashboards, applying GenAI/RAG where it fits, and communicating complex ideas clearly to non-technical stakeholders through uninterrupted hard work and intense focus.

Sr. Data & AI Engineer Professional with 10+ years of hands on

experience in the IT industry, who enjoys connecting the DOTS:be i t ideas

from different disciplines, people from different teams or applications

form different industries. I have strong technical skill and specialized in

Data Engineering, Azure, GCP, spark, ETL/ELT, Data Warehousing ,

Visualization ions , RAG Pipelines, GenAI & LLMs.

My Passion lies in solving business problems with tailored data, applying

right approach & communicating complex ideas to non - technical

stakeholders.

I believe in uninterrupted hard work & intense focus.

Experience

Work history, roles, and key accomplishments

Current

Senior Consultant

Current

Deloitte

Nov 2022 - Present (3 years 9 months)

Senior Data & AI ENgineer

Data Pipelines Batch Processing Distributed Data Processing Fault Tolerance Event Driven Architecture Dashboard Development Apache Spark Kafka SingleStore Data Lake Real Time Analytics Data Ingestion data transformation

Software Engineer III

Oracle Cerner

Apr 2022 - Oct 2022 (6 months)

Designed ETL pipelines using Azure Data Factory and implemented data export/import workflows into Azure Data Lake Storage with Azure DataBricks. Loaded and transformed data into Snowflake and built dashboards in New Relic for logs analysis, visualization, monitoring, and performance monitoring for Snowflake stored procedures.

Azure Storage Dashboarding Log Analysis Azure Data Factory Azure Data Lake Store Azure Databricks Snowflake New Relic ETL Data Imports

I.T Analyst

Tata Consultancy Services

Mar 2017 - Mar 2022 (5 years)

Designed Spark batch ETL pipelines and built a data quality scorecard to help business teams understand and improve insights from data. Implemented data export/import workflows using minIO (Python, Boto3) and Druid (Python, PyDruid), and created dashboards in Kibana (ELK) and Apache Superset for logs analysis and reporting.

Druid Ingestion Specs data transformation JSON CSV Processing Apache Spark Minio Python Apache Druid ETL Kibana ELK Stack Apache Superset Data Imports Dashboarding

Associate Software Engineer

Herbalife International India Pvt. Ltd.

Sep 2014 - Mar 2017 (2 years 6 months)

Worked on a Hadoop cluster (15 nodes, ~500 TB) and delivered data processing using Hadoop ecosystem tools such as Hive, Pig, and Sqoop with Cloudera Manager and HDP. Designed Hive external/internal tables using partitioning and bucketing concepts, built data loading workflows into the data warehouse, and wrote MapReduce jobs and HiveQL for data cleaning and preprocessing.