# Pusala dinesh

Pusala dinesh is a remote worker on Himalayas, SDE-2 | Data Engineering at Sigmoid Analytics, based in India.

Source: https://himalayas.app/@pusaladinesh

```text
Data Engineer at Sigmoid Analytics who built a document retrieval platform processing 500K+ files for GenAI search.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 2236k+ INR |
| Job categories | Data Engineer |
| Skills | Data Engineering, ETL ELT, Data Pipelines, Apache Spark, PySpark, Databricks, Delta Lake, Medallion Architecture, Data Modeling, Data Warehouse, Data Quality, Data Validation, Spark SQL Optimization, Incremental Ingestion, Snowflake |

## About

```text
At Sigmoid Analytics, I designed Databricks and PySpark pipelines for a GenAI-powered document retrieval platform, processing more than 500K structured and unstructured documents. The platform reduced manpower requirements by 60% and shortened request turnaround time by removing manual technical handoffs.

I implemented a Bronze–Silver–Gold Medallion architecture on Delta Lake and built incremental ingestion from source APIs into ADLS. I also developed document processing workflows from extraction and OCR through chunking and embedding generation, publishing results to Azure AI Search for vector and semantic retrieval.

Earlier at Sigmoid Analytics, I maintained ETL/ELT pipelines and optimized Spark SQL transformations, reducing incremental pipeline runtime by 70%. I also built data quality frameworks that reduced incorrect or duplicate ingestion by over 90%, and completed a Databricks training capstone using a Medallion architecture and star schema.
```

## Experience

### SDE-2 | Data Engineering (current)

Sigmoid Analytics. Jan 2026 - Present

```text
Designed and implemented scalable Databricks/PySpark pipelines for GenAI/RAG workloads, processing 500K+ documents. Built Medallion architecture on Delta Lake and automated publishing to Azure AI Search.
```

Skills: Python, SQL, PySpark, Databricks, Delta-Lake, Azure, ADF, ADLS, AI-Search, Snowflake, Airflow, GenAI, RAG, Vector-Search, OCR, Data-Modeling

### SDE-1 | Data Engineering

Sigmoid Analytics. Jan 2024 - Dec 2025

```text
Designed and maintained end-to-end ETL/ELT pipelines, optimized Spark SQL transformations, and built data quality frameworks reducing incorrect ingestion by over 90%.
```

Skills: ETL, ELT, Spark-SQL, Snowflake, Airflow, Data-Quality, Azure-Key-Vault, Schema-Validation, Metadata-Management, Lineage-Tracking

### ASDE | Data Engineering

Sigmoid Analytics. Sep 2022 - Dec 2023

```text
Completed foundational training in data engineering across AWS, GCP, and Azure. Built a Databricks pipeline for sales data ingestion and transformation, and integrated GA4 event tracking.
```

Skills: AWS, GCP, Azure, Databricks, ADLS, Medallion-Architecture, Star-Schemas, GA4

## Education

### Databricks

Databricks Data Engineer Associate, Data Engineering

```text
Earned the Databricks Data Engineer Associate certification in November 2024.
```

### Google Cloud

GCP Professional Data Engineer, Data Engineering

```text
Earned the GCP Professional Data Engineer certification in May 2023.
```

### Indian Institute of Technology (IIT) Bhubaneswar

BTech, Electrical Engineering. 2018 - 2022. Grade: 8.46/10.0

```text
Pursued a BTech in Electrical Engineering, achieving a CGPA of 8.46/10.0.
```

## Tech stack

- Amazon Redshift
- Snowflake
- Azure Synapse
- Apache Spark
- AWS Glue
- Apache Hive
- Microsoft Azure
- Google Cloud Platform
- Amazon S3
- PySpark
- dbt
- MongoDB
- Databricks
- Azure DevOps
- Python
- C++
- C
- Git
- Docker
- Amazon EMR
- SQL
- Delta Lake
- Apache Kafka

To contact Pusala, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Harshith Kumar K](https://himalayas.app/@harshithkumark): Senior Software Engineer (Data Engineering), TEKsystems Global Solution (American Automobile Association)
- [Shiv Kumar](https://himalayas.app/@shivkumar2): Data Engineer, Adidas
- [Shreyasi Chakraborty](https://himalayas.app/@shreyasichakraborty): Data Engineer (Conversion), Hyland
- [akshay paranjape](https://himalayas.app/@akshayparanjape): Data Engineer, Scaler
- [Bala santhosh](https://himalayas.app/@balasanthosh): Assistant Manager Data Engineering, LatentView Analytics Adobe
- [Keerthana Srinath](https://himalayas.app/@keerthanasrinath): Cloud Engineer II, MathCo
- [Soumya Das](https://himalayas.app/@soumyadas1): Associate Software Engineer, Tata Consultancy Services
- [Aditi Vaidya](https://himalayas.app/@aditivaidya): Senior Data Engineer, Konverge.AI
- [Sameer Kumar](https://himalayas.app/@sameerkumar10): Software Engineer II, MAQ Software
- [Priya Panwar](https://himalayas.app/@priyapanwar): Data Engineer, Genpact