# Siddhant Chaturvedi

Siddhant Chaturvedi is a remote worker on Himalayas, Senior Software Engineer at Snowflake, Inc., based in United States.

Source: https://himalayas.app/@siddhantchaturvedi

```text
Senior Software Engineer at Snowflake building low-latency streaming infrastructure that cut runtime to under eight seconds and infrastructure costs by about 20%.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 111k+ USD |
| Job categories | Software Engineer, Data Engineer, Cloud Engineer, Machine Learning Engineer |
| Skills | Distributed Systems, Data Engineering, Stream Processing, Data Pipeline Architecture, Cloud Native Architecture, Microservices, Query Optimization, Infrastructure as Code, CI CD, Observability, Data Modeling, Data Governance, Python, PySpark, Java |

## About

```text
At Snowflake, Inc., I designed end-to-end streaming infrastructure using Apache Spark and Snowflake’s native compute engine, reducing runtime from 45 seconds to under eight seconds and monthly infrastructure costs by about 20%. I also built a Golang auto-scaling service that adjusted streaming resources to Kafka and Kinesis throughput.

At Salesforce, I worked on real-time data transformations for Salesforce IoT Cloud (Thunder) and automated ETL workflows for Salesforce Einstein AI. My work included processing more than 10 million daily device events and reducing model refresh time from eight hours to under one hour.
```

## Experience

### Senior Software Engineer (current)

[Snowflake, Inc.](https://himalayas.app/companies/snowflake). May 2018 - Present

```text
Architected and developed high-performance distributed event-processing services and supporting infrastructure in Python and PySpark for enterprise-scale workloads. Designed end-to-end streaming infrastructure using Apache Spark and Snowflake's native compute engine, reducing runtime from 45 seconds to under 8 seconds and cutting monthly infrastructure costs by ~20%.
```

Skills: Python, PySpark, Apache-Spark, Kafka, Kinesis, Snowflake, Terraform, Docker, Kubernetes, GitHub-Actions, Jenkins, Prometheus, Grafana, DBT, Java, Go, CI-CD, AWS, Azure, GCP

### Software Engineer

[Salesforce](https://himalayas.app/companies/salesforce). Jun 2015 - Jul 2018

```text
Leveraged Databricks on AWS to build real-time data transformations for the Salesforce IoT Cloud (Thunder), using PySpark and Structured Streaming to process over 10 million daily device events from Kafka. Optimized Spark jobs by tuning executor memory, dynamic allocation, and broadcast joins, achieving a 25% latency reduction.
```

Skills: Databricks, PySpark, Spark-SQL, Kafka, AWS, ETL, CI-CD, Data-Engineering, Performance-Optimization

## Education

### University of Arizona

Master of Science, Management Information Systems. 2016 - 2017

```text
Master of Science in Management Information Systems from the University of Arizona from 2016 to 2017.
```

### Rajiv Gandhi Prodyogiki Vishwavidyalaya

Bachelor of Engineering, Electronics and Communications Engineering. 2009 - 2013

```text
Bachelor of Engineering in Electronics and Communications Engineering from Rajiv Gandhi Prodyogiki Vishwavidyalaya from 2009 to 2013.
```

## Tech stack

- Snowflake
- Apache Spark
- Tableau
- Looker
- Amazon EC2
- Amazon S3
- Google Cloud Storage
- Kubernetes
- Jenkins
- GitHub Actions
- PySpark
- dbt
- Databricks
- Slack
- Terraform
- Python
- Java
- PagerDuty
- Grafana
- Prometheus
- Git
- Docker
- Amazon EMR
- SQL
- Azure Blob Storage
- Apache Iceberg
- Golang
- Apache Kafka
- AWS
- Azure

To contact Siddhant, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [santosh kharal](https://himalayas.app/@santoshkharal): Lead Data Engineer, Raytheon Company
- [Julian Smith](https://himalayas.app/@juliansmith1): Senior Data Engineer, Stripe
- [Sabal Subedi](https://himalayas.app/@sabalsubedi): Data Engineer, Change Healthcare
- [Sangay Tenzin](https://himalayas.app/@sangaytenzin): Data Engineer, Change Healthcare
- [Aryan Ahmed](https://himalayas.app/@aryanahmed): Principal Data Engineer, Strivio
- [Mounika Reddy](https://himalayas.app/@mounikareddy2): Data Engineer, OpenAI
- [Justin Feng](https://himalayas.app/@justinfeng): Staff Software Engineer, Shopify
- [Sara Wood](https://himalayas.app/@sarawood1): Lead Data Engineer, Databricks
- [Joseph Lee](https://himalayas.app/@josephlee3): Senior Software Engineer, Antenna
- [Abhinav Chauhan](https://himalayas.app/@abhinavchauhan4): Principal Engineer/Technical Lead, CompanyA
