# Mit Shah

Mit Shah is a remote worker on Himalayas, Software Engineer I at Atlan, based in India.

Source: https://himalayas.app/@mitshah

```text
Software Engineer I at Atlan, improving metadata lineage pipelines and processing 100M+ assets per run.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Job categories | Software Engineer |
| Skills | Backend Development, Metadata Driven Ingestion, Data Lineage, SQL Parsers, Distributed Systems, API Development, Real Time Bidding, Event Driven Architecture, OAuth, Role Based Access Control, Rate limiting, Redis caching, Database Indexing, AutoScaling, Java |
| Website | https://mitshah.dev |

## About

```text
At Atlan, I work on metadata ingestion, parsing, and lineage pipelines. During my Associate Software Engineer Intern role, I migrated pipelines from Argo Workflows to Temporal, improving the reliability SLA from 98% to 99.5% and reducing a 10M-asset BigQuery crawl from 12 hours to 3.

I built and maintained connectors for Snowflake, BigQuery, Databricks, dbt, and MSSQL, supporting runs of metadata extraction, parsing, and lineage generation across 100M+ assets. I also improved SQLGlot parsing and cross-account lineage over 50M+ queries for enterprise customers including Mastercard and JPMorgan Chase.

At FyreGig, I built the backend for a security research platform serving 2K+ users, including a Puppeteer pipeline that aggregates jobs from 20+ sites. I also developed secure APIs with Google OAuth, RBAC, and rate limiting.

My other work includes a Node.js backend for an attendance app with 1000+ active users and an ERP backend with secure payment processing and automated settlement pipelines. I also built Evently, a distributed event booking backend, and contributed to a real-time bidding platform supporting 5,000+ concurrent users.
```

## Experience

### Software Engineer I (current)

[Atlan](https://himalayas.app/companies/atlan). Jul 2026 - Present

```text
Migrated metadata ingestion and lineage pipelines from Argo Workflows to Temporal, improving reliability SLA from 98% to 99.5% and reducing BigQuery crawl time from 12h to 3h. Built and maintained connectors for Snowflake, BigQuery, Databricks, dbt, and MSSQL, scaling to 100M+ assets per run.
```

Skills: Python, Go, Temporal, ArgoWorkflows, Snowflake, BigQuery, Databricks, DBT, MSSQL, Networkx, SQLGlot, KEDA, VPA

### Associate Software Engineer Intern

[Atlan](https://himalayas.app/companies/atlan). Nov 2025 - Jun 2026

```text
Migrated metadata ingestion, parsing, and lineage pipelines from Argo Workflows to Temporal, lifting reliability SLA from 98% to 99.5% and cutting 10M-asset BigQuery crawl from 12h to 3h. Built and maintained connectors for Snowflake, BigQuery, Databricks, dbt, and MSSQL, scaling to 100M+ assets per run.
```

Skills: Python, Go, Temporal, ArgoWorkflows, Snowflake, BigQuery, Databricks, DBT, MSSQL, Networkx, SQLGlot, KEDA, VPA

### Software Developer Intern

FyreGig. Jan 2025 - Jun 2025

```text
Built the backend of a security research platform serving 2K+ users on the MERN stack, including a Puppeteer scraping pipeline that aggregates jobs from 20+ sites. Built secure APIs with Google OAuth, RBAC, and rate limiting, improved performance with Redis caching and database indexing, and covered them with Jest unit tests.
```

Skills: MERN, Puppeteer, OAuth, RBAC, Redis, Jest

### Software Developer Intern

Sora Infotech. Jun 2024 - Dec 2024

```text
Built the Node.js backend (MySQL, Redis) for an attendance app with 1000+ active users, covering attendance, notifications, and push updates, plus a Flutter client with facial recognition and geofencing.
```

Skills: NodeJS, MySQL, Redis, Flutter, Facial-Recognition, Geofencing

### Software Developer Intern

The Crazy Entrepreneur. Jun 2022 - Aug 2022

```text
Built an ERP backend (Node.js, MongoDB) with CSV import/export for campaign and payment management, implementing secure payment processing, monitoring, and automated settlement pipelines.
```

Skills: NodeJS, MongoDB, CSV, Payment-Processing, Monitoring

## Education

### SVKM’s Dwarkadas J. Sanghvi College of Engineering

B.Tech., Computer Engineering. 2023 - 2026. Grade: 9.07/10

```text
Pursuing a B.Tech. in Computer Engineering with a CGPA of 9.07/10.
```

## Tech stack

- Amazon EC2
- Amazon S3
- GitHub
- Kubernetes
- Flutter
- MySQL
- PostgreSQL
- MongoDB
- Node.js
- Next.js
- Puppeteer
- Redis
- Jest
- JavaScript
- Python
- Java
- Go
- Kafka
- FastAPI
- Grafana
- Amazon RDS
- Git
- Docker
- TimescaleDB
- Temporal
- DuckDB
- SQLGlot
- k6
- Daft
- Claude Code
- KEDA
- AWS

To contact Mit, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Alisha Sharma](https://himalayas.app/@alishasharma): Software Engineering Intern, Ola Krutrim
- [Ayush Aryan](https://himalayas.app/@ayusharyan): SDE 1, Eventstrat.ai
- [Debojyoti Mandal](https://himalayas.app/@debojyotimandal): Software Engineer II, Deep Sync
- [Abhuday Sudhir](https://himalayas.app/@abhudaysudhir1): Software Engineer Intern, 7startup
- [harshita roonwal](https://himalayas.app/@harshitaroonwal1): Software Developer Intern, Rippling
- [ADITYA CHATURVEDI](https://himalayas.app/@adityachaturvedi): Technical Coordinator, ThingQubator
- [Vanshika Agarwal](https://himalayas.app/@vanshikaagarwal1): Software Engineer 2, Atlassian
- [Ansh Rastogi](https://himalayas.app/@anshrastogi): Software Engineer Intern, Amalgamic
- [Akshat Mathur](https://himalayas.app/@akshatmathur2): Software Engineering Intern, Outcom.AI
- [Nirupama Singh](https://himalayas.app/@nirupamasingh): Associate Software Development Engineer, Juspay
