
Prashit Gupta
@prashitgupta
Senior Data Engineer at ReliaQuest, building Snowflake security analytics and AI workflows that reduce manual data ops.
What I'm looking for
At ReliaQuest, I architect Snowflake-based security analytics and work on data pipelines using Python, dbt, and Snowflake. I’ve unified more than 20 source systems and improved query latency by 40%.
I’m also developing RAG pipelines, MCP server integrations, and Claude-based automation to reduce manual data operations. My work supports cybersecurity decisions where data quality matters.
At Zai, I engineered AWS Glue and DMS pipelines that cut transfer windows by 35%, and modelled a Snowflake data warehouse with dbt incremental models. Those models halved full-refresh runtimes.
At Mobile Premier League (MPL), I built PySpark jobs processing more than 400 million user events per day and tuned Spark jobs to run 30% faster. I’ve also mentored five engineers and helped reduce pipeline errors across ReliaQuest’s data organization by 25%.
Experience
Work history, roles, and key accomplishments
- Data Pipelines with Python, DBT and Snowflake as Data Warehouse (40% Improved latency).
- 20+ source unification .
- Consuming and Processing Real Time Kafka Topics .
- RAG pipelines, MCP server integrations, Claude-based automation .
- Technical Leadership for data engineering team .
- Engineered AWS Glue + DMS pipelines cutting transfer windows 35%.
- Modelled Snowflake DWH with dbt incremental models.
- Halved full-refresh runtime.
- CloudFormation and Terraform IaC
- Daily release cadence
AWS Glue, AWS DMS, AWS CloudFormation, Buildkite, Flyway Migrations, dbt, File Parsing/Processing,Snowflake Data Warehouse, Data Pipelines, Docker
Built PySpark jobs processing 400M+ user events/day. Tuned Spark 30% faster via partitioning, broadcast joins, caching
MongoDb, Cassandra, MarkLogic, SQL engines on Hadoop(Drill,Presto) ,Snowflake.
Glue Data Catalog ,Glue Crawlers, Athena, CloudWatch, Data Migration Service(DMS) ,SCT.
Asp.Net, Netezza , Oracle Data Integrator, Hadoop ,Hive,Spark, Scala, Tableau, AWS ,S3
Education
Degrees, certifications, and relevant coursework
Anthropic
Introduction to Model Context Protocol
Mar 2026
Anthropic
Claude in Amazon Bedrock
Jun 2026
Anthropic
Certificate of completion: Introduction to agent skills
May 2026
Amazon Web Services (AWS)
AWS Certified Solutions Architect – Professional
Jan 2022 · Expired Jan 2025
Amazon Web Services
AWS Certified Solutions Architect - Associate
Jun 2018 · Expired Jun 2021
Lovely Professional University
Bachelor of Technology (B.Tech.), Computer Science
2010 - 2014
Army Public School
HSE
2008 - 2010
MarkLogic
MarkLogic Fundamentals
MongoDB
Mongo DB Aggregation Framework
MongoDB
Mongo DB Performance
MongoDB
Mongo DB for Developers
Tech stack
Software and tools used professionally
Snowflake
Apache Spark
Presto
AWS Glue
Tableau
Looker
Amazon S3
AWS Step Functions
Kubernetes
Argo
Pandas
PySpark
dbt
Flyway
MongoDB
Cassandra
Hadoop
Terraform
AWS CloudFormation
Python
ASP.NET
Scala
Kafka
PagerDuty
Grafana
Docker
Vault
Amazon Athena
Buildkite
Apache Arrow
Apache Parquet
MarkLogic
Oracle Data Integrator
Apache Kafka
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Prashit?
You can contact Prashit and 90k+ other talented remote workers on Himalayas.
Message PrashitGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
