Sandeep Vaid
@sandeepvaid
Backend engineer building fault-tolerant ETL pipelines and cloud-native APIs for large-scale government education data.
What I'm looking for
I architected and owned an end-to-end, fault-tolerant ETL pipeline at Convegenius that ingests 100M+ government education records daily across 6+ Indian states, with PostgreSQL transactional staging and rollback to keep 99.9% data consistency.
I also built a column-level differential reconciliation engine for MIS vs UDISE data, migrating past materialized view upsert limitations to indexed PostgreSQL tables with a pre-aggregated summary layer—cutting processing from hours to minutes.
Across multiple pipelines, I centralized log management and observability into a unified real-time dashboard, and implemented production-grade recovery with exponential backoff retries, health checks, AWS CloudWatch logging, and Slack webhook integration.
Before that, at TravelCorporationofIndia I helped deliver React-based products like a theme-editor, integrated AWS Cognito for authentication, built backend/mobile guide integrations, and improved guide search performance by 2.35 seconds.
Experience
Work history, roles, and key accomplishments
Software Engineer II
Convegenius
Jun 2024 - Present (2 years 2 months)
Architected and owned end-to-end delivery of a fault-tolerant ETL pipeline ingesting 100M+ government education records daily across 6+ Indian states. Designed a column-level differential reconciliation engine and migrated RBAC configuration from DynamoDB to PostgreSQL.
Full-Stack Developer
Travel Corporation of India
May 2023 - Jun 2024 (1 year 1 month)
Spearheaded development of a customizable React theme-editor using hooks, Redux, and Saga. Integrated AWS Cognito for authentication and engineered advanced search algorithms for guides.
Software Development Engineer
Argoid (Acquired by Amagi)
Jul 2022 - May 2023 (10 months)
Architected a reusable service layer for configuration and task management, reducing manual workload by 80%. Built an Administration Console with RBAC and developed a Shopify script for behavioral data collection.
Education
Degrees, certifications, and relevant coursework
Bikaner Technical University Kota
Bachelor of Technology, Computer Science
2018 - 2022
Bachelor of Technology in Computer Science from Bikaner Technical University Kota from 2018 to 2022.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Sandeep?
You can contact Sandeep and 90k+ other talented remote workers on Himalayas.
Message SandeepGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
