Sahil Yadav

I am a Software Lead in backend and AI technologies with over 5 Years of experience building large scale distributed systems, proven track record in handling infrastructure at 5,000+ server scale, and optimizing databases for millions of reads and writes.

At Marquee Equity I designed and deployed a Master–Worker distributed scraping system on NestJS (TypeScript – NodeJS, Puppeteer) with 5000 AWS Ec2 instances as child workers and 10 master instances, enabling large-scale inbound and outbound lead generation. I managed deployments using GitLab CI/CD on a self-hosted GitLab instance and automated responses using Google Gemini on GCP Vertex AI.

I scaled Postgres DB infrastructure to handle 1M+ plus writes and multimillion reads every hour by applying right indexes, data archival policies, and partitions on big tables, and leveraged Open Telemetry data from Signoz to fine tune queries, allowing a vertical RDS scale-down and 50% savings.

I led HR management and data warehouse projects using NextJS, NestJS, Prisma and TypeORM to streamline recruitment and centralize data from tools like Crunchbase and Apollo. I am hands-on with GoLang, NodeJS, TypeScript, Postgres, AWS services, Docker, and AI platforms including Microsoft Azure AI Studio and Google Vertex AI.