Ajay Raut
@ajayraut1
AI cloud and GPU infrastructure leader building scalable platforms for GenAI workloads.
IndiaWhat I'm looking for
I’m a 2× Founder and infrastructure leader with 22+ years designing and scaling hyperscale cloud, AI cloud, and datacenter platforms across ecommerce, telecom, fintech, and AI-driven enterprises. I’m currently building GPUForge, an AI-native GPU fleet orchestration platform.
My focus is defining and executing next-generation AI infrastructure strategy spanning GPU platforms, cloud networking, and distributed systems. I build scalable, resilient, and cost-efficient AI cloud ecosystems that support large-scale training, inference, and GenAI workloads across hybrid and multi-cloud environments.
I’ve designed high-performance AI datacenter and networking architectures using InfiniBand, RoCEv2, Lossless Ethernet, SDN, and Kubernetes to improve GPU efficiency, scalability, orchestration, and system performance. I’ve led optimization across GPU scheduling, compute, storage, and network layers to reduce latency, increase throughput, and improve utilization.
I deliver outcomes through platform engineering and automation-first delivery—integrating PyTorch and TensorFlow with Kubernetes for end-to-end model lifecycle and continuous inference. Across 20,000+ nodes and 20+ datacenters, I’ve driven $5M+ cost savings and 2× performance improvements, including $4M annual savings from standardized load balancing and replacing a $6M commercial stack with an in-house platform.
Experience
Work history, roles, and key accomplishments
Founder & CEO / CPO
Gpuforge
Apr 2026 - Present (3 months)
Currently building GPUForge, an AI-native GPU fleet orchestration platform. Spearheads next-generation AI cloud networking for large-scale training and inference across multi-tenant GPU environments.
AI Cloud Network Architect
Coupang
Jul 2025 - Apr 2026 (9 months)
Architected AI cloud networking to support large-scale training and inference workloads across multi-tenant GPU environments. Engineered high-performance GPU cluster networking using InfiniBand, RoCEv2, and lossless Ethernet, integrating storage and cloud networking services.
Sr Director - Cloud Networking Architect
Ola Krutrim
Aug 2024 - Jul 2025 (11 months)
Orchestrated AI cloud platform and GPU infrastructure architecture for GenAI workloads. Designed cloud networking stacks and platform integrations spanning VPC/SDN/LBaaS, OpenStack Neutron, Kubernetes networking, and lossless storage and Ethernet/RoCEv2 fabrics.
Distinguished Architect
Walmart Global Tech
Jul 2022 - Jul 2024 (2 years)
Defined edge and cloud platform architectures integrating CDN providers, public cloud, and private datacenter environments for high-scale ecommerce traffic. Developed scalable Layer 4/7 ingress and edge infrastructure strategies to improve reliability, performance, and operational efficiency.
VP, Infrastructure & Network Engineering
IDFC First Bank
Aug 2021 - Jul 2022 (11 months)
Directed enterprise-wide infrastructure, network, and security architecture for large-scale banking systems in a regulated environment. Led infrastructure modernization initiatives to reduce operational risk and drive cost optimization across datacenter, network, security, and DevOps domains.
AVP / Sr. Software Architect
Reliance Jio
Dec 2019 - Aug 2021 (1 year 8 months)
Conceptualized and delivered a hybrid cloud management platform spanning AWS, Azure, GCP, on-prem Kubernetes, and vCenter ecosystems. Designed multi-tenant governance, orchestration, MFA/access control, API integration, and CI/CD deployment frameworks for Kubernetes-based cloud services.
Founder & CTO
Stretch Cloud Technologies
Jan 2019 - Aug 2019 (7 months)
Founded an edge computing platform focused on cloud services and infrastructure automation. The edge cloudlet architecture developed at StretchCloud informs distributed GPU fleet management approach for GPUForge.
Engineering Manager
Flipkart
Mar 2017 - Jul 2019 (2 years 4 months)
Oversaw platform engineering teams across networking, systems, and software development within the Cloud Platform Group. Delivered elastic software load balancing solutions to remove infrastructure capacity constraints during high-traffic events.
Earlier Roles
Yahoo
Feb 2007 - Mar 2017 (10 years 1 month)
Held earlier progressively responsible roles across network engineering, architecture, security QA, solution consulting, and technical leadership, supporting datacenter and networking services.
Earlier Roles
InMobi
Feb 2007 - Mar 2017 (10 years 1 month)
Held earlier progressively responsible roles across network engineering, architecture, security QA, solution consulting, and technical leadership, supporting datacenter and networking services.
Earlier Roles
Sify
Feb 2007 - Mar 2017 (10 years 1 month)
Held earlier progressively responsible roles across network engineering, architecture, security QA, solution consulting, and technical leadership, supporting datacenter and networking services.
Earlier Roles
Flipkart
Feb 2007 - Mar 2017 (10 years 1 month)
Held earlier progressively responsible roles across network engineering, architecture, security QA, solution consulting, and technical leadership, supporting datacenter and networking services.
Earlier Roles
Juniper
Feb 2007 - Mar 2017 (10 years 1 month)
Held earlier progressively responsible roles across network engineering, architecture, security QA, solution consulting, and technical leadership, supporting datacenter and networking services.
Earlier Roles
D-Link
Feb 2007 - Mar 2017 (10 years 1 month)
Held earlier progressively responsible roles across network engineering, architecture, security QA, solution consulting, and technical leadership, supporting datacenter and networking services.
Education
Degrees, certifications, and relevant coursework
IIM Lucknow
Executive Program, Digital Transformation
Completed an Executive Program in Digital Transformation at IIM Lucknow.
Symbiosis Centre for Information Technology (SCIT)
Post Graduate Diploma in Management (PGDM), Network & IT Management
Earned a PGDM with a focus on Network and IT Management from SCIT (Symbiosis).
Mumbai University
Bachelor of Engineering, Information Technology
Completed a Bachelor of Engineering in Information Technology from Mumbai University.
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Ajay?
You can contact Ajay and 90k+ other talented remote workers on Himalayas.
Message AjayGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
