Open to opportunities

Leo Jinto

@leojinto

Message

Senior ML/AI engineer specializing in scalable distributed systems.

United States

Message

What I'm looking for

I seek engineering roles building scalable, fault-tolerant AI/ML infrastructure where I can optimize GPU efficiency, architect distributed systems, and mentor teams while driving production-grade ML deployments.

I am a senior ML/AI and distributed systems engineer with 15+ years of experience building scalable, production-ready infrastructure for AI workloads across cloud, HPC, and edge environments.

I specialize in GPU acceleration, kernel-level optimizations, and designing fault-tolerant distributed training and inference platforms using tools like PyTorch, vLLM, and container orchestration across AWS, GCP, and Azure.

My work has delivered measurable results: low-latency speech recognition at 35ms with 97% accuracy, a real-time multilingual translation module that drove 500% user adoption, and an ML inference engine with 21% faster performance for edge devices.

I bring cross-disciplinary systems thinking, hands-on engineering rigor, and a research-oriented mindset to roles that require architecting large-scale ML systems, optimizing GPU efficiency, and enabling robust, cost-effective AI deployments.

Experience

Work history, roles, and key accomplishments

Current

AI Integration Engineer

Current

Tango

Jan 2025 - Present (1 year 5 months)

Designed and deployed scalable AI infrastructure and a distributed LLM moderation system for Xilos, optimizing GPU-backed inference and delivery pipelines to improve throughput and cost-efficiency for enterprise and government clients.

Python PyTorch VLLM fastAPI PostgreSQL AWS Sagemaker Prompt Engineering RAG

Lead Software Engineer

Ntro

Jan 2022 - Feb 2025 (3 years 1 month)

Architected and led AI-integrated backend systems supporting up to 1,000 concurrent users, delivered a low-latency speech recognition engine (35ms, 97% accuracy) and multilingual translation module driving 500% user growth.

fastAPI Python GPU Inference Signal Processing NLP React TypeScript MongoDB

ML Researcher

Future OS

Feb 2016 - Jan 2022 (5 years 11 months)

Spearheaded design and deployment of scalable, fault-tolerant ML infrastructure for Expo City Dubai and smart city initiatives, implementing distributed GPU pipelines, resource scheduling, and high-availability AI services.

Distributed Systems Edge Computing NLP Anomaly Detection Load Balancing Fault Tolerance Benchmarking

HPC Kernel Engineer

ITC Management Group

Oct 2013 - Dec 2015 (2 years 2 months)

Designed a high-performance ML inference engine in C/C++ for edge devices (21% faster) and developed computer-vision systems for medical imaging achieving 98% accuracy while enabling significant cost and time reductions.

C C++Kernel Optimization Embedded Systems Computer Vision Model Compression

Backend / DevOps Engineer

Diro Systems

Aug 2011 - Sep 2013 (2 years 1 month)

Developed and maintained backend services and CI/CD pipelines for high-availability distributed applications, improving reliability through container orchestration, monitoring, and cost-optimized cloud provisioning on AWS.

Backend Development DevOps CI CD Docker Kubernetes AWS Microservices Monitoring APIs

Automation Test Analyst

euNetworks

Mar 2009 - Mar 2011 (2 years)

Developed embedded software integrating multimodal real-time data and on-device ML for performance tracking, and engineered an RL-based AI agent that outperformed professional players by 40% on public leaderboards.

Embedded Software Real Time Systems Reinforcement Learning Testing Automation