Skip to main content
LT
Looking for a job

Lokesh Thalla

@lokeshthalla

I build production LLM evaluation platforms and GPU-accelerated inference systems for enterprise AI.

United States
Message

At Scale AI, I own end-to-end development of an enterprise LLM evaluation platform, increasing benchmark coverage by 42% and reducing regression detection time by 35%.

I build automated and human-in-the-loop evaluation workflows with Python and PyTorch, including RAG evaluation, agentic workflow testing, AI safety benchmarks, and LLM-as-Judge frameworks.

Previously at NVIDIA, I deployed GPU-accelerated LLM inference microservices with Kubernetes, Docker, and TensorRT-LLM, improving throughput by 45% and reducing production latency by 32%.

I also bring production ML, cloud, and data-platform experience from Accenture, where I built AI-powered applications, data pipelines, REST APIs, and cloud-native deployments across AWS and Azure.

Experience

Work history, roles, and key accomplishments

Education

Degrees, certifications, and relevant coursework

Saint Louis University logoSU

Saint Louis University

Master of Science, Information Systems

Master of Science in Information Systems from Saint Louis University.

AW

AWS

AWS Certified Machine Learning Engineer – Associate, Machine Learning

AWS Certified Machine Learning Engineer – Associate certification.

NV

NVIDIA

NVIDIA Certified Associate: Generative AI and LLMs, Generative AI and LLMs

NVIDIA Certified Associate: Generative AI and LLMs certification.

DA

Databricks

Databricks Certified Machine Learning Professional, Machine Learning

Databricks Certified Machine Learning Professional certification.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan