Skip to main content
Manali LatkarML
Open to opportunities

Manali Latkar

@manalilatkar

I build production LLM services, evaluation pipelines, and Kubernetes platforms.

India
Message

At IBM ISDL Labs, I co-lead a five-engineer squad building open-source AI services for IBM Power, including RAG chatbots, document digitization, summarization, entity extraction, and translation.

I build evaluation-first LLM features: I created a Go evaluation pipeline that identified a 32-point English-German RAG accuracy gap, gated release, and helped improve German accuracy from 52% to 66% through retrieval and generation tuning.

I re-architected document summarization into an asynchronous job service, reducing client-perceived latency from roughly 20 seconds to 25ms. I also prototype and benchmark vLLM workloads on IBM Spyre accelerators, instrument RAG ingestion pipelines, and lead CI/CD for 10 microservices across x86 and ppc64le.

Previously, I delivered Kubernetes lifecycle-management capabilities at Coredge, IoT analytics at Delta IOT for John Deere, and enterprise integration and full-stack products at ThoughtWorks. I mentor engineers, contribute to Kubernetes Cluster API and IBM project-ai-services, and was recognized with IBM's Growth Award and Coredge's Mountain Mover Award.

Experience

Work history, roles, and key accomplishments

IBM ISDL Labs logoIL
Current

Senior Cloud & AI Engineer

Jul 2024 - Present (2 years 2 months)

Co-lead a 5-engineer squad building IBM's open-source AI services platform, including RAG chatbot, document digitization, summarization, and entity extraction. Built evaluation pipelines and tuned retrieval/generation parameters to improve accuracy and drive release decisions.

Coredge logoCO

SDE-II

Coredge

Jan 2022 - Jun 2024 (2 years 5 months)

Designed and delivered a resource reservation system for Robin-based clusters, shipped serverless workflows, and led Velero-based backup and recovery for Kubernetes clusters. Architected notification queues and reduced DB round-trips by ~6x.

DI

Contingent Engineer

Delta IOT

Apr 2020 - Dec 2021 (1 year 8 months)

Delivered a quality metrics dashboard and IoT data processing pipelines for John Deere, maintained Python test-execution packages, and drove Python 2 to 3 migration.

Education

Degrees, certifications, and relevant coursework

AP

Army Institute of Technology, Pune

Bachelor of Engineering, Electronics and Telecommunications

Bachelor of Engineering in Electronics and Telecommunications from Army Institute of Technology, Pune, completed in 2012.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan