Guru Varshini B
@guruvarshinib
Agentic AI Engineer building HITL-enforced multi-agent and RAG systems, with frontier LLM evaluation expertise.
What I'm looking for
I’m an Agentic AI Engineer with two years building production multi-agent and RAG systems, plus hands-on frontier model evaluation. I design HITL-enforced agentic pipelines and implement AWS Bedrock Guardrails for prompt injection blocking and PII protection, then evaluate LLM output quality using structured rubrics and LLM-as-judge frameworks.
I’ve shipped multi-tenant platforms and agent workflows that measurably improve retrieval and reliability—like a self-correcting Agentic RAG system with labeled evaluation harnesses and strong gains (recall@k, MRR) plus out-of-domain abstention. At Turing (contracted to Anthropic, Microsoft, and ServiceNow), I lead quality calibration, build failure taxonomies for agentic tool-use errors, and support RLHF and multi-tool agentic workflow training across enterprise domains.
Experience
Work history, roles, and key accomplishments
AI Evaluation Engineer
Turing
Jul 2024 - Present (2 years)
Evaluated frontier LLM outputs for Anthropic RLHF training using structured rubrics and failure taxonomies, including preference rating, agentic task quality, and multi-step reasoning. Designed and led multi-tool agentic workflow evaluations across enterprise platforms and contributed to data QA and quality calibration across annotators.
Education
Degrees, certifications, and relevant coursework
National Engineering College, Kovilpatti
Computer Science & Engineering with Honors in AI/ML, Artificial Intelligence and Machine Learning
2021 - 2025
Grade: CGPA: 9.33 / 10
Honors specialization in Artificial Intelligence and Machine Learning within Computer Science & Engineering (2021–2025), achieving CGPA 9.33/10.
Tech stack
Software and tools used professionally
GitHub
GitHub Actions
MongoDB
Gmail
Node.js
Next.js
JavaScript
Java
PyTorch
scikit-learn
Streamlit
FastAPI
MongoDB Atlas
PayPal
Serverless
Vercel
GuardRails
SQL
ServiceNow
Hugging Face
LangChain
Ollama
ChromaDB
Pinecone
Auth.js
CrewAI
Railway
Harness
Synthesized
Ragas
Agentic
LangGraph
LangSmith
Tavily
PEFT
Unsloth
Qwen
Durable
Task
Remote
Namespace
X++
Availability
Location
Authorized to work in
Website
guruvarshinib.aiJob categories
Skills
Interested in hiring Guru?
You can contact Guru and 90k+ other talented remote workers on Himalayas.
Message GuruGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
