# Mithra Vardhan

Mithra Vardhan is a remote worker on Himalayas, Software Engineer, AI at Julia AI, based in United States.

Source: https://himalayas.app/@mithravardhan

```text
AI Engineer at Julia AI building production RAG and agent platforms serving 1,200+ daily users.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | AI Engineer, Machine Learning Engineer, Software Engineer |
| Skills | Agentic AI, Multi agent orchestration, RAG, LLM Evaluation, Inference Optimization, Responsible AI, Hybrid Search, Cross Encoder Re Ranking, Fine Tuning, Deep Learning, Natural Language Processing, Data Pipelines, Distributed Systems, Microservices, API Development |
| LinkedIn | https://linkedin.com/in/mithra-vardhan-yalla |
| GitHub | https://github.com/MithraVardhan |

## About

```text
At Julia AI, I own an AI-powered code search platform serving 1,200+ daily users across four products. I built its multi-agent orchestration, production RAG pipeline, and evaluation frameworks, with the RAG pipeline achieving 2.1-second P95 latency.

I established evaluation methods adopted company-wide, achieving a 22% MRR lift, and built a complexity-aware LLM router that reduced inference costs by 60%. I also implemented responsible AI guardrails and human-in-the-loop approval workflows for production agents.

At Hitachi Vantara, I optimized Java and Spring Boot APIs, led an eight-service monolith decomposition, and designed an event-driven pipeline processing 2M+ events per hour. My project work includes multi-agent systems, responsible AI code review, Llama fine-tuning and serving, and distributed task processing.
```

## Experience

### Software Engineer, AI (current)

Julia AI. May 2025 - Present

```text
Own the AI-powered code search platform end-to-end, serving 1,200+ daily users across four products. Built multi-agent orchestration, production RAG pipeline, and eval frameworks in Python using LangGraph, tool calling, and structured outputs.
```

Skills: Python, LangGraph, RAG, PyTorch, SBERT, BM25, Pgvector, AWS-ECS, Docker, Kubernetes, Prometheus, Grafana, OpenTelemetry, GPT-4, LLaMA, Go, CI-CD

### Software Engineer

[Hitachi Vantara](https://himalayas.app/companies/hitachi-vantara). Jan 2023 - Dec 2023

```text
Optimized RESTful and GraphQL APIs using Java and Spring Boot with PostgreSQL, reducing API latency 35% and increasing throughput 50%. Led monolith-to-microservices decomposition and designed event-driven data pipelines.
```

Skills: Java, Spring-Boot, PostgreSQL, REST, GraphQL, RabbitMQ, Docker, AWS-ECS, CI-CD, Junit, SonarQube

### Software Developer Intern

Smart Knower. Feb 2022 - Dec 2022

```text
Built async task queue with Celery and Redis, led Agile sprints, and executed data migration that reduced storage redundancy by 70%.
```

Skills: Celery, Redis, Agile, Data-Migration

## Education

### Northeastern University

Master of Science, Information Systems. Grade: 3.9/4.0

```text
Pursuing a Master of Science in Information Systems with a Machine Learning Concentration, expected to complete in April 2026.
```

## Tech stack

- Amazon S3
- SonarQube
- Kubernetes
- PostgreSQL
- MongoDB
- Spring Boot
- Redis
- Terraform
- Python
- Java
- Go
- C++
- TensorFlow
- PyTorch
- MLflow
- scikit-learn
- Kafka
- RabbitMQ
- Celery
- FastAPI
- Grafana
- Prometheus
- OpenTelemetry
- Amazon DynamoDB
- gRPC
- AWS Lambda
- TypeScript
- JUnit
- Docker
- SQL
- Amazon SageMaker
- Hugging Face
- Weights & Biases
- Pydantic
- Pinecone
- vLLM
- OpenAI API
- Langfuse
- Ragas
- pgvector
- Faiss
- LangGraph
- LangSmith
- Sentence Transformers
- Retrieval-Augmented Generation (RAG)

To contact Mithra, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Sai Teja Meka](https://himalayas.app/@saitejameka): AI Engineer Intern, Cloud Bridge Solutions Inc
- [snehit vaddi](https://himalayas.app/@snehitvaddi): AI Engineer GenAI Systems, ModMed
- [Suki Xiao](https://himalayas.app/@suqixiao): Staff Software Engineer, AWS
- [Shivani Ajay Harane](https://himalayas.app/@shivaniajayharane): AI Research Assistant, Binghamton University
- [Matthew Liu](https://himalayas.app/@matthewliu): Software Engineer NotionAI, Notion
- [Alex Potts](https://himalayas.app/@alexpotts): Senior Full Stack AI Engineer, Luxoft
- [Saivedant Hava](https://himalayas.app/@saivedanthava): AI Engineer, AIA Enterprises LLC
- [Jerry Yang](https://himalayas.app/@jerryyang1): Backend & AI Developer, Microsoft
- [Habib Rehman](https://himalayas.app/@habibrehman1): Lead Applied AI Engineer, Elastic
- [Sayedebady User](https://himalayas.app/@sayedebadyuser): Senior AI Engineer, New Relic
