# Manoj Mali

Manoj Mali is a remote worker on Himalayas, Staff Software Engineer at Gruve.ai, based in India.

Source: https://himalayas.app/@manojmali

```text
Principal AI engineer at Gruve.ai building a multi-agent coding platform and production AI systems.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 16600k+ INR |
| Job categories | AI Engineer, Software Engineer, Platform Engineer |
| Skills | Agentic AI, Multi agent orchestration, RAG, LLM Evaluation, LLMOps, Distributed Systems, Real Time AI Inference, Conversational AI, Microservices, System Architecture, Technical Strategy, Model Serving, Tool calling, MCP, Agent Memory |
| Website | https://manojmali.com |
| LinkedIn | https://linkedin.com/in/manojpmali |
| GitHub | https://github.com/MinsterMind |

## About

```text
At Gruve.ai, I lead backend and platform engineering for PulseAI and an AI developer-tooling platform. I designed a pluggable multi-agent interface for Gemini, Codex, GitHub Copilot, and OpenHands, and built governed model deployment and observability layers for PulseAI.

At Symbl.ai, I architected a real-time RAG assistant that gives sales reps contextual suggestions during live calls, and designed an LLM call-scoring pipeline. I helped scale the platform from 60 to 5,000+ concurrent sessions while reducing infrastructure costs by 50%.

Earlier, I re-architected Chalo’s monolith into microservices for real-time bus tracking and built its ticket-booking platform. At Crowdfire, I built an article recommendation engine; at Tata Consultancy Services, I designed database systems and PL/SQL services for enterprise clients.
```

## Experience

### Staff Software Engineer (current)

Gruve.ai. Apr 2025 - Present

```text
Lead backend and platform engineering for AI products, including PulseAI and an AI developer-tooling platform. Built model endpoint deployment and observability layers, designed a pluggable multi-agent interface, and delivered Windows support.
```

Skills: Python, fastAPI, TypeScript, NodeJS, Java, SQL, Kafka, Redis, RabbitMQ, PostgreSQL, AWS, GCP, Azure, Kubernetes, Docker, Terraform, CI-CD, GitOps, Gemini, Codex, GitHub-Co-Pilot, OpenHands, Azure-Trusted-Signing, GitHub-OIDC, KMS, CWE-494, Security-Remediation

### Principal Software Engineer, Scalable Systems Architect

[Symbl.ai](https://himalayas.app/companies/symbl-ai). Aug 2023 - Feb 2025

```text
Served as principal-level architect for scalable systems, focusing on real-time RAG and LLM scoring pipelines.
```

Skills: Lang-Chain, OpenAI, WebSockets, Kafka, Python, fastAPI, ChromaDB, Redis, LLM-Evaluation, Real-Time-Systems, Scalability, Cost-Optimization

### Principal Software Engineer

[Symbl.ai](https://himalayas.app/companies/symbl-ai). May 2020 - Feb 2025

```text
Architected a real-time RAG assistant for live sales calls and designed an LLM call-scoring pipeline. Scaled platform concurrency from 60 to 5,000+ concurrent sessions and reduced infrastructure cost by 50%.
```

Skills: Lang-Chain, OpenAI, WebSockets, Kafka, Python, fastAPI, ChromaDB, Redis, LLM-Evaluation, Real-Time-Systems, Scalability, Cost-Optimization

### Staff Software Engineer

[Symbl.ai](https://himalayas.app/companies/symbl-ai). Oct 2021 - Aug 2023

```text
Contributed to the conversational intelligence platform, focusing on real-time RAG and LLM scoring pipelines.
```

Skills: Lang-Chain, OpenAI, WebSockets, Kafka, Python, fastAPI, ChromaDB, Redis, LLM-Evaluation, Real-Time-Systems, Scalability, Cost-Optimization

### Senior Software Engineer

[Symbl.ai](https://himalayas.app/companies/symbl-ai). May 2020 - Oct 2021

```text
Worked on the conversational intelligence platform, contributing to real-time RAG and LLM scoring pipelines.
```

Skills: Lang-Chain, OpenAI, WebSockets, Kafka, Python, fastAPI, ChromaDB, Redis, LLM-Evaluation, Real-Time-Systems, Scalability, Cost-Optimization

### Software Development Engineer III

Chalo. Dec 2017 - May 2020

```text
Re-architected a monolith into microservices processing 1M+ GPS records per day for real-time bus tracking and ETA prediction. Built a ticket-booking platform serving 40,000+ MAU and mentored 4 engineers.
```

Skills: Microservices, CI-CD, GPS-Tracking, Predictive-ETA, Ticket-Booking, Mentorship

### Senior Software Developer

Crowdfire. Jun 2015 - Dec 2017

```text
Built an article recommendation engine ingesting 0.5M+ articles per day and a user-analytics service tracking 100,000+ profiles.
```

Skills: NodeJS, Python, RabbitMQ, Recommendation-Engine, Analytics

### System Engineer

[Tata Consultancy Services](https://himalayas.app/companies/tata-consultancy-services). Mar 2013 - May 2015

```text
Designed database systems and PL/SQL services for enterprise clients, improving reliability by 30% and cutting data-retrieval time by 20%.
```

Skills: Pl-SQL, Database-Design, Reliability, Performance-Optimization

## Education

### Shivaji University

Bachelor of Engineering, Information Technology. 2008 - 2012

```text
Bachelor of Engineering in Information Technology from Shivaji University, Kolhapur, completed in 2012.
```

## Tech stack

- Kubernetes
- PostgreSQL
- Node.js
- Redis
- Terraform
- Python
- Java
- PyTorch
- Kafka
- RabbitMQ
- FastAPI
- Grafana
- Prometheus
- OpenTelemetry
- Gemini
- TypeScript
- Docker
- GuardRails
- SQL
- Hugging Face
- Snyk
- LangChain
- LlamaIndex
- ChromaDB
- vLLM
- Langfuse
- GitHub Copilot
- pgvector
- LangGraph
- LangSmith
- PEFT
- OpenHands
- Retrieval-Augmented Generation (RAG)
- AWS
- OpenAI
- Azure
- Codex

To contact Manoj, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [sanjay tambe](https://himalayas.app/@sanjaytambe): Principal Software Engineer, Cerence (India) LLP
- [krishna kumar](https://himalayas.app/@krishnakumar16): Principal Engineer, Zuora
- [Perumala Ranjith Kumar](https://himalayas.app/@perumalaranjithkumar): Software Engineer, Tata Consultancy Services
- [mallepalli himasagar](https://himalayas.app/@mallepallihimasagar): Software Engineer AI/ML and Generative AI, Pega Systems
- [Manan Gupta](https://himalayas.app/@manangupta): Software Engineer Advanced, Gartner Research and Advisory Pvt Ltd
- [kanak sethi](https://himalayas.app/@kanaksethi): Senior Software Engineer, Sia Partners
- [Chetan Anand](https://himalayas.app/@chetananand1): Software Development Engineer, Nokia Solutions & Networks
- [Shashidhar Nagareddy](https://himalayas.app/@shashidharnagareddy): Senior AI Engineer Agentic AI Platform, Intuit
- [jatin kundra](https://himalayas.app/@jatinkundra): Senior Software Engineer, Fintapp
- [Tanmay Kayande](https://himalayas.app/@tanmaykayande): System Engineer (Agentic AI & Backend Systems), Tata Consultancy Services
