Open to opportunities

Anil Sahith

@anilsahith

Message

I'm a software engineer building production AI inference platforms, real-time voice integrations, and edge ML systems.

India

Message

What I'm looking for

I'm seeking Software Engineer, Product Engineer, Forward Deployed Engineer, Applied AI Engineer, or Data Scientist roles building production-scale AI systems, distributed infrastructure, low-latency inference pipelines, and cloud-native products.

I'm building production AI systems at Arrowhead AI, including 20+ Rust-to-WebAssembly client integrations that connect an AI voice platform to partner CRMs and APIs during live calls.

Previously at Matters.AI, I designed a distributed GKE inference platform for OCR and NER workloads. It sustained up to 10k RPS ingress traffic, processed 1M+ documents with a 0.001% failure rate, and reduced p99 inference latency below 100 ms for NER and 500 ms for OCR.

At Noccarc Robotics, I built a real-time ECG arrhythmia detection pipeline for edge patient monitors, covering preprocessing, deep-learning inference, alarms, and visualization. I also designed an embedded hybrid ResNet, CBAM, and GRU model that detected 20+ cardiac abnormalities in under 300 ms while using less than 12% of a CPU core.

I also build multi-agent products for crypto trading, adaptive exam preparation, and automated data analysis. I enjoy working across Python, Rust, C++, cloud GPUs, Kubernetes, and low-latency ML infrastructure.

Experience

Work history, roles, and key accomplishments

Current

SDE II

Current

Arrowhead AI

Mar 2026 - Present (5 months)

Built and deployed 20+ production client integrations as Rust plugins compiled to WebAssembly (Extism), connecting the AI voice platform to partner CRMs and APIs in real time during live calls. Architected a platform-wide circuit breaker driven by PromQL metrics, exposing REST APIs, MCP tools, and CLI utilities that improved production resiliency and accelerated incident response during live campa

Rust WebAssembly Extism Prometheus PromQL REST APIs MCP CLI Circuit Breakers Incident Response

Software Engineer - AI/ML

Matters.AI

Dec 2025 - Mar 2026 (3 months)

Designed and deployed a distributed AI inference platform on GKE, routing OCR and NER workloads across self-hosted GPU backends using Redis Streams; sustained up to 10k RPS of ingress traffic and 3K RPS downstream capacity with health-aware routing, rate limiting, and retry/DLQ mechanisms, achieving a 0.001% failure rate across 1M+ docs. Deployed GPU inference services using ONNX Runtime, TensorRT

GKE Kubernetes REDIS Streams OCR NER ONNX Runtime TensorRT VLLM GPU Inference Distributed Systems Rate Limits

AI/ML Engineer

Noccarc Robotics Pvt. Ltd.

Jun 2024 - May 2025 (11 months)

Implemented an end-to-end real-time ECG Arrhythmia Detection pipeline for edge patient monitors, integrating signal preprocessing, deep learning inference, alarm generation, and frontend visualization to detect 20+ cardiac abnormalities, reducing clinical response time in ICU environments. Designed a lightweight hybrid neural network (ResNet + CBAM + GRU) optimized for embedded deployment, achievi

ECG Signal Processing Deep Learning ResNet Embedded Systems Edge Computing