Skip to main content
KM
Looking for a job

Karan Malhotra

@karanmalhotra

I build enterprise AI, RAG, and data platforms that improve reliability and outcomes.

United States
Message

At Microsoft, I lead AI/data system design for enterprise generative AI, LLM, and NLP applications, spanning ingestion, retrieval, evaluation, APIs, infrastructure, and production operations. I architected a multi-tenant RAG platform and improved grounded-answer pass rates from 78% to 91% while reducing hallucination incidents by 40%.

I’ve built cloud-native data pipelines and applied AI solutions across Microsoft, CDI, and Infosys, from Azure Databricks and Snowflake workflows to device telemetry, computer vision, and financial batch-processing systems. I focus on reliable delivery, data quality, observability, and scalable production deployment.

Experience

Work history, roles, and key accomplishments

Microsoft logoMI

Software Engineer - AI

Aug 2022 - Sep 2026 (4 years 1 month)

Led AI/Data system design and delivery for a six-engineer squad building enterprise Generative AI, LLM-powered, and NLP applications. Architected a multi-tenant RAG platform using Azure OpenAI Service, Azure AI Search, Semantic Kernel, FastAPI, Redis, AKS/Kubernetes, and hybrid/vector retrieval.

CC

Software Engineer | Data Engineering & Applied AI Focus

Computer Design & Integration LLC (CDI)

Aug 2017 - Aug 2022 (5 years)

Built and supported data-processing workflows for enterprise mobile-device telemetry, diagnostic logs, identifiers, and operational events using Python, Pandas, NumPy, SQL, and AWS. Developed AWS-based data workflows using Amazon S3, AWS Lambda, AWS Glue, and Athena for ingesting, processing, transforming, and querying operational and telemetry data.

IN

Software Engineer | Data Engineering & Financial Systems Focus

Aug 2014 - Jun 2016 (1 year 10 months)

Supported large-scale financial and insurance platforms for AMP Australia and Aviva UK Life, implementing and maintaining critical batch data-processing and policy-processing workflows. Investigated production batch failures using SQL, Java, relational databases, and mainframe systems.

Education

Degrees, certifications, and relevant coursework

Stony Brook University logoSU

Stony Brook University

Master of Science (M.S.), Computer Engineering

2016 - 2017

Grade: 3.52 / 4.00

Completed a Master of Science in Computer Engineering with a GPA of 3.52 out of 4.00.

SRM Institute of Science and Technology, Chennai logoSC

SRM Institute of Science and Technology, Chennai

Bachelor of Technology (B.Tech.), Instrumentation and Control Engineering

2010 - 2014

Grade: 9.0 / 10.0

Earned a Bachelor of Technology in Instrumentation and Control Engineering with a grade of 9.0 out of 10.0.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan