HimalayasHimalayas logo
Siva Datta KoneruSK
Looking for a job

Siva Datta Koneru

@sivadattakoneru

Senior AI engineer building production LLM and RAG systems that scale reliably and cut costs.

India
Message

What I'm looking for

I’m looking for a team where I can architect and ship production LLM/RAG systems, optimize inference cost and latency, and lead cross-functional delivery. I value engineering excellence, reliability, and measurable impact on users.

I’m a Senior AI & Full Stack Engineer with 9+ years of experience building enterprise systems at Bloomberg and Upland Software. I specialize in architecting production LLM applications, RAG pipelines, and high-throughput microservices that teams can trust in real operations.

At Upland Software, I built an enterprise RAG pipeline and AI content-curation system using Azure OpenAI and semantic vector search, scaling to 11,000+ users. I optimized LLM inference and API utilization across LangChain and vLLM to reduce latency by 20% and cut AI operational costs by 35% through token caching and batch processing. I also improved generative output quality and content creation efficiency by 60% with dynamic prompts, retrieval tuning, and optimized context windows.

I’ve led engineering teams to modernize platforms and raise reliability standards. I led a 5-engineer team to modernize legacy systems into scalable React SPAs and .NET microservices, automating CI/CD to reduce operational overhead by 30%. I mentored engineers and established strong observability with New Relic, cutting incident detection time by 30% and supporting two internal team promotions within 18 months.

Earlier at Bloomberg, I designed and scaled Fixed Income analytics aggregation systems with Apache Druid and Elasticsearch, processing 100 million records/day while reducing data processing time by 60% using Splunk and Grafana. I also migrated legacy UNIX systems to Linux and implemented Jenkins CI/CD. In my recent contract role at GoodNotes, I triaged 100+ production defects and built AI-powered engineering workflows integrating Jira, Slack, and Notion MCPs.

Experience

Work history, roles, and key accomplishments

GoodNotes logoGO

Full Stack Software Engineer

Nov 2025 - Apr 2026 (5 months)

Triaged and resolved 100+ production defects across iOS and backend systems, improving stability and reducing user-reported issues by 80%. Built AI-powered engineering workflows integrating Jira, Slack, and Notion MCPs, and developed an image manipulation feature that increased adoption by 2%.

Education

Degrees, certifications, and relevant coursework

Rochester Institute of Technology logoRT

Rochester Institute of Technology

Master of Science, Information Science & Technology

2014 - 2017

Grade: CGPA: 3.91 / 4.0

Activities and societies: Teaching Assistance Fellowship and merit scholarship (all semesters).

Earned a Master of Science in Information Science & Technology from Rochester Institute of Technology from 2014 to 2017.

Manipal Institute of Technology logoMT

Manipal Institute of Technology

Bachelor of Engineering, Computer Science

2010 - 2014

Grade: CGPA: 7.2 / 10

Activities and societies: President, Rotaract Club of Manipal.

Earned a Bachelor of Engineering in Computer Science from Manipal Institute of Technology from 2010 to 2014.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan