Skip to main content
HimalayasHimalayas logo
Siva Datta KoneruSK
Looking for a job

Siva Datta Koneru

@sivadattakoneru

Senior AI engineer building production LLM and RAG systems that scale reliably and cut costs.

India
Message

What I'm looking for

I’m looking for a team where I can architect and ship production LLM/RAG systems, optimize inference cost and latency, and lead cross-functional delivery. I value engineering excellence, reliability, and measurable impact on users.

I’m a Senior AI & Full Stack Engineer with 9+ years of experience building enterprise systems at Bloomberg and Upland Software. I specialize in architecting production LLM applications, RAG pipelines, and high-throughput microservices that teams can trust in real operations.

At Upland Software, I built an enterprise RAG pipeline and AI content-curation system using Azure OpenAI and semantic vector search, scaling to 11,000+ users. I optimized LLM inference and API utilization across LangChain and vLLM to reduce latency by 20% and cut AI operational costs by 35% through token caching and batch processing. I also improved generative output quality and content creation efficiency by 60% with dynamic prompts, retrieval tuning, and optimized context windows.

I’ve led engineering teams to modernize platforms and raise reliability standards. I led a 5-engineer team to modernize legacy systems into scalable React SPAs and .NET microservices, automating CI/CD to reduce operational overhead by 30%. I mentored engineers and established strong observability with New Relic, cutting incident detection time by 30% and supporting two internal team promotions within 18 months.

Earlier at Bloomberg, I designed and scaled Fixed Income analytics aggregation systems with Apache Druid and Elasticsearch, processing 100 million records/day while reducing data processing time by 60% using Splunk and Grafana. I also migrated legacy UNIX systems to Linux and implemented Jenkins CI/CD. In my recent contract role at GoodNotes, I triaged 100+ production defects and built AI-powered engineering workflows integrating Jira, Slack, and Notion MCPs.

Experience

Work history, roles, and key accomplishments

GoodNotes logoGO

Full Stack Software Engineer

Nov 2025 - Apr 2026 (5 months)

Triaged and resolved 100+ production defects across iOS and backend systems, improving stability and reducing user-reported issues by 80%. Built AI-powered engineering workflows integrating Jira, Slack, and Notion MCPs, and developed an image manipulation feature that increased adoption by 2%.

Education

Degrees, certifications, and relevant coursework

Rochester Institute of Technology logoRT

Rochester Institute of Technology

Master of Science, Information Science & Technology

2014 - 2017

Grade: CGPA: 3.91 / 4.0

Activities and societies: Teaching Assistance Fellowship and merit scholarship (all semesters).

Earned a Master of Science in Information Science & Technology from Rochester Institute of Technology from 2014 to 2017.

Manipal Institute of Technology logoMT

Manipal Institute of Technology

Bachelor of Engineering, Computer Science

2010 - 2014

Grade: CGPA: 7.2 / 10

Activities and societies: President, Rotaract Club of Manipal.

Earned a Bachelor of Engineering in Computer Science from Manipal Institute of Technology from 2010 to 2014.

Find your dream job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan