Siva Datta Koneru
@sivadattakoneru
Senior AI engineer building production LLM and RAG systems that scale reliably and cut costs.
What I'm looking for
I’m a Senior AI & Full Stack Engineer with 9+ years of experience building enterprise systems at Bloomberg and Upland Software. I specialize in architecting production LLM applications, RAG pipelines, and high-throughput microservices that teams can trust in real operations.
At Upland Software, I built an enterprise RAG pipeline and AI content-curation system using Azure OpenAI and semantic vector search, scaling to 11,000+ users. I optimized LLM inference and API utilization across LangChain and vLLM to reduce latency by 20% and cut AI operational costs by 35% through token caching and batch processing. I also improved generative output quality and content creation efficiency by 60% with dynamic prompts, retrieval tuning, and optimized context windows.
I’ve led engineering teams to modernize platforms and raise reliability standards. I led a 5-engineer team to modernize legacy systems into scalable React SPAs and .NET microservices, automating CI/CD to reduce operational overhead by 30%. I mentored engineers and established strong observability with New Relic, cutting incident detection time by 30% and supporting two internal team promotions within 18 months.
Earlier at Bloomberg, I designed and scaled Fixed Income analytics aggregation systems with Apache Druid and Elasticsearch, processing 100 million records/day while reducing data processing time by 60% using Splunk and Grafana. I also migrated legacy UNIX systems to Linux and implemented Jenkins CI/CD. In my recent contract role at GoodNotes, I triaged 100+ production defects and built AI-powered engineering workflows integrating Jira, Slack, and Notion MCPs.
Experience
Work history, roles, and key accomplishments
Triaged and resolved 100+ production defects across iOS and backend systems, improving stability and reducing user-reported issues by 80%. Built AI-powered engineering workflows integrating Jira, Slack, and Notion MCPs, and developed an image manipulation feature that increased adoption by 2%.
Education
Degrees, certifications, and relevant coursework
Rochester Institute of Technology
Master of Science, Information Science & Technology
2014 - 2017
Grade: CGPA: 3.91 / 4.0
Activities and societies: Teaching Assistance Fellowship and merit scholarship (all semesters).
Earned a Master of Science in Information Science & Technology from Rochester Institute of Technology from 2014 to 2017.
Manipal Institute of Technology
Bachelor of Engineering, Computer Science
2010 - 2014
Grade: CGPA: 7.2 / 10
Activities and societies: President, Rotaract Club of Manipal.
Earned a Bachelor of Engineering in Computer Science from Manipal Institute of Technology from 2010 to 2014.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Website
sdkoneru.comSalary expectations
Social media
Job categories
Skills
Interested in hiring Siva Datta?
You can contact Siva Datta and 90k+ other talented remote workers on Himalayas.
Message Siva DattaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
