Himalayas logo
ZH
Open to opportunities

Zakary Heppler

@zakaryheppler

Senior Backend & AI Engineer specializing in RAG, agentic AI, and scalable cloud-native systems.

United States
Message

What I'm looking for

I seek senior engineering roles building production-grade AI systems (RAG, agentic agents) in cloud-native environments with strong DevOps, observability, and enterprise governance.

I am a Senior Backend and AI Engineer with 10+ years building production-grade AI applications using RAG, vector databases, and multi-agent orchestration across cloud-native environments. I specialize in Python and C#/.NET, designing secure RESTful APIs, embedding pipelines, semantic search systems, and structured LLM evaluation workflows to deliver enterprise-ready AI solutions.

I have hands-on experience deploying containerized AI services on Kubernetes with IaC and CI/CD, instrumenting observability, and integrating Azure OpenAI and Azure infrastructure. I translate complex AI use cases into secure, scalable, performance-optimized systems aligned with enterprise governance and production reliability standards.

Experience

Work history, roles, and key accomplishments

Snyk logoSN

Senior Backend & Agentic AI Engineer

Jan 2023 - Jan 2026 (3 years)

Architected and deployed production-grade RAG pipelines and multi-agent orchestration frameworks, reducing hallucination risk and improving semantic retrieval accuracy for enterprise AI services. Built Python and C#/.NET backend services, deployed on Azure Kubernetes Service with CI/CD and telemetry to optimize cost and reliability.

TR

Senior Backend & Automation Engineer

TrueFoundry

Jun 2021 - Dec 2022 (1 year 6 months)

Designed backend control-plane systems and reusable RAG integration layers for lifecycle management of LLM services, enabling secure, autoscaled Kubernetes deployments and Infrastructure-as-Code for Azure environments. Implemented CI/CD gates and telemetry for evaluation and production rollouts.

MI

Senior Backend & AI Engineer

Markovate Inc

Mar 2020 - May 2021 (1 year 2 months)

Developed AI-enhanced backend microservices and hybrid RAG retrieval systems for fintech and healthcare, deploying inference endpoints on AWS and improving reliability via optimized indexing, caching, and logging. Led incident response and translated stakeholder requirements into production AI services.

Azumo logoAZ

Backend Engineer

Sep 2018 - Jan 2020 (1 year 4 months)

Built scalable RESTful and GraphQL APIs for recommendation and personalization engines, integrated MLflow for experiment tracking, and implemented caching and CI/CD pipelines to reduce inference latency and streamline model promotion.

MA

Backend & AI Engineer

MetroCity AI

Jun 2015 - Sep 2018 (3 years 3 months)

Developed backend AI platforms integrating NLP and computer vision models, containerized services for production on AWS, and built orchestration and monitoring systems to support distributed inference and dataset annotation workflows.

Education

Degrees, certifications, and relevant coursework

University of the Philippines Diliman logoUD

University of the Philippines Diliman

Bachelor of Science, Computer Science

2011 - 2015

Activities and societies: Capstone project on scalable distributed backend systems; collaborative engineering projects, version control and peer review workflows.

Completed a Bachelor’s Degree in Computer Science with coursework in data structures, algorithms, distributed systems, artificial intelligence, and databases; capstone focused on scalable distributed backend systems.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Zakary Heppler - Senior Backend & Agentic AI Engineer - Snyk | Himalayas