Zakary Heppler
@zakaryheppler
Senior Backend & AI Engineer specializing in RAG, agentic AI, and scalable cloud-native systems.
What I'm looking for
I am a Senior Backend and AI Engineer with 10+ years building production-grade AI applications using RAG, vector databases, and multi-agent orchestration across cloud-native environments. I specialize in Python and C#/.NET, designing secure RESTful APIs, embedding pipelines, semantic search systems, and structured LLM evaluation workflows to deliver enterprise-ready AI solutions.
I have hands-on experience deploying containerized AI services on Kubernetes with IaC and CI/CD, instrumenting observability, and integrating Azure OpenAI and Azure infrastructure. I translate complex AI use cases into secure, scalable, performance-optimized systems aligned with enterprise governance and production reliability standards.
Experience
Work history, roles, and key accomplishments
Architected and deployed production-grade RAG pipelines and multi-agent orchestration frameworks, reducing hallucination risk and improving semantic retrieval accuracy for enterprise AI services. Built Python and C#/.NET backend services, deployed on Azure Kubernetes Service with CI/CD and telemetry to optimize cost and reliability.
Senior Backend & Automation Engineer
TrueFoundry
Jun 2021 - Dec 2022 (1 year 6 months)
Designed backend control-plane systems and reusable RAG integration layers for lifecycle management of LLM services, enabling secure, autoscaled Kubernetes deployments and Infrastructure-as-Code for Azure environments. Implemented CI/CD gates and telemetry for evaluation and production rollouts.
Senior Backend & AI Engineer
Markovate Inc
Mar 2020 - May 2021 (1 year 2 months)
Developed AI-enhanced backend microservices and hybrid RAG retrieval systems for fintech and healthcare, deploying inference endpoints on AWS and improving reliability via optimized indexing, caching, and logging. Led incident response and translated stakeholder requirements into production AI services.
Built scalable RESTful and GraphQL APIs for recommendation and personalization engines, integrated MLflow for experiment tracking, and implemented caching and CI/CD pipelines to reduce inference latency and streamline model promotion.
Backend & AI Engineer
MetroCity AI
Jun 2015 - Sep 2018 (3 years 3 months)
Developed backend AI platforms integrating NLP and computer vision models, containerized services for production on AWS, and built orchestration and monitoring systems to support distributed inference and dataset annotation workflows.
Education
Degrees, certifications, and relevant coursework
University of the Philippines Diliman
Bachelor of Science, Computer Science
2011 - 2015
Activities and societies: Capstone project on scalable distributed backend systems; collaborative engineering projects, version control and peer review workflows.
Completed a Bachelor’s Degree in Computer Science with coursework in data structures, algorithms, distributed systems, artificial intelligence, and databases; capstone focused on scalable distributed backend systems.
Tech stack
Software and tools used professionally
AWS IAM
Microsoft Azure
GitHub
GitLab
Kubernetes
Azure Kubernetes Service
GitHub Actions
GitLab CI
PostgreSQL
Rollout
Node.js
.NET Core
.NET
ASP.NET Core
Redis
Terraform
AWS CloudFormation
Java
ASP.NET
JSON
TensorFlow
PyTorch
MLflow
scikit-learn
Kubeflow
Kafka
RabbitMQ
FastAPI
Grafana
Prometheus
Windows
GraphQL
gRPC
Elasticsearch
AWS Lambda
OAuth2
Docker
Airflow
Time Analytics
Root Cause
TimescaleDB
Amazon Web Services (AWS)
SQL
XGBoost
Hugging Face
Snyk
Seldon
LangChain
AutoGen
CrewAI
Plane
Ray
OpenAI API
Hugging Face Spaces
ArgoCD
TrueFoundry
Bash
Agentic
LangGraph
Google Cloud Vertex AI Workbench
Loops
Middleware
Remote
Jan
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Skills
Interested in hiring Zakary?
You can contact Zakary and 90k+ other talented remote workers on Himalayas.
Message ZakaryFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
