Franklin Zhang
@franklinzhang3
Senior AI software engineer building scalable LLM-driven commerce systems.
United StatesWhat I'm looking for
I am a Senior AI Software Engineer with 11+ years building AI-powered, full-stack commerce and healthcare systems at scale. I specialize in designing LLM-driven products, distributed backend services, and intuitive frontend experiences, and I have delivered end-to-end features that integrate Generative AI, RAG, agentic workflows, and robust safety guardrails into production.
My work spans model orchestration and routing, real-time inference pipelines, MLOps, and cloud-native deployment across AWS and GCP. I collaborate closely with product and design to ship reliable, high-traffic multi-tenant services, and I focus on observability, CI/CD, and cost/latency optimization to ensure safe, efficient AI-driven user experiences.
Experience
Work history, roles, and key accomplishments
SHLed development of AI-powered merchant features and LLM orchestration layers that improved latency/cost tradeoffs and enabled secure experimentation across multi-tenant commerce workflows.
Machine Learning Engineer
Viz.ai
Oct 2018 - Dec 2021 (3 years 2 months)
Built real-time clinical intelligence and model inference pipelines, integrating deep learning models into low-latency backend services for clinician decision support.
Education
Degrees, certifications, and relevant coursework
UHUniversity of Houston
Bachelor of Science, Computer Science
2010 - 2014
Completed a Bachelor of Science in Computer Science focusing on software engineering and systems development.
Availability
Location
United StatesAuthorized to work in
Job categories
Skills
Interested in hiring Franklin?
You can contact Franklin and 90k+ other talented remote workers on Himalayas.
Message FranklinFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
