John Pritchard
@jhpritch-dev
AI Infrastructure Engineer building privacy-first distributed LLM inference and platform-grade MLOps systems.
What I'm looking for
I build the infrastructure layer behind distributed AI inference, so LangGraph can decide which model runs, why, and what to do if it fails. My flagship BIFROST RAG system is a production-grade, distributed inference platform running on three nodes with Kubernetes orchestration, eight inference endpoints, and a custom German (Elementary) complexity classifier that routes each request in real time—delivering 86% cost reduction versus cloud-only AI without sacrificing capability.
I also create autonomous, verifiable pipelines like AUTOPILOT (LangGraph-based), where tasks are decomposed into parallel DAGs and executed with hierarchical escalation across NPU/iGPU/GPU tiers, then validated through a six-level objective harness before returning results. With JARVIS-OFFLINE mode, I enable zero-cloud-egress operation for air-gapped or compliance-restricted environments, backed by production observability (Prometheus/Grafana), zero-trust networking (Tailscale/WireGuard), and a modern platform stack (K3s/Kubernetes, FluxCD GitOps, ChromaDB/Qdrant, ROCm GPU optimization, and Pydantic v2 contracts).
Experience
Work history, roles, and key accomplishments
Designed and operated BIFROST, a 3-node distributed AI inference platform with 8 endpoints and Kubernetes orchestration, reducing AI inference costs by 86% versus cloud-only with no capability loss. Built LangGraph-based AUTOPILOT task routing with tiered NPU/iGPU/GPU escalation and enabled JARVIS-OFFLINE zero-cloud-egress deployments with production observability and zero-trust networking.
Embedded Systems Engineer
Henry Hawkinson
Oct 1990 - Jul 2023 (32 years 9 months)
Installed and maintained CPU-driven electronic control systems, relay logic, and electromechanical integrations, performing systematic diagnosis across digital control, analog circuits, and physical components. Supported client maintenance agreements across South Carolina and delivered complex hardware restoration and microprocessor switching system installations.
Adjunct Music Professor
Christopher Newport University
Aug 2021 - May 2023 (1 year 9 months)
Taught foreign language diction (German, French) and aural skills, delivering instruction across multiple instructional modalities. Administered online course delivery platforms and digital assessment tools to support course evaluation and student progress.
Assistant Store Manager
uBreakiFix
Mar 2018 - Aug 2018 (5 months)
Provided PC and mobile device hardware/software diagnostics and repair, delivering customer-facing technical support across varied technical literacy levels. Trained junior technicians on systematic troubleshooting methodology.
Doctoral Assistant
University of South Carolina
Aug 2010 - May 2013 (2 years 9 months)
Designed an ad hoc WiFi wireless telemetry system for real-time physiological data collection and deployed it using IoT sensors and wireless networking. Presented system architecture to a research committee and supported practical IoT infrastructure deployment in a high-stakes environment.
Assistant Professor
Kennesaw State University
Aug 2002 - May 2006 (3 years 9 months)
Developed online course delivery platforms across online-only, hybrid, and traditional modalities. Implemented live student-response systems for real-time assessment of 100+ students and built PC-based electronic assessment with automated grade integration.
Education
Degrees, certifications, and relevant coursework
University of South Carolina
Doctor of Musical Arts, Music Performance (Voice)
2010 - 2013
Earned a Doctor of Musical Arts in Music Performance (Voice) at the University of South Carolina.
University of Florida
Master of Music, Voice and Opera
2008 - 2009
Earned a Master of Music in Voice and Opera at the University of Florida.
University of Michigan
Master of Music, Music Theory
1995 - 1996
Earned a Master of Music in Music Theory at the University of Michigan.
Columbus State University
Bachelor of Music, Organ and Bassoon
1989 - 1994
Earned a Bachelor of Music in Organ and Bassoon at Columbus State University.
Availability
Location
Authorized to work in
Portfolio
rawmark.ioSalary expectations
Social media
Job categories
Skills
Interested in hiring John?
You can contact John and 90k+ other talented remote workers on Himalayas.
Message JohnFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
