Himalayas logo
CH
Open to opportunities

Carter Ho

@carterho1

Senior software engineer specializing in scalable cloud systems and AI-enabled backends.

United States
Message

What I'm looking for

I seek roles building scalable cloud-native and AI-enabled backends with strong security and observability, in teams that value mentorship and engineering excellence.

I am a senior software engineer with extensive experience designing and operating high-scale cloud-native systems, primarily on Azure and AWS. I have architected services handling tens of thousands of requests per second, implemented distributed caching, and standardized IaC to achieve high availability and low latency.

I build AI-enabled middleware and integrations—using FastAPI, LangChain, and Azure OpenAI—to deliver domain-specific insights and reduce model hallucination, and I modernize identity and security with OAuth2/OpenID Connect and RBAC for multi-tenant environments. I also design cross-platform interoperability solutions using gRPC and sidecar patterns to bridge legacy and modern stacks.

I mentor engineers in Clean Architecture and SOLID principles, lead migrations and observability efforts that improve reliability and compliance (HIPAA/GDPR), and consistently drive performance and cost improvements across databases, caching, and asynchronous service patterns.

Experience

Work history, roles, and key accomplishments

Microsoft logoMI
Current

Senior Software Engineer

May 2021 - Present (4 years 9 months)

Architected high-scale Azure services handling 50k+ RPS and achieved 99.99% uptime; built Python AI middleware (FastAPI, LangChain, Azure OpenAI) to reduce model hallucination and modernized identity/security with OAuth2/OpenID Connect and Azure AD.

US

Senior Software Engineer

Universal Health Services

Oct 2017 - Apr 2021 (3 years 6 months)

Led Cerner Millennium integrations using HL7 v2 and REST APIs to improve clinical data retrieval and migrated legacy data to AWS (S3/RDS), while enforcing HIPAA-compliant security with OAuth2 and MFA.

SC

Software Engineer

ScienceSoft

Jul 2012 - Aug 2017 (5 years 1 month)

Developed C#/.NET backend services for high-volume product catalogs, integrated Stripe/PayPal to achieve 98% payment success, and improved MySQL performance by 20% via query tuning and caching.

Education

Degrees, certifications, and relevant coursework

The University of Texas at Arlington logoTA

The University of Texas at Arlington

Bachelor of Science, Computer Science

2008 - 2012

Completed a Bachelor of Science in Computer Science focusing on software engineering and systems development from 2008 to 2012.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Carter Ho - Senior Software Engineer - Microsoft | Himalayas