Open to opportunities

James Anderson

@jamesanderson6

Message

Senior software engineer building scalable LLM and RAG platforms for scientific domains.

United States

Message

What I'm looking for

I’m looking for a team building production LLM/RAG systems on cloud-native microservices, with strong observability, CI/CD, and security. I want to tackle retrieval/vector search at scale and mentor engineers while driving measurable impact.

I’m a Senior Software Engineer and AI Engineer specializing in LLMs, RAG architectures, and scalable AI/ML platforms for scientific domains. I bring ~10 years building cloud-native microservices and data pipelines with production focus on reliability, performance, and secure deployment.

At Infosys Consulting, I architected a cloud-native AI platform layer integrating OpenAI and Anthropic LLMs with LangChain and LangGraph, delivering sub-second retrieval latency for 95% of queries. I decomposed monoliths into Kubernetes-hosted microservices, cut mean time to recovery by 48%, and scaled embedding generation to 15M+ embeddings while lowering query costs by 32%.

I also lead resilient RAG orchestration using AutoGen and Crew.ai agents, with retries/backoff/circuit breakers to maintain 99.9% uptime in production stress tests. I mentor ML engineers and translate domain workflows into explainable agent flows, improving experiment-to-insight speed by 3x while strengthening observability through Prometheus, Grafana, and ELK.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer

Current

Infosys Consulting

May 2024 - Present (2 years 2 months)

Architected a cloud-native AI platform integrating OpenAI and Anthropic LLMs with LangChain/LangGraph to deliver sub-second RAG retrieval for 95% of queries. Improved resilience and operations by decomposing to Kubernetes microservices (48% lower MTTR) and implementing fault-tolerant agent orchestration with 99.9% uptime during stress tests.

LLM RAG LLMs (LangChain LangGraph Pinecone Pgvector Kubernetes fastAPI Airflow

Senior Full Stack Software Engineer

USAA

Aug 2021 - Mar 2024 (2 years 7 months)

Architected a multi-tenant microservices platform with ASP.NET Core, Docker, and Kubernetes, improving horizontal scalability 4x for high-throughput financial workflows. Built ML inference APIs integrating embeddings and Pinecone similarity search, increasing conversion by 12% and accelerating searches by 40% with pgvector.

ASP.NET Core fastAPI Microservices Kubernetes Pinecone Pgvector SignalR

Senior Software Engineer

Carenet Health

Nov 2020 - Jul 2021 (8 months)

Modernized inventory and scheduling backends using ASP.NET Core and Spring Boot, containerized with Docker and deployed on AWS to support 500+ clinics at 99.5% availability. Implemented secure, PHI-protecting APIs with OAuth2/JWT/MFA and RBAC, and reduced storage costs 21% through AWS RDS/S3 migration and lifecycle policies.

ASP.NET Core Spring Boot AWS Docker Delta Lake

Software Engineer

Texas Controls - USA

Sep 2019 - Aug 2020 (11 months)

Developed TypeScript/Node.js microservices with Express for transaction processing with 99.9% event delivery reliability handling millions of retail events. Built policy search using REST APIs with PostgreSQL + pgvector to reduce lookup times 46% and implemented WebSocket + Redis streaming for under-300ms propagation on 95% of events.

TypeScript PostgreSQL Pgvector WebSockets Redis MongoDB Gitlab CI

Software Engineer

Sira Consulting

Jul 2018 - Jul 2019 (1 year)

Built Node.js/TypeScript microservices for retail order workflows achieving 99.8% uptime during peak holiday traffic and supporting 4x seasonal load increases. Developed React frontend components and TypeScript client libraries to standardize integrations, reducing integration time by 35% and improving dashboard engagement by 23% with WebSocket notifications.

Node TypeScript React WebSockets Kubernetes API Documentation

Software Engineer

PerformixBiz

Oct 2016 - Jun 2018 (1 year 8 months)

Developed full-stack HR and logistics dashboards with Node.js/Express, React, and TypeScript for 200+ customers, including real-time metrics. Scaled transaction-processing microservices with Docker and Kubernetes (3x peak throughput), integrating Stripe to reduce manual reconciliation by 64% and implementing analytics pipelines that cut manual reporting effort by 78%.

Node Express React TypeScript Docker Kubernetes Stripe PostgreSQL Gitlab CI