Open to opportunities

Austin Miller

@austinmiller

Senior software engineer at Akamai who wrote Inference Cloud’s routing layer for AI traffic between edge GPU sites and core regions.

United States

Message

At Akamai Technologies, I wrote the request routing logic for Inference Cloud, steering AI inference traffic between edge GPU sites and core regions. The product launched on NVIDIA Blackwell GPUs and BlueField DPUs.

I also built Go services and Terraform modules for Akamai’s managed Kubernetes App Platform, and provisioned internal developer clusters through Crossplane and Argo CD. I wired OpenTelemetry and Prometheus into edge services, with that data feeding Akamai Cloud’s 2025 FedRAMP High Ready assessment.

At Amazon Web Services (AWS), I moved service tables from Oracle to DynamoDB and Aurora as part of Amazon’s internal Oracle exit. After major service incidents, I helped split a front-end fleet into cells and added reliability measures including alarms, staged deployments, and automatic rollback.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer

Current

Akamai Technologies

Apr 2024 - Present (2 years 6 months)

Wrote request routing logic for Inference Cloud, steering AI inference traffic between edge GPU sites and core regions. Built Go services and Terraform modules for managed Kubernetes App Platform, and provisioned internal clusters via Crossplane and Argo CD.

Go Terraform Kubernetes Crossplane ArgoCD OpenTelemetry Prometheus Grafana Loki Kyverno AI Inference Edge GPU Routing NVIDIA Blackwell Hardware NVIDIA Bluefield DPUs DNS CI CD GitOps

Software Development Engineer II

Amazon Web Services (AWS)

Jul 2019 - Aug 2022 (3 years 1 month)

Split a front-end fleet into cells after the November 2020 Kinesis outage, adding alarms and wave-based deploys. Moved service tables off Oracle onto DynamoDB and Aurora as part of Amazon's internal Oracle exit, and added resilience measures after the December 2021 us-east-1 network event.