Open to opportunities

Ally Abdullah

@allyabdullah

Message

Senior AI/ML engineer specializing in LLM, RAG, and production MLOps to cut latency and improve relevance.

United States

Message

What I'm looking for

I’m looking for a role where I can build production-grade LLM/RAG and AI agent systems, optimize latency and relevance, and own MLOps end-to-end—while working with a strong engineering culture that values testing, security, and maintainable architecture.

I’m a Senior AI/ML Engineer with 10+ years of experience designing, building, and deploying production-grade machine learning systems, GenerativeAI applications, and scalable AI platforms. I specialize in LLM applications, Retrieval-Augmented Generation (RAG), AI agents, NLP, semantic search, and ML infrastructure, with a strong focus on taking ideas from experimentation to reliable production.

I’ve built and optimized high-impact systems—especially RAG pipelines using LangChain and LlamaIndex—leveraging OpenAI/Claude and vector databases to improve response relevance. I reduced API inference latency by 35–40% through caching, retrieval optimization, and backend performance tuning, and I’ve delivered scalable inference services on AWS with Docker, Kubernetes, and CI/CD automation. I also design secure enterprise AI systems using RBAC, OAuth2/JWT authentication, and data governance controls.

In my recent roles, I architected LLM applications and ML inference systems supporting 10K+ daily AI requests, engineered end-to-end ML deployment pipelines (AWS SageMaker, MLflow, automated testing), and maintained engineering excellence through TDD and clean architecture. I also mentor junior engineers and build maintainable workflows across the full lifecycle—model registry, model serving, evaluation, and monitoring—so teams can ship faster with confidence.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer – AI/ML

Current

Techlogix

Sep 2022 - Present (3 years 10 months)

Architected and deployed production-grade LLM applications and ML inference systems using RAG and optimized retrieval pipelines. Improved API latency and throughput, automated end-to-end ML deployment pipelines, and implemented secure RBAC/multi-tenant authorization.

Python PyTorch fastAPI RAG Embeddings REST APIs GraphQL Django AWS Sagemaker Docker Kubernetes MLFlow CI CD TypeScript RBAC JWT Profiling Caching Pytest Playwright MLOps Test Coverage

Software Engineer – Backend & ML

ScaleAI

Jun 2019 - Aug 2022 (3 years 2 months)

Developed scalable AI-powered backend platforms and automated grant evaluation workflows. Built ML scoring/classification pipelines and secure authentication/authorization systems using JWT and RBAC.

Python Django fastAPI PostgreSQL scikit learn Feature Engineering Model Validation JWT Pandas Authentication Authorization

Machine Learning Engineer

Redflag

Sep 2016 - Sep 2019 (3 years)

Built and productionized NLP and machine learning models using Scikit-learn and Hugging Face Transformers for automated text classification. Deployed low-latency ML inference services and integrated secure authentication using OAuth2 and JWT.

Machine Learning NLP scikit learn Hugging Face Transformers Python Django fastAPI Flask JWT Model Evaluation Indexing Query Optimization

Junior Machine Learning Engineer

Upwork

Jan 2016 - Sep 2016 (8 months)

Helped companies build and deploy production-ready AI solutions, including generative AI/LLM applications, RAG systems, and AI agents. Delivered projects across the full pipeline from prototypes to scalable enterprise systems using Python and common MLOps tools.