NIKHILESH User
@nikhileshuser
AI Software Engineer at RP-Tech International Solutions who improved LLM pipeline accuracy from 70% to 80% through evaluation-driven development.
IndiaWhat I'm looking for
At RP-Tech International Solutions, I built a metrics module for production LLM agent evaluation, tracking latency, throughput, cost, and prompt-cache hit rate to support performance optimisation and anomaly detection.
I also led a structured evaluation of agent frameworks, comparing LangGraph, CrewAI, and a custom asyncio orchestrator. I synthesised a 500-contract evaluation corpus for reproducible testing.
I implemented the selected pipeline in Python and FastAPI, using Pydantic v2, pgvector RAG, and asynchronous orchestration. Evaluation-driven development improved accuracy from 70% to 80% and macro-F1 from 0.64 to 0.74.
At Midas Advisory, I built RAG pipelines with LangChain and LlamaIndex and developed FastAPI services for LLM-powered features. I hold a Master's degree in Artificial Intelligence from Queen Mary University of London, where my dissertation explored the relationship between temperature and creativity in large language models.
Experience
Work history, roles, and key accomplishments
• Built a metrics module for production LLM agent evaluation: captured per-stage timing and computed p50/p95/p99 latency, throughput, cost and prompt-cache hit rate from JSON logs enabling performance optimisation and anomaly detection.
• Led agent framework evaluation through structured benchmarking: compared LangGraph, CrewAI and a custom asyncio orchestrator across performance characteristics,
▪ Built end-to-end RAG pipelines with LangChain and LlamaIndex covering document ingestion, chunking, embedding generation, and grounded LLM responses powering internal Q&A and summarisation across the business.
▪ Developed Python backend services in FastAPI to expose LLM-powered features, integrated with PostgreSQL stores and external APIs for real-time information retrieval.
▪ Implemented functi
Education
Degrees, certifications, and relevant coursework
Udemy
The Complete Data Structures and Algorithms Course in Python
Mar 2025
DeepLearning.AI
Pretraining LLMs
Jan 2025
Queen Mary University of London
Master's degree, Artificial Intelligence
2023 - 2024
Pursuing my Master's in Artificial Intelligence at Queen Mary University of London has allowed me to deepen my expertise in cutting-edge technologies and methodologies. The program’s rigorous curriculum covered essential areas such as Natural Language Processing, Deep Learning, Bayesian Neural Networks, and Machine Learning Algorithms, providing me with a robust framework to tackle complex challen
Shri Shivaji Science College
Bachelor's degree, Computer Science
2019 - 2022
During my undergraduate studies, I delved deep into the foundational and advanced aspects of computer applications, equipping myself with critical skills in software engineering, data structures, object-oriented programming, and database management systems. My coursework was rigorously designed to blend theoretical knowledge with practical application, preparing me for real-world challenges in the
Availability
Location
IndiaAuthorized to work in
United KingdomSalary expectations
Social media
Interested in hiring NIKHILESH?
You can contact NIKHILESH and 90k+ other talented remote workers on Himalayas.
Message NIKHILESHGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
