Skip to main content
Ayush pratap SinghAS
Looking for a job

Ayush pratap Singh

@ayushpratapsingh2

Freelance AI Evaluator at Meridial.ai | AI Intern at Grootz | Freelanced with Perplexity AI | Built AI Security and RAG Projects

India
Message

I have hands-on experience in AI evaluation, Generative AI, LLMs, and AI agent development. I currently work as a Freelance AI Evaluator at Meridial.ai, where I evaluate LLM responses for accuracy, relevance, completeness, and instruction-following. Previously, I interned at Grootz, researching AI agents and GenAI tools and building automated workflows using n8n and AI APIs. I also freelanced with Perplexity AI on Comet Browser research, product testing, AI-assisted workflows, and user outreach.

My projects include an Agentic Firewall Guardrail for detecting prompt injection and preventing data exfiltration, a Medical RAG Chatbot using LangChain and FAISS, and a Resume–JD Matcher powered by LLM APIs. My AI security project achieved a 100% attack block rate with 0% false positives across 29 test cases.

My technical skills include Python, SQL, LangChain, RAG pipelines, prompt engineering, LLM evaluation, AI security testing, and workflow automation. I have also led the AI/ML community at Google Developer Group on Campus, organizing technical workshops and supporting peer learning.

I am interested in AI/ML engineering, Generative AI, AI research and development, LLM evaluation, and AI product roles. I enjoy solving practical problems, experimenting with emerging AI technologies, and building reliable solutions that create real-world value. I am looking for opportunities where I can contribute my technical skills, take ownership, and continue learning in a fast-paced team.

Experience

Work history, roles, and key accomplishments

Meridial.ai logoME
Current

AI Evaluator

Oct 2026 - Present (0 months)

Evaluate LLM-generated responses against structured rubrics for instruction adherence, factual accuracy, relevance, completeness, and clarity. Run side-by-side comparative evaluations and write evidence-based justifications linking specific issues to assigned ratings.

CA

R&D and Product Promotion Associate

Comet Browser, Perplexity AI

Sep 2025 - Nov 2025 (2 months)

Researched and tested Comet across user scenarios, evaluating AI-assisted workflows and usability. Demonstrated Comet to prospective users through outreach and live demos, supporting onboarding.

Education

Degrees, certifications, and relevant coursework

SRM Institute of Science & Technology logoST

SRM Institute of Science & Technology

B.Tech, Computer Science

2023 -

Grade: 8.36

Pursuing a B.Tech in Computer Science with a specialization in Data Science, maintaining a CGPA of 8.36.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan