Open to opportunities

Aarsh Majmudar

@aarshmajmudar

Message

AI Evaluation and LLM Quality Analyst improving model safety, accuracy, and user experience.

India

Message

What I'm looking for

I’m looking for a role where I can run structured LLM evaluation, red teaming, and safety improvements—partnering with teams to raise model accuracy, reduce hallucinations, and deliver measurable customer value through fast, rigorous iteration.

I’m an AI Evaluation and LLM Quality Analyst with 7+ years of experience across AI model training, LLM evaluation, and client-facing operations. I combine technical expertise in RLHF/Human-in-the-Loop with a customer-centric approach to ensure models behave reliably in real scenarios.

At xAI, I contributed to 15+ AI/LLM training and evaluation projects by performing LLM evaluation, response ranking, hallucination detection, and empathy tracing. I also optimized reasoning traces and thinking traces while verifying source relevance (e.g., X posts for Grok) to improve logic, transparency, and contextual performance.

I strengthen safety and robustness through AI red teaming and adversarial testing to uncover vulnerabilities, prompt injection risks, and failure modes. I build structured test cases with prompt engineering to evaluate edge cases, and I deliver high-quality feedback that supports AI safety, alignment, bias mitigation, and performance consistency.

Beyond evaluation, I bring a practical ops mindset from sales and customer experience roles, including business development and end-to-end customer lifecycle ownership in solar sales. I’ve also built and secured self-hosted homelab infrastructure using Linux, Docker/Proxmox, and zero-trust tooling—so I’m comfortable connecting model behavior to systems, data, and deployment realities.

Experience

Work history, roles, and key accomplishments

AI Tutor / Quality Analyst

xAI

Apr 2025 - Oct 2025 (6 months)

Contributed to 15+ AI/LLM training and evaluation projects using RLHF and Human-in-the-Loop methods, improving reasoning transparency and verifying source relevance for tasks like Grok X-post checks. Performed LLM evaluation, ranking, hallucination detection, empathy tracing, and red teaming, achieving elite 6.8/7 average and peaking at 6.99/7 while supporting QA precision across 90% of assigned p

LLM Evaluation Prompt Engineering Hallucination Detection AI Red Teaming Adversarial Testing Response Ranking

Business Development Manager

Speed-O-Energy

Mar 2025 - Apr 2025 (1 month)

Led digital-first initiatives to drive revenue growth and cost reduction through stakeholder management and market expansion. Managed client acquisition, improved lead conversion via conversion rate optimization, and supported key accounts to enhance retention and satisfaction through consistent feedback and follow-ups.

Business Development Revenue Growth Stakeholder Management Client Acquisition Lead Conversion Account Management Customer Retention Performance Tracking Conversion Rate Optimization

Solar Sales Consultant

Sunrun Power

Oct 2023 - Mar 2025 (1 year 5 months)

Designed optimized solar system layouts and quotations by collaborating with engineering, procurement, and field installation teams to ensure technical accuracy. Managed the full customer lifecycle from consultation through installation and improved efficiency and customer satisfaction with a solution-driven sales approach.

Solar Layouts Cross Functional Collaboration Customer Lifecycle Management Lead To Install Follow Through Procurement Coordination Sales Process Optimization Customer Satisfaction

Customer Experience Specialist

Etech Global Services

Oct 2018 - Mar 2022 (3 years 5 months)

Delivered cross-functional support across pilot projects in training, retention, technical support, and sales while maintaining strong performance in partially remote operations. Improved customer experience using KPI-driven, data-informed insights and proactive issue resolution.

Customer Experience (CX)Training Programs Retention Strategy Technical Support Sales Support KPI Tracking Data Insights Remote Collaboration

Online Sales Representative

Etech Global Services

Mar 2017 - May 2018 (1 year 2 months)

Exceeded sales targets and collaborated with internal teams to streamline online sales workflows and support execution. Focused on improving process flow to strengthen sales performance and responsiveness.

Online Sales Sales Target Achievement Process Improvement Customer Support

Junior Java Developer

Silverwing Technologies

Sep 2016 - Feb 2017 (5 months)

Developed and maintained web applications using Java and front-end technologies including HTML, CSS, and JavaScript. Contributed to ongoing updates and support for production web features.

Java Web Application Development HTML CSS JavaScript Application Maintenance Debugging