Udaykiran Suryadevara
@udaykiransuryadevara
AI Quality and Evaluation professional with 3+ years of experience across LLM, VLM, and multimodal AI systems.
What I'm looking for
AI Evaluation Specialist with 3+ years of experience evaluating and improving LLM, VLM, and multimodal AI systems through human feedback, quality assurance, and structured evaluation frameworks.
Experienced in response ranking, factuality validation, hallucination detection, conversational AI assessment, annotation QA, and multimodal quality review across text, image, video, and audio.
Promoted from MLE I to MLE II at Amazon, where I supported large-scale VLM and annotation quality programs, performing 800–900 weekly audits while maintaining a 97% quality target.
Currently evaluating personalised conversational AI at Deccan AI across factuality, reasoning, contextual grounding, safety, and preference ranking workflows.
Currently strengthening technical capabilities in Python, SQL, data analysis, and AI evaluation methodologies.
Core Areas:
• LLM Evaluation & AI Quality Assurance
• RLHF-Style Evaluation & Response Ranking
• Factuality Validation & Hallucination Detection
• Conversational AI & Multi-Turn Assessment
• Vision-Language Model (VLM) Evaluation
• Annotation QA, QC & Reviewer Calibration
• Multimodal AI (Text, Image, Video, & Audio)
• AI Safety, Alignment & Human Feedback Systems
Experience
Work history, roles, and key accomplishments
AI Operations Associate
Deccan AI
Jan 2026 - Present (5 months)
Performed rubric-based evaluation of personalised LLM-generated responses within consumer health and wellness AI workflows, delivering structured quality assessments that directly informed model calibration cycles.
AI Data Specialist
Innodata
Nov 2025 - Jan 2026 (2 months)
Delivered high-quality dataset creation, annotation, validation, and quality review for LLM and multimodal AI workflows, supporting downstream RLHF and supervised fine-tuning. Conducted rubric-based evaluations (including factuality and hallucination checks) and completed 6+ model-training support task types such as bounding box annotation and image-text/video-text alignment.
Led QA for vision-language model outputs, verifying video descriptions against actions, objects, and sequences and reducing mismatch and edge-case errors by over 25%. Reviewed video-level attributes and supported bounding box QA to improve labeling accuracy.
AI Evaluation Specialist
Soul AI
Sep 2024 - Jan 2025 (4 months)
Evaluated 1,000+ LLM responses using RLHF-style methodologies across factuality, reasoning, alignment, and instruction-following dimensions. Identified hallucinations and edge cases and provided structured feedback to support model improvement workflows.
Quality Assurance Engineer
Pennar Industries Limited
Feb 2022 - Jun 2022 (4 months)
Developed and implemented a record-keeping system achieving 100% traceability of components and materials and maintained over 99% dimensional accuracy compliance across parts. Improved inspection documentation and process controls.
Technical Service Executive
Kalva Engineers Pvt Ltd
Mar 2021 - Jun 2021 (3 months)
Executed ultrasonic, magnetic particle, and liquid penetrant testing on high-risk infrastructure to identify surface and subsurface defects and ensure component integrity. Maintained safety and testing compliance across projects.
Junior Engineer Intern
United Engineering & Construction Co
Aug 2020 - Mar 2021 (7 months)
Completed over 500 NDT inspections using radiographic and visual methods and assisted senior engineers with documentation of inspection findings and material testing reports. Ensured inspections adhered to safety and quality standards.
Junior Engineer
Manjira Machine Builders
Sep 2018 - Nov 2019 (1 year 2 months)
Conducted over 1,000 NDT inspections, identifying cracks, corrosion, and structural faults with a 97% detection rate to support manufacturing quality and safety. Performed routine inspections and reported findings for remediation.
Education
Degrees, certifications, and relevant coursework
KL University
Bachelor of Technology, Mechanical Engineering
Completed Bachelor of Technology in Mechanical Engineering, graduating in 2019.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Udaykiran?
You can contact Udaykiran and 90k+ other talented remote workers on Himalayas.
Message UdaykiranFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
