Skip to main content
SB
Looking for a job

SOMA BHATTACHARYA

@somabhattacharya

Bengali AI evaluator at Outlier and Handshake AI, comparing assistant, voice, and TTS responses and reviewing robotics video captions.

India
Message

At Handshake AI's Octahedron Project, I compare AI personal assistants on real-world tasks and score their responses for correctness, coherence, helpfulness, and tone. I write evidence-based justifications and create everyday Bengali prompts to assess how naturally and appropriately the models respond.

At Outlier, I evaluate Bengali voice-model conversations and text-to-speech audio, using project rubrics to assess response quality, pronunciation, and naturalness. I also review egocentric video captions for robotics training data, checking clip segmentation and correcting annotation errors against project guidelines.

Previously, I worked at Tabsons India as a Media Logger and then a Media Quality Analyst for Bengali and Assamese news channels. I logged and tagged broadcasts, then reviewed media and metadata for accuracy, completeness, and compliance using Xentaurix and RBM.

Experience

Work history, roles, and key accomplishments

HA
Current

AI Comparison Evaluator – Bengali

Handshake AI

Oct 2026 - Present (1 month)

Evaluated and compared side-by-side responses from two AI personal assistants, scoring across multiple dimensions and writing evidence-based justifications. Designed custom test prompts for everyday scenarios to probe model capabilities.

Side By Side Comparison
Rubric Based Scoring
Ranked Choice Voting
Written Justification
Prompt Design
Bengali Linguistic Assessment
OU
Current

AI Data Annotator / AI Trainer

Outlier

Jul 2026 - Present (4 months)

Conducted side-by-side voice conversations with AI models, evaluated responses, and voted on stronger outputs. Reviewed and corrected caption annotations on egocentric video clips for robotics data, and evaluated text-to-speech audio outputs using an Elo-style rating system.

Model Comparison
Voting
Rubric Based Scoring
Egocentric Video Annotation
Caption Reviewing And Editing
Text To Speech Evaluation
ELO Rating
Bengali Linguistic Assessment
TI

Media Quality Analyst

Tabsons India

Feb 2026 - Jun 2026 (4 months)

Reviewed logged media content and metadata for Bengali and Assamese news channels for accuracy, completeness, and compliance with broadcast guidelines. Identified and flagged content, timestamp, and formatting issues.

Content Review
Metadata And Reference Verification
Broadcast Compliance
Xentaurix
RBM
TI

Media Logger

Tabsons India

Jan 2025 - Jan 2026 (1 year)

Supported live news monitoring and media logging for leading Bengali and Assamese channels. Logged and tagged media content using Xentaurix and RBM software, performing accurate timestamping and metadata management.

Media Logging
Time StampingMetadata Management
Content Categorization
Xentaurix
RBM

Education

Degrees, certifications, and relevant coursework

SE

Self-Paced

Data Analytics Certification, Data Analytics

Ongoing self-paced certification in Data Analytics covering MS Excel, SQL, and Power BI.

North Bengal University logoNU

North Bengal University

Master of Arts, Rural Development

Grade: 69.00%

Completed a Master of Arts in Rural Development from North Bengal University in 2024 with a score of 69.00%.

North Bengal University logoNU

North Bengal University

Bachelor of Arts (Honours), Sociology

Grade: 61.38%

Completed a Bachelor of Arts (Honours) in Sociology from North Bengal University in 2020 with a score of 61.38%.

WE

West Bengal Council of Higher Secondary Education

Higher Secondary, General

Grade: 64.00%

Completed Higher Secondary education from the West Bengal Council of Higher Secondary Education in 2017 with a score of 64.00%.

WE

West Bengal Board of Secondary Education

Madhyamik (Secondary), General

Grade: 51.00%

Completed Madhyamik (Secondary) education from the West Bengal Board of Secondary Education in 2015 with a score of 51.00%.

DA

Diploma in Computer Information Technology & Application

Diploma in Computer Information Technology & Application, Computer Information Technology

Completed a diploma in Computer Information Technology and Application, covering MS Word, Excel, and PowerPoint.

CD

Certificate Course in Soft Skills and Personality Development

Certificate Course, Soft Skills

Completed a certificate course in Soft Skills and Personality Development.

Tech stack

Software and tools used professionally

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

70k+ INR

Job categories

AI Data AnnotatorLLM EvaluatorAI Trainer
Video Quality Analyst
Media Logging

Skills

LLM Evaluation
Bengali Linguistic Assessment
Side By Side Comparison
Preference Ranking
Multidimensional Rubric Scoring
Written Justification
Speech AI Evaluation
Text To Speech Evaluation
ELO Based Ranking
RLHF Workflows
Prompt Design and Testing
Generative AI Evaluation
Hallucination and Factual Error Detection
Instruction Following Assessment
Model Benchmarking

Interested in hiring SOMA?

You can contact SOMA and 600K+ other talented remote workers on Himalayas.

Message SOMA

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan