Looking for a job

Ansh Surmawala

@anshsurmawala

Data Analyst at Outlier AI, evaluating LLM outputs and supporting fine-tuning with prompt testing and preference rankings.

Canada

Message

At Outlier AI, I design evaluation prompts for LLM alignment and recall testing, assess outputs for factual accuracy and reasoning, and rank model variants to contribute to fine-tuning improvements.

At Imperia Fincon Solutions, I built PySpark workflows for data cleansing and transformation and designed Power BI dashboards for KPI reporting. My projects include a data quality tool using the Anthropic API and fraud detection pipelines and dashboards.

Experience

Work history, roles, and key accomplishments

Current

Production Associate

Current

Toyota Motor Manufacturing Corporation

Dec 2024 - Present (1 year 10 months)

Contributed to quality compliance reporting by documenting non-conformance data and traceability records. Tracked production deviation data and supported process improvement initiatives by flagging data anomalies.

Data Documentation Quality and Compliance Root Cause Analysis Anomaly Detection

Current

Data Analyst

Current

Outlier AI

Sep 2024 - Present (2 years 1 month)

Designed evaluation prompts for alignment testing and recall assessment across LLMs. Assessed model outputs for factual inaccuracies, reasoning errors, and coherence, and conducted preference ranking and testing across model variants.

Prompt Engineering LLM Evaluation Data Labeling Data Curation Python

Data Analyst

Imperia Fincon Solutions

Jan 2024 - Dec 2024 (11 months)

Engineered SQL stored procedures, complex joins, and window functions to validate data integrity during system migration. Built PySpark workflows to automate data cleansing, transformation, and standardization, and designed Power BI dashboards to track KPIs.

SQL PySpark Power BI DAX Power Query ETL Data Governance Data Warehouse

Education

Degrees, certifications, and relevant coursework

Brock University

Bachelor of Computer Science, Computer Science

2020 - 2024

Bachelor of Computer Science from Brock University, with coursework in advanced mathematics, statistics, finance, computer science, and linear algebra.