Prompt Engineer-Data Science & Quality Analysis

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Prompt Engineer – Data Science & Quality Analysis in the United States.

This role offers the chance to shape advanced Voice AI systems that are actively used in production by major retail and restaurant brands. You will design and optimize prompts for large language models, analyze outputs, and drive data quality and performance improvements. Collaborating with cross-functional teams, you will lead experiments, refine evaluation frameworks, and ensure AI outputs are accurate, safe, and aligned with business goals. This position provides the opportunity to mentor a team of analysts, apply data science expertise, and contribute to AI solutions that directly impact operational efficiency and user experience.

Accountabilities:

• Develop, test, and refine prompts for LLM tasks including text generation, question answering, and data extraction.
• Design evaluation frameworks and analyze outputs using quantitative metrics, human-in-the-loop feedback, and user insights.
• Conduct experiments, measure performance, and iterate prompt designs to improve accuracy, consistency, and safety.
• Build and maintain regression test suites to ensure continued prompt quality across evolving models and use cases.
• Collaborate with data science, product, legal, engineering, and operations teams to align prompt strategies with organizational objectives.
• Lead and mentor a team of analysts, overseeing prioritization, experimentation, and reporting workflows.
• Stay current on emerging prompting techniques, LLM behaviors, and AI safety best practices.

Requirements

• Bachelor’s degree in Data Science, Computer Science, Statistics, Engineering, or a related field with 3–6 years of relevant experience.
• Strong analytical and programming skills in Python (pandas, NumPy, scikit-learn).
• Proficiency in SQL and experience with relational databases (MySQL, PostgreSQL, Oracle, MS SQL).
• Experience designing and conducting experiments in applied AI or NLP contexts.
• Understanding of data processing, quality measurement, and testing fundamentals.
• Proven experience leading analyst or operations teams with prioritization, mentorship, and collaboration skills.
• Excellent problem-solving, communication, and presentation skills for both technical and non-technical stakeholders.
• Must be flexible to work US hours at least until 6 pm ET and have a reliable remote work setup.

Preferred Qualifications:

• Experience with LLM evaluation and prompt engineering workflows.
• Familiarity with tools such as LangFuse and Galileo for prompt analysis.
• Knowledge of cloud platforms (AWS, GCP, Azure) and data pipeline tools.
• Familiarity with machine learning concepts and NLP workflows.
• Master’s or PhD in Data Science, Statistics, Computer Science, or related field.

Benefits

• Health Care Plan (Medical, Dental & Vision)

· Retirement Plan (401k)

• Life Insurance (Basic, Voluntary & AD&D)

· Flexible Paid Time Off

• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability

· Training & Development

· Work From Home

· Stock Option Plan

Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching.

When you apply, your profile goes through our AI-powered screening process designed to identify top talent efficiently and fairly:

• 🔍 Our AI evaluates your CV and LinkedIn profile thoroughly, analyzing your skills, experience, and achievements.
• 📊 It compares your profile to the job’s core requirements and past success factors to determine your match score.
• 🎯 Based on this analysis, we automatically shortlist the 3 candidates with the highest match to the role.
• 🧠 When necessary, our human team may perform an additional manual review to ensure no strong profile is missed.

The process is transparent, skills-based, and free of bias — focusing solely on your fit for the role. Once the shortlist is completed, it is shared directly with the company, who then manages interviews and next steps.

Thank you for your interest!