Psychometrician

What you will be doing

• Data Analysis and Validation:
• Conduct statistical analyses to evaluate the reliability, validity, and fairness of assessments (maintain item pValues, field testing items, etc.)
• Perform item analysis, differential item functioning (DIF) analysis, and other psychometric evaluations.
• Evaluate criterion, proficiency predictive validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance and proficiency levels on high-stakes assessments.
• Evaluate consequential validity evidence to provide insights to internal and external stakeholders.
• Evaluate p validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance on high-stakes assessments.
• Analyze test data to generate reports and provide actionable insights for internal and external stakeholders.


• Research and Methodology:
• Conduct validity studies in partnership with the Research team for specific districts/institutions and markets.
• Stay current on advancements in psychometric methods and educational measurement as well as state assessment requirements, suggesting new and revised assessment methodologies.
• Partner with Research and Products to contribute to scholarly publications and/or conference proposals.
• Partner with product managers and team to inform assessment strategy


• Technical Documentation:
• Prepare technical reports and documentation detailing psychometric analyses, methodologies, and findings.
• Ensure clear communication of complex statistical concepts to non-technical audiences.


• Quality Assurance:
• Participate in quality assurance processes to ensure the accuracy and integrity of assessment data and results.
• Collaborate with software developers to implement and refine automated scoring and analysis systems.


• Training and Support:
• Provide training and support to internal teams and external partners on psychometric principles and best practices.
• Assist in the development of training materials and resources.

What you will need to know/have

• A doctoral degree (Ph.D. or Ed.D.) in Psychometrics, Educational Measurement, Quantitative Psychology, or a related field.
• At least 3 years of experience in psychometrics, educational measurement, or a related field, preferably within an educational assessment company or academic setting.
• Experience with item response theory (IRT), classical test theory (CTT), and other psychometric models.
• Proficiency in statistical software and programming languages (e.g., Python, R, Stata).
• Strong analytical, problem-solving, critical thinking, time management and organizational skills.
• Excellent written and verbal communication skills.
• Ability to work collaboratively in a team-oriented environment.
• Ability to translate complex technical and psychometrics research and statistical information into team-facing and user-facing results, actionable plans, and recommendations.
• A passion for education and a drive to improve assessment materials and experiences for educators and learners

Get in on all the awesome at Instructure!

• Competitive salary, equity and 401k.
• Medical, dental, disability, and life insurance.
• HSA program, vision, voluntary life, and AD&D.
• Tuition reimbursement.
• Paid time off, 11 paid holidays, and flexible work schedules.
• LifeStyle Spending Account