Open to opportunities

talie jorion

@taliejorion

Message

Data scientist quantifying uncertainty to validate models and mitigate risk in high-stakes decisions.

United States

Message

What I'm looking for

I’m looking to lead probabilistic, measurement-driven work in high-stakes settings—building reliable, interpretable models with monitoring, calibration, and risk governance, and turning statistical evidence into decisions I can stand behind.

I’m a data scientist and measurement specialist focused on quantifying uncertainty, validating model behavior, and assessing risk in high-stakes decision systems. I over a decade of experience designing probabilistic models, leading technical teams, and translating complex statistical findings into actionable governance decisions.

As Principal Data Scientist at BitSight, I lead a technical team building performance analysis tied to a data ransomware susceptibility index. I productionize probabilistic models with explicit monitoring, documentation, and interpretability standards, and I forecast breach risk using calibration, uncertainty quantification, and threshold-setting for decision support—while addressing data sparsity and reporting bias through hierarchical and survival modeling.

I also build defensible data pipelines, developing imputation and NLP-based integration across cyber loss datasets with systematic error analysis and reliability assessment. Earlier, as a Psychometrician at PSI Services LLC and PearsonVUE, I led automated item and exam analytics, test equating, validation studies, and reporting tools—bringing the same reliability and construct-validity rigor into scalable, decision-oriented systems.

Experience

Work history, roles, and key accomplishments

Current

Principal Data Scientist

Current

BitSight

Jan 2022 - Present (4 years 6 months)

Led a technical team and cross-functional efforts to productionize probabilistic models for breach-risk forecasting, including monitoring, documentation, and interpretability standards for client governance. Developed NLP-based data integration pipelines and applied calibration, uncertainty quantification, and hierarchical/survival modeling to improve robustness under data sparsity and bias.

Associate Director

Visible Risk

Jan 2021 - Jan 2022 (1 year)

Developed probabilistic risk models and production-ready pipelines to drive actionable insights for clients.

Risk Modeling Risk Analysis Data Pipelines Model Productionization

Psychometrician

PSI Services LLC

Jan 2019 - Jan 2021 (2 years)

Designed an automated tool to detect compromised exam items using NLP and web scraping, and conducted item- and exam-level psychometric analyses. Managed assessment portfolios and led SMEs across job analysis, item writing/reviews, validation studies, and standard setting.

NLP Web Scraping Psychometrics Exam Level Analysis Test Equating Reporting Job Analysis Item Writing Standard Setting Assessment Life Cycle SME

Psychometrician

PearsonVUE

Jan 2016 - Jan 2019 (3 years)

Automated item-response analyses and reporting using R, improving analyst productivity, and built Shiny apps for panels used by SMEs. Presented research on bias detection automation with supervised machine learning and contributed to validity framework development for innovative items.

R Report Automation Shiny Scoring Models Presentation Technical Advisory

Education

Degrees, certifications, and relevant coursework

University of Illinois at Chicago

Doctor of Philosophy (Ph.D.), Learning Sciences / Measurement, Evaluation, Statistics, and Assessment

2010 - 2016

Completed a Ph.D. in Learning Sciences with a focus on measurement, evaluation, statistics, and assessment at the University of Illinois at Chicago from 2010 to 2016.