top of page
Introduction to Human Raters and Rating Systems
Introduction to Human Raters and Rating Systems

Wed, Jul 16

|

Online Workshop

Introduction to Human Raters and Rating Systems

We will discuss the creation of rating scales, rater training and monitoring, rating designs, scoring, and more!

Time & Location

Jul 16, 2025, 1:00 PM – 5:00 PM EDT

Online Workshop

Course Topics

In this online event we will discuss:


(1) The basics of scoring open-ended tasks with humans

(2) Common human rater errors

(3) Statistical models to adjust for rater errors in scoring

(4) Metrics for detecting aberrant raters and rater pool monitoring

(5) Best practices for human rating processes

Tickets

  • Intro Raters & Rating Systems

    $400.00

Total

$0.00

Share this event

BroadMetrics Logo with a human brain and robotic brain

Assessment | AI | Analytics

BroadMetrics is a psychometric consultancy dedicated to creating solutions to a broad array of assessment problems. In addition to the application of psychometrics to typical assessment scenarios, we apply measurement science principles to the applied AI sciences, evaluating AI and generating quality human labeling data.

100 Menlo Park Drive, Ste 101

Edison, NJ 08818

  • LinkedIn

© 2025 BroadMetrics, LLC

bottom of page