Skip to content

Check you can trust the scores

Read the agreement figures for your own workspace before you act on a score.

Use this before you tell somebody their agent scores 71, so you know what that number can carry.

  1. Open Scoring quality in the left rail.

    Its opening line says how many of your team's verdicts we matched.

    The Scoring quality screen: five cards for how much was scored and how well it matched a person, the four-cell square of verdicts, and every score area weakest first.
  2. Read the five cards across the top.

  3. Read the square under them.

    Each cell is one of the four things that can happen to a verdict.

  4. Read the newest verdicts we got wrong.

    Each one carries the reason the reviewer wrote.

  5. Press Read it on one, or Change the rule.

  6. Read By score area, weakest first.

  7. Read the How we decide column.

    A model decides the area, a stopwatch does, or no live rule reaches it.

  8. Press Open on a row, or Read more.

    Read more appears where too few verdicts sit beside ours to compare.

  9. Press For engineers, or Download the method.

    The working behind every figure on the screen.

What the five cards mean

How much we looked atThe share of finished conversations that carry a score
We matched your teamHow often we landed where your own reviewers landed
What the real failure rate isA range, corrected for our own known mistakes
Your own reviewers agreed with each otherWhether two of your people who read the same rule landed together
Same conversation scored twiceHow far a score moves when nothing about the conversation changed
A blank in the tableNot measured. Never zero

Reading it right

  • Act on an area that matched a person often and has enough read by a person behind it. An area with too few says so rather than showing a number.
  • Same conversation scored twice is your floor for change. A move smaller than that figure is not movement.
  • If an area you need is unmeasured, the fix is examples. Record Agree or Disagree as you read conversations.
Nothing on this screen changes a score, a rule or a setting. Change the rule and Start reading are doors to screens that do.

Read next

This page as markdown