Exams Benchmark Introductions

Overview

Exams are a great way to bring your team up to speed and onboard new team members.

A Repeatable Template

An Exam is like a template. Each time an Annotator goes to start it, it's a fresh copy. If you are familiar with Video Game instances it's similar to that concept.

Setting the Gold Standard

Instances that already exist on files when the Job is created will automatically be assumed to be the Gold Standard.

The Gold Standard is used by the Auto Grader.

Awards

Both regular work and Exams can grant and require Awards.
With an Exam, however you can build in choices about results in terms of the Auto Grader.

Grading Exams

After a user completes an exam you can view the grading screen and review their results.