The review form (RUBRIC_V2)

The rating scale
Every rating uses five points:
5 Excellent - no meaningful problem
4 Good - minor problems only
3 Acceptable - usable with some problems
2 Weak - major problems
1 Unacceptable - serious problems
Choose N/A only if a criterion truly cannot be judged. Each criterion has a short Help line you can open.

What you see
Everyone answers the common part. English reviewers also answer the language part; aerospace reviewers the aerospace part, for their selected topics. The target CEFR level is shown at the top of every form.

Passage review
Common: suitability as the basis for reading-comprehension items; overall passage quality; recommendation (definitely include, include with minor revisions, include only after substantial revision, do not include); the most important problem.
Language: grammatical and lexical accuracy; coherence, clarity and readability; the CEFR level you judge the passage to be; whether its overall difficulty suits the target level.
Aerospace: accuracy of the technical information and freedom from fabricated content; aerospace terminology; relevance to aerospace engineering learners; a description of any technical error.

Item review
Common: the correct answer is supported by the passage and only one option is clearly best; overall item quality; recommendation (accept, accept with minor revision, revise substantially, reject); the most important problem.
Language: the stem and options are clear, unambiguous and grammatically compatible; the distractors are plausible; the item gives no clue to the answer; language and difficulty suit the target level; the skill mainly assessed.
Aerospace: terminology and technical content are accurate; the item can be answered from the passage without outside knowledge; a description of any technical error.

When a comment is required
- If you rate technical correctness 2 or lower, describe the technical error.
- If you recommend rejecting an item, or revising it substantially, describe the most important problem. The same applies to a passage you would include only after substantial revision, or not include.

When a review counts
A review counts when every required answer for your part is given and enough time was spent on it.

Reviewer titles
As your counted reviews grow you receive a title, with a short thank-you and a notification: 25 Cadet Reviewer, 50 Flight Reviewer, 100 Senior Reviewer, 150 Chief Reviewer, 250 Distinguished Reviewer. Your title shows on your dashboard and in Account Center. Titles are never compared between reviewers.