The names used referred to the commonest cancer types in each rubric (for example, rubric C69-72 referred to eye cancer and other cancers of the central nervous system as well as brain cancer); rubric C73-75 referred to thyroid cancer and other endocrine cancers).
As the dynamic resources are filled with new data for each completed rubric pair, the speed of the process of interactively deciding the word alignments is continuously increasing.
Each rubric has several categories with multiple criteria to be assessed (see Figure 1 for a sample rubric).
For each question, the rubric specifies explicit grading criteria.
In addition to being provided with reading materials before the class began, teacher-participants were provided an essay rubric detailing the requirements to be met for each paper; from this rubric we created an essay scoring rubric aligned with those requirements.
Agreement for each of the rubrics used in this article was calculated.
For example, a rubric for a film commentary might include themes, acting, imagery, and content.
Again, these indicators became the attributes and dimensions (see next section) that were refined for each draft of the rubric.
Students were provided with the scoring rubric for each paper upon assignment.
We also calculated a difficulty score for each question, using a rubric that was developed by the course instructors (Table 3).
