We achieved quick turnaround times by using clearly defined rubrics to score students' work; in some cases, homework and in-class work that served the purpose of practice were only scored qualitatively.
The high inter-rater reliability is attributed to the greater objectivity achieved through the use of the semi-structured interview format and the clearly defined scoring rubric created for each of the judgment vignettes.
The high inter-rater reliability is attributed to the greater objectivity achieved through the used of the semi-structured interview format and clearly defined scoring rubric created for each of the judgment vignettes.
Furthermore, even if the constructs are defined in rubrics, each rater interprets the constructs differently (MacIntyre, 2007).
She is the first American to win the award, which is open to any novelist writing about the nine countries defined in the rubric as south Asian.
The rubric defined categories of possible answers for each question and associated scores; answers that demonstrated greater comprehension of the concept or skill received higher scores.
Any student response that could not be classified according to correct reasoning as defined by the rubric was subject to discussion about whether the list should be amended.
Additionally, the research conducted has provided some interesting findings that suggest further actions to improve and better define future rubrics, oriented to communication or even other competences.
The Medical Judgment Vignettes are scored on a well-defined rubric based on Colby and Kohlberg's work on moral reasoning as functional stages of development [ 9].
Clearly defined criteria in the rubric also relates to improvement of instruction for it helps clarify instructional goals and serves as teaching targets (Arter & McTighe, 2001).
Of the 44 respondents who added comments about what assessments they would like to have available, eight indicated they wanted better student evaluation surveys; 11 indicated they would like to have surveys of GTA satisfaction, especially validated surveys; and 19 said they wanted to do GTA teaching observations, particularly using a rubric or defined protocol.
