In this context, evaluation rubrics are among some of the most useful tools to obtain evidence on competency acquisition.
Because of differences in the complexity of the assessment questions (some of which were multipart), the total number of concepts in the coding rubric varied widely among questions, ranging from seven (the nature of matter) to 26 (community dynamics).
The list includes avoiding selection bias, deciding whether to analyze a given event in terms of frequency or magnitude, describing probabilistic effects using a "fraction of attributable risk" or a "risk ratio" rubric, and quantifying uncertainty, among others.
In the past eight years, the smart-cities rubric has become fashionable among global urban planners, who want to use digital technology and big data to create surveillance-heavy intelligent systems that control how people live, consume energy, go to work, and stay healthy and safe.
Our hope is that our rubric will help in distinguishing among these, and other, examples.
Rather than trying to break expressions into their constituent parts, as Ekman had, the center was interested in natural, easily understood portrayals; under the rubric of "thinking," it distinguished among brooding, choosing, fantasizing, judging, thoughtfulness.
Rubric practice sessions could be done among teachers and through the practice session a document that describes each criterion can be produced (Andrade, 2005).
Applied physics, biophysics, astrophysics, plasma physics, and mathematical physics (among others) are fields in which this primary rubric should be used.
After comparing and discussing the results among raters, we refined the rubric, obtaining an overall 88% agreement.
This rubric should reflect the nature of understanding among the students who have created them, and also be valid and reliable.
