Sentence examples for random raters from inspiring English sources

We calculated dependability coefficients for test situations in which random raters are used (equation  2) and for a situation using a fixed rater pair (equation  4).

In contrast, if TTE global rating scores were used, the physicians would have to scan at least 4 cases, each to be rated independently by three random raters for comparable results (Table  3).

It was found all three approaches outperformed the random rater significantly (p < 0.01).

Four random cases rated by one random rater resulted in a phi value of 0.81 for global ratings and two random cases rated by one random rater showed a phi value of 0.92 for checklist scores.

The model had the following structure: 1) the GWB scores were used as the dependent variable; 2) the eight CEP components were used as independent variables; 3) to correct for clustering within raters, a random (rater dependent) intercept was included; and 4) the factor age was included in the model together with the interaction terms with each of the CEP components (eg, age × morbidities).

As seen in Table  3, physicians would have to scan 2 different patients/cases with one random rater judging each situation using the TTE total checklist scores, for the test to reach dependability coefficients suitable for a high stakes test situation (Φ > 0.90) [ 13].

aR, right; L, left; IQR, interquartile range; CI, confidence interval; MRC, Medical Research Council; bweighted kappa treating strength scale as ordinal linear weights; ctwo-way random effects model (raters and participants treated as random effects) intraclass correlation coefficient treating strength scale as continuous.

Table 5 Intra-rater (test retest) reliability and inter-rater reliability (measured by intraclass correlation coefficient — ICC) for posterior tibial cortex (PTC) and tibial proximal anatomical axis (TPAA) methods obtained by repeated measurements in 50 random radiographs   PTC TPAA Intra-rater (rater 1) 0.67 0.79 Intra-rater (rater 2) 0.89 0.93 Inter-rater (among 3 raters) 0.81 0.81.

Regular random tests of inter-rater reliability were conducted between the raters by independent ratings of 2 raters for 15 assessments.

Bechger et al. (2010) suggest a practical way to avoid halo effects by assigning "raters at random to combinations of examinees and assignments" (Bechger et al. 2010, pp. 616 617).

The students were distributed between the two raters in random order.