The mean interrater reliability coefficient between the two independent judges was found to be Kappa = 0.95 across the three Medical Judgment Vignettes.
Reliability requirements are higher with individualized use because confidence intervals of the scores are based on the Standard Error of the Mean (SEM), and reliability coefficients <0.9 provide too wide intervals for individual monitoring [ 2].
The subscales have a mean internal consistency reliability coefficient of 0.71, mean test retest reliability co-efficient over 6 months of 0.62, and strong criterion validity for predicting psychological disorders [ 49].
The larger the sampling errors of a study and thus the smaller its sample size, the more the mean value across all reliability coefficients is a true estimate of the reliability of the particular study.
The SDQ subscales have a mean internal consistency reliability coefficient of 0.71, a mean test-retest reliability coefficient over six months of 0.62 and demonstrate good criterion validity for predicting psychological disorders [ 35].
Reliability coefficients, means, and SDs for the EORTC QLQ-H&N35 are listed in Table 3.
The means, standard deviations, and reliability coefficients (Cronbach's coefficient α) of the patient reported outcomes are shown in Table 1.
The following research questions are addressed: (1) What is the mean internal consistency reliability (coefficient Alpha) of PSDQ scores across studies to date? (2) Which factors influence the reliability estimates?
First, means, standard deviations, correlations, and reliability coefficients were calculated (see Table 1).
Tables 1 and 2 show the reliability coefficients and standardised response mean for each study and instrument.
