Sentence examples for reliability of marking from inspiring English sources

The Ofqual survey found that while there was wide support for GCSEs and A-levels as trusted qualifications and as preparation for further study, many of those surveyed had reservations about the reliability of marking, the number of changes and the curtailing of assessment within exams.

Inter-rater reliability of marking involving GP tutors who only marked 1 – 3 portfolios was very low.

Two raters independently scored the first test occasion (n = 24) to evaluate the inter-rater reliability of the marking guidelines.

Despite the mentoring they provided being highly rated by students the very low inter-rater reliability of their marking suggests that the GP teachers did not share a clear understanding of the aims of the portfolio as a support for learning and an assessment tool with the other raters.

When the K-REC instrument with the above alternate clinical scenario was completed by a sample of entry-level physiotherapy students (n = 15), the inter-rater reliability of the marking guidelines remained high (2 raters, item 1: 93% agreement, items 2-6 and 8-9: 100%, item 7: ICC 0.97, and total scores: ICC 0.97).

Warren et al. [ 28] and Whittle and Levine [ 29] tested intrarater reliability however the marking of the anatomical landmarks was only undertaken once before repeated measurements were taken, without allowing for removal and replacement of the markers between repeated measurements.

Z Division worked on improving the mechanical and electrical reliability of the Mark 3 Fat Man bomb, but this work was disrupted by the Crossroads tests.

Lastly, the different methods of assessments were often used with no discussion about their validity and reliability, and marking schemes were inconsistent across the different studies.

For all four courses the comparative judgment method showed higher levels of reliability than analytical marking, but the comparative judgement scores and rankings were typically moderately to highly correlated with the scores from traditional analytical marking (Newhouse, 2011).

Portfolio assessment achieved moderate levels of inter-rater reliability when marked by teachers who marked large numbers (< 20) of portfolios.

Benefits of automated marking, and potentially high reliability at low cost make MCQs a viable option when writing high stakes assessments in clinical medicine.