The information on optimal generation sites is used further to optimize system reliability assessed via reliability indices calculation.
Intergrader and intragrader reliability was assessed on a random sub-sample of 184 and 97 images, respectively, using quadratic weighted kappa kappa) and correlation analysis (R2).
Interrater reliability was assessed on a randomly selected set of 240 gestures (18 %) by a second coder who was trained and blind to the experimental design.
Test-retest reliability was assessed on 10 subjects.
Intra-rater reliability was assessed on two consecutive visits with a 2-day interval.
Inter-rater reliability was assessed on a sample of transcripts and found to be satisfactory.
Inter-coder reliability was assessed on a 5% sample of indexed data and revealed no substantial differences in the application of the thematic framework between researchers.
Internal consistency reliability was assessed on the full sample (N = 295) for each of the two sections using Cronbach's alpha.
Two trained graders independently applied the computer program and intergrader and intragrader reliability was assessed on a random sample of 50 images, with repeat grading performed after a 2-week interval.
