In order to ensure coding accuracy for data elements abstracted from the narrative records, two coders coded a random selection of 100 cases, and Kappa coefficients were calculated to ensure reliability in coding between raters.
Acceptable percentages of agreement (96% ≤ POA ≤ 100%) and, in one case, an acceptable kappa coefficient (κ = 0.91) were reported for dynamic squatting [ 12, 26].
The level of agreement among professionals will be assessed after training on simulated cases through Cohen's kappa coefficient.
For agreement on whether an individual was a case or not the kappa coefficient was 0.92, for the diagnostic group 0.90, for the precise diagnosis 0.72, for severity of the case 0.59 and for treatment needed 0.49.
For each question, we report the percentage of agreement between the two teams, calculated as the number of cases with the same response divided by the total number of cases, and the corresponding Cohen's Kappa coefficient [ 35].
We noted that, for the Kappa coefficient, in some cases, the agreement value is high and the coefficient is low.
Additionally, we determined the intra- and interobserver agreement for the estimation of the tumor-desmoplasia-necrosis distribution with a test of reproducibility by calculating the Spearman's rank correlation coefficient (r) and with a test of reliability by evaluating the weighted kappa coefficient in 22 cases.
The overall Kappa coefficient was қ = 0.88 (141 of 185 cases applicable; Table 2).
In cases of dissociative disorders, personality disorders, and drug abuse, the Cohen Kappa coefficient was about 0.45.
The kappa coefficient was also calculated, giving values larger than 0.80 and in some cases equal to 1.00.
