Kappa statistic measured agreement on tool components assessed by the neurologist and non-physician healthcare workers.
The Family Caregivers Support Agreement (FCSA) tool was used to document the support needs of caregivers.
The Kappa-coefficient was 0.63 what indicates substantial inter-rater agreement and tool's reliability [ 28].
The Family Caregivers Support Agreement (FCSA) tool, based on a partnership approach between caregiver and assessor, was used to collect data in the course of a semi-structured interview, combined with open-ended questions.
Comparing the agreement between tools with the same technique with different thresholds and the agreement between tools with different detection techniques, we observed that the latter is lower, but not significantly.
Section 4.3 analyzes the agreement among tools.
The overall agreement among tools varies from 83 to 98% considering all smells in both systems.
We investigate recall, precision, and agreement of tools in detecting three code smells: God Class, God Method, and Feature Envy.
In general, in both systems, there was a higher average of agreement between tools that implemented the same detection technique.
The low standard deviation supports the fact that the agreement between tools remains high across versions of both systems.
