Seven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology.
A total of 239 instances of usability issues, including multiple instances of the same problem, were recorded: 65 (27%) in navigation, 145 (61%) in content comprehension and completeness, 25 (10%) in socio-cultural appropriateness, and 4 (2%) in proxy user problems (Table 3).
When connecting these terms to the forms of equivalence between original and translated instruments as mentioned earlier by Flaherty et al. [ 15], comprehensibility relates to semantic equivalence, acceptability to technical equivalence, relevance to content equivalence, and completeness to semantic, criterion or conceptual equivalence [ 13].
Similarly, we didn't collected data about the contents, and the completeness, of staff training.
Concurrently, site validity is being explored for content completeness (content validity) and interaction with the resources for gaining knowledge and making clinical decisions (construct validity).
Therefore, this aspect was labeled with zero points for a "poor" answer, three for a "satisfactory" and six for a "good" answer, whereas in contrast, the other two aspects of content quality (completeness and openness) were scored with zero, one and two points for a "poor", "satisfactory" or "good" answer, respectively.
Content validity assessment involves patient and clinician evaluation of the importance and completeness of the content contained in the measures, usually obtained through qualitative research [ 18, 19].
This is critical for giving the user an understanding of the coverage and completeness of the content provided, and the security that all relevant contents for his/her problem are at one comprehensible place.
Furthermore persons who recalled the earlier field tests with the original HRA-E instrument confirmed that updates had resulted in improvement related to ease of administration and completeness of contents.
Although some researchers may have little experience with this technique and it seems to be infrequently reported, Cognitive Interviewing has been recommended by the Food and Drug Administration FDAas as part of the development of Patient Reported Outcome (PRO) measures as it is key in ensuring understanding and completeness of conceptual content of questions [ 18].
