Respondents were asked to rate each QI adopting the RAND Appropriateness Methodology (scales 1 9, 1=extremely inappropriate; 9=extremely appropriate), according to the selection criteria of relevance, scientific soundness (validity, reliability, comparability) and feasibility (precise definition and specification, data feasibility, reliability of data collection).
Therefore, we were not able determine the extent to which the specified data elements were actually being collected or the completeness or reliability of data collection.
To ensure the reliability of data collection through hours of recordings, AgCl electrodes were attached to participants' scalp using an adhesive paste (EC2, Natus Neurology Inc., Middleton, WI, USA).
Studies were evaluated in terms of: (a) participants, (b) setting, (c) communication options assessed, (d) design, (e) communication skill(s) taught to the participant, (f) intervention procedures, (g) outcomes of the intervention and outcome of the preference assessment, (h) follow-up and generalization, and (i) reliability of data collection and treatment integrity.
To achieve reliability in data collection, data were triangulated by interviewing various members of the ecosystem.
Inter-coder reliability in data collection among the doctors was checked.
Thus, overall reliability of data collection was good.
The main weakness identified by the DoCDat criteria is in the reliability of data collection.
There was good or some attempt to establish the : F: Reliability of data collection tools.
To guarantee reliability of data collection, the coding scheme was pilot-tested by two independent researchers.
