However, the pair-wise comparison is subjective and the quality of the results is dependent on the expert's judgement.
While our methodology still requires the domain expert's judgement, it partially automates the validation process by generating a set of yes/no questions from the model.
To test the reliability of the process, the first expert's judgement on a case was systematically submitted to the second expert, to check for consensus in the scoring.
Similarly, in the free clinics established by the Party, patients were encouraged to challenge the medical expert's judgements based on the patient's illness experience.
Based on expert's opinion and author's judgement, 11 water quality (pollutant) variables (Alkalinity, Dissolved Solids (DS), Hardness, pH, Ca, Mg, Fe, Fluoride, As, Sulphate, Nitrates) are selected for the quality assessment.
This decision is based mainly on the intensivist's expert judgement as well as his awareness of current ICU bed availability.
He was supported throughout by Domenico Scala, the independent head of Fifa's audit and compliance committee, who talked through a report in which he outlined how two legal experts had reconfirmed Eckert's judgement that there should be no revote for the 2018 and 2022 tournaments.
Reliance on expert clinical judgement is all very well, but unless it is operationalised, the research can't be replicated.
Methodologies utilised in the project included questionnaire, expert panel judgement, group interview, automated textual analysis and analysis of rater reliability.
As with first-line antibiotics, it is important that agreed local policies are followed, along with expert clinical judgement.
Experts have recommended that metrics should "supplement, not supplant, expert judgement" (Hicks et al., 2015; Wilsdon et al., 2015).
