This study examines the effect that reducing input data requirements of the ARM has on the accuracy of the methodology and comments on the trade-off between model simplification and accuracy.
AJA conducted search, extracted data, did analysis and wrote first draft of paper CR advised on methodology and commented on drafts CC commented on drafts and helped in writing of paper VF helped design study and commented on paper.
For BMJ we had access to the critiques of reviewers and editors but not the original submission and tallied the percentage of words devoted to comments about methodology and to comments specifically about the reporting of results.
There is also information available for each indicator which provides the relevant definition, methodology and additional comments.
A number of aspects of the current methodology and results merit comment.
If you choose to look at rankings, find one that uses more than four data points, is transparent about its methodology and ensures that universities are able to review and comment on methodology and correct data errors.
They were then given a summary of a proposed trial methodology and asked again to comment.
Substandard features were absent in 1,333 888%) ratings; the methodology and statistical review had commented on 132 (10%) of these.
Substandard features were deemed present in 166 (12%) of 1,519 ratings; the methodology and statistical review had commented on 82 (44%) of these.
State-of-the-art features were present in 31 (14%) of 217 ratings; the methodology and statistical review had commented on 13 (42%) of these.
