Still, Mr. Mehsling said the new evaluation systems could result in more objective reviews.
Goodness knows we need more objective reviewing services of the vendor landscape.
Given the wide variability in article quality and format across multiple non-healthcare disciplines, we applied criteria that selected for more objective review-style work and for decision support relating to the high or moderately high-level decisions akin to those made by physicians.
The separation of scientific and fiscal merit at the NIH made the review process more objective, because reviewers were independent of the institute and their "evaluations were made independently of the program needs of the intramural scientists," Mandel says.
Although we used a set of criteria to arrive at an overall judgement to make our review more objective and systematic, quality judgement scores should always be interpreted with caution, because the use of some criteria inevitably involves a subjective element derived from the reviewer's expertise.
Systematic reviews allow for a more objective appraisal than traditional narrative reviews [ 57], which are often biased in their selection of studies and thus may be unreliable in their recommendations of interventions [ 58].
Computer-based clinical psychometric behavioural tests, which subjectively assess aspects of impulsive choice or impulsive action, provide a more objective measure of impulsivity (reviewed by Chamberlain and Sahakian, 2007; Kertzman et al., 2006).
Although systematic reviews with meta-analyses are considered more objective than other types of reviews, our results suggest that the interpretation of the data remains a highly subjective process even among reviewers with extensive experience conducting meta-analyses.
Using a stricter search strategy, a more objective outcome evaluation and a rigorous review method, we expect that our systematic review will provide a more convincing conclusion.
Moreover, systematic reviews permit a more objective appraisal of evidence than is allowed by the traditional narrative-style reviews that are more commonly associated with animal research [ 21].
