Generally the items with poor inter-rater agreement were those that required substantial judgment about the potential for the study methods to yield biased results.
As a result, the suit can proceed, perhaps costing the bank — and Mr. Ritter and two other former senior executives — substantial judgments.
"This is somewhat remarkable in my judgment," said Benjamin Brafman, who represented a family that sued the city after a relative died in the 2003 Staten Island Ferry crash, "because the admissions by the city suggest that it recognizes their responsibility, and could well expose the city to substantial judgments that may not even have to be litigated, given the breadth of these admissions".
This failure meant such claimants were placed at a substantial disadvantage, the judgment concluded.
Five minutes are, of course, not enough for a substantial and informed judgment, but they're enough to stoke desire or to inhibit it.
The correlation patterns were consistent with our hypotheses and there was a substantial agreement in judgments between the family physicians in the initial and the validation study.
But for a person infected in 2009 to die of AIDS in the future would probably require a substantial amount of bad judgment or bad luck: the medications, if properly prescribed and properly taken, appear almost infallible.
The rules in effect tell reporters to avoid circumstances that we know from experience create a substantial risk that professional judgment may be unduly influenced by improper considerations like financial gain.
Although taking into account a variety of scientific and social impact factors can only strengthen and further inform the research evaluation process, the more traditional research value of publishing still appears to play a substantial role in peer judgments about researchers' policy influence.
