Finally, we evaluated the accuracy of the entity extraction and the relation judgments, as well as the combined accuracy across the full pipeline.
The Turkers' relation judgments were evaluated both individually and in aggregate across each candidate according to a variety of aggregation strategies.
The GAF baseline score (T0) of this study was 37.6 indicating impaired reality testing and communication and impairment in work, family judgment or mood and or major impairment in several areas, such as work or school, family relations, judgment, thinking, or mood.
On this approach, judgments of daintiness, dumpiness, delicacy and elegance stand in a special and intimate relation to judgments of beauty and ugliness (or aesthetic merit and demerit), and it is only in virtue of this intimate relation that we can think of all these judgments as belonging to the same category.
Second, whatever the relation between judgments about what it is best to decide and decisions, it is unlikely that these judgments will deliver a satisfying account of control over decisions.
The relation between judgments of the moral quality of action and other so-called "factual" knowledge was also much debated.
By contrast again, the three kinds of relation of judgments are supposed by Kant to capture the three basic ways in which simple 1-place subject-predicate propositions can be either atomic (elementary) or molecular (compound) in respect of their truth-values.
The downstream representation of candidate relations for judgment by Turkers relied on identification of all mentions, to highlight them in context.
The two pragmatic criteria also showed a high level of accuracy in relation to judgments based on the original five criteria (84% agreement, 67% sensitivity, 93% specificity).
