As expected, the self-agreement measures are higher than the inter-annotator agreement measures.
Table 7 A contingency table for the inter-annotator agreement, excluding self-agreement Leave Neutral Remain Total Leave 1174 11741174 Neutral 646 1607 – 2253 Remain 273 975 2132 3380 Total 2093 2582 2582 6807.
The annotation quality is shown as a contingency table of inter-annotator agreement in Table 7, and a contingency table of annotator self-agreement in Table 8.
Table 8 A contingency table for the annotators' self-agreement Leave Neutral Remain Total Leave 472 – – 472 Neutral 92 692 – 784 Remain 61 162 837 1060 Total 625 854 837 231625
During the annotation process, the annotator's performance was monitored in terms of the inter-annotator agreement and self-agreement, based on 20% of the tweets which were intentionally duplicated.
Consistent with Harris & Schaubroeck, we found a good agreement between expert and peer ratings which were higher than expert-self agreement.
We know that so-called "self-exclusion" agreements are not enforced and are mostly unenforceable.
Rational choice theorists explore self-enforcing agreements, the costs associated with them, and the circumstances in which they break down.
While 11 First Nations groups in the territory have signed self-government agreements – representing almost half of such agreements signed across the country – much work remains to get the agreements recognised and implemented, said Grand Chief Peter Johnston, of the Council of Yukon First Nations.
However, he said, Bennett is right only in a "naive, optimistic sense" — if modern treaties and self-government agreements were negotiated on a level playing field.
Only in Nova Scotia, BC and Quebec do some First Nations — those with specific education and/or self-government agreements — have the right to determine the language taught their children in public schools.
