Consistent with Harris & Schaubroeck, we found a good agreement between expert and peer ratings which were higher than expert-self agreement.
As expected, the self-agreement measures are higher than the inter-annotator agreement measures.
The annotation quality is shown as a contingency table of inter-annotator agreement in Table 7, and a contingency table of annotator self-agreement in Table 8.
Table 7 A contingency table for the inter-annotator agreement, excluding self-agreement Leave Neutral Remain Total Leave 1174 11741174 Neutral 646 1607 – 2253 Remain 273 975 2132 3380 Total 2093 2582 2582 6807.
Table 8 A contingency table for the annotators' self-agreement Leave Neutral Remain Total Leave 472 – – 472 Neutral 92 692 – 784 Remain 61 162 837 1060 Total 625 854 837 231625
During the annotation process, the annotator's performance was monitored in terms of the inter-annotator agreement and self-agreement, based on 20% of the tweets which were intentionally duplicated.
Three subscales of the SSMIS measure self-stigma: stereotype agreement, stereotype self-concurrence and self-esteem decrement [ 27].
The self-billing agreement shall renew thereafter for further periods of 12 months on receipt of successive self-billing invoices from GNM. 8.
Since the 2009 self-rule agreement, Greenland has chased the resulting opportunities.
Under the new self-government agreement, Greenland will get half of any proceeds from oil or minerals.
It was a self-enforceable agreement that anyone could follow and see whether we were abiding by it.
