|Title||Inﬂuence of Text Type and Text Length on Anaphoric Annotation|
|Publication Type||Conference Paper|
|Year of Publication||2008|
|Authors||Goecke, D, Stührenberg, M, Witt, A|
|Conference Name||Language Resources and Evaluation (LREC)|
|Conference Location||Marrakech, Morocco|
We report the results of a study that investigates the agreement of anaphoric annotations. The study focuses on the inﬂuence of the factors text length and text type on a corpus of scientiﬁc articles and newspaper texts. In order to measure inter-annotator agreement we compare existing approaches and we propose to measure each step of the annotation process separately instead of measuring the resulting anaphoric relations only. A total amount of 3642 anaphoric relations has been annotated for a corpus of 53038 tokens (12327 markables). The results of the study show that text type has more inﬂuence on inter-annotator agreement than text length. Furthermore, the deﬁnition of well-deﬁned annotation instructions and coder training is a crucial point in order to receive good annotation results.