Title | Influence of Text Type and Text Length on Anaphoric Annotation |
Publication Type | Conference Paper |
Year of Publication | 2008 |
Authors | Goecke D, Stührenberg M, Witt A |
Conference Name | Language Resources and Evaluation (LREC) |
Conference Location | Marrakech, Morocco |
Abstract | We report the results of a study that investigates the agreement of anaphoric annotations. The study focuses on the influence of the factors text length and text type on a corpus of scientific articles and newspaper texts. In order to measure inter-annotator agreement we compare existing approaches and we propose to measure each step of the annotation process separately instead of measuring the resulting anaphoric relations only. A total amount of 3642 anaphoric relations has been annotated for a corpus of 53038 tokens (12327 markables). The results of the study show that text type has more influence on inter-annotator agreement than text length. Furthermore, the definition of well-defined annotation instructions and coder training is a crucial point in order to receive good annotation results. |
URL | http://www.lrec-conf.org/proceedings/lrec2008/pdf/368_paper.pdf |
- Log in or register to post comments
- Google Scholar