You are here

Evaluating Query Languages for a Corpus Processing System

TitleEvaluating Query Languages for a Corpus Processing System
Publication TypeConference Paper
Year of Publication2012
AuthorsFrick E, Schnober C, Bański P
Conference NameThe eighth international conference on Language Resources and Evaluation (LREC)
PublisherEuropean Language Resources Association (ELRA)
Conference LocationIstanbul, Turkey

This paper documents a pilot study conducted as part of the development of a new corpus processing system at the Institut für Deutsche Sprache in Mannheim and in the context of the ISO TC37 SC4/WG6 activity on the suggested work item proposal “Corpus Query Lingua Franca”. We describe the first phase of our research: the initial formulation of functionality criteria for query language evaluation and the results of the application of these criteria to three representatives of corpus query languages, namely COSMAS II, Poliqarp, and ANNIS QL. In contrast to previous works on query language evaluation that compare a range of existing query languages against a small number of queries, our approach analyses only three query languages against criteria derived from a suite of 300 use cases that cover diverse aspects of linguistic research.