You are here

KoGra-DB: Using MapReduce for Language Corpora.

TitleKoGra-DB: Using MapReduce for Language Corpora.
Publication TypeConference Paper
Year of Publication2013
AuthorsSchneider, R
EditorHorbach, M
Conference NameINFORMATIK 2013 -- Informatik angepasst an Mensch, Organisation und Umwelt
PublisherGesellschaft für Informatik
Conference LocationKoblenz
ISBN Number978-3-88579-614-5

Linguistic query systems are special purpose IR applications. We present a novel state-of-the-art approach for the efficient exploitation of very large linguistic corpora, combining the advantages of relational database management systems (RDBMS) with the functional MapReduce programming model. Our implementation uses the German DEREKO reference corpus with multi-layer linguistic annotations and several types of text-specific metadata, but the proposed strategy is language-independent and adaptable to large-scale multilingual corpora.