You are here

A Scalable Topic-Based Open Source Search Engine

TitleA Scalable Topic-Based Open Source Search Engine
Publication TypeConference Paper
Year of Publication2004
AuthorsBuntine W, Löfström J, Perkiö J, Perttu S, Poroshin V, Sil T, Tirri H, Tuominen A, Tuulos V
Conference NameInternational conference on web intelligence, WI2004
PublisherIEEE Computer Society
Conference LocationBeijing, China
Keywordssearch engine

Site-based or topic-specific search engines work with mixed success because of the general difficulty of the information retrieval task, and the lack of good link information to allow authorities to be identified. We are advocating an open source approach to the problem because of its scope and need for software components. We have adopted a topic-based search engine because it represents the next generation of capability. This paper outlines our scalable system for site-based or topic-specific search, and demonstrates the developing system on a small 250,000 document collection of EU and UN web pages.