|Title||A Scalable Topic-Based Open Source Search Engine|
|Publication Type||Conference Paper|
|Year of Publication||2004|
|Authors||Buntine, W, Löfström, J, Perkiö, J, Perttu, S, Poroshin, V, Sil, T, Tirri, H, Tuominen, A, Tuulos, V|
|Conference Name||International conference on web intelligence, WI2004|
|Publisher||IEEE Computer Society|
|Conference Location||Beijing, China|
Site-based or topic-specific search engines work with mixed success because of the general difficulty of the information retrieval task, and the lack of good link information to allow authorities to be identified. We are advocating an open source approach to the problem because of its scope and need for software components. We have adopted a topic-based search engine because it represents the next generation of capability. This paper outlines our scalable system for site-based or topic-specific search, and demonstrates the developing system on a small 250,000 document collection of EU and UN web pages.