|
|
|
|
|
A Two-Tier Distributed Full-Text Indexing System |
|
PP: 321-326 |
|
Author(s) |
|
Wei-Zhe Zhang,
Hui-Xiang Chen,
Hui He,
Gui Chen,
|
|
Abstract |
|
The performance of indexing systems is very important for a search engine. Usually, indexing systems on large-scale clusters
can provide high search efficiency, but it brings expensive hardware costs. The costs would be greatly reduced if a distributed indexing
system runs on small-scale clusters connected by the Internet. Two current inverted file partitioning schemes: document partitioning and
term partitioning, have their merits individually. A two-tier distributed full-text indexing system is implemented, which uses document
partitioning among the clusters and term partitioning inside each cluster. Our experiments show that the system performs well in search
efficiency, resource consuming and load balance. |
|
|
|
|
|