HKUST Institutional Repository >
Computer Science and Engineering >
CSE Technical Reports >
Please use this identifier to cite or link to this item:
|Title: ||Document ranking on weight-partitioned signature files|
|Authors: ||Lee, Dik Lun|
|Issue Date: ||16-Dec-1994 |
|Series/Report no.: ||Computer Science Technical Report ; HKUST-CS94-39|
|Abstract: ||A signature file organization, called the weight-partitioned signature file, for supporting document ranking is proposed.
It employs multiple signature files, each of which corresponds to one term frequency, to represent terms with different term frequencies. Words with the same term frequency in a document are grouped together and hashed into the signature file corresponding to that term frequency. This eliminates the need to explicitly record the term frequency for each word.
We investigate the effect of false drops on retrieval effectiveness if they are not eliminated in the search process.
We have shown that false drops introduce insignificant degradation on precision and recall when the false drop probability is below a certain threshold. This is an important result since false drop elimination could become the bottleneck in systems using fast signature file search techniques.
We perform an analytical study on the performance of the weight-partitioned signature file under different search strategies and configurations. An optimal formula is obtained to determine for a fixed total storage overhead the storage to be allocated to each partition in order to minimize the effect of false drops on document ranks. Experiments were performed using two document collections to support the analytical results.|
|Appears in Collections:||CSE Technical Reports|
Files in This Item:
All items in this Repository are protected by copyright, with all rights reserved.