标题: A statistics-based approach to incrementally update inverted files
作者: Shieh, WY
Chung, CP
资讯工程学系
Department of Computer Science
关键字: information retrieval;inverted file;incremental update;statistical approach;spare space
公开日期: 1-三月-2005
摘要: Many information retrieval systems use the inverted file as indexing structure. The inverted file, however, requires inefficient reorganization when new documents are to be added to an existing collection. Most studies suggest dealing with this problem by sparing free space in an inverted file for incremental updates. In this paper, we propose a run-time statistics-based approach to allocate the spare space. This approach estimates the space requirements in an inverted file using only a little most recent statistical data on space usage and document update request rate. For best indexing speed and space efficiency, the amount of the spare space to be allocated is determined by adaptively balancing the trade-offs between reorganization reduction and space utilization. Experiment results show that the proposed space-sparing approach significantly avoids reorganization in updating an inverted file, and in the meantime, unused free space can be well controlled such that the file access speed is not affected. (C) 2003 Elsevier Ltd. All rights reserved.
URI: http://dx.doi.org/10.1016/j.ipm.2003.10.004
http://hdl.handle.net/11536/13941
ISSN: 0306-4573
DOI: 10.1016/j.ipm.2003.10.004
期刊: INFORMATION PROCESSING & MANAGEMENT
Volume: 41
Issue: 2
起始页: 275
结束页: 288
显示于类别:Articles


文件中的档案:

  1. 000225323100007.pdf

If it is a zip file, please download the file and unzip it, then open index.html in a browser to view the full text content.