高性能文本索引系统的设计与实现

In view of the traditional text index technology have problem such as too large space consumption and word segmention inaccurate, high performance text index was designed and implemented. The system uses compressed full-text self-index algorithm saves a lot of space of index, avoiding the influence of word segmentation method of natural language, and extends the search function with wildcard search algorithm. The system can realize multi-threaded parallel processing in the high performance processors with many-core CPU, improving the processing speed. Experimental results show that the system has high practical value, it can reduce space consumption of text index to about 50% of original text.