中文信息處理中的信息壓縮

Chinese text Compression using Chinese Language Information Processing

在傳送大規模真實中文信息中，特別是在個人通信系統中，準確高效的信息壓縮分法是極為必要的。一個好的信息壓縮方法，可以節約大量的傳輸時間和存儲空間。信息壓縮有兩種基本途徑，第一種是，去處寓于信源的相關性之中冗餘度，另一種是，去處寓于概率的非等分布之中冗餘度，改變信源的概率分布，以期盡可能達到等概率分布的目的。本文提出了一種全新的信息壓縮方法，這種方法在理論中充分利用了信源的相關性，同時又根據中文信息處理中對詞的界定，把握了其不等概分布特性，運用最優雖搜索方法，把信源相關性與信源的不等概分布有機地結合起來，從而達到了高效壓縮信息的目的，在文中，列舉了實例結果。

To transport the large scale authentic Chinese text, especially in the personal telecommunication system, it is necessary to establish a highly efficient coding method. A good coding system can reduce transportation time. There are two basic ways to compress information. One way is to get rid of the perplexity is in the relativity of information source. The other is to remove the perplexity of not equal probabilistic distribution. In this paper, a novel information compressing method is presented. It utilizes the relativity of the information source and catchs the information of different probabilistic distribution according to the definition of Chinese words. The relativity and not equal probabilistic distribution are connected by a optimum searching method. The aim of high compressing ratio is reached. And. Some experimental results are also covered.