Shannon信息度量的统一理论

It is pointed out that the inconsistency on the information measure natures of Shannon continuous and discrete information entropies is a fundamental problem of classical information theory, and the primary cause for this problem lies in that, when defining the continuous information entropy based on continuous probability fields and Shannon information axiom, people can not form a uniform information measure due to the existence of divergence or information singularity. To solve this problem, this article will improve the definitions of probability fields and information entropies based on the quantized mathematical theory, which can eliminate the information singularity and achieve the consistency of continuous and discrete information entropies on the natures of information measure, and thus form a unified theory of Shannon's information measure.