高级搜索

信息论的历程：从经典到现代

, 

downloadPDF

上一篇

下一篇

牛凯, 张平. 2026: 信息论的历程：从经典到现代, 物理, 55(6): 387-399. doi: 10.7693/wl20260603
引用本文: 牛凯, 张平. 2026: 信息论的历程：从经典到现代, 物理, 55(6): 387-399. doi: 10.7693/wl20260603
shu
NIU Kai, ZHANG Ping. 2026: The evolution of information theory： from classical to modern, Physics, 55(6): 387-399. doi: 10.7693/wl20260603
Citation: NIU Kai, ZHANG Ping. 2026: The evolution of information theory： from classical to modern, Physics, 55(6): 387-399. doi: 10.7693/wl20260603
shu

信息论的历程：从经典到现代

  • 1 北京邮电大学 泛网无线通信教育部重点实验室 北京 100876;

  • 2 北京邮电大学 网络与交换技术全国重点实验室 北京 100876

    • 通讯作者: 牛凯,email:niukai@bupt.edu.cn; 

The evolution of information theory： from classical to modern

  • 1 The Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China;

  • 2 The State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China

    • Corresponding author: NIU Kai, niukai@bupt.edu.cn ; 

  • 摘要:

    文章系统梳理了信息论从经典到现代的演进历程，强调其科学内涵与全局意义。首先回顾香农创立的经典信息论，阐述其以概率论为基础的语法信息度量体系，包括信息熵、互信息、信道容量与率失真函数，以及三大编码定理。这一理论定理奠定了现代通信的理论基础。之后进一步探讨信息论与物理学(如热力学、量子力学)的深刻联系，揭示信息作为描述世界基本属性的潜力。在此基础上，介绍语义信息论的创新框架，提出“同义映射”作为沟通语法与语义的桥梁，构建语义熵、语义互信息、语义信道容量与语义率失真函数等新度量体系，并介绍三大语义编码定理，展示语义通信在扩展经典极限、实现高效“达意”传输方面的理论优势。最后展望语义信息论与人工智能、任务导向通信等前沿领域的融合，旨在推动构建智能、高效、可理解的未来信息网络。全文从科学发展的脉络出发，展现了信息论在不断深化对信息本质的理解，并持续拓展其理论边界与应用广度。

    Abstract: A review is presented of the evolution of information theory from its classical foundations to modern developments, with emphasis on its scientific content and global significance. We begin by reviewing Shannon’s classical information theory, elucidating its probabilistic framework for syntactic information measurement, including key concepts such as entropy, mutual information, channel capacity, and rate-distortion functions, along with the three fundamental coding theorems that underpin modern communication systems. The deep connections between information theory and physics—particularly thermodynamics and quantum mechanics—are explored, from which information is revealed as a fundamental descriptor of the physical world. Based on this, we introduce an innovative framework for semantic information theory, proposing“synonymous mapping”as a bridge between syntax and semantics. A new measurement system is constructed, featuring the entropy, mutual information, channel capacity, and rate-distortion functions of semantics. The three semantic coding theorems are demonstrated, showcasing how semantic communication can transcend classical limits to achieve more efficient meaning-oriented transmission. Finally, the paper discusses the integration of semantic information theory with cutting-edge fields such as artificial intelligence and task-oriented communications, paving the way for intelligent, efficient, and interpretable future information networks. From the trajectory of scientific development it is shown how information theory deepens our understanding of the nature of information, and also continuously expands the boundaries of theory and applications.
  • 加载中
  • Wiener N. Cybernetics or Control and Communication in the Animal and the Machine. New York:John Wiley & Sons, 1948
    Wheeler J A. Information, Physics, Quantum:The Search for Links. In:Zurek W (Ed.). Complexity, Entropy, and the Physics of Information. Redwood City, CA:Addison-Wesley, 1990. pp. 3—28
    Shannon C E. The Bell System Technical Journal, 1948, 27(4): 379；623
    Shannon C E, Weaver W. The Mathematical Theory of Communication. Urbana:The University of Illinois Press, 1949
    Hartley R V L. The Bell System Technical Journal, 1928, 7(3):535
    Clausius R. Annalen der Physik, 1865, 125(7):353
    Maxwell J C. Theory of Heat (1st ed.). London:Longmans, Green, and Co., 1871
    Gibbs J W. Elementary Principles in Statistical Mechanics, Developed with Special Reference to the Rational Foundation of Thermodynamics. New York:Charles Scribner’s Sons, 1902
    Jaynes E T. Phys. Rev., 1957, 106(4):620
    Jaynes E T. Phys. Rev., 1957, 108(2):171
    von Neumann J. Mathematical Foundations of Quantum Mechanics. Princeton:Princeton University Press, 1955
    Landauer R. IBM Journal of Research and Development, 1961, 5(3):183
    Bekenstein J D. Phys. Rev. D, 1973, 7(8):2333
    Hawking S W. Commun. Math. Phys., 1975, 43(3):199
    Niu K, Zhang P. Journal of Communications, 2024, 45:7
    Niu K, Zhang P. The Mathematical Theory of Semantic Communication. Springer-Nature press, 2025
    牛凯. 语义信息论. 北京:科学出版社, 2025
  • 加载中
计量
  • 文章访问数:  425
  • HTML全文浏览数:  425
  • PDF下载数:  17
  • 施引文献:  0
出版历程
  • 收稿日期:  2026-03-29

信息论的历程：从经典到现代

    通讯作者: 牛凯,email:niukai@bupt.edu.cn; 
  • 1 北京邮电大学 泛网无线通信教育部重点实验室 北京 100876;
  • 2 北京邮电大学 网络与交换技术全国重点实验室 北京 100876
  • 收稿日期:  2026-03-29

摘要: 

文章系统梳理了信息论从经典到现代的演进历程，强调其科学内涵与全局意义。首先回顾香农创立的经典信息论，阐述其以概率论为基础的语法信息度量体系，包括信息熵、互信息、信道容量与率失真函数，以及三大编码定理。这一理论定理奠定了现代通信的理论基础。之后进一步探讨信息论与物理学(如热力学、量子力学)的深刻联系，揭示信息作为描述世界基本属性的潜力。在此基础上，介绍语义信息论的创新框架，提出“同义映射”作为沟通语法与语义的桥梁，构建语义熵、语义互信息、语义信道容量与语义率失真函数等新度量体系，并介绍三大语义编码定理，展示语义通信在扩展经典极限、实现高效“达意”传输方面的理论优势。最后展望语义信息论与人工智能、任务导向通信等前沿领域的融合，旨在推动构建智能、高效、可理解的未来信息网络。全文从科学发展的脉络出发，展现了信息论在不断深化对信息本质的理解，并持续拓展其理论边界与应用广度。

English Abstract

    全文HTML

参考文献 (17)

目录

/

返回文章
返回