MS004203-信息论与编码

研究生课程开设申请表

开课院（系、所）：信息科学与工程学院

课程申请开设类型： 新开□     重开√   更名□（请在□内打勾，下同）

一、课程介绍（含教学目标、教学要求等）（300字以内）

 本课程为“信息与通信工程”一级学科硕士研究生而开设，是“通信与信息系统”二级学科硕士研究生的专业基础课，计划学时54学时，3学分。

 本课程教学方式以讲课为主，通过习题作业、讨论、课程论文、期终考试等环节，要求学生掌握信息的度量方法、Shannon的三个定理、Shannon公式、信源编码和信道编码基本理论和常用的方法等基础知识。

二、教学大纲（含章节目录）：（可附页）

 本课程内容如下。

1.  信息科学及其发展

   1.  通信系统的基本概念

   2.  信息科学的基本概念

   3.  信息理论的研究内容

   4. Shannon信息论梗概

   5.  本课程的主要内容及要求

 思考题

2.  信息的度量

   1.  度量信息的基本思路

   2.  信息量和熵

   3.  互信息量和平均互信息量

   4.  本章小结

 习题

3.  离散信源

   1.  离散信源的分类及其描述

   2.  离散信源的熵

   3.  信源的冗余度

   4.  信源符号序列分组定理

   5.  平稳离散信源及其性质

   6.  本章小结

 习题

4.  离散信源的编码

   1.  信源编码的目的和模型

   2.  信息传输速率和编码效率

   3.  单义可译定理

   4.  无失真信源编码定理（Shannon第一定理）

   5.  几种常用的信源编码

   6.  汉字编码方案及其讨论

   7.  图象消息的编码

   8.  误码对信源译码的影响

   9.  本章小结

 习题

5.  离散信道及信道编码

   1.  信道的分类及其描述

   2.  信道容量

   3.  有扰离散信道的传输特性

   4.  译码准则

   5.  有扰离散信道的信道编码定理（Shannon第二定理）

   6.  信道编码定理的应用举例

   7.  本章小结

 习题

6.  连续消息和连续信道

   1.  连续消息的信息度量

   2.  连续消息在信道上的传输问题

   3. Shannon信道容量公式的含义及其应用

   4.  连续消息的识别和理想接收机

   5.  连续信源的数字处理及其编码

   6.  本章小结

 习题

7.  网络信息理论初步

   1.  多址信道及其传输特性

   2.  广播信道及其传输特性

   3.  本章小结

 习题

8.  信息率失真理论及其应用

   1.  对失真的描述

   2.  信息率失真函数

   3.  几种信源的信息率失真函数的计算

   4.  保真度准则下的信源编码定理（Shannon第三定理）

   5.  信息率失真理论的应用举例与信息价值

   6.  本章小结

 习题

9.  差错控制的基本概念

   1.  差错控制系统及其理论基础

   2.  纠错编码的基本概念及其本质

   3.  纠错编码方法的性能评价

   4.  本章小结

 习题

10.  线性分组码

    1.  近世代数的一些基础知识

    2.  线性分组码的编码

    3.  线性分组码的译码

    4.  线性分组码举例

    5.  本章小结

 习题

11.   循环码

    1.  循环码的描述

    2.  循环码的编码和译码

    3.  二元BCH码

    4.  多元BCH码和RS码

    5.  其它循环码

    6.  本章小结

 习题

12.   纠突发错误码

    1.  纠突发错误码的定义及其基本性质

    2.  常用纠错码纠突发错误的能力及译码方法

    3.  法尔码

    4.  交错码

    5.  纠突发和随机错误码

    6.  本章小结

 习题

13.   卷积码

    1.  卷积码的描述及其编码

    2.  卷积码的最大似然译码

    3.  卷积码的序列译码

    4.  多进制卷积码

    5.  恶性卷积码及译码的错误扩展

    6.  卷积码的性能分析及好码的概念

    7.  本章小结

 习题

14.   保密通信的理论基础

    1.  保密通信的技术体制及数学模型

    2.  传输线路保密技术的信息论基础

    3.  信息保密技术的基础知识

    4.  几种密码体制的介绍

    5.  本章小结

 习题

15.   信息理论的广泛应用

    1.  多媒体通信中的信源编码与信道编码

    2.  计算机通信网中的信源编码与信道编码

    3.  移动通信系统中的信源编码与信道编码

    4.  信息理论在其它学科的应用简介

    5.  本章小结

 思考题

三、教学周历

四、主讲教师简介：

沈连丰：1952年7月出生，男，1979～1982在南京工学院（现为东南大学）无线电通信专业攻读研究生，获硕士学位，毕业后留校任教至今。现任东南大学移动通信国家重点实验室教授、博士生导师，从事专业为通信与信息系统，研究方向有移动通信网络理论与技术、短距离无线通信和泛在网络、信息理论与编码等。1991～1993在香港生产力促进局做访问学者，1998～1999任香港通信科技中心高级顾问，1994～2008年多次在香港中文大学合作研究和讲学。作为项目负责人先后承担国家自然科学基金、国家科技攻关、国家863计划、国家973计划子课题、教育部和江苏省以及海外合作等项目数十项；已获授权发明专利12项；近年获教育部科技进步一等奖1项，江苏省科技进步一等奖1项、二等奖1项、三等奖2项，南京市科技进步二等奖1项，均为第一获奖人；获江苏省高等教育教学成果二等奖1项，为第二获奖人；近5年本人以及和学生、同事共同在学术刊物和国内国际学术会议上发表论文100多篇，其中SCI/EI收录80多篇；已出版专著和教材8部；2004年被授予“东南大学突出贡献科技工作者”称号，2006年被评为“信息产业科技创新先进工作者”（信息产业部），2007年获第二届“江苏创新创业人才奖”（中共江苏省委、江苏省人民政府）。

五、任课教师信息（包括主讲教师）：

Application Form For Opening Graduate Courses

School (Department/Institute): School of Information Science and Engineering

Course Type: New Open □   Reopen     Rename □（Please tick in □, the same below）

1. Course Introduction (including teaching goals and requirements) within 300 words:

Information Theory and Codingis a technology fundamental course for the master students of discipline of Information and Communication Engineering, especially Communication and Information System. The students will learn and grasp the methods of information measurement, Shannon’s three theories and Shannon Formula, fundamental theories and methods of Source Coding, Channel Coding and Encryption by attending the lecture, homework, discussion, course paper and exam.

2. Teaching Syllabus (including the content of chapters and sections. A sheet can be attached):

1. Information Science and Its Development

1. Base Conception of Communication System

2. Base Conception of Information Science

3. What the Information Theory Researches

4. Introduction to Shannon Information Theory

5. Outline of Course

Problems

2. Information Measurement

2.1 Concepts and thoughtway of Information Measurement

2.2 Information and Entropy

2.3 Mutual Information and Average Mutual Information

2.4 Conclusion

Problems

3. Discrete Information Source

3.1 Types and Description of Discrete Information Source

3.2 Entropy of Discrete Information Source

3.3 Redundancy of Information Source

3.4 Grouping Theory for Symbol Sequences of Information Source

3.5 Stationary Discrete Information Source and Its Performances

3.6 Conclusion

Problems

4. Encoding of Discrete Information Source

4.1 Aim and Mode of Source Encoder

4.2 Rate of Information and Coding Efficiency

4.3 Theory of Krift

4.4 Theory of Distortionless Information Source Coding (Shannon’s 1st Theory)

4.5 Some Samples of Source Coding

4.6 Schemes of Chinese Coding and Discussion

4.7 Coding of Image Message

4.8 Effects of the Error for Source Decoding

4.9 Conclusion

Problems

5. Discrete Channel and Channel Coding

5.1 Types of Channels and Description

5.2 Channel Capability

5.3 Characters of Disturbing Channel

5.4 Rules of Decoding

5.5 Theory of Disturbing Discrete Channel Coding (Shannon’s 2nd Theory)

5.6 Some Samples of Shannon’s 2nd Theory

5.7 Conclusion

Problems

6. Consecutive Message and Consecutive Channel

6.1 Information Measurement for Consecutive Message

6.2 Transmission of Consecutive Message in Channel

6.3 Shannon Formula and Its Application

6.4 Identification for Consecutive Message and Ideal Receiver

6.5 Digital Process and Coding for Consecutive Message

6.6 Conclusion

Problems

7. Introduction to Network Information Theory

7.1 Multi-access Channel and Its Transmission Characters

7.2 Broadcast Channel and Its Transmission Characters

7.3 Conclusion

Problems

8. Rate of Distortion Information Theory and Its Application

8.1 Description for Distortion

8.2 Function of Rate of Distortion Information

8.3 Calculation of Function of Rate of Distortion Information for Some Information Source

8.4 Source Coding Theory Based on Rule of Limited Distortion (Shannon’s 3rd Theory)

8.5 Application Samples of Rate of Distortion Information Theory and Information Value

8.6 Conclusion

Problems

9. Essential Concepts of Error Control

9.1 Error Control System and Its Theoretical Foundation

9.2 Essential Concepts of Error Detection and Correction

9.3 Performance Evaluation for Methods of Error Detection and Correction

9.4 Conclusion

Problems

10. Linear Block Codes

10.1 Mathematical Foundation

10.2 Encode of Linear Block Code

10.3 Decode of Linear Block Code

10.4 Some Samples of Linear Block Code

10.5 Conclusion

Problems

11. Cyclic Codes

11.1 Description of Cyclic Codes

11.2 Encode and Decode of Cyclic Codes

11.3 Binary BCH Codes

11.4 General BCH Codes and RS Codes

11.5 Others Cyclic Codes

11.6 Conclusion

Problems

12. Burst Error Correction Codes

12.1 Definition of Burst Error Correction Codes and Its Properties

12.2 Decode Methods and Performance Analysis for Burst Error Correction Codes

12.3 Fire Codes

12.4 Interleaving Codes

12.5 Burst and Random Errors Correction Codes

12.6 Conclusion

Problems

13. Convolution Codes

13.1 Description of Convolution Codes and Encoding

13.2 Maximum Likelihood Decoding

13.3 Sequential Decoding

13.4 M-ary Convolution Codes

13.5 Bad Convolution Codes and Error Expandability in Decoding

13.6 Performance Analysis and Good Convolution Codes

13.7 Conclusion

Problems

14. Information Theory Foundation of Secrecy Communication

14.1 Technique System and Mathematical Modeling of Secrecy Communication System

14.2 Information Theory Foundation of Transmission Encryption

14.3 Information Theory Foundation of Message Encryption

14.4 Samples of Encryption and Decryption

14.5 Conclusion

Problems

15. Wide Application of Information Theory

15.1 Source Coding and Channel Coding in Multi-media Communications

15.2 Source Coding and Channel Coding in Computer Network

15.3 Source Coding and Channel Coding in Mobile Communication Systems

15.4 Introduction to Application of Information Theory except for Communication

15.5 Conclusion

3. Teaching Schedule:

Note: 1.Above one, two, and three items are used as teaching Syllabus in Chinese and announced on the Chinese website of Graduate School. The four and five items are preserved in Graduate School.

2. Course terms: Spring, Autumn , and Spring-Autumn term.  

3. The teaching languages for courses: Chinese, English or Chinese-English.

4. Applicable range of discipline: public, first-class discipline, second-class discipline, and third-class discipline.

5. Practice includes: experiment, investigation, research report, etc.

6. Teaching methods: lecture, seminar, practice, etc.

7. Examination for degree courses must be in paper.

8. Teaching material websites are those which have already been announced.

9. Brief introduction of chief lecturer should include: personal information (date of birth, gender, degree achieved, professional title), research direction, teaching and research achievements. (within 100-500 words)

4. Brief Introduction of Chief lecturer:

Shen Lianfeng was born in Jiangsu Province, China, on July 22, 1952. He received the B.S. degree in Radio Technology and M.S. degree in Radio Communications from Southeast University (former Nanjing Institute of Technology), Nanjing, China, in 1978 and 1982 respectively. Since 1982, he has been a teacher at the National Mobile Communications Research Laboratory, Southeast University. He is a professor and supervisor of Ph. D students. His research interests include the Theory and Technology of Mobile Communication Network, Short Distance Wireless Communication and Ambient Ubiquity Networks, Information Theory and Coding. He worked in the Telecom Technology Centre of Hong Kong (TTC) as a Senior Consultant in 1998 to 1999 and in the Productivity Council of Hong Kong (HKPC) as a visiting scholar and a consultant in 1991 to 1993. On the other hand, he joined the research groups of Department of Information Engineering and Department of Electronic Engineering of the Chinese University of Hong Kong (CUHK) many times as a co-researcher or visiting professor. He was the leader of projects including the National Natural Science Foundation of China (NSFC), the Key R&D Program of China, the National High Technology Research and Development Program of China (863 Program), sub-project of The National Basic Research Program of China (973 Program) and from Ministry of Education, Jiangsu Province and oversea cooperation. Up to 2008, he has gained 12 invention patents and over ten Government Awards including the First-class of the Science and Technology Prizes of the Government of Jiangsu Province, the First-class of the Science and Technology Prizes of the Ministry of Education of China and so on. He has published eight works and over 100 papers. He gained the honors including the Excellent Researcher of Southeast University on Outstanding Contribution to Science and Technology (2004), the Advanced Worker on Innovation of Information Technology by Ministry of Information Industry of China (2006) and the Award of Innovation and Former of Jiangsu Province by the Government of Jiangsu Province and Committee of Jiangsu Province of the CCP.

5. Lecturer Information (include chief lecturer)