The communication chain is constituted by a source and a recipient, separated by a transmission channel which may represent a portion of cable, an optical fiber, a radio channel, or a satellite link. Whatever the channel, the processing blocks implemented in the communication chain have the same foundation. This book aims to itemize.
In this first volume, after having presented the base of the information theory, we will study the source coding techniques with and without loss. Then we analyze the correcting codes for block errors, convutional and concatenated used in current systems.
Preface xiii
List of Acronyms xv
Notations xix
Introduction xxiii
Chapter 1 Introduction to Information Theory 1
1.1 Introduction 1
1.2 Review of probabilities 2
1.3 Entropy and mutual information 7
1.4 Lossless source coding theorems 20
1.5 Theorem for lossy source coding 30
1.6 Transmission channel models 34
1.7 Capacity of a transmission channel 40
1.8 Exercises 54
Chapter 2 Source Coding 57
2.1 Introduction 57
2.2 Algorithms for lossless source coding 58
2.3 Sampling and quantization 69
2.4 Coding techniques for analog sources with memory 87
2.5 Application to the image and sound compression 101
2.6 Exercises 116
Chapter 3 Linear Block Codes 121
3.1 Introduction 121
3.2 Finite fields 122
3.3 Linear block codes 127
3.4 Decoding of binary linear block codes 152
3.5 Performance of linear block codes 172
3.6 Cyclic codlƒ7