- •Copyright
- •Contents
- •About the Author
- •Foreword
- •Preface
- •Glossary
- •1 Introduction
- •1.1 THE SCENE
- •1.2 VIDEO COMPRESSION
- •1.4 THIS BOOK
- •1.5 REFERENCES
- •2 Video Formats and Quality
- •2.1 INTRODUCTION
- •2.2 NATURAL VIDEO SCENES
- •2.3 CAPTURE
- •2.3.1 Spatial Sampling
- •2.3.2 Temporal Sampling
- •2.3.3 Frames and Fields
- •2.4 COLOUR SPACES
- •2.4.2 YCbCr
- •2.4.3 YCbCr Sampling Formats
- •2.5 VIDEO FORMATS
- •2.6 QUALITY
- •2.6.1 Subjective Quality Measurement
- •2.6.2 Objective Quality Measurement
- •2.7 CONCLUSIONS
- •2.8 REFERENCES
- •3 Video Coding Concepts
- •3.1 INTRODUCTION
- •3.2 VIDEO CODEC
- •3.3 TEMPORAL MODEL
- •3.3.1 Prediction from the Previous Video Frame
- •3.3.2 Changes due to Motion
- •3.3.4 Motion Compensated Prediction of a Macroblock
- •3.3.5 Motion Compensation Block Size
- •3.4 IMAGE MODEL
- •3.4.1 Predictive Image Coding
- •3.4.2 Transform Coding
- •3.4.3 Quantisation
- •3.4.4 Reordering and Zero Encoding
- •3.5 ENTROPY CODER
- •3.5.1 Predictive Coding
- •3.5.3 Arithmetic Coding
- •3.7 CONCLUSIONS
- •3.8 REFERENCES
- •4 The MPEG-4 and H.264 Standards
- •4.1 INTRODUCTION
- •4.2 DEVELOPING THE STANDARDS
- •4.2.1 ISO MPEG
- •4.2.4 Development History
- •4.2.5 Deciding the Content of the Standards
- •4.3 USING THE STANDARDS
- •4.3.1 What the Standards Cover
- •4.3.2 Decoding the Standards
- •4.3.3 Conforming to the Standards
- •4.7 RELATED STANDARDS
- •4.7.1 JPEG and JPEG2000
- •4.8 CONCLUSIONS
- •4.9 REFERENCES
- •5 MPEG-4 Visual
- •5.1 INTRODUCTION
- •5.2.1 Features
- •5.2.3 Video Objects
- •5.3 CODING RECTANGULAR FRAMES
- •5.3.1 Input and output video format
- •5.5 SCALABLE VIDEO CODING
- •5.5.1 Spatial Scalability
- •5.5.2 Temporal Scalability
- •5.5.3 Fine Granular Scalability
- •5.6 TEXTURE CODING
- •5.8 CODING SYNTHETIC VISUAL SCENES
- •5.8.1 Animated 2D and 3D Mesh Coding
- •5.8.2 Face and Body Animation
- •5.9 CONCLUSIONS
- •5.10 REFERENCES
- •6.1 INTRODUCTION
- •6.1.1 Terminology
- •6.3.2 Video Format
- •6.3.3 Coded Data Format
- •6.3.4 Reference Pictures
- •6.3.5 Slices
- •6.3.6 Macroblocks
- •6.4 THE BASELINE PROFILE
- •6.4.1 Overview
- •6.4.2 Reference Picture Management
- •6.4.3 Slices
- •6.4.4 Macroblock Prediction
- •6.4.5 Inter Prediction
- •6.4.6 Intra Prediction
- •6.4.7 Deblocking Filter
- •6.4.8 Transform and Quantisation
- •6.4.11 The Complete Transform, Quantisation, Rescaling and Inverse Transform Process
- •6.4.12 Reordering
- •6.4.13 Entropy Coding
- •6.5 THE MAIN PROFILE
- •6.5.1 B slices
- •6.5.2 Weighted Prediction
- •6.5.3 Interlaced Video
- •6.6 THE EXTENDED PROFILE
- •6.6.1 SP and SI slices
- •6.6.2 Data Partitioned Slices
- •6.8 CONCLUSIONS
- •6.9 REFERENCES
- •7 Design and Performance
- •7.1 INTRODUCTION
- •7.2 FUNCTIONAL DESIGN
- •7.2.1 Segmentation
- •7.2.2 Motion Estimation
- •7.2.4 Wavelet Transform
- •7.2.6 Entropy Coding
- •7.3 INPUT AND OUTPUT
- •7.3.1 Interfacing
- •7.4 PERFORMANCE
- •7.4.1 Criteria
- •7.4.2 Subjective Performance
- •7.4.4 Computational Performance
- •7.4.5 Performance Optimisation
- •7.5 RATE CONTROL
- •7.6 TRANSPORT AND STORAGE
- •7.6.1 Transport Mechanisms
- •7.6.2 File Formats
- •7.6.3 Coding and Transport Issues
- •7.7 CONCLUSIONS
- •7.8 REFERENCES
- •8 Applications and Directions
- •8.1 INTRODUCTION
- •8.2 APPLICATIONS
- •8.3 PLATFORMS
- •8.4 CHOOSING A CODEC
- •8.5 COMMERCIAL ISSUES
- •8.5.1 Open Standards?
- •8.5.3 Capturing the Market
- •8.6 FUTURE DIRECTIONS
- •8.7 CONCLUSIONS
- •8.8 REFERENCES
- •Bibliography
- •Index
Bibliography
1.A. Puri and T. Chen (eds), Multimedia Systems, Standards and Networks, Marcel Dekker, 2000.
2.A. Sadka, Compressed Video Communications, John Wiley & Sons, 2002.
3.A. Walsh and M. Bourges-S´evenier (eds), MPEG-4 Jump Start, Prentice-Hall, 2002.
4.B. Haskell, A. Puri, A. Netravali, Digital Video: An Introduction to MPEG-2, Chapman & Hall, 1996.
5.F. Pereira and T. Ebrahimi (eds), The MPEG-4 Book, IMSC Press, 2002.
6.I. E. G. Richardson, Video Codec Design, John Wiley & Sons, 2002.
7.K. K. Parhi and T. Nishitani (eds), Digital Signal Processing for Multimedia Systems, Marcel Dekker, 1999.
8.K. R. Rao and J. J. Hwang, Techniques and Standards for Image, Video and Audio Coding, Prentice Hall, 1997.
9.M. Ghanbari, Video Coding: An Introduction to Standard Codecs, IEE Press, 1999.
10.M. J. Riley and I. E. G. Richardson, Digital Video Communications, Artech House, 1997.
11.V. Bhaskaran and K. Konstantinides, Image and Video Compression Standards: Algorithms and Architectures, Kluwer, 1997.
12.W. B. Pennebaker, J. L. Mitchell, C. Fogg and D. LeGall, MPEG Digital Video Compression Standard, Chapman & Hall, 1997.
13.IEEE Transactions on Circuits and Systems for Video Technology, special issue on H.264/AVC, to appear in 2003.
H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia.
Iain E. G. Richardson. C 2003 John Wiley & Sons, Ltd. ISBN: 0-470-84837-5
Index
adaptive memory control 166 |
digital video 2 |
|
||
alpha block |
Discrete Cosine Transform 46, 187, 234 |
|||
binary 123, 125 |
basis patterns 47 |
|
||
grey scale 133 |
shape-adaptive 138, 237 |
|
||
animation |
|
DPCM 44 |
|
|
face, FBA 156 |
DWT |
See wavelet transform 149 |
||
Arbitrary Slice Order (ASO) 168 |
|
|
|
|
AVC 159 |
|
entropy coding 61, 198, 238 |
|
|
|
|
arithmetic coding 5, 69, 241 |
||
BAB |
See alpha block 123 |
context-based 72, 126, 212 |
||
|
|
CAVLC 201 |
|
|
CABAC |
See entropy coding 212 |
Exp-Golomb 199 |
|
|
CAE |
See entropy coding 126 |
Huffman 62 |
|
|
CAVLC |
See entropy coding 201 |
reversible VLCs 115 |
|
|
chrominance 15 |
error propagation 113, 265 |
|
||
coding |
|
|
|
|
mesh 155 |
FBA 156 |
|
|
|
run-level 58 |
fields 13, 120, 162, 212 |
|
||
scalable 142 |
file formats 263 |
|
||
FGS 145 |
filter |
|
|
|
spatial 142 |
deblocking 184 |
|
||
temporal 144 |
post-processing 243 |
|
||
synthetic 155 |
pre-processing 242 |
|
||
texture 132, 149 |
Fine Granular Scalability |
See coding: scalable 145 |
||
tools (MPEG-4 Visual) 100 |
Flexible Macroblock Order (FMO) 168 |
|||
zero-tree 60, 150 |
formats 19 |
|
||
colour space |
4CIF 19 |
|
||
RGB 14 |
CIF 19 |
|
|
|
YCrCb 15 |
ITU-R 601, 20 |
|
||
commercial CODECs 274 |
QCIF 19 |
|
||
|
|
SQCIF 19 |
|
|
data partitioning 115, 220 |
|
|
|
|
deblocking filter 184 |
H.261 96 |
|
|
|
Digital Versatile Disk 3 |
H.263 96 |
|
|
|
H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia.
Iain E. G. Richardson. C 2003 John Wiley & Sons, Ltd. ISBN: 0-470-84837-5
• |
INDEX |
280 |
Human Visual System 3, 21, 25 hypothetical reference decoder 90
IDR 167
IEC 86 interfacing 241
interlace 13, 106, 120, 162, 212 Internet Streaming Media Alliance 92 ISO 6, 86
ITU 6, 87
Joint Video Team (JVT) 87
JPEG 5, 27, 83, 85, 95
JPEG2000 95
levels 91 luminance 15
macroblock 33, 164 partition 170
motion compensation 32, 33 Global 118
OBMC 100 region based 41 sub-pixel 37, 172 tree structured 170
motion estimation 32, 33, 226 Fast Search 231
Full Search 230 MAE 228 MSE 228
region based 234 SA(T)D 228 SAE 40, 228 sub-pixel 233
motion vector prediction 175
MPEG 2, 6, 85, 86 MPEG-1 95 MPEG-2 2, 96
MPEG-4 Industry Forum 92
Network Abstraction Layer 161, 220
optical flow 30
patents 274 performance 246
computational 254 optimisation 255 rate-distortion 246, 251
platforms 270 prediction
bidirectional 209 direct 210
intra 110, 177 16 × 16, 180 4 × 4, 177
weighted 211 profiles 91, 101, 162
Advanced Coding Efficiency 138 Advanced Real Time Simple 121 Advanced Simple 115
baseline 165 Core 124
Core Scalable 148 Core Studio 155 FGS 149
main 133 Main 207 N-bit 141
Scalable Texture 152 Simple 106
Simple Scalable 148 Simple Studio 153
quality DSCQS 22
ITU-R 500-10, 22 objective 22 PSNR 23 subjective 21, 247
quantization 51, 191, 238 scalar 52
vector 55
Rate control 256
rate-distortion See performance 246 RBSP 163, 220
redundancy statistical 27 subjective 27
reference
buffer management 166 long term 166
short term 166
SA-DCT See Discrete Cosine Transform 138 sampling
4-2-0, 17
4-2-2, 17, 154
4-4-4, 17, 154 spatial 11 temporal 11
scalable coding See coding: scalable 142 segmentation 226
short header 109 slice 114, 164
B-slice 207 groups 167
INDEX |
• |
|
281 |
|
|
I-slice 167
P-slice 167 redundant 167 SI-slice 216 SP-slice 216
SNHC See coding:synthetic 156 SP slice See slice 216
sprite 136
transport 262 MPEG-2 262 RTP 263
VCEG 6, 7, 85, 87, 98, 223
video capture 10 video codec 28, 72
Video Coding Layer 163 video object 101, 103 video object plane 103
B-VOP 116
I-VOP 107
P-VOP 109 video packet 114
Video Quality Experts Group 24 video sequence 13
interlaced 13 progressive 13
wavelet transform 50, 149, 238