- •Contents
- •Figures
- •Tables
- •Preface
- •Acknowledgments
- •1. Raster images
- •Aspect ratio
- •Geometry
- •Image capture
- •Digitization
- •Perceptual uniformity
- •Colour
- •Luma and colour difference components
- •Digital image representation
- •Square sampling
- •Comparison of aspect ratios
- •Aspect ratio
- •Frame rates
- •Image state
- •EOCF standards
- •Entertainment programming
- •Acquisition
- •Consumer origination
- •Consumer electronics (CE) display
- •Contrast
- •Contrast ratio
- •Perceptual uniformity
- •The “code 100” problem and nonlinear image coding
- •Linear and nonlinear
- •4. Quantization
- •Linearity
- •Decibels
- •Noise, signal, sensitivity
- •Quantization error
- •Full-swing
- •Studio-swing (footroom and headroom)
- •Interface offset
- •Processing coding
- •Two’s complement wrap-around
- •Perceptual attributes
- •History of display signal processing
- •Digital driving levels
- •Relationship between signal and lightness
- •Algorithm
- •Black level setting
- •Effect of contrast and brightness on contrast and brightness
- •An alternate interpretation
- •Brightness and contrast controls in LCDs
- •Brightness and contrast controls in PDPs
- •Brightness and contrast controls in desktop graphics
- •Symbolic image description
- •Raster images
- •Conversion among types
- •Image files
- •“Resolution” in computer graphics
- •7. Image structure
- •Image reconstruction
- •Sampling aperture
- •Spot profile
- •Box distribution
- •Gaussian distribution
- •8. Raster scanning
- •Flicker, refresh rate, and frame rate
- •Introduction to scanning
- •Scanning parameters
- •Interlaced format
- •Interlace and progressive
- •Scanning notation
- •Motion portrayal
- •Segmented-frame (24PsF)
- •Video system taxonomy
- •Conversion among systems
- •9. Resolution
- •Magnitude frequency response and bandwidth
- •Visual acuity
- •Viewing distance and angle
- •Kell effect
- •Resolution
- •Resolution in video
- •Viewing distance
- •Interlace revisited
- •10. Constant luminance
- •The principle of constant luminance
- •Compensating for the CRT
- •Departure from constant luminance
- •Luma
- •“Leakage” of luminance into chroma
- •11. Picture rendering
- •Surround effect
- •Tone scale alteration
- •Incorporation of rendering
- •Rendering in desktop computing
- •Luma
- •Sloppy use of the term luminance
- •Colour difference coding (chroma)
- •Chroma subsampling
- •Chroma subsampling notation
- •Chroma subsampling filters
- •Chroma in composite NTSC and PAL
- •Scanning standards
- •Widescreen (16:9) SD
- •Square and nonsquare sampling
- •Resampling
- •NTSC and PAL encoding
- •NTSC and PAL decoding
- •S-video interface
- •Frequency interleaving
- •Composite analog SD
- •15. Introduction to HD
- •HD scanning
- •Colour coding for BT.709 HD
- •Data compression
- •Image compression
- •Lossy compression
- •JPEG
- •Motion-JPEG
- •JPEG 2000
- •Mezzanine compression
- •MPEG
- •Picture coding types (I, P, B)
- •Reordering
- •MPEG-1
- •MPEG-2
- •Other MPEGs
- •MPEG IMX
- •MPEG-4
- •AVC-Intra
- •WM9, WM10, VC-1 codecs
- •Compression for CE acquisition
- •AVCHD
- •Compression for IP transport to consumers
- •VP8 (“WebM”) codec
- •Dirac (basic)
- •17. Streams and files
- •Historical overview
- •Physical layer
- •Stream interfaces
- •IEEE 1394 (FireWire, i.LINK)
- •HTTP live streaming (HLS)
- •18. Metadata
- •Metadata Example 1: CD-DA
- •Metadata Example 2: .yuv files
- •Metadata Example 3: RFF
- •Metadata Example 4: JPEG/JFIF
- •Metadata Example 5: Sequence display extension
- •Conclusions
- •19. Stereoscopic (“3-D”) video
- •Acquisition
- •S3D display
- •Anaglyph
- •Temporal multiplexing
- •Polarization
- •Wavelength multiplexing (Infitec/Dolby)
- •Autostereoscopic displays
- •Parallax barrier display
- •Lenticular display
- •Recording and compression
- •Consumer interface and display
- •Ghosting
- •Vergence and accommodation
- •20. Filtering and sampling
- •Sampling theorem
- •Sampling at exactly 0.5fS
- •Magnitude frequency response
- •Magnitude frequency response of a boxcar
- •The sinc weighting function
- •Frequency response of point sampling
- •Fourier transform pairs
- •Analog filters
- •Digital filters
- •Impulse response
- •Finite impulse response (FIR) filters
- •Physical realizability of a filter
- •Phase response (group delay)
- •Infinite impulse response (IIR) filters
- •Lowpass filter
- •Digital filter design
- •Reconstruction
- •Reconstruction close to 0.5fS
- •“(sin x)/x” correction
- •Further reading
- •2:1 downsampling
- •Oversampling
- •Interpolation
- •Lagrange interpolation
- •Lagrange interpolation as filtering
- •Polyphase interpolators
- •Polyphase taps and phases
- •Implementing polyphase interpolators
- •Decimation
- •Lowpass filtering in decimation
- •Spatial frequency domain
- •Comb filtering
- •Spatial filtering
- •Image presampling filters
- •Image reconstruction filters
- •Spatial (2-D) oversampling
- •Retina
- •Adaptation
- •Contrast sensitivity
- •Contrast sensitivity function (CSF)
- •24. Luminance and lightness
- •Radiance, intensity
- •Luminance
- •Relative luminance
- •Luminance from red, green, and blue
- •Lightness (CIE L*)
- •Fundamentals of vision
- •Definitions
- •Spectral power distribution (SPD) and tristimulus
- •Spectral constraints
- •CIE XYZ tristimulus
- •CIE [x, y] chromaticity
- •Blackbody radiation
- •Colour temperature
- •White
- •Chromatic adaptation
- •Perceptually uniform colour spaces
- •CIE L*a*b* (CIELAB)
- •CIE L*u*v* and CIE L*a*b* summary
- •Colour specification and colour image coding
- •Further reading
- •Additive reproduction (RGB)
- •Characterization of RGB primaries
- •BT.709 primaries
- •Leggacy SD primaries
- •sRGB system
- •SMPTE Free Scale (FS) primaries
- •AMPAS ACES primaries
- •SMPTE/DCI P3 primaries
- •CMFs and SPDs
- •Normalization and scaling
- •Luminance coefficients
- •Transformations between RGB and CIE XYZ
- •Noise due to matrixing
- •Transforms among RGB systems
- •Camera white reference
- •Display white reference
- •Gamut
- •Wide-gamut reproduction
- •Free Scale Gamut, Free Scale Log (FS-Gamut, FS-Log)
- •Further reading
- •27. Gamma
- •Gamma in CRT physics
- •The amazing coincidence!
- •Gamma in video
- •Opto-electronic conversion functions (OECFs)
- •BT.709 OECF
- •SMPTE 240M OECF
- •sRGB transfer function
- •Transfer functions in SD
- •Bit depth requirements
- •Gamma in modern display devices
- •Estimating gamma
- •Gamma in video, CGI, and Macintosh
- •Gamma in computer graphics
- •Gamma in pseudocolour
- •Limitations of 8-bit linear coding
- •Linear and nonlinear coding in CGI
- •Colour acuity
- •RGB and R’G’B’ colour cubes
- •Conventional luma/colour difference coding
- •Luminance and luma notation
- •Nonlinear red, green, blue (R’G’B’)
- •BT.601 luma
- •BT.709 luma
- •Chroma subsampling, revisited
- •Luma/colour difference summary
- •SD and HD luma chaos
- •Luma/colour difference component sets
- •B’-Y’, R’-Y’ components for SD
- •PBPR components for SD
- •CBCR components for SD
- •Y’CBCR from studio RGB
- •Y’CBCR from computer RGB
- •“Full-swing” Y’CBCR
- •Y’UV, Y’IQ confusion
- •B’-Y’, R’-Y’ components for BT.709 HD
- •PBPR components for BT.709 HD
- •CBCR components for BT.709 HD
- •CBCR components for xvYCC
- •Y’CBCR from studio RGB
- •Y’CBCR from computer RGB
- •Conversions between HD and SD
- •Colour coding standards
- •31. Video signal processing
- •Edge treatment
- •Transition samples
- •Picture lines
- •Choice of SAL and SPW parameters
- •Video levels
- •Setup (pedestal)
- •BT.601 to computing
- •Enhancement
- •Median filtering
- •Coring
- •Chroma transition improvement (CTI)
- •Mixing and keying
- •Field rate
- •Line rate
- •Sound subcarrier
- •Addition of composite colour
- •NTSC colour subcarrier
- •576i PAL colour subcarrier
- •4fSC sampling
- •Common sampling rate
- •Numerology of HD scanning
- •Audio rates
- •33. Timecode
- •Introduction
- •Dropframe timecode
- •Editing
- •Linear timecode (LTC)
- •Vertical interval timecode (VITC)
- •Timecode structure
- •Further reading
- •34. 2-3 pulldown
- •2-3-3-2 pulldown
- •Conversion of film to different frame rates
- •Native 24 Hz coding
- •Conversion to other rates
- •Spatial domain
- •Vertical-temporal domain
- •Motion adaptivity
- •Further reading
- •36. Colourbars
- •SD colourbars
- •SD colourbar notation
- •Pluge element
- •Composite decoder adjustment using colourbars
- •-I, +Q, and Pluge elements in SD colourbars
- •HD colourbars
- •References
- •38. SDI and HD-SDI interfaces
- •Component digital SD interface (BT.601)
- •Serial digital interface (SDI)
- •Component digital HD-SDI
- •SDI and HD-SDI sync, TRS, and ancillary data
- •Analog sync and digital/analog timing relationships
- •Ancillary data
- •SDI coding
- •HD-SDI coding
- •Interfaces for compressed video
- •SDTI
- •Switching and mixing
- •Timing in digital facilities
- •Summary of digital interfaces
- •39. 480i component video
- •Frame rate
- •Interlace
- •Line sync
- •Field/frame sync
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Picture center, aspect ratio, and blanking
- •Halfline blanking
- •Component digital 4:2:2 interface
- •Component analog R’G’B’ interface
- •Component analog Y’PBPR interface, EBU N10
- •Component analog Y’PBPR interface, industry standard
- •40. 576i component video
- •Frame rate
- •Interlace
- •Line sync
- •Analog field/frame sync
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Picture center, aspect ratio, and blanking
- •Component digital 4:2:2 interface
- •Component analog 576i interface
- •Scanning
- •Analog sync
- •Picture center, aspect ratio, and blanking
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Component digital 4:2:2 interface
- •Scanning
- •Analog sync
- •Picture center, aspect ratio, and blanking
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Component digital 4:2:2 interface
- •43. HD videotape
- •HDCAM (D-11)
- •DVCPRO HD (D-12)
- •HDCAM SR (D-16)
- •JPEG blocks and MCUs
- •JPEG block diagram
- •Level shifting
- •Discrete cosine transform (DCT)
- •JPEG encoding example
- •JPEG decoding
- •Compression ratio control
- •JPEG/JFIF
- •Motion-JPEG (M-JPEG)
- •Further reading
- •46. DV compression
- •DV chroma subsampling
- •DV frame/field modes
- •Picture-in-shuttle in DV
- •DV overflow scheme
- •DV quantization
- •DV digital interface (DIF)
- •Consumer DV recording
- •Professional DV variants
- •47. MPEG-2 video compression
- •MPEG-2 profiles and levels
- •Picture structure
- •Frame rate and 2-3 pulldown in MPEG
- •Luma and chroma sampling structures
- •Macroblocks
- •Picture coding types – I, P, B
- •Prediction
- •Motion vectors (MVs)
- •Coding of a block
- •Frame and field DCT types
- •Zigzag and VLE
- •Refresh
- •Motion estimation
- •Rate control and buffer management
- •Bitstream syntax
- •Transport
- •Further reading
- •48. H.264 video compression
- •Algorithmic features, profiles, and levels
- •Baseline and extended profiles
- •High profiles
- •Hierarchy
- •Multiple reference pictures
- •Slices
- •Spatial intra prediction
- •Flexible motion compensation
- •Quarter-pel motion-compensated interpolation
- •Weighting and offsetting of MC prediction
- •16-bit integer transform
- •Quantizer
- •Variable-length coding
- •Context adaptivity
- •CABAC
- •Deblocking filter
- •Buffer control
- •Scalable video coding (SVC)
- •Multiview video coding (MVC)
- •AVC-Intra
- •Further reading
- •49. VP8 compression
- •Algorithmic features
- •Further reading
- •Elementary stream (ES)
- •Packetized elementary stream (PES)
- •MPEG-2 program stream
- •MPEG-2 transport stream
- •System clock
- •Further reading
- •Japan
- •United States
- •ATSC modulation
- •Europe
- •Further reading
- •Appendices
- •Cement vs. concrete
- •True CIE luminance
- •The misinterpretation of luminance
- •The enshrining of luma
- •Colour difference scale factors
- •Conclusion: A plea
- •Radiometry
- •Photometry
- •Light level examples
- •Image science
- •Units
- •Further reading
- •Glossary
- •Index
- •About the author
Historical NTSC standards documents indicate a “precorrection” with a 1⁄2.2-power (approximately 0.45), but in practice the BT.1886 EOCF is used. See Gamma in video on page 318.
SMPTE RP 187, Center, Aspect Ratio and Blanking of Video Images.
STL - SEAV-0H + 0.5(SAL -1)
STL
858 -736 + 0.5(720 -1)
=
858
=321
572
Three nonlinear primary components R’, G’, and B’ are computed such that the intended image appearance is obtained on the reference display in the reference viewing conditions; see Reference display and viewing conditions, on page 427.
In the default power-up state of a camera, the nonlinear primary components are computed from the camera’s RGB tristimulus estimates according to the opto-electronic conversion function of BT.709 OECF, described on page 320; this process is loosely called gamma correction.
The colorimetric properties of the display primaries are supposed to conform to BT.709 primaries described on page 290: DTV transmission standards call for BT.709, and modern consumer displays use BT.709. However, production and mastering of 480i content historically used SMPTE primary chromaticities, not BT.709 (see SMPTE RP 145 primaries, Table 26.5 on page 293).
Luma (Y’)
Luma in 480i systems is computed as a weighted sum of nonlinear R’, G’, and B’ primary components, according to the luma coefficients of BT.601, as detailed in BT.601 luma, on page 346:
601Y'= 0.299 R'+ 0.587 G'+ 0.114 B' |
Eq 39.1 |
The luma component Y’, being a weighted sum of nonlinear R’G’B’ components, has no simple relationship with CIE relative luminance (Y) used in colour science. Video encoding specifications typically place no upper bound on luma bandwidth (though transmission standards may).
Picture center, aspect ratio, and blanking
The center of the picture is located midway between the central two of the 720 active samples of BT.601, at the fraction 321⁄572 between 0H instants. Concerning the vertical center, see Table 39.1, on page 446.
In 4:3 systems, the aspect ratio is defined to be 4:3 with respect to a clean aperture pixel array, 708 samples wide at a sampling rate of 13.5 MHz, and 480 lines high.
450 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
SMPTE RP 202, Video Alignment for MPEG-2 Coding.
30.593 ≈ 63.555 − 732 − 716
213.5
41.259 ≈ 63.555 + 858 − 732 + 2
213.5
In Transition samples, on page 378, I mentioned that it is necessary to avoid, at the start of a line, an instantaneous transition from blanking to picture information. SMPTE standards call for picture information to have a risetime of 140±20 ns. For 480i or 576i video, a blanking transition is best implemented as a threesample sequence where the video signal is limited in turn to 10%, 50%, and 90% of its full excursion.
No studio standard addresses square sampling of 480i video. I recommend using a sample rate of 780fH, that is, 12 3⁄11 MHz (i.e., 12.272727 MHz). I recommend using 648 samples – or, failing that, 644 or 640 – centered as mentioned above.
When MPEG-2 with 480 or 512 image rows is used in the studio, the bottom image row corresponds to line 525 (as indicated in Table 39.1). The bottom lefthand halfline (on line 263) is not among the coded image rows. Unfortunately, 480i DV systems digitize a range one image row up from this.
Halfline blanking
Most component video equipment treats the top and bottom lines of both fields as integral lines; blanking of halflines is assumed to be imposed at the time of conversion to analog. In composite equipment and analog equipment, halfline blanking must be imposed.
In the composite and analog domains, video information at the bottom of the picture, on the left half of line 263, should terminate 30.593 µs after 0H. This timing is comparable to blanking at the end of a full line, but preceding the midpoint between 0H instants instead of preceding the 0H instant itself.
Historically, in the composite and analog domains, a right halfline at the top of the picture – such as picture on line 284 – commenced about 41 µs after 0H. This timing is comparable to blanking at the start of
a full line, but following the midpoint between 0H instants instead of following the 0H instant itself. However, in NTSC broadcast, line 284 must remain available for closed captioning (along with line 21). So, it is now pointless for studio equipment to carry the traditional right-hand halfline of picture on line 284: Picture should be considered to comprise 482 full lines, plus a left-hand halfline on line 263.
CHAPTER 39 |
480I COMPONENT VIDEO |
451 |
8-bit code
708 CLEAN
235
1251/2
16
|
|
|
2 |
359 360 |
716 |
|
|
|
|
|
|
|
|
||||
736 |
|
0 |
720 SAL |
|
719 |
|
|
|
|
|
|
|
|
||||
|
0H |
Sample clocks, 13.5 MHz |
858 STL |
|||||
Figure 39.2 480i component digital 4:2:2 luma waveform
SDI was introduced on page 432. Eight-bit SD interfaces between digital ICs are often described as “601” (where horizontal and vertical sync signals are conveyed on dedicated wires) or “656” (where sync is embedded as TRS codes).
Halfline blanking has been abolished from progressive scan video, and from JPEG, MPEG, and HD.
Component digital 4:2:2 interface
The CB and CR colour difference components of digital video are formed by scaling B’-Y’ and R’-Y’ components, as described in CBCR components for SD on page 361. Y’CBCR signals are usually conveyed through the serial digital interface (SDI), which I introduced on page 432. R’G’B’ 4:4:4 (or R’G’B’A 4:4:4:4) components can be conveyed across a dual-link interface using two SDI channels; alternatively, the single-link
540 Mb/s SDI interface of SMPTE 344M can be used. In 13.5 MHz sampling of 480i, the sample located 16 sample clock intervals after EAV corresponds to the line sync datum (0H): If digitized, that sample would
take the 50% value of analog sync.
Figure 39.2 above shows a waveform drawing of luma in a 480i component digital 4:2:2 system.
Component analog R’G’B’ interface
A component analog 480i R’G’B’ interface is based on nonlinear R’, G’, and B’ signals. Analog R’,G’, B’ signals are conveyed as voltage, with a range of 1 V from synctip to reference white. (Transient excursions slightly above reference white are permitted.)
452 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
SMPTE 253M, Three-Channel RGB
Analog Video Interface.
In studio systems, analog component R’G’B’ signals ideally have zero setup, so zero in Equation 39.2 corresponds to 0 VDC. According to SMPTE 253M, unity corresponds to 700 mV. Sync is added to the green component according to Equation 39.2, where sync and active are taken to be unity when asserted and zero otherwise:
G' |
= |
7 |
(active G') + |
3 |
(−sync) |
Eq 39.2 |
|
10 |
|||||
sync |
10 |
|
|
|
||
Sadly, the SMPTE R’G’B’ analog interface is unpopular, and “NTSC-related” levels are usually used, either with or without setup.
Some systems, such as 480i studio video in Japan, use a picture-to-sync ratio of 10:4 and zero setup. In this case, unity in Equation 39.3 corresponds to 5⁄7 V, about 714 mV:
V' |
= |
5 |
(active V') + |
2 |
(− sync) |
Eq 39.3 |
|
|
|||||
sync |
7 |
7 |
|
|
||
Many systems – such as computer framebuffers using the levels of the archaic EIA RS-343-A standard – code component video similarly to composite video, with 10:4 picture-to-sync ratio and 7.5% setup:
V' |
= |
3 |
active + |
37 |
(active V') + |
2 |
(− sync) |
Eq 39.4 |
|
|
|
||||||
sync |
56 |
56 |
7 |
|
|
|||
The PB and PR scale factors are appropriate only for component analog interfaces. For details concerning scale factors in component digital systems, see CBCR components for SD, on page 361. For details concerning scale factors in composite analog or digital NTSC or PAL, see UV components, in Chapter 5 of Composite NTSC and PAL: Legacy Video Systems.
Component analog Y’PBPR interface, EBU N10
The PB and PR colour difference components of analog video are formed by scaling B’-Y’ and R’-Y’ components, as described in PBPR components for SD on page 359. Wideband PB and PR components are theoretically possible but very rarely used; normally, PB and PR are lowpass filtered to half the bandwidth of luma.
Component Y’PBPR signals in 480i are sometimes interfaced with zero setup, with levels according to the EBU Tech. N10 standard. Zero (reference blanking level) for Y’, PB, and PR corresponds to a level of 0 VDC, and unity corresponds to 700 mV. Sync is added to the luma
CHAPTER 39 |
480I COMPONENT VIDEO |
453 |
Voltage, mV |
|
|
|
|
|
|
|
||||||||
52 |
8/9 |
|
|
|
|
||||||||||
|
|
|
|
|
|
|
|||||||||
700 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
350 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
-300 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
352/3 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|||||
|
0H 4.7 Time, µs |
635/9 |
|||||||||||||
Figure 39.3 480i component analog luma waveform with SMPTE levels and zero setup.
EIA/CEA-770.2, Standard Definition
TV Analog Component Video Interface.
CEA/CEDIA-863-B, Connection Color Codes for Home Theater Systems.
component; sync is taken to be unity when asserted and zero otherwise:
Y' |
= |
7 |
Y'+ |
3 |
(− sync) |
Eq 39.5 |
|
|
|||||
sync |
10 |
10 |
|
|
||
Figure 39.3 shows a waveform drawing of luma in a 480i component analog interface according to the EBU Tech. N10 standard. In North America, the levels of EBU N10 mysteriously became known as “SMPTE levels,” or “SMPTE/EBU N10 interface,” even though N10 is solely an EBU standard and SMPTE failed to
standardize a component analog luma/colour difference interface.
CEA has standardized the 700 mV, zero-setup levels for use by consumer electronics devices such as DVD players and set-top boxes, for 480i and 480p formats at 4:3 and 16:9 aspect ratios.
In 2011, about a quarter of a century after the introduction of component analog video interfaces, CEA (with CEDIA, Custom Electronic Design and Installation Association) standardized the colours of the connectors to be used: green for Y’, blue for CB, and red for CR. (In the consumer domain, composite NTSC or PAL video is typically carried on a wire having yellow connectors.)
454 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
