- •Contents
- •Figures
- •Tables
- •Preface
- •Acknowledgments
- •1. Raster images
- •Aspect ratio
- •Geometry
- •Image capture
- •Digitization
- •Perceptual uniformity
- •Colour
- •Luma and colour difference components
- •Digital image representation
- •Square sampling
- •Comparison of aspect ratios
- •Aspect ratio
- •Frame rates
- •Image state
- •EOCF standards
- •Entertainment programming
- •Acquisition
- •Consumer origination
- •Consumer electronics (CE) display
- •Contrast
- •Contrast ratio
- •Perceptual uniformity
- •The “code 100” problem and nonlinear image coding
- •Linear and nonlinear
- •4. Quantization
- •Linearity
- •Decibels
- •Noise, signal, sensitivity
- •Quantization error
- •Full-swing
- •Studio-swing (footroom and headroom)
- •Interface offset
- •Processing coding
- •Two’s complement wrap-around
- •Perceptual attributes
- •History of display signal processing
- •Digital driving levels
- •Relationship between signal and lightness
- •Algorithm
- •Black level setting
- •Effect of contrast and brightness on contrast and brightness
- •An alternate interpretation
- •Brightness and contrast controls in LCDs
- •Brightness and contrast controls in PDPs
- •Brightness and contrast controls in desktop graphics
- •Symbolic image description
- •Raster images
- •Conversion among types
- •Image files
- •“Resolution” in computer graphics
- •7. Image structure
- •Image reconstruction
- •Sampling aperture
- •Spot profile
- •Box distribution
- •Gaussian distribution
- •8. Raster scanning
- •Flicker, refresh rate, and frame rate
- •Introduction to scanning
- •Scanning parameters
- •Interlaced format
- •Interlace and progressive
- •Scanning notation
- •Motion portrayal
- •Segmented-frame (24PsF)
- •Video system taxonomy
- •Conversion among systems
- •9. Resolution
- •Magnitude frequency response and bandwidth
- •Visual acuity
- •Viewing distance and angle
- •Kell effect
- •Resolution
- •Resolution in video
- •Viewing distance
- •Interlace revisited
- •10. Constant luminance
- •The principle of constant luminance
- •Compensating for the CRT
- •Departure from constant luminance
- •Luma
- •“Leakage” of luminance into chroma
- •11. Picture rendering
- •Surround effect
- •Tone scale alteration
- •Incorporation of rendering
- •Rendering in desktop computing
- •Luma
- •Sloppy use of the term luminance
- •Colour difference coding (chroma)
- •Chroma subsampling
- •Chroma subsampling notation
- •Chroma subsampling filters
- •Chroma in composite NTSC and PAL
- •Scanning standards
- •Widescreen (16:9) SD
- •Square and nonsquare sampling
- •Resampling
- •NTSC and PAL encoding
- •NTSC and PAL decoding
- •S-video interface
- •Frequency interleaving
- •Composite analog SD
- •15. Introduction to HD
- •HD scanning
- •Colour coding for BT.709 HD
- •Data compression
- •Image compression
- •Lossy compression
- •JPEG
- •Motion-JPEG
- •JPEG 2000
- •Mezzanine compression
- •MPEG
- •Picture coding types (I, P, B)
- •Reordering
- •MPEG-1
- •MPEG-2
- •Other MPEGs
- •MPEG IMX
- •MPEG-4
- •AVC-Intra
- •WM9, WM10, VC-1 codecs
- •Compression for CE acquisition
- •AVCHD
- •Compression for IP transport to consumers
- •VP8 (“WebM”) codec
- •Dirac (basic)
- •17. Streams and files
- •Historical overview
- •Physical layer
- •Stream interfaces
- •IEEE 1394 (FireWire, i.LINK)
- •HTTP live streaming (HLS)
- •18. Metadata
- •Metadata Example 1: CD-DA
- •Metadata Example 2: .yuv files
- •Metadata Example 3: RFF
- •Metadata Example 4: JPEG/JFIF
- •Metadata Example 5: Sequence display extension
- •Conclusions
- •19. Stereoscopic (“3-D”) video
- •Acquisition
- •S3D display
- •Anaglyph
- •Temporal multiplexing
- •Polarization
- •Wavelength multiplexing (Infitec/Dolby)
- •Autostereoscopic displays
- •Parallax barrier display
- •Lenticular display
- •Recording and compression
- •Consumer interface and display
- •Ghosting
- •Vergence and accommodation
- •20. Filtering and sampling
- •Sampling theorem
- •Sampling at exactly 0.5fS
- •Magnitude frequency response
- •Magnitude frequency response of a boxcar
- •The sinc weighting function
- •Frequency response of point sampling
- •Fourier transform pairs
- •Analog filters
- •Digital filters
- •Impulse response
- •Finite impulse response (FIR) filters
- •Physical realizability of a filter
- •Phase response (group delay)
- •Infinite impulse response (IIR) filters
- •Lowpass filter
- •Digital filter design
- •Reconstruction
- •Reconstruction close to 0.5fS
- •“(sin x)/x” correction
- •Further reading
- •2:1 downsampling
- •Oversampling
- •Interpolation
- •Lagrange interpolation
- •Lagrange interpolation as filtering
- •Polyphase interpolators
- •Polyphase taps and phases
- •Implementing polyphase interpolators
- •Decimation
- •Lowpass filtering in decimation
- •Spatial frequency domain
- •Comb filtering
- •Spatial filtering
- •Image presampling filters
- •Image reconstruction filters
- •Spatial (2-D) oversampling
- •Retina
- •Adaptation
- •Contrast sensitivity
- •Contrast sensitivity function (CSF)
- •24. Luminance and lightness
- •Radiance, intensity
- •Luminance
- •Relative luminance
- •Luminance from red, green, and blue
- •Lightness (CIE L*)
- •Fundamentals of vision
- •Definitions
- •Spectral power distribution (SPD) and tristimulus
- •Spectral constraints
- •CIE XYZ tristimulus
- •CIE [x, y] chromaticity
- •Blackbody radiation
- •Colour temperature
- •White
- •Chromatic adaptation
- •Perceptually uniform colour spaces
- •CIE L*a*b* (CIELAB)
- •CIE L*u*v* and CIE L*a*b* summary
- •Colour specification and colour image coding
- •Further reading
- •Additive reproduction (RGB)
- •Characterization of RGB primaries
- •BT.709 primaries
- •Leggacy SD primaries
- •sRGB system
- •SMPTE Free Scale (FS) primaries
- •AMPAS ACES primaries
- •SMPTE/DCI P3 primaries
- •CMFs and SPDs
- •Normalization and scaling
- •Luminance coefficients
- •Transformations between RGB and CIE XYZ
- •Noise due to matrixing
- •Transforms among RGB systems
- •Camera white reference
- •Display white reference
- •Gamut
- •Wide-gamut reproduction
- •Free Scale Gamut, Free Scale Log (FS-Gamut, FS-Log)
- •Further reading
- •27. Gamma
- •Gamma in CRT physics
- •The amazing coincidence!
- •Gamma in video
- •Opto-electronic conversion functions (OECFs)
- •BT.709 OECF
- •SMPTE 240M OECF
- •sRGB transfer function
- •Transfer functions in SD
- •Bit depth requirements
- •Gamma in modern display devices
- •Estimating gamma
- •Gamma in video, CGI, and Macintosh
- •Gamma in computer graphics
- •Gamma in pseudocolour
- •Limitations of 8-bit linear coding
- •Linear and nonlinear coding in CGI
- •Colour acuity
- •RGB and R’G’B’ colour cubes
- •Conventional luma/colour difference coding
- •Luminance and luma notation
- •Nonlinear red, green, blue (R’G’B’)
- •BT.601 luma
- •BT.709 luma
- •Chroma subsampling, revisited
- •Luma/colour difference summary
- •SD and HD luma chaos
- •Luma/colour difference component sets
- •B’-Y’, R’-Y’ components for SD
- •PBPR components for SD
- •CBCR components for SD
- •Y’CBCR from studio RGB
- •Y’CBCR from computer RGB
- •“Full-swing” Y’CBCR
- •Y’UV, Y’IQ confusion
- •B’-Y’, R’-Y’ components for BT.709 HD
- •PBPR components for BT.709 HD
- •CBCR components for BT.709 HD
- •CBCR components for xvYCC
- •Y’CBCR from studio RGB
- •Y’CBCR from computer RGB
- •Conversions between HD and SD
- •Colour coding standards
- •31. Video signal processing
- •Edge treatment
- •Transition samples
- •Picture lines
- •Choice of SAL and SPW parameters
- •Video levels
- •Setup (pedestal)
- •BT.601 to computing
- •Enhancement
- •Median filtering
- •Coring
- •Chroma transition improvement (CTI)
- •Mixing and keying
- •Field rate
- •Line rate
- •Sound subcarrier
- •Addition of composite colour
- •NTSC colour subcarrier
- •576i PAL colour subcarrier
- •4fSC sampling
- •Common sampling rate
- •Numerology of HD scanning
- •Audio rates
- •33. Timecode
- •Introduction
- •Dropframe timecode
- •Editing
- •Linear timecode (LTC)
- •Vertical interval timecode (VITC)
- •Timecode structure
- •Further reading
- •34. 2-3 pulldown
- •2-3-3-2 pulldown
- •Conversion of film to different frame rates
- •Native 24 Hz coding
- •Conversion to other rates
- •Spatial domain
- •Vertical-temporal domain
- •Motion adaptivity
- •Further reading
- •36. Colourbars
- •SD colourbars
- •SD colourbar notation
- •Pluge element
- •Composite decoder adjustment using colourbars
- •-I, +Q, and Pluge elements in SD colourbars
- •HD colourbars
- •References
- •38. SDI and HD-SDI interfaces
- •Component digital SD interface (BT.601)
- •Serial digital interface (SDI)
- •Component digital HD-SDI
- •SDI and HD-SDI sync, TRS, and ancillary data
- •Analog sync and digital/analog timing relationships
- •Ancillary data
- •SDI coding
- •HD-SDI coding
- •Interfaces for compressed video
- •SDTI
- •Switching and mixing
- •Timing in digital facilities
- •Summary of digital interfaces
- •39. 480i component video
- •Frame rate
- •Interlace
- •Line sync
- •Field/frame sync
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Picture center, aspect ratio, and blanking
- •Halfline blanking
- •Component digital 4:2:2 interface
- •Component analog R’G’B’ interface
- •Component analog Y’PBPR interface, EBU N10
- •Component analog Y’PBPR interface, industry standard
- •40. 576i component video
- •Frame rate
- •Interlace
- •Line sync
- •Analog field/frame sync
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Picture center, aspect ratio, and blanking
- •Component digital 4:2:2 interface
- •Component analog 576i interface
- •Scanning
- •Analog sync
- •Picture center, aspect ratio, and blanking
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Component digital 4:2:2 interface
- •Scanning
- •Analog sync
- •Picture center, aspect ratio, and blanking
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Component digital 4:2:2 interface
- •43. HD videotape
- •HDCAM (D-11)
- •DVCPRO HD (D-12)
- •HDCAM SR (D-16)
- •JPEG blocks and MCUs
- •JPEG block diagram
- •Level shifting
- •Discrete cosine transform (DCT)
- •JPEG encoding example
- •JPEG decoding
- •Compression ratio control
- •JPEG/JFIF
- •Motion-JPEG (M-JPEG)
- •Further reading
- •46. DV compression
- •DV chroma subsampling
- •DV frame/field modes
- •Picture-in-shuttle in DV
- •DV overflow scheme
- •DV quantization
- •DV digital interface (DIF)
- •Consumer DV recording
- •Professional DV variants
- •47. MPEG-2 video compression
- •MPEG-2 profiles and levels
- •Picture structure
- •Frame rate and 2-3 pulldown in MPEG
- •Luma and chroma sampling structures
- •Macroblocks
- •Picture coding types – I, P, B
- •Prediction
- •Motion vectors (MVs)
- •Coding of a block
- •Frame and field DCT types
- •Zigzag and VLE
- •Refresh
- •Motion estimation
- •Rate control and buffer management
- •Bitstream syntax
- •Transport
- •Further reading
- •48. H.264 video compression
- •Algorithmic features, profiles, and levels
- •Baseline and extended profiles
- •High profiles
- •Hierarchy
- •Multiple reference pictures
- •Slices
- •Spatial intra prediction
- •Flexible motion compensation
- •Quarter-pel motion-compensated interpolation
- •Weighting and offsetting of MC prediction
- •16-bit integer transform
- •Quantizer
- •Variable-length coding
- •Context adaptivity
- •CABAC
- •Deblocking filter
- •Buffer control
- •Scalable video coding (SVC)
- •Multiview video coding (MVC)
- •AVC-Intra
- •Further reading
- •49. VP8 compression
- •Algorithmic features
- •Further reading
- •Elementary stream (ES)
- •Packetized elementary stream (PES)
- •MPEG-2 program stream
- •MPEG-2 transport stream
- •System clock
- •Further reading
- •Japan
- •United States
- •ATSC modulation
- •Europe
- •Further reading
- •Appendices
- •Cement vs. concrete
- •True CIE luminance
- •The misinterpretation of luminance
- •The enshrining of luma
- •Colour difference scale factors
- •Conclusion: A plea
- •Radiometry
- •Photometry
- •Light level examples
- •Image science
- •Units
- •Further reading
- •Glossary
- •Index
- •About the author
Introduction to HD |
15 |
Fujio, Takashi, J. Ishida, T. Komoto, and Taiji Nishizawa (1980), High definition television system – signal standards and transmission, SMPTE Journal, 89 (8): 579–584 (Aug.).
Fujio, Takashi (1981), “High definition television systems: desirable standards, signal forms, and transmission systems,” in IEEE Tr. Comm. 29 (12): 1882–1891 (Dec.).
Fujio, Takashi, et al. (1982), High Definition television, NHK Science and Technical Research Laboratories Technical Monograph 32 (June).
Developmental HD systems had 1125/60.00/2:1 scanning, an aspect ratio of 5:3, and 1035 active lines. The alternate 59.94 Hz field rate was added later. Aspect ratio was changed to 16:9 to achieve international agreement upon standards. A count of 1080 image rows was eventually agreed upon to provide square sampling. The developmental 1035i (1125/60) system, standardized in SMPTE 240M, was discussed in the first edition of this book.
This chapter outlines the 1280× 720 and 1920× 1080 image formats for high-definition (HD) television, and introduces the scanning parameters of the associated video systems such as 720p60 and 1080i30.
Today’s HD systems stem from research directed by Dr. Fujio at NHK (Nippon Hoso Kyokai, the Japan Broadcasting Corporation). HD has about twice the vertical and twice the horizontal resolution of conventional television, a picture aspect ratio of 16:9, at least two channels of CD-quality audio, and a frame rate of 23.976 Hz or higher. By my definition, HD has 3⁄4-million pixels or more. NHK conceived HD to have interlaced scanning; however, progressive HD systems have since emerged.
Studio HD has a sampling rate of 74.25 MHz, 5.5 times that of the BT.601 standard for SD. HD has
a pixel rate of about 60 megapixels per second. Apart from a few annoying exceptions, parameters of R’G’B’ coding are similar those of SD standards – in fact, several parameters adopted for HD in BT.709 have essentially been retrofitted into SD. Details concerning scanning, sample rates, and interface levels of HD will be presented in 1280× 720 HD on page 467 and 1920× 1080 HD on page 473. Unfortunately, the parameters for Y’CBCR colour coding for HD differ from the parameters for SD! Details will be provided in
Component video colour coding for HD, on page 369.
HD scanning
A great debate took place in the 1980s and 1990s concerning whether HD should have interlaced or
141
720p60
1280 × 720
1080p30,
1080i30
1920 × 1080
1650
|
|
|
|
1280 |
|
750 |
|
|
720 |
|
|
|
|
|
74.25 MHz |
16:9 |
|
|
2200 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1920 |
|
1125 |
|
1080 |
|
|
|
|
|
74.25 MHz |
16:9 |
||
|
|
|
|
|
|
Figure 15.1 HD rasters at 30 and 60 frames per second are standardized in two formats, 1280×720 (1 Mpx, always progressive), and 1920×1080 (2 Mpx, interlaced or progressive). The
latter is often denoted 1080i, but the standards accommodate progressive scan. These sketches are scaled to match Figures 13.1 and 13.2; pixels in these sketches have identical area.
In Numerology of HD scanning, on page 395, I explain the origin of the numbers in Figure 15.1.
progressive scanning. At given flicker and data rates, interlace offers some increase in static spatial resolution, as suggested by Figure 8.8 on page 91. Broadcasters have historically accepted the motion artifacts and spatial aliasing that accompany interlace, in order to gain some static spatial resolution. In the HD debate, the computer industry and the creative film community were resolutely set against interlace. Eventually, both camps compromised to some degree and HD standards were established to accommodate both interlaced and progressive image formats. To be commercially viable a receiver must decode both formats, though there is no “legal” requirement to do so.
Figure 15.1 above sketches the rasters of the 1 Mpx progressive system (1280× 720, 720p60) and the 2 Mpx interlaced system (1920× 1080, 1080i30) that were agreed upon. 1280× 720 is very simply related to 1920× 1080: 1280 is two thirds of 1920, and 720 is two thirds of 1080.
142 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
Image |
Progressive/interlace |
Image |
|
||
format |
‡Frame rate [Hz] |
aspect ratio |
Sampling |
||
640 |
× 480 |
p |
24, 30, 60 |
4:3 |
Square |
|
|
i |
30 |
|
|
704 |
× 480 |
p |
24, 30, 60 |
4:3 |
Nonsquare |
|
|
i |
30 |
|
|
|
|
p |
24, 30, 60 |
16:9 |
Nonsquare |
|
|
i |
30 |
|
|
1280 |
× 720 |
p |
24, 30, 60 |
16:9 |
Square |
1920× 1080 |
p |
24, 30 |
16:9 |
Square |
|
|
|
i |
30 |
|
|
|
|
|
|
|
|
‡Frame rates modified by the ratio 1000⁄1001 – that is, frame rates of 23.976 Hz, 29.97 Hz, and 59.94 Hz – are
permitted.
Table 15.1 ATSC A/53 Table 3 defines the so-called 18 formats – including 12 SD formats – for digital television in the U.S. I find the layout of ATSC’s Table 3 to be hopelessly contorted, so I rearranged it. ATSC specifies 704 SAL for several SD formats, instead of BT.601’s 720 SAL; see
page 380. ATSC standard A/53 doesn’t accommodate 25 Hz and 50 Hz frame rates, but A/63 does.
ATSC A/53, Digital Television
Standard.
In addition to the 1 Mpx (progressive) and 2 Mpx (interlaced) systems, several SD scanning systems and several additional frame rates were included in the ultimate ATSC standards for U.S. digital television (DTV). Table 15.1 summarizes the “18 formats” that are found in Table 3 of the ATSC’s A/53 standard.
The 1920× 1080 system was conceived as interlacedonly (1080i30), but was adapted to 24 and 30 Hz progressive scan (1080p24, 1080p30) using the standard 74.25 MHz sample rate. The adaptation to 24 Hz was seminal to digital cinema. Figure 15.2 overleaf sketches raster structures for 24 Hz and 25 Hz systems; Table 15.2 summarizes the scanning parameters.
In Sony’s legacy hdcam system, the 1920× 1080 image was downsampled to 1440× 1080, and colour difference signals were subsampled 3:1:1, prior to compression. This was an internal representation only; there was no corresponding uncompressed external interface standard. The current Sony hdcam sr format represents 1920× 1080 image data directly at 4:2:2 (or in some variations 4:4:4), and alleviates the need for such downsampling.
SMPTE ST 274 provides for carriage of a 1920× 1080 image at a frame rate of 25 Hz: 1125 total lines are
CHAPTER 15 |
INTRODUCTION TO HD |
143 |
1125/25 |
|
|
|
|
1125/24 |
|
|
|
|
STL |
2640 |
|
|
2200 |
|
2750 |
|
|
|
|
|
|
|
|
|
|
|
|
1920 |
1125 |
1125 |
|
1080 |
|
|
|
|
74.25 MHz |
16:9 |
|
|
|
|
|
Figure 15.2 HD rasters at 24 Hz and 25 Hz carry an array of 1920× 1080 active samples, using
a 74.25 MHz sampling rate at the interface. For 24 Hz (1080p24), the 1920× 1080 array is carried in an 1125/24 raster. For 25 Hz, the array is carried in an 1125/25 raster.
retained, and STL is increased to 2640. This yields the 1080p25 format, using an 1125/25 raster. Scanning can be either progressive or interlaced; with progressive scanning, the signal is usually interfaced using the progressive segmented frame (PsF) scheme that I introduced on page 94.
For 24 Hz, 1125 total lines are retained, and STL is increased to 2750 to achieve the 24 Hz frame rate. This yields the 1080p24 format, in an 1125/24 raster. This system is used in digital cinema (D-cinema). A variant at
24 ≈23.976 23.976 Hz is accommodated.
1.001
Table 15.2 summarizes the scanning parameters for 720p, 1080i, and 1080p systems. Studio interfaces for HD will be introduced in SDI and HD-SDI interfaces, on page 429.
Colour coding for BT.709 HD
The conventional view of BT.709 “encoding” involves the OECF in the standard. In Image acquisition and presentation, on page 19, the argument is made that what matters is the display process. Faithful presentation of completed program material requires that the display EOCF be standardized. A standard camera OECF (such as that in BT.709) is useful for engineering
144 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
System |
Scanning |
SMPTE standard |
STL |
LT |
NC (SAL) NR (LA) |
|
720p60 |
750/60/1:1 |
SMPTE ST 296 |
1650 |
750 |
1280 |
720 |
1080i30 |
1125/60/2:1 |
SMPTE ST 274 |
2200 |
1125 |
1920 |
1080 |
1080p60¶ |
1125/60/1:1 |
SMPTE ST 274 |
2200 |
1125 |
1920 |
1080 |
1080p30 |
1125/30/1:1 |
SMPTE ST 274 |
2200 |
1125 |
1920 |
1080 |
1080i25 |
1125/25/2:1 |
SMPTE ST 274 |
2640 |
1125 |
1920 |
1080 |
1080p25 |
1125/25/1:1 |
SMPTE ST 274 |
2640 |
1125 |
1920 |
1080 |
1080p24 |
1125/24/1:1 |
SMPTE ST 274 |
2750 |
1125 |
1920 |
1080 |
|
|
|
|
|
|
|
Table 15.2 HD scanning parameters. are summarized. SMPTE ST 274 includes a progressive 2 Mpx, 1080p60 system with 1125/60/1:1 scanning, flagged with ¶ above; this system is not permitted for ATSC broadcasting. Each of the 24, 30, and 60 Hz systems above has an associated system at 1000⁄1001 of that rate.
purposes, but has no impact upon faithful presentation. In practice, so-called BT.709 program material has R’G’B’ data values established so that the inrtended image appearance is obtained when those R’G’B’ values are displayed through a reference EOCF (for example, that of BT.1886) into a known set of viewing conditions (unfortunately, not yet standardized).
BT.709 defines Y’CBCR colour coding. Unfortunately, the luma coefficients standardized in BT.709 – and the CBCR scale factors derived from them – differ from those of SD. Y’CBCR coding now comes in two flavors: coding for small (SD) pictures, and coding for large (HD) pictures. I will present details concerning this troublesome issue in SD and HD luma chaos, on page 350.
CHAPTER 15 |
INTRODUCTION TO HD |
145 |
This page intentionally left blank
