- •Contents
- •Figures
- •Tables
- •Preface
- •Acknowledgments
- •1. Raster images
- •Aspect ratio
- •Geometry
- •Image capture
- •Digitization
- •Perceptual uniformity
- •Colour
- •Luma and colour difference components
- •Digital image representation
- •Square sampling
- •Comparison of aspect ratios
- •Aspect ratio
- •Frame rates
- •Image state
- •EOCF standards
- •Entertainment programming
- •Acquisition
- •Consumer origination
- •Consumer electronics (CE) display
- •Contrast
- •Contrast ratio
- •Perceptual uniformity
- •The “code 100” problem and nonlinear image coding
- •Linear and nonlinear
- •4. Quantization
- •Linearity
- •Decibels
- •Noise, signal, sensitivity
- •Quantization error
- •Full-swing
- •Studio-swing (footroom and headroom)
- •Interface offset
- •Processing coding
- •Two’s complement wrap-around
- •Perceptual attributes
- •History of display signal processing
- •Digital driving levels
- •Relationship between signal and lightness
- •Algorithm
- •Black level setting
- •Effect of contrast and brightness on contrast and brightness
- •An alternate interpretation
- •Brightness and contrast controls in LCDs
- •Brightness and contrast controls in PDPs
- •Brightness and contrast controls in desktop graphics
- •Symbolic image description
- •Raster images
- •Conversion among types
- •Image files
- •“Resolution” in computer graphics
- •7. Image structure
- •Image reconstruction
- •Sampling aperture
- •Spot profile
- •Box distribution
- •Gaussian distribution
- •8. Raster scanning
- •Flicker, refresh rate, and frame rate
- •Introduction to scanning
- •Scanning parameters
- •Interlaced format
- •Interlace and progressive
- •Scanning notation
- •Motion portrayal
- •Segmented-frame (24PsF)
- •Video system taxonomy
- •Conversion among systems
- •9. Resolution
- •Magnitude frequency response and bandwidth
- •Visual acuity
- •Viewing distance and angle
- •Kell effect
- •Resolution
- •Resolution in video
- •Viewing distance
- •Interlace revisited
- •10. Constant luminance
- •The principle of constant luminance
- •Compensating for the CRT
- •Departure from constant luminance
- •Luma
- •“Leakage” of luminance into chroma
- •11. Picture rendering
- •Surround effect
- •Tone scale alteration
- •Incorporation of rendering
- •Rendering in desktop computing
- •Luma
- •Sloppy use of the term luminance
- •Colour difference coding (chroma)
- •Chroma subsampling
- •Chroma subsampling notation
- •Chroma subsampling filters
- •Chroma in composite NTSC and PAL
- •Scanning standards
- •Widescreen (16:9) SD
- •Square and nonsquare sampling
- •Resampling
- •NTSC and PAL encoding
- •NTSC and PAL decoding
- •S-video interface
- •Frequency interleaving
- •Composite analog SD
- •15. Introduction to HD
- •HD scanning
- •Colour coding for BT.709 HD
- •Data compression
- •Image compression
- •Lossy compression
- •JPEG
- •Motion-JPEG
- •JPEG 2000
- •Mezzanine compression
- •MPEG
- •Picture coding types (I, P, B)
- •Reordering
- •MPEG-1
- •MPEG-2
- •Other MPEGs
- •MPEG IMX
- •MPEG-4
- •AVC-Intra
- •WM9, WM10, VC-1 codecs
- •Compression for CE acquisition
- •AVCHD
- •Compression for IP transport to consumers
- •VP8 (“WebM”) codec
- •Dirac (basic)
- •17. Streams and files
- •Historical overview
- •Physical layer
- •Stream interfaces
- •IEEE 1394 (FireWire, i.LINK)
- •HTTP live streaming (HLS)
- •18. Metadata
- •Metadata Example 1: CD-DA
- •Metadata Example 2: .yuv files
- •Metadata Example 3: RFF
- •Metadata Example 4: JPEG/JFIF
- •Metadata Example 5: Sequence display extension
- •Conclusions
- •19. Stereoscopic (“3-D”) video
- •Acquisition
- •S3D display
- •Anaglyph
- •Temporal multiplexing
- •Polarization
- •Wavelength multiplexing (Infitec/Dolby)
- •Autostereoscopic displays
- •Parallax barrier display
- •Lenticular display
- •Recording and compression
- •Consumer interface and display
- •Ghosting
- •Vergence and accommodation
- •20. Filtering and sampling
- •Sampling theorem
- •Sampling at exactly 0.5fS
- •Magnitude frequency response
- •Magnitude frequency response of a boxcar
- •The sinc weighting function
- •Frequency response of point sampling
- •Fourier transform pairs
- •Analog filters
- •Digital filters
- •Impulse response
- •Finite impulse response (FIR) filters
- •Physical realizability of a filter
- •Phase response (group delay)
- •Infinite impulse response (IIR) filters
- •Lowpass filter
- •Digital filter design
- •Reconstruction
- •Reconstruction close to 0.5fS
- •“(sin x)/x” correction
- •Further reading
- •2:1 downsampling
- •Oversampling
- •Interpolation
- •Lagrange interpolation
- •Lagrange interpolation as filtering
- •Polyphase interpolators
- •Polyphase taps and phases
- •Implementing polyphase interpolators
- •Decimation
- •Lowpass filtering in decimation
- •Spatial frequency domain
- •Comb filtering
- •Spatial filtering
- •Image presampling filters
- •Image reconstruction filters
- •Spatial (2-D) oversampling
- •Retina
- •Adaptation
- •Contrast sensitivity
- •Contrast sensitivity function (CSF)
- •24. Luminance and lightness
- •Radiance, intensity
- •Luminance
- •Relative luminance
- •Luminance from red, green, and blue
- •Lightness (CIE L*)
- •Fundamentals of vision
- •Definitions
- •Spectral power distribution (SPD) and tristimulus
- •Spectral constraints
- •CIE XYZ tristimulus
- •CIE [x, y] chromaticity
- •Blackbody radiation
- •Colour temperature
- •White
- •Chromatic adaptation
- •Perceptually uniform colour spaces
- •CIE L*a*b* (CIELAB)
- •CIE L*u*v* and CIE L*a*b* summary
- •Colour specification and colour image coding
- •Further reading
- •Additive reproduction (RGB)
- •Characterization of RGB primaries
- •BT.709 primaries
- •Leggacy SD primaries
- •sRGB system
- •SMPTE Free Scale (FS) primaries
- •AMPAS ACES primaries
- •SMPTE/DCI P3 primaries
- •CMFs and SPDs
- •Normalization and scaling
- •Luminance coefficients
- •Transformations between RGB and CIE XYZ
- •Noise due to matrixing
- •Transforms among RGB systems
- •Camera white reference
- •Display white reference
- •Gamut
- •Wide-gamut reproduction
- •Free Scale Gamut, Free Scale Log (FS-Gamut, FS-Log)
- •Further reading
- •27. Gamma
- •Gamma in CRT physics
- •The amazing coincidence!
- •Gamma in video
- •Opto-electronic conversion functions (OECFs)
- •BT.709 OECF
- •SMPTE 240M OECF
- •sRGB transfer function
- •Transfer functions in SD
- •Bit depth requirements
- •Gamma in modern display devices
- •Estimating gamma
- •Gamma in video, CGI, and Macintosh
- •Gamma in computer graphics
- •Gamma in pseudocolour
- •Limitations of 8-bit linear coding
- •Linear and nonlinear coding in CGI
- •Colour acuity
- •RGB and R’G’B’ colour cubes
- •Conventional luma/colour difference coding
- •Luminance and luma notation
- •Nonlinear red, green, blue (R’G’B’)
- •BT.601 luma
- •BT.709 luma
- •Chroma subsampling, revisited
- •Luma/colour difference summary
- •SD and HD luma chaos
- •Luma/colour difference component sets
- •B’-Y’, R’-Y’ components for SD
- •PBPR components for SD
- •CBCR components for SD
- •Y’CBCR from studio RGB
- •Y’CBCR from computer RGB
- •“Full-swing” Y’CBCR
- •Y’UV, Y’IQ confusion
- •B’-Y’, R’-Y’ components for BT.709 HD
- •PBPR components for BT.709 HD
- •CBCR components for BT.709 HD
- •CBCR components for xvYCC
- •Y’CBCR from studio RGB
- •Y’CBCR from computer RGB
- •Conversions between HD and SD
- •Colour coding standards
- •31. Video signal processing
- •Edge treatment
- •Transition samples
- •Picture lines
- •Choice of SAL and SPW parameters
- •Video levels
- •Setup (pedestal)
- •BT.601 to computing
- •Enhancement
- •Median filtering
- •Coring
- •Chroma transition improvement (CTI)
- •Mixing and keying
- •Field rate
- •Line rate
- •Sound subcarrier
- •Addition of composite colour
- •NTSC colour subcarrier
- •576i PAL colour subcarrier
- •4fSC sampling
- •Common sampling rate
- •Numerology of HD scanning
- •Audio rates
- •33. Timecode
- •Introduction
- •Dropframe timecode
- •Editing
- •Linear timecode (LTC)
- •Vertical interval timecode (VITC)
- •Timecode structure
- •Further reading
- •34. 2-3 pulldown
- •2-3-3-2 pulldown
- •Conversion of film to different frame rates
- •Native 24 Hz coding
- •Conversion to other rates
- •Spatial domain
- •Vertical-temporal domain
- •Motion adaptivity
- •Further reading
- •36. Colourbars
- •SD colourbars
- •SD colourbar notation
- •Pluge element
- •Composite decoder adjustment using colourbars
- •-I, +Q, and Pluge elements in SD colourbars
- •HD colourbars
- •References
- •38. SDI and HD-SDI interfaces
- •Component digital SD interface (BT.601)
- •Serial digital interface (SDI)
- •Component digital HD-SDI
- •SDI and HD-SDI sync, TRS, and ancillary data
- •Analog sync and digital/analog timing relationships
- •Ancillary data
- •SDI coding
- •HD-SDI coding
- •Interfaces for compressed video
- •SDTI
- •Switching and mixing
- •Timing in digital facilities
- •Summary of digital interfaces
- •39. 480i component video
- •Frame rate
- •Interlace
- •Line sync
- •Field/frame sync
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Picture center, aspect ratio, and blanking
- •Halfline blanking
- •Component digital 4:2:2 interface
- •Component analog R’G’B’ interface
- •Component analog Y’PBPR interface, EBU N10
- •Component analog Y’PBPR interface, industry standard
- •40. 576i component video
- •Frame rate
- •Interlace
- •Line sync
- •Analog field/frame sync
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Picture center, aspect ratio, and blanking
- •Component digital 4:2:2 interface
- •Component analog 576i interface
- •Scanning
- •Analog sync
- •Picture center, aspect ratio, and blanking
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Component digital 4:2:2 interface
- •Scanning
- •Analog sync
- •Picture center, aspect ratio, and blanking
- •R’G’B’ EOCF and primaries
- •Luma (Y’)
- •Component digital 4:2:2 interface
- •43. HD videotape
- •HDCAM (D-11)
- •DVCPRO HD (D-12)
- •HDCAM SR (D-16)
- •JPEG blocks and MCUs
- •JPEG block diagram
- •Level shifting
- •Discrete cosine transform (DCT)
- •JPEG encoding example
- •JPEG decoding
- •Compression ratio control
- •JPEG/JFIF
- •Motion-JPEG (M-JPEG)
- •Further reading
- •46. DV compression
- •DV chroma subsampling
- •DV frame/field modes
- •Picture-in-shuttle in DV
- •DV overflow scheme
- •DV quantization
- •DV digital interface (DIF)
- •Consumer DV recording
- •Professional DV variants
- •47. MPEG-2 video compression
- •MPEG-2 profiles and levels
- •Picture structure
- •Frame rate and 2-3 pulldown in MPEG
- •Luma and chroma sampling structures
- •Macroblocks
- •Picture coding types – I, P, B
- •Prediction
- •Motion vectors (MVs)
- •Coding of a block
- •Frame and field DCT types
- •Zigzag and VLE
- •Refresh
- •Motion estimation
- •Rate control and buffer management
- •Bitstream syntax
- •Transport
- •Further reading
- •48. H.264 video compression
- •Algorithmic features, profiles, and levels
- •Baseline and extended profiles
- •High profiles
- •Hierarchy
- •Multiple reference pictures
- •Slices
- •Spatial intra prediction
- •Flexible motion compensation
- •Quarter-pel motion-compensated interpolation
- •Weighting and offsetting of MC prediction
- •16-bit integer transform
- •Quantizer
- •Variable-length coding
- •Context adaptivity
- •CABAC
- •Deblocking filter
- •Buffer control
- •Scalable video coding (SVC)
- •Multiview video coding (MVC)
- •AVC-Intra
- •Further reading
- •49. VP8 compression
- •Algorithmic features
- •Further reading
- •Elementary stream (ES)
- •Packetized elementary stream (PES)
- •MPEG-2 program stream
- •MPEG-2 transport stream
- •System clock
- •Further reading
- •Japan
- •United States
- •ATSC modulation
- •Europe
- •Further reading
- •Appendices
- •Cement vs. concrete
- •True CIE luminance
- •The misinterpretation of luminance
- •The enshrining of luma
- •Colour difference scale factors
- •Conclusion: A plea
- •Radiometry
- •Photometry
- •Light level examples
- •Image science
- •Units
- •Further reading
- •Glossary
- •Index
- •About the author
30
fFR = 1.001 ≈29.97Hz
fH |
= |
9 |
≈15.734 kHz |
|
|||
|
0.572 |
|
|
It is confusing to refer to fields as odd and even. Use first field and second field instead.
480i component video |
39 |
This chapter details the scanning, timing, sync structure, and picture structure of 480i29.97 (525/59.94/2:1) video. The scanning and timing information in this chapter applies to all variants of 480i video, both analog and digital. The sync information relates to component analog, composite analog, and composite digital systems.
Frame rate
480i video represents stationary or moving two-dimen- sional images sampled temporally at a constant rate of 30⁄1.001 frames per second. For studio video, the tolerance on frame rate is normally ±10 ppm. In practice the tolerance applies to a master clock at a high frequency, but for purposes of computation and standards writing, it is convenient to reference the tolerance to the frame rate.
Interlace
A frame is conveyed as a sequence of 525 horizontal raster lines of equal duration, uniformly scanned top to bottom and left to right. Scanning has 2:1 interlace to form a first field and a second field; scan lines in the second field are displaced vertically by half the vertical sampling pitch, and delayed temporally by half the frame time, from scanning lines in the first field. In MPEG-2 terms, the first field is the bottom field.
Lines are numbered consecutively throughout the frame, starting at 1.
445
Table 39.1 480i line assignment
EQ Equalization pulse
BR Broad pulse
CC Closed caption
[n] Line number relative to start of second field (deprecated)
§V=0 in RP 125-1992, and in the 480i version of BT.601-4 (1994); in later standards, V=1 for these lines.
◊The thick vertical bar at the right indicates lines carried in 480i or 480p MPEG-2 according to SMPTE RP 202. (The vertical center of the picture is located midway between lines 404 and 142.) Unfortunately, 480i DV systems digitize a range one image row up from this.
‡In analog terminology, lines 1 through 3 are considered part of the first field; lines 264 and 265 are considered part of the second field.
Line number, |
Line number, |
|
Contents, |
|
Contents, |
|
|
first field |
second field |
V |
|
|
|
||
(F=0) |
(F=1) |
left half |
|
right half |
|
|
|
|
266 [3] |
|
EQ |
|
BR |
|
|
4 |
|
|
BR |
|
BR |
|
|
|
267 [4] |
|
BR |
|
BR |
|
|
5 |
|
|
BR |
|
BR |
|
|
|
268 [5] |
|
BR |
|
BR |
|
|
6 |
|
|
BR |
|
BR |
|
|
|
269 [6] |
|
BR |
|
EQ |
|
|
7 |
|
|
EQ |
|
EQ |
|
|
|
270 [7] |
|
EQ |
|
EQ |
|
|
8 |
|
|
EQ |
|
EQ |
|
|
|
271 [8] |
|
EQ |
|
EQ |
|
|
9 |
|
|
EQ |
|
EQ |
|
|
|
272 [9] |
|
EQ |
|
none |
|
|
10–19 |
|
§ |
Vertical interval video |
|
|
||
|
|
(10 lines) |
|
|
|||
|
|
V=0 |
|
|
|||
|
273–282 |
Vertical interval video |
|
|
|||
|
[10–19] |
|
(10 lines) |
|
|
||
20 |
|
|
Vertical interval video |
|
|
||
|
283 [20] |
|
Vertical interval video |
|
|
||
21 |
|
|
|
CC |
|
|
|
|
284 [21] |
|
|
CC |
|
|
|
22 |
|
lines) |
Picture |
|
|
||
|
285 [22] |
Picture |
|
|
|||
|
(487 |
|
|
||||
23–261 |
|
Picture |
◊ |
|
|||
|
|
V=0 |
(239lines) |
|
|
||
|
286–524 |
Picture |
|
|
|||
|
|
|
|
||||
|
[23–261] |
|
(239 lines) |
|
|
||
262 |
|
|
Picture |
|
|
||
|
525 [262] |
|
Picture |
|
|
||
263 |
|
|
Picture |
|
EQ |
|
|
|
‡1 |
|
EQ |
|
EQ |
|
|
‡264 [1] |
|
|
EQ |
|
EQ |
|
|
|
‡2 |
|
EQ |
|
EQ |
|
|
‡265 [2] |
|
|
EQ |
|
EQ |
|
|
|
‡3 |
|
EQ |
|
EQ |
|
|
446 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
Concerning closed captions, see
ANSI/EIA/CEA-608-B, Line 21
Data Services.
For details concerning VITC line assignment, see SMPTE RP 164,
Location of Vertical Interval Timecode.
Table 39.1 opposite shows the vertical structure of a frame in 480i video, and indicates the assignment of line numbers and their content.
In legacy equipment, the picture may start as early as line 20 or line 283. However, video on lines 21 and 284 is liable to be replaced by line 21 closed caption data upon NTSC transmission, so it is pointless to provide more than 483 picture lines in the studio. With the wide use of 480i DV and MPEG-2 systems, I argue that it is pointless to provide more than 480 lines; however, 483 lines were broadcast in analog NTSC.
Lines 10 through 21 and 273 through 284 may carry ancillary (“vertical interval”) signals either related or unrelated to the picture. If vertical interval timecode (VITC) is used, it should be located on line 14 (277); a second, redundant copy can be placed on line 16 (279). Failing line 14, line 18 (281) is suggested. See
Vertical interval timecode (VITC), on page 402.
Line sync
Horizontal events are referenced to an instant in time denoted 0H. In the analog domain, 0H is defined by the 50%-point of the leading (negative-going) edge of each line sync pulse. In a component digital interface, the correspondence between sync and the digital information is determined by a timing reference signal (TRS) conveyed across the interface. (See SDI and HD-SDI sync, TRS, and ancillary data, on page 433.)
In an analog interface, every line commences at 0H with the negative-going edge of a sync pulse. With the exception of vertical sync lines, which I will describe in a moment, each line commences with a normal sync pulse, to be described. Each line that commences with normal sync may contain video information. Every line that commences with a sync pulse other than normal sync maintains blanking level, except for the intervals occupied by sync pulses.
Field/frame sync
To define vertical sync, the frame is divided into intervals of halfline duration. Each halfline either contains no sync information or commences with the assertion of a sync pulse having one of three durations, each having a tolerance of ±0.100 µs:
CHAPTER 39 |
480I COMPONENT VIDEO |
447 |
EIA and FCC standards in the United States rounded the equalization pulse duration to two digits, to
2.3 µs, slightly less than the theoretical value of 2.35 µs. Equipment is usually designed to the letter of the regulation, rather than its intent.
Line 263 commences with a normal sync pulse and has an equalization pulse halfway through the line. Line 272 commences with an equalization pulse and remains at blanking with no sync pulse halfway through the line. For analog details, see Chapter 2, Analog SD sync, genlock, and interface, of Composite NTSC and PAL: Legacy Video Systems.
SMPTE RP 168, Definition of Vertical Interval Switching Point for Synchronous Video Switching.
•A normal sync pulse having a duration of 4.7 µs
•An equalization pulse having half the duration of a normal sync pulse
•A broad pulse, having a duration of half the line time less the duration of a normal sync pulse
Each set of 525 halflines in the field commences with a vertical sync sequence as follows:
•Six preequalization pulses
•Six broad pulses
•Six postequalization pulses
Vertical events are referenced to an instant in time denoted 0V. In the analog domain, 0V is defined by the first equalization pulse coincident with 0H. Line number 1 is signalled by 0V; lines count in interlaced time order (not spatial order) throughout the frame. 480i systems are exceptional in identifying 0V and line 1 at the first equalization pulse: In 576i, and in HD, 0V and line 1 are marked at the first broad pulse.
Historically, in the analog domain, 0V was defined for each field by the 50%-point of the first equalization pulse; lines were numbered from 1 to 263 in the first field and from 1 to 262 in the second field. In the digital domain, the first field contains 262 lines and the second field contains 263 lines.
Figure 39.1 opposite shows details of the sync structure; this waveform diagram is the analog of Table 39.1,
480i line assignment, on page 446.
When sync is represented in analog or digitized 4fSC form, a raised-cosine transition having a risetime (from 10% to 90%) of 140±20 ns is imposed; the midpoint of the transition is coincident with the idealized sync.
Switching between video sources is performed in the vertical interval, to avoid disruption of sync or picture. Switching occurs 30±5 µs after 0H of the first normal line of each field. In 480i systems, switching occurs midway through line 10. (If field 2 were dominant, switching would occur midway through line 273.)
R’G’B’ EOCF and primaries
Picture information is referenced to linear-light primary red, green, and blue (RGB) tristimulus values, represented in abstract terms in the range 0 (reference black) to +1 (reference white).
448 |
DIGITAL VIDEO AND HD ALGORITHMS AND INTERFACES |
39 CHAPTER
VIDEO COMPONENT 480I
FIRST FIELD |
|
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
|
|
|
|
CC |
|
EQ EQ EQ EQ EQ EQ BR BR BR BR BR BR EQ EQ EQ EQ EQ EQ |
|
|
|
EQ |
|||||||||
525 1 |
2 |
3 |
4 |
5 |
6 |
7 |
8 |
9 |
10 |
11 |
12 ... 21 |
22 |
23 ... 262 263 |
|
SECOND FIELD |
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
|
|
|
|
|
|
CC |
|
EQ EQ EQ EQ EQ EQ BR BR BR BR BR BR EQ EQ EQ EQ EQ EQ |
|
|
|
|
|||||||||
262 263 |
264 |
265 |
266 |
267 |
268 |
269 |
270 |
271 |
272 |
273 |
274 ... 283 |
284 |
285 286 ... 525 |
Figure 39.1 480i raster, vertical. This drawing shows thewaveformswaveformsof firstof theandfirstsecoand lds,fieconddetailingfields, detailing the vertical sync intervals. CC indicates a line that may contain EIA 608 (“line 21”) closed caption data.
449
