- •Preface
- •Acknowledgments
- •Contents
- •1 Introduction
- •1.1 Auditory Temporal and Spatial Factors
- •1.2 Auditory System Model for Temporal and Spatial Information Processing
- •2.1 Analysis of Source Signals
- •2.1.1 Power Spectrum
- •2.1.2 Autocorrelation Function (ACF)
- •2.1.3 Running Autocorrelation
- •2.2 Physical Factors of Sound Fields
- •2.2.1 Sound Transmission from a Point Source through a Room to the Listener
- •2.2.2 Temporal-Monaural Factors
- •2.2.3 Spatial-Binaural Factors
- •2.3 Simulation of a Sound Field in an Anechoic Enclosure
- •3 Subjective Preferences for Sound Fields
- •3.2.1 Optimal Listening Level (LL)
- •3.2.4 Optimal Magnitude of Interaural Crosscorrelation (IACC)
- •3.3 Theory of Subjective Preferences for Sound Fields
- •3.4 Evaluation of Boston Symphony Hall Based on Temporal and Spatial Factors
- •4.1.1 Brainstem Response Correlates of Sound Direction in the Horizontal Plane
- •4.1.2 Brainstem Response Correlates of Listening Level (LL) and Interaural Crosscorrelation Magnitude (IACC)
- •4.1.3 Remarks
- •4.2.2 Hemispheric Lateralization Related to Spatial Aspects of Sound
- •4.2.3 Response Latency Correlates of Subjective Preference
- •4.3 Electroencephalographic (EEG) Correlates of Subjective Preference
- •4.3.3 EEG Correlates of Interaural Correlation Magnitude (IACC) Changes
- •4.4.1 Preferences and the Persistence of Alpha Rhythms
- •4.4.2 Preferences and the Spatial Extent of Alpha Rhythms
- •4.4.3 Alpha Rhythm Correlates of Annoyance
- •5.1 Signal Processing Model of the Human Auditory System
- •5.1.1 Summary of Neural Evidence
- •5.1.1.1 Physical Characteristics of the Ear
- •5.1.1.2 Left and Right Auditory Brainstem Responses (ABRs)
- •5.1.1.3 Left and Right Hemisphere Slow Vertex Responses (SVRs)
- •5.1.1.4 Left and Right Hemisphere EEG Responses
- •5.1.1.5 Left and Right Hemisphere MEG Responses
- •5.1.2 Auditory Signal Processing Model
- •5.2 Temporal Factors Extracted from Autocorrelations of Sound Signals
- •5.3 Auditory Temporal Window for Autocorrelation Processing
- •5.5 Auditory Temporal Window for Binaural Processing
- •5.6 Hemispheric Specialization for Spatial Attributes of Sound Fields
- •6 Temporal Sensations of the Sound Signal
- •6.1 Combinations of Temporal and Spatial Sensations
- •6.2 Pitch of Complex Tones and Multiband Noise
- •6.2.1 Perception of the Low Pitch of Complex Tones
- •6.2.3 Frequency Limits of Missing Fundamentals
- •6.3 Beats Induced by Dual Missing Fundamentals
- •6.4 Loudness
- •6.4.1 Loudness of Sharply Filtered Noise
- •6.4.2 Loudness of Complex Noise
- •6.6 Timbre of an Electric Guitar Sound with Distortion
- •6.6.3 Concluding Remarks
- •7 Spatial Sensations of Binaural Signals
- •7.1 Sound Localization
- •7.1.1 Cues of Localization in the Horizontal Plane
- •7.1.2 Cues of Localization in the Median Plane
- •7.2 Apparent Source Width (ASW)
- •7.2.1 Apparent Width of Bandpass Noise
- •7.2.2 Apparent Width of Multiband Noise
- •7.3 Subjective Diffuseness
- •8.1 Pitches of Piano Notes
- •8.2 Design Studies of Concert Halls as Public Spaces
- •8.2.1 Genetic Algorithms (GAs) for Shape Optimization
- •8.2.2 Two Actual Designs: Kirishima and Tsuyama
- •8.3 Individualized Seat Selection Systems for Enhancing Aural Experience
- •8.3.1 A Seat Selection System
- •8.3.2 Individual Subjective Preference
- •8.3.3 Distributions of Listener Preferences
- •8.5 Concert Hall as Musical Instrument
- •8.5.1 Composing with the Hall in Mind: Matching Music and Reverberation
- •8.5.2 Expanding the Musical Image: Spatial Expression and Apparent Source Width
- •8.5.3 Enveloping Music: Spatial Expression and Musical Dynamics
- •8.6 Performing in a Hall: Blending Musical Performances with Sound Fields
- •8.6.1 Choosing a Performing Position on the Stage
- •8.6.2 Performance Adjustments that Optimize Temporal Factors
- •8.6.3 Towards Future Integration of Composition, Performance and Hall Acoustics
- •9.1 Effects of Temporal Factors on Speech Reception
- •9.2 Effects of Spatial Factors on Speech Reception
- •9.3 Effects of Sound Fields on Perceptual Dissimilarity
- •9.3.1 Perceptual Distance due to Temporal Factors
- •9.3.2 Perceptual Distance due to Spatial Factors
- •10.1 Method of Noise Measurement
- •10.2 Aircraft Noise
- •10.3 Flushing Toilet Noise
- •11.1 Noise Annoyance in Relation to Temporal Factors
- •11.1.1 Annoyance of Band-Pass Noise
- •11.2.1 Experiment 1: Effects of SPL and IACC Fluctuations
- •11.2.2 Experiment 2: Effects of Sound Movement
- •11.3 Effects of Noise and Music on Children
- •12 Introduction to Visual Sensations
- •13 Temporal and Spatial Sensations in Vision
- •13.1 Temporal Sensations of Flickering Light
- •13.1.1 Conclusions
- •13.2 Spatial Sensations
- •14 Subjective Preferences in Vision
- •14.1 Subjective Preferences for Flickering Lights
- •14.2 Subjective Preferences for Oscillatory Movements
- •14.3 Subjective Preferences for Texture
- •14.3.1 Preferred Regularity of Texture
- •15.1 EEG Correlates of Preferences for Flickering Lights
- •15.1.1 Persistence of Alpha Rhythms
- •15.1.2 Spatial Extent of Alpha Rhythms
- •15.2 MEG Correlates of Preferences for Flickering Lights
- •15.2.1 MEG Correlates of Sinusoidal Flicker
- •15.2.2 MEG Correlates of Fluctuating Flicker Rates
- •15.3 EEG Correlates of Preferences for Oscillatory Movements
- •15.4 Hemispheric Specializations in Vision
- •16 Summary of Auditory and Visual Sensations
- •16.1 Auditory Sensations
- •16.1.1 Auditory Temporal Sensations
- •16.1.2 Auditory Spatial Sensations
- •16.1.3 Auditory Subjective Preferences
- •16.1.4 Effects of Noise on Tasks and Annoyance
- •16.2.1 Temporal and Spatial Sensations in Vision
- •16.2.2 Visual Subjective Preferences
- •References
- •Glossary of Symbols
- •Abbreviations
- •Author Index
- •Subject Index
Chapter 12
Introduction to Visual Sensations
Part I of this book considers the basis for auditory perceptual qualities and preferences, especially as they relate to architectural acoustics. The auditory primary sensations were classified as either temporal or spatial sensations, which are described in terms of a signal-processing model of the central auditory system. The model consists of a monaural autocorrelation mechanism (ACF) and a binaural crosscorrelation mechanism (IACF). The temporal factors extracted from the ACF associated with the left hemisphere and the spatial factors extracted from the IACF associated with the right hemisphere, respectively, effectively describe temporal and spatial sensations. Such specializations of human cerebral hemispheres play an important role in making temporal and spatial factors independent with respect to subjective judgments. The auditory temporal sensations are loudness, pitch (missing fundamental), timbre, and duration sensations. The auditory spatial sensations include sound localization, apparent sound width (ASW), and subjective diffuseness (envelopment).
Part II considers perceptual qualities and preferences in vision. Visual sensations can be considered in terms of temporal and spatial sensations that are based on analogous correlation mechanisms, and similar methods can be used to assess their associated subjective preferences. The visual temporal sensation of flicker rate is analogous to auditory pitch and the missing fundamental phenomenon (Fujii et al., 2000). Considerable physiological and psychological evidence exists for temporal autoand crosscorrelation representations in vision and in many other sensory modalities (Cariani, 2001). The visual spatial sensations include contrast, regularity, and coarseness of the focal vision (Fujii et al., 2003), as well as localization. Visual sensations in relation to temporal factors may well be described in terms of brain activities (Soeta et al., 2002a, b; Soeta et al., 2002). Table 12.1 summarizes temporal and spatial sensations in vision as well as their subjective preferences. The table provides the features of temporal and spatial autocorrelation representations that are thought to be associated with each visual perceptual attribute, as well as their corresponding neural activity observables and the sections in this volume where they are discussed.
Y. Ando, P. Cariani (Guest ed.), Auditory and Visual Sensations, |
235 |
DOI 10.1007/b13253_12, C Springer Science+Business Media, LLC 2009 |
|
Table 12.1 Summary of sensations and subjective preference in relation to factors extracted from the ACF and IACF, and neurophysiological locus and observables described in Part II of this volume
Sensations and subjective |
Acoustic |
|
|
|
|
|
preference |
correlate |
Representation |
Main factor |
Locus |
Observable(s) |
Section(s) |
|
|
|
|
|
|
|
Temporal sensations |
|
|
|
|
|
|
and preference |
|
|
|
|
|
|
Periodicity pitch |
Fundamental |
Temporal ACF |
τ1 extracted from the |
|
|
13.1 |
|
frequency |
|
ACF |
|
|
|
Subjective preference of the |
|
Temporal ACF |
τ1, φ1 extracted |
Left hemisphere |
EEG, MEG |
14.1, 15.1, 15.2 |
period of flickering light |
|
|
from the ACF |
|
|
|
Subjective preference of the |
|
Temporal ACF |
τ1 extracted from the |
Left hemisphere |
EEG |
14.2. 15.3 |
period of moving single |
|
|
ACF |
|
|
|
target |
|
|
|
|
|
|
Spatial sensations and |
|
|
|
|
|
|
preference |
|
|
|
(Right hemisphere)1 |
|
|
Contrast |
|
Spatial ACF |
(0) and δ1 |
|
13.2 |
|
|
|
|
extracted from the |
|
|
|
|
|
|
ACF |
|
|
|
Regularity |
|
Spatial ACF |
δ1 and φ1 extracted |
(Right hemisphere) |
|
13.2 |
|
|
|
from the ACF |
|
|
|
Coarseness |
|
Spatial ACF |
(0) and δ1 |
(Right hemisphere) |
|
13.2 |
|
|
|
extracted from the |
|
|
|
|
|
|
ACF |
|
|
|
Subjective preference |
|
Spatial ACF |
φ1 extracted from |
(Right hemisphere) |
|
14.3 |
of texture |
|
|
the ACF |
|
|
|
|
|
|
|
|
|
|
1From previous works, it is considered that the spatial factors are associated with the right hemisphere.
236
Sensations Visual to Introduction 12
