- •Preface
- •Acknowledgments
- •Contents
- •1 Introduction
- •1.1 Auditory Temporal and Spatial Factors
- •1.2 Auditory System Model for Temporal and Spatial Information Processing
- •2.1 Analysis of Source Signals
- •2.1.1 Power Spectrum
- •2.1.2 Autocorrelation Function (ACF)
- •2.1.3 Running Autocorrelation
- •2.2 Physical Factors of Sound Fields
- •2.2.1 Sound Transmission from a Point Source through a Room to the Listener
- •2.2.2 Temporal-Monaural Factors
- •2.2.3 Spatial-Binaural Factors
- •2.3 Simulation of a Sound Field in an Anechoic Enclosure
- •3 Subjective Preferences for Sound Fields
- •3.2.1 Optimal Listening Level (LL)
- •3.2.4 Optimal Magnitude of Interaural Crosscorrelation (IACC)
- •3.3 Theory of Subjective Preferences for Sound Fields
- •3.4 Evaluation of Boston Symphony Hall Based on Temporal and Spatial Factors
- •4.1.1 Brainstem Response Correlates of Sound Direction in the Horizontal Plane
- •4.1.2 Brainstem Response Correlates of Listening Level (LL) and Interaural Crosscorrelation Magnitude (IACC)
- •4.1.3 Remarks
- •4.2.2 Hemispheric Lateralization Related to Spatial Aspects of Sound
- •4.2.3 Response Latency Correlates of Subjective Preference
- •4.3 Electroencephalographic (EEG) Correlates of Subjective Preference
- •4.3.3 EEG Correlates of Interaural Correlation Magnitude (IACC) Changes
- •4.4.1 Preferences and the Persistence of Alpha Rhythms
- •4.4.2 Preferences and the Spatial Extent of Alpha Rhythms
- •4.4.3 Alpha Rhythm Correlates of Annoyance
- •5.1 Signal Processing Model of the Human Auditory System
- •5.1.1 Summary of Neural Evidence
- •5.1.1.1 Physical Characteristics of the Ear
- •5.1.1.2 Left and Right Auditory Brainstem Responses (ABRs)
- •5.1.1.3 Left and Right Hemisphere Slow Vertex Responses (SVRs)
- •5.1.1.4 Left and Right Hemisphere EEG Responses
- •5.1.1.5 Left and Right Hemisphere MEG Responses
- •5.1.2 Auditory Signal Processing Model
- •5.2 Temporal Factors Extracted from Autocorrelations of Sound Signals
- •5.3 Auditory Temporal Window for Autocorrelation Processing
- •5.5 Auditory Temporal Window for Binaural Processing
- •5.6 Hemispheric Specialization for Spatial Attributes of Sound Fields
- •6 Temporal Sensations of the Sound Signal
- •6.1 Combinations of Temporal and Spatial Sensations
- •6.2 Pitch of Complex Tones and Multiband Noise
- •6.2.1 Perception of the Low Pitch of Complex Tones
- •6.2.3 Frequency Limits of Missing Fundamentals
- •6.3 Beats Induced by Dual Missing Fundamentals
- •6.4 Loudness
- •6.4.1 Loudness of Sharply Filtered Noise
- •6.4.2 Loudness of Complex Noise
- •6.6 Timbre of an Electric Guitar Sound with Distortion
- •6.6.3 Concluding Remarks
- •7 Spatial Sensations of Binaural Signals
- •7.1 Sound Localization
- •7.1.1 Cues of Localization in the Horizontal Plane
- •7.1.2 Cues of Localization in the Median Plane
- •7.2 Apparent Source Width (ASW)
- •7.2.1 Apparent Width of Bandpass Noise
- •7.2.2 Apparent Width of Multiband Noise
- •7.3 Subjective Diffuseness
- •8.1 Pitches of Piano Notes
- •8.2 Design Studies of Concert Halls as Public Spaces
- •8.2.1 Genetic Algorithms (GAs) for Shape Optimization
- •8.2.2 Two Actual Designs: Kirishima and Tsuyama
- •8.3 Individualized Seat Selection Systems for Enhancing Aural Experience
- •8.3.1 A Seat Selection System
- •8.3.2 Individual Subjective Preference
- •8.3.3 Distributions of Listener Preferences
- •8.5 Concert Hall as Musical Instrument
- •8.5.1 Composing with the Hall in Mind: Matching Music and Reverberation
- •8.5.2 Expanding the Musical Image: Spatial Expression and Apparent Source Width
- •8.5.3 Enveloping Music: Spatial Expression and Musical Dynamics
- •8.6 Performing in a Hall: Blending Musical Performances with Sound Fields
- •8.6.1 Choosing a Performing Position on the Stage
- •8.6.2 Performance Adjustments that Optimize Temporal Factors
- •8.6.3 Towards Future Integration of Composition, Performance and Hall Acoustics
- •9.1 Effects of Temporal Factors on Speech Reception
- •9.2 Effects of Spatial Factors on Speech Reception
- •9.3 Effects of Sound Fields on Perceptual Dissimilarity
- •9.3.1 Perceptual Distance due to Temporal Factors
- •9.3.2 Perceptual Distance due to Spatial Factors
- •10.1 Method of Noise Measurement
- •10.2 Aircraft Noise
- •10.3 Flushing Toilet Noise
- •11.1 Noise Annoyance in Relation to Temporal Factors
- •11.1.1 Annoyance of Band-Pass Noise
- •11.2.1 Experiment 1: Effects of SPL and IACC Fluctuations
- •11.2.2 Experiment 2: Effects of Sound Movement
- •11.3 Effects of Noise and Music on Children
- •12 Introduction to Visual Sensations
- •13 Temporal and Spatial Sensations in Vision
- •13.1 Temporal Sensations of Flickering Light
- •13.1.1 Conclusions
- •13.2 Spatial Sensations
- •14 Subjective Preferences in Vision
- •14.1 Subjective Preferences for Flickering Lights
- •14.2 Subjective Preferences for Oscillatory Movements
- •14.3 Subjective Preferences for Texture
- •14.3.1 Preferred Regularity of Texture
- •15.1 EEG Correlates of Preferences for Flickering Lights
- •15.1.1 Persistence of Alpha Rhythms
- •15.1.2 Spatial Extent of Alpha Rhythms
- •15.2 MEG Correlates of Preferences for Flickering Lights
- •15.2.1 MEG Correlates of Sinusoidal Flicker
- •15.2.2 MEG Correlates of Fluctuating Flicker Rates
- •15.3 EEG Correlates of Preferences for Oscillatory Movements
- •15.4 Hemispheric Specializations in Vision
- •16 Summary of Auditory and Visual Sensations
- •16.1 Auditory Sensations
- •16.1.1 Auditory Temporal Sensations
- •16.1.2 Auditory Spatial Sensations
- •16.1.3 Auditory Subjective Preferences
- •16.1.4 Effects of Noise on Tasks and Annoyance
- •16.2.1 Temporal and Spatial Sensations in Vision
- •16.2.2 Visual Subjective Preferences
- •References
- •Glossary of Symbols
- •Abbreviations
- •Author Index
- •Subject Index
40 |
4 Electrical and Magnetic Responses in the Central Auditory System |
|||
|
|
Table 4.1 Summary of overall argument in this chapter |
||
|
|
|
|
|
|
Acoustic factor |
Subjective response |
Neuronal correlate and locus |
|
|
|
|
|
|
|
l(0), r(0), |
Localization in the |
Auditory brainstem responses (ABRs) |
|
|
τIACC, IACC |
horizontal plane |
|
|
|
t1, LL |
Subjective preference |
N2-latency in slow vertex responses (SVRs), |
|
|
|
|
Right hemispheric amplitude response |
|
|
IACC |
Subjective preference |
N2-latency in SVR |
|
|
|
Subjective |
Right hemispheric amplitude response |
|
|
|
diffuseness |
|
|
|
t1, Tsub, IACC |
Subjective preference |
Alpha wave in electroencephalography (EEG) |
|
|
|
|
Left ( t1, Tsub) and right (IACC) |
|
|
|
|
hemispheric responses |
|
|
t1 |
Subjective preference |
Alpha wave in magnetoencephalography |
|
|
|
|
(MEG) |
|
|
|
|
Left hemispheric response |
|
|
τε (φ1) in the |
Annoyance |
Alpha wave in magnetoencephalography |
|
|
band-pass noise |
|
(MEG) |
|
|
|
|
Right hemispheric response |
|
|
|
|
|
|
4.1 Auditory Brainstem Responses (ABRs)
The internal binaural crosscorrelation function may provide a neural representation for spatial sensations and their subjective preferences. In a series of experiments, we recorded and analyzed left and right auditory brainstem responses (ABRs) in order to investigate the nature of neural representations and signal processing in the auditory pathway.
Auditory brainstem responses (ABRs) are short-latency (0–10 ms) auditoryevoked electrical potentials that are stimulus-triggered averages of the summed electrical responses of many thousands of neurons in the cochlea, brainstem, and midbrain. In effect, the ABR measures the early impulse response of the auditory system, which primarily reflects electrical potentials generated by the first stages of auditory processing. The slow vertex response (SVR) is a longer latency (10–500 ms) averaged auditory-evoked potential that, due to electrode placement on the scalp, reflects activity in later, cortical stages of auditory processing. Peaks in ABRs and SVRs reflect the synchronized component of electrical activity in dendrites, cell bodies, and axons of large populations of neurons. Most of this electrical activity is thought to be generated by synaptic currents associated with dendritic inputs. The methods used in our studies for recording human electrical potentials (ABRs, SVRs, and EEGs) are safe, non-invasive, and relatively inexpensive.
4.1.1Brainstem Response Correlates of Sound Direction in the Horizontal Plane
To probe the neural correlates of horizontal sound direction (azimuth), source signals p(t) of trains of clicks (50 μs pulses) were presented every 100 ms for 200 s
4.1 Auditory Brainstem Responses (ABRs) |
41 |
(2,000 times). Signals were supplied to loudspeakers positioned at various horizontal angles (0–180◦) with respect to the front of the subject, all on the subject’s righthand side. The distance between each loudspeaker and the center of the head was kept at 68 ± 1 cm. The speakers had a frequency response of ± 3 dB for 100 Hz–
10kHz.
Left and right ABRs were recorded through electrodes placed on the vertex, and
the left and right mastoids (Ando and Hosaka, 1983; Ando, 1985). Typical examples of recorded ABR waveforms as a function of the horizontal angle of sound incidence are shown in Fig. 4.1 (Ando et al., 1991). It can be readily appreciated that waves I–VI differ in peak amplitude and latency as the sound location changes its angle of incidence relative to the subject’s head. Similar ABR waveforms were obtained from each of four participating subjects (males, 23 ± 2 years of age). Their ABRs were averaged together and the mean amplitude of the ABR waveform peaks (waves I–VI) was computed as a function of the horizontal angle (Fig. 4.2a–f).
Left ABR |
subject : MR |
Right ABR |
ξ : |
|
ξ |
|
|
Amplitude of ABR
0°
30°
|
60° |
|
|
|
|
90° |
|
|
|
|
120° |
|
|
|
|
150° |
|
|
|
|
180° |
0.5 μv |
|
|
|
|
|
|
|
0 |
5 |
10 0 |
5 |
10 |
|
|
Latency |
[ms] |
|
Fig. 4.1 Examples of auditory brainstem response (ABR), as a function of response latency (0–10 ms) and horizontal angle of sound incidence. The abscissa indicates the latency of neuronal response in right and left auditory pathways relative to the time when the single pulse arrives at the right ear entrance. Arrows indicate the arrival time of the free-field sound at the cochlea, which depends upon the sound source location of the right hand side of the subject, and the baseline amplitude of the ABR. Roman numerals I–VI indicate successive peaks in the ABR that reflect synchronized activity at successive stations in the ascending auditory pathway. The suffix signifies the response from the left and right electrodes, which preferentially record neural responses from that side. Signals were obtained between electrodes at the vertex and left and right mastoids (Ando et al., 1991)
42
(a)
|
1.0 |
|
|
0.8 |
|
[μV] |
0.6 |
|
amplitude |
0.4 |
|
|
||
Mean |
0.2 |
|
0 |
||
|
–0.20° 30° 60°
(c)
(e)
4 Electrical and Magnetic Responses in the Central Auditory System
(b)
Ir
Il
90° 120° 150° 180°
ξ |
(d) |
|
(f)
Fig. 4.2 Averaged amplitudes of ABR for each wave I–VI. The four different sizes of circles indicated the number of available data from four subjects. Filled circles: Left ABRs; Empty circles: Right ABRs. (a) Wave I. (b) Wave II. (c) Wave III. (d) Wave IV. (e) Wave V. (f) Wave VI. The source location of each wave (ABR) was previously investigated for both animal and human subjects (Jewett, 1970; Lev and Sohmer, 1972; Buchwald and Huang, 1975)
4.1 Auditory Brainstem Responses (ABRs) |
43 |
As one might expect, the average peak I amplitudes from the right electrode are greater than those from the left (r > l for angles ξ = 30–120◦, p < 0.01). This asymmetry may reflect interaural differences in sound pressure (head shadowing) produced by the source location on the right-hand side. However, this tendency is reversed for wave II for two angles ξ = 60–90◦ (l > r, p < 0.05, Fig. 4.2b). Yet another reversal is seen in the behavior of wave III (Fig. 4.2c), which is similar to that of wave I (r > l, p < 0.01). This tendency once again reverses for wave IV (Fig. 4.2d, l > r, p < 0.05) and is maintained further in wave VI (Fig. 4.2f, l > r, p < 0.05) even though absolute values are amplified.
From these patterns, it might be inferred that the flow of the left and right neural signals is interchanged three times in the binaural pathway: at the levels of the cochlear nucleus, superior olivary complex, and the lateral lemniscus, as shown in the auditory pathway schematic of Fig. 4.3. The interaction at the inferior colliculus in particular may be operative for binaural signal processing, as discussed below. In wave V as shown in Fig. 4.2e, such a reversal cannot be seen, and the relative behavior of amplitudes of the left and the right are parallel and similar. Thus, these two amplitudes were averaged and plotted in Fig. 4.6 (V symbols). For comparison, the amplitudes of wave IV (left – l and right – r) were normalized to their respective ABR amplitudes at the frontal sound incidence. These may correspond to the normalized sound pressures at the right and left ear entrances, respectively, which are also plotted.
Fig. 4.3 High-level schematic illustration of the flow of neural signals in the ascending auditory pathway. In this schematic, the ascending pathway proceeds from left to right through successive stations. EC: external canal; ED and BC: eardrum and middle ear bone chain; BM and HC: basilar membrane, inner hair cell, and auditory nerve (not shown); CN: cochlear nucleus; SOC: superior olivary complex; LLN: lateral lemniscus nucleus; IC: inferior colliculus; MGB: medial denticulate body; AC: auditory cortex of the right and left cerebral hemispheres
