- •Preface
- •Acknowledgments
- •Contents
- •1 Introduction
- •1.1 Auditory Temporal and Spatial Factors
- •1.2 Auditory System Model for Temporal and Spatial Information Processing
- •2.1 Analysis of Source Signals
- •2.1.1 Power Spectrum
- •2.1.2 Autocorrelation Function (ACF)
- •2.1.3 Running Autocorrelation
- •2.2 Physical Factors of Sound Fields
- •2.2.1 Sound Transmission from a Point Source through a Room to the Listener
- •2.2.2 Temporal-Monaural Factors
- •2.2.3 Spatial-Binaural Factors
- •2.3 Simulation of a Sound Field in an Anechoic Enclosure
- •3 Subjective Preferences for Sound Fields
- •3.2.1 Optimal Listening Level (LL)
- •3.2.4 Optimal Magnitude of Interaural Crosscorrelation (IACC)
- •3.3 Theory of Subjective Preferences for Sound Fields
- •3.4 Evaluation of Boston Symphony Hall Based on Temporal and Spatial Factors
- •4.1.1 Brainstem Response Correlates of Sound Direction in the Horizontal Plane
- •4.1.2 Brainstem Response Correlates of Listening Level (LL) and Interaural Crosscorrelation Magnitude (IACC)
- •4.1.3 Remarks
- •4.2.2 Hemispheric Lateralization Related to Spatial Aspects of Sound
- •4.2.3 Response Latency Correlates of Subjective Preference
- •4.3 Electroencephalographic (EEG) Correlates of Subjective Preference
- •4.3.3 EEG Correlates of Interaural Correlation Magnitude (IACC) Changes
- •4.4.1 Preferences and the Persistence of Alpha Rhythms
- •4.4.2 Preferences and the Spatial Extent of Alpha Rhythms
- •4.4.3 Alpha Rhythm Correlates of Annoyance
- •5.1 Signal Processing Model of the Human Auditory System
- •5.1.1 Summary of Neural Evidence
- •5.1.1.1 Physical Characteristics of the Ear
- •5.1.1.2 Left and Right Auditory Brainstem Responses (ABRs)
- •5.1.1.3 Left and Right Hemisphere Slow Vertex Responses (SVRs)
- •5.1.1.4 Left and Right Hemisphere EEG Responses
- •5.1.1.5 Left and Right Hemisphere MEG Responses
- •5.1.2 Auditory Signal Processing Model
- •5.2 Temporal Factors Extracted from Autocorrelations of Sound Signals
- •5.3 Auditory Temporal Window for Autocorrelation Processing
- •5.5 Auditory Temporal Window for Binaural Processing
- •5.6 Hemispheric Specialization for Spatial Attributes of Sound Fields
- •6 Temporal Sensations of the Sound Signal
- •6.1 Combinations of Temporal and Spatial Sensations
- •6.2 Pitch of Complex Tones and Multiband Noise
- •6.2.1 Perception of the Low Pitch of Complex Tones
- •6.2.3 Frequency Limits of Missing Fundamentals
- •6.3 Beats Induced by Dual Missing Fundamentals
- •6.4 Loudness
- •6.4.1 Loudness of Sharply Filtered Noise
- •6.4.2 Loudness of Complex Noise
- •6.6 Timbre of an Electric Guitar Sound with Distortion
- •6.6.3 Concluding Remarks
- •7 Spatial Sensations of Binaural Signals
- •7.1 Sound Localization
- •7.1.1 Cues of Localization in the Horizontal Plane
- •7.1.2 Cues of Localization in the Median Plane
- •7.2 Apparent Source Width (ASW)
- •7.2.1 Apparent Width of Bandpass Noise
- •7.2.2 Apparent Width of Multiband Noise
- •7.3 Subjective Diffuseness
- •8.1 Pitches of Piano Notes
- •8.2 Design Studies of Concert Halls as Public Spaces
- •8.2.1 Genetic Algorithms (GAs) for Shape Optimization
- •8.2.2 Two Actual Designs: Kirishima and Tsuyama
- •8.3 Individualized Seat Selection Systems for Enhancing Aural Experience
- •8.3.1 A Seat Selection System
- •8.3.2 Individual Subjective Preference
- •8.3.3 Distributions of Listener Preferences
- •8.5 Concert Hall as Musical Instrument
- •8.5.1 Composing with the Hall in Mind: Matching Music and Reverberation
- •8.5.2 Expanding the Musical Image: Spatial Expression and Apparent Source Width
- •8.5.3 Enveloping Music: Spatial Expression and Musical Dynamics
- •8.6 Performing in a Hall: Blending Musical Performances with Sound Fields
- •8.6.1 Choosing a Performing Position on the Stage
- •8.6.2 Performance Adjustments that Optimize Temporal Factors
- •8.6.3 Towards Future Integration of Composition, Performance and Hall Acoustics
- •9.1 Effects of Temporal Factors on Speech Reception
- •9.2 Effects of Spatial Factors on Speech Reception
- •9.3 Effects of Sound Fields on Perceptual Dissimilarity
- •9.3.1 Perceptual Distance due to Temporal Factors
- •9.3.2 Perceptual Distance due to Spatial Factors
- •10.1 Method of Noise Measurement
- •10.2 Aircraft Noise
- •10.3 Flushing Toilet Noise
- •11.1 Noise Annoyance in Relation to Temporal Factors
- •11.1.1 Annoyance of Band-Pass Noise
- •11.2.1 Experiment 1: Effects of SPL and IACC Fluctuations
- •11.2.2 Experiment 2: Effects of Sound Movement
- •11.3 Effects of Noise and Music on Children
- •12 Introduction to Visual Sensations
- •13 Temporal and Spatial Sensations in Vision
- •13.1 Temporal Sensations of Flickering Light
- •13.1.1 Conclusions
- •13.2 Spatial Sensations
- •14 Subjective Preferences in Vision
- •14.1 Subjective Preferences for Flickering Lights
- •14.2 Subjective Preferences for Oscillatory Movements
- •14.3 Subjective Preferences for Texture
- •14.3.1 Preferred Regularity of Texture
- •15.1 EEG Correlates of Preferences for Flickering Lights
- •15.1.1 Persistence of Alpha Rhythms
- •15.1.2 Spatial Extent of Alpha Rhythms
- •15.2 MEG Correlates of Preferences for Flickering Lights
- •15.2.1 MEG Correlates of Sinusoidal Flicker
- •15.2.2 MEG Correlates of Fluctuating Flicker Rates
- •15.3 EEG Correlates of Preferences for Oscillatory Movements
- •15.4 Hemispheric Specializations in Vision
- •16 Summary of Auditory and Visual Sensations
- •16.1 Auditory Sensations
- •16.1.1 Auditory Temporal Sensations
- •16.1.2 Auditory Spatial Sensations
- •16.1.3 Auditory Subjective Preferences
- •16.1.4 Effects of Noise on Tasks and Annoyance
- •16.2.1 Temporal and Spatial Sensations in Vision
- •16.2.2 Visual Subjective Preferences
- •References
- •Glossary of Symbols
- •Abbreviations
- •Author Index
- •Subject Index
Chapter 15
EEG and MEG Correlates of Visual Subjective
Preferences
15.1 EEG Correlates of Preferences for Flickering Lights
We have sought to find visual analogies of our comprehensive auditory signal processing model. The last chapter dealt with temporal and spatial sensations in vision that may be mediated by temporal and spatial autocorrelation representations. In the chapter we take up the neural response correlates of visual subjective preferences. For this purpose we analyzed EEG responses to visual stimuli using techniques and analyses similar to those used for auditory stimuli (Chapter 4). Because subjective preference is perhaps the most primitive response of an organism, as in the auditory case, we expected to find response correlates for preferred conditions in the persistence, temporal coherence, and extent of alpha rhythms in EEG and MEG signals. Table 15.1 summarizes our experiments and neural response correlates.
Table 15.1 Summary of overall argument in this chapter
Acoustic factor |
Subjective response |
Locus |
Neuronal correlate |
|
|
|
|
Period of flickering |
Subjective preference |
Left hemisphere |
Alpha wave in EEG |
light, T |
|
|
|
Period of flickering |
Subjective preference |
Left hemisphere |
Alpha wave in MEG |
light, T |
|
|
|
Period of moving |
Subjective preference |
Left hemisphere |
Alpha wave in EEG |
target, T |
|
|
|
|
|
|
|
15.1.1 Persistence of Alpha Rhythms
Human cortical responses corresponding to subjective preferences for flicker lights were investigated. We studied the effects of fluctuations in the period and mean luminance of flickering light sources. Paired comparison tests were used to measure subjective preferences. Then, in order to identify neural response correlates of visual preferences, electroencephalographic (EEG) recordings were taken from the same subjects during presentations of more and less favored flicker conditions. Analogous to our findings with auditory subjective preferences, we found that the
Y. Ando, P. Cariani (Guest ed.), Auditory and Visual Sensations, |
267 |
DOI 10.1007/b13253_15, C Springer Science+Business Media, LLC 2009 |
|
268 |
15 EEG and MEG Correlates of Visual Subjective Preferences |
effective durations of alpha rhythms, measured at occipital electrodes O1 and O2, were longer for the more preferred visual stimuli. In the preferred conditions, alpha rhythms persist longer, with higher temporal coherence, and extend over wider spatial regions of the cerebral cortex.
As reported by Lindsay (1952), who considered the relation of brain activity and behavioral states, the presence of alpha rhythms in the EEG of a human subject corresponds well to mental states associated with relaxation and free creative thought. The term alpha refers to the frequency band between about 8 and 13 Hz. The differentiation of basic emotions (i.e., intention, anxiety, aggression, sadness, and joy) by means of EEG-coherences has been discussed extensively (Hinrichs and Machleidt, 1992). Intention, aggression, and joy are mainly characterized by an increase in alpha-coherence, whereas a decrease is seen for anxiety and sorrow. In Chapter 4, we have discussed the method for using the ACF to analyze brain waves to examine the relationship between brain activities and the scale value of subjective preference as an overall impression of the sound field. We analyzed the effective duration of the normalized ACF envelope (τe) of the alpha waves when temporal factors such as the initial time delay gap between the direct sound and the first reflection ( t1) and the subsequent reverberation time (Tsub) were varied. Results showed that the τe of the alpha waves is longer only in the left cerebral hemisphere for the preferred conditions of these temporal factors. The relationship between subjective preference and the ACF of the alpha waves in response to the tempo of a noise burst, for example, has been investigated (Chen et al., 1997). Results showed that the τe of the alpha waves is longer only in the left cerebral hemisphere for the preferred tempo of a noise burst. Petsche (1996) analyzed EEG changes caused by mental processes of a higher order by using coherence analysis. Acts of creative thinking, whether verbal, visual, or musical, were characterized by a more increased coherence between occipital and frontopolar electrode sites than were other mental tasks. Results were interpreted as showing a stronger involvement of the long cortico-cortical fiber systems in creative tasks.
In this section we examine whether the scale value of subjective preference of visual stimuli reflects the temporal information in EEG in the left or right cerebral hemisphere (Soeta et al., 2002a). First, the PCT was performed for flickering light sources of varied period and mean luminance. From results of scaling the value of subjective preference, the most preferred and relatively less preferred light sources were selected as paired stimuli for brain wave recordings. Then, relationships between the scale value of subjective preference and the factors extracted from the ACF in the alpha waves were examined.
The light source was a 7-mm-diameter green light-emitting diode (LED), and was viewed by the subject at the distance of 0.6m from it in dark surroundings. The LED stimulus field was spatially uniform, and its size corresponded with 0.67◦ of the visual angle. The luminance of the stimulus is given by
l(t) = L0[1 + mcos(2πft)] |
(15.1) |
where L0 is the mean luminance, m is modulation (relative) amplitude fixed at 1.0, and f is the temporal frequency of the stimulus. The period T = 1/f was set at 0.4, 0.8,
15.1 EEG Correlates of Preferences for Flickering Lights |
269 |
1.6, or 2.4 s, and mean luminance was set at 7.5, 30, and 120 cd/m2. The duration of the stimuli was fixed at 5 s. Ten 23to 25-year-old subjects participated in the experiment. All had normal or corrected-to-normal vision. They adapted to the dark and looked at the LED stimulus seated in a dark room with a comfortable thermal environment. The PCT was conducted for each subject by having each subject compare 66 pairs per session and having 10 sessions. The subject was asked which stimulus they preferred to watch. The scale value of subjective preference of each subject, which is regarded as the linear psychological distance between light sources, was obtained (Ando and Singh, 1996; Ando, 1998).
The average scale values of preference obtained from the 10 subjects are shown in Fig. 15.1. The most preferred period, [T]p, for all subjects were estimated by fitting a suitable polynomial curve to a graph on which the scale values were plotted. The value of [T]p for all of the subjects was 1.27 s at a mean luminance of 7.5 cd/m2, 1.49 s at a mean luminance of 30 cd/m2, and 1.76 s at a mean luminance of 120 cd/m2. The most preferred period, i.e. peak of the scale value, shifted gradually toward longer periods as the mean luminance was increased (Fig. 15.2). This may imply that the most preferred condition corresponds to a constant total amount of excitation from the physical environment. Too much or too little excitation may be less preferred.
Fig. 15.1 Averaged scale values of subjective preference as a function of the flicker period. Different symbols indicate different mean luminance. ,
7.5 cd/m2; ◦ , 30 cd/m2; , 120 cd/m2. Solid curve is expressed by Equation (15.2)
Similar to the above, the preference evaluation curve may commonly be
expressed by |
|
S = SL ≈ −α |x|β |
(15.2) |
where α and β are the weighting coefficient and a constant, respectively, and x = log10T – log10[T]p. Values of α and β were obtained by using the quasi-Newton numerical method, respectively, and were approximately 4.90 and 1.56, respectively. It is interesting that the value of β ≈ 3/2 was consistent with other preference judgments performed including those for the sound and visual fields. When the hori-
270 |
15 EEG and MEG Correlates of Visual Subjective Preferences |
Fig. 15.2 The most preferred flicker periods [T]p obtained by 10 subjects as a function of the mean luminance
zontal axis of Fig. 15.1 is normalized by the most preferred period [T]p, then all results may be reduced by a single curve as shown in Fig. 15.2. Without loss of any generality, the scale value can be adjusted to zero at the preferred condition, so that scale values for different [T]p values of mean luminance had similar tendencies as shown in Fig. 15.3. Therefore, the preference evaluation curve can be calculated by Equation (15.2) with β = 3/2.
Effects of the period and mean luminance on the scale value of preference were examined for all 10 subjects using the two-way analysis of variance (ANOVA) method. The results clearly indicated that effects of the period were significant
Fig. 15.3 Scale values of preference as a function of the flicker period normalized by the most preferred periods [T]p. Different symbols indicate different mean luminance. , 7.5 cd/m2; ◦ , 30 cd/m2; , 120 cd/m2. Solid curve is expressed by Equation (15.2)
15.1 EEG Correlates of Preferences for Flickering Lights |
271 |
(p < 0.01). The period and mean luminance were independent influences on the subjective preference judgment.
Next, the same subjects that were used in the preference tests participated in EEG recordings. The EEG was recorded under three conditions: (1) period varied and mean luminance fixed; (2) period fixed and mean luminance varied; (3) both period and mean luminance varied. To find a significant effect of subjective preference on an EEG, the most preferred flickering light and the relatively less preferred flickering light were selected as paired stimuli. The paired stimuli were set for each subject according to their individual preferences. The subject watched the most and the least preferred flickering lights alternatively. A series of EEG was recorded 3 times for each subject, and each series consisted of 10 stimuli pairs.
The EEG was recorded from the left and right cerebral hemispheres of subjects using silver electrodes (7 mm diameter) at scalp locations T3, T4, T5, T6, O1, and O2, as shown in Fig. 15.4 (10–20 International Electrode Placement System). A reference electrode was attached to the earlobe of a subject. A ground electrode was placed on the forehead of a subject. The recorded data were filtered with a digital band-pass filter with cutoff frequencies of 8 and 13 Hz (alpha-wave range).
Fig. 15.4 Top view of a subject’s head and electrode positions on the scalp for EEG recordings (10–20 International Electrode Placement System)
An example of a measured ACF is shown in Fig. 15.5a. The ACF may be characterized by four variables (see Sections 2.2 and 5.2). Figure 15.5b shows the absolute value in the logarithmic form as a function of the delay time. To find the degree of ACF envelope decay, the effective duration, τe, is determined. As shown in Fig. 15.5b, the straight-line regression of the ACF can be drawn by using only the initial declining portion, 0 dB > 10 log |φ(τ)| > –5 dB. In most case, the envelope decay of the initial part of the ACF may fit a straight line. The value of τ1
272 |
15 EEG and MEG Correlates of Visual Subjective Preferences |
Fig. 15.5 (a) An example of a normalized autocorrelation function ACF of an EEG alpha-band signal (8–13 Hz) showing definitions of the delay time of the first peak τ 1 and its amplitude φ1. (b) Determination of the effective duration (τ e) of the alpha rhythm by estimating the slope of the envelope of the autocorrelation function and determining the delay at which it reaches 10% of its maximal, zero-lag value. Effective duration measures duration of temporal coherence, i.e., the duration for which repetitive structure persists in a signal
corresponded mostly with the center frequency in the range 8–13 Hz and thus was not analyzed.
Referring to the results in Section 5.3, the integration interval 2T was selected as 2.5 s in the running ACF analysis to obtain the values of τe, (0), and φ1. Table 15.2 shows results of the one-way ANOVA for τe, (0), and φ1 values of the alpha wave for the 10 subjects. Significant effects were found when the period was varied and the mean luminance was fixed and when both period and luminance were varied. However, significant effects were not found when the period was fixed and the luminance was varied except for (0) at O1.
Only when the period was varied were the values of τe, (0), and φ1 for the most preferred stimuli larger than those for the less preferred stimuli for all subjects, as shown in Figs. 15.6, 15.7, and 15.8. The tendency was especially clear in the
Table 15.2 Results of one-way ANOVA at each electrode position under three conditions
|
|
Factor |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
τe |
|
|
(0) |
|
|
φ1 |
|
||
|
|
|
|
|
|
|
|
|
|
|
|
Condition |
Electrode position |
F value |
Significance level |
F value |
Significance level |
F value |
Significance level |
||||
|
|
|
|
|
|
|
|
|
|
||
(1) |
O1 |
143.2 |
<0.001 |
|
52.4 |
<0.001 |
|
132.8 |
<0.001 |
||
|
T5 |
18.8 |
<0.001 |
|
19.7 |
<0.001 |
|
38.2 |
<0.001 |
||
|
T3 |
15.6 |
<0.001 |
|
12.1 |
<0.01 |
|
25.5 |
<0.001 |
||
|
O2 |
81.2 |
<0.001 |
|
51.3 |
<0.001 |
|
121.6 |
<0.001 |
||
|
T6 |
36.9 |
<0.001 |
|
28.5 |
<0.001 |
|
52.1 |
<0.001 |
||
|
T4 |
26.4 |
<0.001 |
|
6.0 |
<0.05 |
|
32.4 |
<0.001 |
||
(2) |
O1 |
2.0 |
|
|
4.4 |
<0.05 |
|
0.3 |
|
||
|
T5 |
0.1 |
|
|
2.4 |
|
|
0.1 |
|
||
|
T3 |
0.1 |
|
|
0.1 |
|
|
0.3 |
|
||
|
O2 |
0.9 |
|
|
3.6 |
|
|
0.9 |
|
||
|
T6 |
3.7 |
|
|
1.2 |
|
|
1.5 |
|
||
|
T4 |
0.1 |
|
|
0.1 |
|
|
0.2 |
|
||
(3) |
O1 |
143.1 |
<0.001 |
|
39.3 |
<0.001 |
|
132.8 |
<0.001 |
||
|
T5 |
27.6 |
<0.001 |
|
47.9 |
<0.001 |
|
64.0 |
<0.005 |
||
|
T3 |
4.6 |
<0.05 |
|
10.6 |
<0.005 |
|
24.6 |
<0.005 |
||
|
O2 |
25.3 |
<0.001 |
|
10.2 |
<0.005 |
|
34.4 |
<0.005 |
||
|
T6 |
10.5 |
<0.01 |
|
27.0 |
<0.001 |
|
32.1 |
<0.001 |
||
|
T4 |
18.4 |
<0.005 |
|
14.2 |
<0.005 |
|
27.4 |
<0.001 |
||
|
|
|
|
|
|
|
|
|
|
|
|
Lights Flickering for Preferences of Correlates EEG 1.15
273
274 |
15 EEG and MEG Correlates of Visual Subjective Preferences |
Fig. 15.6 Effective durations τe of EEG alpha rhythms at different electrode positions in response to a change in flicker period using preferred and less preferred rates. Error bars represent 95% confidence interval. ◦ , higher preference; •, lower preference
Fig. 15.7 Magnitudes (0) of EEG alpha rhythms at different electrode positions in response to a change in flicker period using preferred and less preferred rates. Error bars represent 95% confidence interval. ◦ , higher preference; •, lower preference
Fig. 15.8 Amplitudes φ1 of EEG alpha rhythms at different electrode positions in response to a change in flicker period using preferred and less preferred rates. Error bars represent 95% confidence interval. ◦ , higher preference; •, lower preference
