- •Stellingen
- •Propositions
- •List of Figures
- •List of Tables
- •1 Introduction
- •Introduction
- •Affect, emotion, and related constructs
- •Affective Computing: A concise overview
- •The closed loop model
- •Three disciplines
- •Human-Computer Interaction (HCI)
- •Health Informatics
- •Three disciplines, one family
- •Outline
- •2 A review of Affective Computing
- •Introduction
- •Vision
- •Speech
- •Biosignals
- •A review
- •Time for a change
- •3 Statistical moments as signal features
- •Introduction
- •Emotion
- •Measures of affect
- •Affective wearables
- •Experiment
- •Participants
- •Equipment and materials
- •Procedure
- •Data reduction
- •Results
- •Discussion
- •Comparison with the literature
- •Use in products
- •4 Time windows and event-related responses
- •Introduction
- •Data reduction
- •Results
- •Mapping events on signals
- •Discussion and conclusion
- •Interpreting the signals measured
- •Looking back and forth
- •5 Emotion models, environment, personality, and demographics
- •Introduction
- •Emotions
- •Modeling emotion
- •Ubiquitous signals of emotion
- •Method
- •Participants
- •International Affective Picture System (IAPS)
- •Digital Rating System (DRS)
- •Signal processing
- •Signal selection
- •Speech signal
- •Heart rate variability (HRV) extraction
- •Normalization
- •Results
- •Considerations with the analysis
- •The (dimensional) valence-arousal (VA) model
- •The six basic emotions
- •The valence-arousal (VA) model versus basic emotions
- •Discussion
- •Conclusion
- •6 Static versus dynamic stimuli
- •Introduction
- •Emotion
- •Method
- •Preparation for analysis
- •Results
- •Considerations with the analysis
- •The (dimensional) valence-arousal (VA) model
- •The six basic emotions
- •The valence-arousal (VA) model versus basic emotions
- •Static versus dynamic stimuli
- •Conclusion
- •IV. Towards affective computing
- •Introduction
- •Data set
- •Procedure
- •Preprocessing
- •Normalization
- •Baseline matrix
- •Feature selection
- •k-Nearest Neighbors (k-NN)
- •Support vector machines (SVM)
- •Multi-Layer Perceptron (MLP) neural network
- •Discussion
- •Conclusions
- •8 Two clinical case studies on bimodal health-related stress assessment
- •Introduction
- •Post-Traumatic Stress Disorder (PTSD)
- •Storytelling and reliving the past
- •Emotion detection by means of speech signal analysis
- •The Subjective Unit of Distress (SUD)
- •Design and procedure
- •Features extracted from the speech signal
- •Results
- •Results of the Stress-Provoking Story (SPS) sessions
- •Results of the Re-Living (RL) sessions
- •Overview of the features
- •Discussion
- •Stress-Provoking Stories (SPS) study
- •Re-Living (RL) study
- •Stress-Provoking Stories (SPS) versus Re-Living (RL)
- •Conclusions
- •9 Cross-validation of bimodal health-related stress assessment
- •Introduction
- •Speech signal processing
- •Outlier removal
- •Parameter selection
- •Dimensionality Reduction
- •k-Nearest Neighbors (k-NN)
- •Support vector machines (SVM)
- •Multi-Layer Perceptron (MLP) neural network
- •Results
- •Cross-validation
- •Assessment of the experimental design
- •Discussion
- •Conclusion
- •10 Guidelines for ASP
- •Introduction
- •Signal processing guidelines
- •Physical sensing characteristics
- •Temporal construction
- •Normalization
- •Context
- •Pattern recognition guidelines
- •Validation
- •Triangulation
- •Conclusion
- •11 Discussion
- •Introduction
- •Hot topics: On the value of this monograph
- •Applications: Here and now!
- •TV experience
- •Knowledge representations
- •Computer-Aided Diagnosis (CAD)
- •Visions of the future
- •Robot nannies
- •Digital Human Model
- •Conclusion
- •Bibliography
- •Summary
- •Samenvatting
- •Dankwoord
- •Curriculum Vitae
- •Publications and Patents: A selection
- •Publications
- •Patents
- •SIKS Dissertation Series
3.4 Affective wearables
is related to affective valence; however, the type of relation depends strongly on the muscle that is measured [133, Chapter 10], [85, Chapter 12], [396, Chapter 9, 1st ed.; Chapter 11]. The corrugator supercilii, which causes a frown when activated, increases linearly with a decrease in valence, while the zygomaticus major, which is responsible for smiling when activated, increases with an increase in valence [373, 592, 664]. The EMGs of these two muscles are known to discriminate best between emotions; see [396, Chapter 9, 1st ed.] for a concise review. The frontalis is a measure for attention (and fatigue) and, hence, is not expected to discriminate between emotions [133, Chapter 10].
These measures have extensively proven their use to detect emotional experiences in laboratory settings, mostly in group-averaged, baseline-corrected paradigms. In order to make them useful for emotion-aware systems, three aspects will have to change:
1.the measurements will have to be done in a less obtrusive manner;
2.the interpretation of the signals will have to be meaningful on an individual (not a group-averaged) level; and
3.robust signal interpretation algorithms will have to be developed that are baseline-free or incorporate automatic (non-manual) baseline correction.
The first issue will be dealt with in the next paragraph, where we will discuss the advent of unobtrusive affective wearables. Our focus for the remainder of the chapter is on the search for robust signal interpretation algorithms that do not need a manual baseline correction.
3.4 Affective wearables
Using the EDA and EMG signals, a system will be able to determine the emotional state of its user, certainly if that system also possesses a user-profile. Affective wearables will facilitate such a system in monitoring the user in an unobtrusive manner. Direct physiological measures are often considered to be obtrusive to the user, but this is not necessarily true. In the field of affective computing, some efforts have been made to design unobtrusive measurement technology: affective wearables. Picard [521] defines an affective wearable as “a wearable system equipped with sensors and tools which enables recognition of its wearer’s affective patterns”. Affective wearables will become smaller in time, due to improved design and smaller technology components. Affective wearables could make a huge difference in user acceptance of direct physiological measures, especially when hidden in daily used tools and objects.
The acceptance of direct physiological measurements is of great importance since indirect physiological measurements are much more subject to noise. Indirect physiological
45
