-
Despite the importance of perceiving and recognizing facial expressions in everyday life, there is no comprehensive test battery for the multivariate assessment of these abilities. As a first step toward such a compilation, we present 16 tasks that measure the perception and recognition of facial emotion expressions, and data illustrating each task's difficulty and reliability. The scoring of these tasks focuses on either the speed or accuracy of performance. A sample of 269 healthy young adults completed all tasks. In general, accuracy and reaction time measures for emotion-general scores showed acceptable and high estimates of internal consistency and factor reliability. Emotion-specific scores yielded lower reliabilities, yet high enough to encourage further studies with such measures. Analyses of task difficulty revealed that all tasks are suitable for measuring emotion perception and emotion recognition related abilities in normal populations.
-
Although there is abundant evidence for female superiority in Face Cognition (FC), a number of questions regarding sex differences remain to be addressed. Here we report a reanalysis of data on the level of latent factors, modeled on the basis of an extensive test battery applied to three samples of over 800 adults in all. In independent samples the measurement structure of FC was invariant for both sexes, indicating that the measurement of the construct does not depend on the context variable sex, and investigating mean performance differences will not be biased by measurement issues—a neglected aspect in previous studies. We confirmed female superiority for face perception (FP) and face memory (FM). For the first time we could show that these sex differences prevailed after accounting for sex differences in broadly measured general cognitive functioning and in object perception. Across adult age, sex differences in FM increased due to the rapid decline of this ability in men, whereas performance in women remained stable across adult age. Self-reported social involvement and things-oriented activities moderated sex-differences in FM. Results show that sex differences are salient at the level of specific FC constructs and that they can be partially explained by social involvement.
-
Whether syntactic and semantic processes during sentence comprehension follow strict sets of rules or succumb to context-dependent heuristics was studied by recording event-related potentials in a dual-task design. In one condition, sentence-extraneous acoustic material was either semantically congruent or incongruent relative to an adjective in the visually presented sentence, the latter being either semantically correct or incorrect within the sentence context. Homologous syntactic (gender) manipulations were performed in another condition. Syntactic processing within the sentence appeared to be blind to the syntactic content of the second task. In contrast, semantically incongruous material of the second task induced fluctuations typically associated with the detection of within-sentence semantic anomalies (N400) even in semantically correct sentences. Subtle but extant differences in topography between this N400 and that obtained with within-sentence semantic violations add to recent proposals of separate semantic subsystems differing in their specificity for sentence structure and computational procedures. Semantically incongruous material of the second task also influenced later stages of the processing of semantically incorrect adjectives (P600 component), which are traditionally assumed to pertain to the syntactic domain. This result is discussed in the light of current proposals of a third combinatorial stream in sentence comprehension.
-
Emotional facial expressions usually arise dynamically from a neutral expression. Yet, most previous research focused on static images. The present study investigated basic aspects of processing dynamic facial expressions. In two experiments, we presented short videos of facial expressions of six basic emotions and non-emotional facial movements emerging at variable and fixed rise times, attaining different intensity levels. In event-related brain potentials (ERP), effects of emotion but also for non-emotional movements appeared as early posterior negativity (EPN) between 200 and 350ms, suggesting an overall facilitation of early visual encoding for all facial movements. These EPN effects were emotion-unspecific. In contrast, relative to happiness and neutral expressions, negative emotional expressions elicited larger late positive ERP components (LPCs), indicating a more elaborate processing. Both EPN and LPC amplitudes increased with expression intensity. Effects of emotion and intensity were additive, indicating that intensity (understood as the degree of motion) increases the impact of emotional expressions but not its quality. These processes can be driven by all basic emotions, and there is little emotion-specificity even when statistical power is considerable (N (Experiment 2)=102).
-
Effects of emotional word meaning have been studied exclusively for words in isolation but not in the context of sentences. We addressed this question within the framework of two-dimensional models of affect, conceiving emotion as a function of valence and arousal. Negative and neutral target verbs, embedded within sentences, were presented while event-related brain potentials (ERPs) and the activity of the Corrugator muscle were recorded. Twenty-one participants performed a semantic decision task on the target verbs. In contrast to single word studies no early posterior negativity was present. However, emotion effects in ERPs were evident in a late positive complex (LPC) for negative, high-arousal words in comparison to neutral words. Interestingly, the LPC was unaffected by pure arousal variation when valence was controlled for, indicating the importance of valence for this emotion-related ERP effect.
-
Decoding the meaning of facial expressions is a major pathway of human communication and has been extensively studied as a basic facet of emotional intelligence. In order to better understand the structure and specificity of the abilities subsumed under emotion decoding from faces (facial emotion perception and facial emotion recognition), the multivariate measurement of individual differences is essential. In the present study, we focused on the abilities to perceive and recognize facial expressions of emotions and investigated their internal structure and nomological net. N = 269 participants with a heterogeneous educational background completed a large test battery including multiple assessment paradigms substantiated in basic experimental research. Results allowed establishing task-general measurement models of facial emotion perception (EP) and recognition (ER). In these measurement models emotion category-related specificity was negligible. The most important conclusion from the present study is the strongly limited specific variance in perceptual performance of certain emotion related facial expressions and emotion decoding from faces in general, relative to face identity processing and fluid cognitive abilities (figural reasoning, working memory and immediate and delayed memory). We discuss implications of the present results for building the nomological net of emotional intelligence and outline desiderata for future research.
-
Event‐related potentials (ERPs) revealed effects of emotional meaning on word recognition at distinguishable processing stages, in rare cases even in the P1 time range. However, the boundary conditions of these effects, such as the roles of different levels of linguistic processing or the relative contributions of the emotional valence and arousal dimensions, remain to be fully understood. The present study addresses this issue by employing two tasks of different processing demands on words that orthogonally varied in their emotional valence and arousal. Effects of emotional valence in ERPs were evident from 100 ms after word onset and showed a task-insensitive processing advantage for positive words. Early posterior negativity (EPN) effects to high-arousing words were limited to the lexical decision task, corroborating recent reports that suggested that perceptual processing as reflected in the EPN might not be as automatic as previously assumed.
-
The usefulness of the event-related potential (ERP) method can be compromised by violations of the underlying assumptions, for example, confounding variations of latency and amplitude of ERP components within and between conditions. Here we show how the ERP subtraction method might yield misleading information due to latency variability of ERP components. We propose a solution to this problem by correcting for latency variability using Residue Iteration Decomposition (RIDE), demonstrated with data from representative go/no-go experiments. The overlap of N2 and P3 components in go/no-go data gives rise to spurious topographical localization of the no-go–N2 component. RIDE decomposes N2 and P3 based on their latency variability. The decomposition restored the N2 topography by removing the contamination from latency-variable late components. The RIDE-derived N2 and P3 give a clearer insight about their functional relevance in the go/no-go paradigm.
-
The degree to which emotional aspects of stimuli are processed automatically is controversial. Here, we assessed the automatic elicitation of emotion-related brain potentials (ERPs) to positive, negative, and neutral words and facial expressions in an easy and superficial face-word discrimination task, for which the emotional valence was irrelevant. Both emotional words and facial expressions impacted ERPs already between 50 and 100 ms after stimulus onset, possibly reflecting rapid relevance detection. Following this initial processing stage only emotionality in faces but not in words was associated with an early posterior negativity (EPN). Therefore, when emotion is irrelevant in a task which requires superficial stimulus analysis, automatically enhanced sensory encoding of emotional content appears to occur only for evolutionary prepared emotional stimuli, as reflected in larger EPN amplitudes to faces, but not to symbolic word stimuli.
-
Faces provide identity- and emotion-related information—basic cues for mastering social interactions. Traditional models of face recognition suggest that following a very first initial stage the processing streams for facial identity and expression depart. In the present study we extended our previous multivariate investigations of face identity processing abilities to the speed of recognising facially expressed emotions. Analyses are based on a sample of N = 151 young adults. First, we established a measurement model with a higher order factor for the speed of recognising facially expressed emotions (SRE). This model has acceptable fit without specifying emotion-specific relations between indicators. Next, we assessed whether SRE can be reliably distinguished from the speed of recognising facial identity (SRI) and found latent factors for SRE and SRI to be perfectly correlated. In contrast, SRE and SRI were both only moderately related to a latent factor for the speed of recognising non-face stimuli (SRNF). We conclude that the processing of facial stimuli—and not the processing of facially expressed basic emotions—is the critical component of SRE. These findings are at variance with suggestions of separate routes for processing facial identity and emotional facial expressions and suggest much more communality between these streams as far as the aspect of processing speed is concerned.
-
The functional locus of emotional valence in word processing remains an open question. In event-related potentials, emotion has been found to elicit an early posterior negativity (EPN), which is assumed to reflect attention catching by the words’ meaning. Previously, the EPN was modulated by word category with verbs exhibiting longer EPN latencies compared with other word categories. Here we examined whether concreteness, a semantic variable, influences emotion processing. Within a lexical decision task for verbs, emotional valence (positive, negative, and neutral) was orthogonally combined with concreteness (concrete and abstract). EPN onset was found already at 250 ms post-stimulus for concrete verbs, whereas it started 50 ms later for abstract verbs. Concreteness effects occurred after the start of main effects of emotion. Thus, the elicitation of the EPN seems to be based on semantic processes, with emotional valence being accessed before other semantic aspects such as concreteness of verbs.
-
Recognizing faces swiftly and accurately is of paramount importance to humans as a social species. Individual differences in the ability to perform these tasks may therefore reflect important aspects of social or emotional intelligence. Although functional models of face cognition based on group and single case studies postulate multiple component processes, little is known about the ability structure underlying individual differences in face cognition. In 2 large individual differences experiments (N = 151 and N = 209), a broad variety of face-cognition tasks were tested and the component abilities of face cognition—face perception, face memory, and the speed of face cognition—were identified and then replicated. Experiment 2 also showed that the 3 face-cognition abilities are clearly distinct from immediate and delayed memory, mental speed, general cognitive ability, and object cognition. These results converge with functional and neuroanatomical models of face cognition by demonstrating the difference between face perception and face memory. The results also underline the importance of distinguishing between speed and accuracy of face cognition. Together our results provide a first step toward establishing face-processing abilities as an independent ability reflecting elements of social intelligence.
-
Plot suspense is one of the most important components of narrative fiction that motivate recipients to follow fictional characters through their worlds. The present study investigates the dynamic development of narrative suspense in excerpts of literary classics from the 19th century in a multi-methodological approach. For two texts, differing in suspense as judged by a large independent sample, we collected (a) data from questionnaires, indicating different affective and cognitive dimensions of receptive engagement, (b) continuous ratings of suspense during text reception from both experts and lay recipients, and (c) registration of pupil diameter as a physiological indicator of changes in emotional arousal and attention during reception. Data analyses confirmed differences between the two texts at different dimensions of receptive engagement and, importantly, revealed significant correlations of pupil diameter and the course of suspense over time. Our findings demonstrate that changes of the pupil diameter provide a reliable ‘online’ indicator of suspense.
-
Affect and motivation influence the error-related negativity (ERN) elicited by full errors; however, it is unknown whether they also influence ERNs to correct responses accompanied by covert incorrect response activation (partial errors). Here we compared a neutral condition with conditions, where correct responses were rewarded or where incorrect responses were punished with gains and losses of small amounts of money, respectively. Data analysis distinguished ERNs elicited by full and partial errors. In the reward and punishment conditions, ERN amplitudes to both full and partial errors were larger than in the neutral condition, confirming participants’ sensitivity to the significance of errors. We also investigated the relationships between ERN amplitudes and the behavioral inhibition and activation systems (BIS/BAS). Regardless of reward/punishment condition, participants scoring higher on BAS showed smaller ERN amplitudes in full error trials. These findings provide further evidence that the ERN is related to motivational valence and that similar relationships hold for both full and partial errors.
-
Emotion effects on cognition have often been reported. However, only few studies investigated emotional effects on subsequent language processing, and in most cases these effects were induced by non-linguistic stimuli such as films, faces, or pictures. Here, we investigated how a paragraph of positive, negative, or neutral emotional valence affects the processing of a subsequent emotionally neutral sentence, which contained either semantic, syntactic, or no violation, respectively, by means of event-related brain potentials (ERPs). Behavioral data revealed strong effects of emotion; error rates and reaction times increased significantly in sentences preceded by a positive paragraph relative to negative and neutral ones. In ERPs, the N400 to semantic violations was not affected by emotion. In the syntactic experiment, however, clear emotion effects were observed on ERPs. The left anterior negativity (LAN) to syntactic violations, which was not visible in the neutral condition, was present in the negative and positive conditions. This is interpreted as reflecting modulatory effects of prior emotions on syntactic processing, which is discussed in the light of three alternative or complementary explanations based on emotion-induced cognitive styles, working memory, and arousal models. The present effects of emotion on the LAN are especially remarkable considering that syntactic processing has often been regarded as encapsulated and autonomous.
-
We studied the case of transparent word labels (e.g., 'push') placed on glass doors, when viewed from the other side as mirror-reversed script, hence requiring an action opposite to word meaning. As compared with a regular view, labels seen 'from the other side' in the glass door situation caused strong delays of actions and a tripling of error rates. This problem is unrelated to mirror reading but is at least partially due to the need to act opposite to word meaning. The glass door effect was not related to practice and age and showed no adaptation effect after incompatible trials. Distribution analyses showed an increased correct reaction time (RT) effect for slower responses, whereas accuracy effects were specific for fast responses. In the literature, problems with such mixed mappings have often been interpreted in the sense of competing action tendencies. Experiments 1 to 4, however, demonstrated that this might merely be a task difficulty effect due to the necessity for a mental transformation in case of mirror-reversed labels. Moreover, our results strongly advocate against using transparent labels because they may pose a considerable risk.
-
In so-called garden-path jokes, an initial semantic representation is violated, and semantic revision reestablishes a coherent representation. 48 jokes were manipulated in three conditions: (i) a coherent ending, (ii) a joke ending, and (iii) a discourse-incoherent ending. A reading times study (N = 24) and three studies with recordings of ERP and pupil changes (N = 21, 24, and 24, respectively) supported the hypothesized cognitive processes. Jokes showed increased reading times of the final word compared to coherent endings. ERP data mainly indicated semantic integration difficulties (N400). Larger pupil diameters to joke endings presumably reflect emotional responses. ERP evidence for increased discourse processing efforts and emotional responses, as assumed to be reflected in modulations of the late left anterior negativity (LLAN) and in an enhanced late frontal positivity (fP600), respectively, remains however incomplete. Processing of incoherent endings was also accompanied by increased reading times, a stronger and sustained N400, and context-sensitive P600 effects. Together, these findings provide evidence for a sequential, non-monotonic, and incremental discourse comprehension of garden-path jokes.
-
For emotional pictures with fear-, disgust-, or sex-related contents, stimulus size has been shown to increase emotion effects in attention-related event-related potentials (ERPs), presumably reflecting the enhanced biological impact of larger emotion-inducing pictures. If this is true, size should not enhance emotion effects for written words with symbolic and acquired meaning. Here, we investigated ERP effects of font size for emotional and neutral words. While P1 and N1 amplitudes were not affected by emotion, the early posterior negativity started earlier and lasted longer for large relative to small words. These results suggest that emotion-driven facilitation of attention is not necessarily based on biological relevance, but might generalize to stimuli with arbitrary perceptual features. This finding points to the high relevance of written language in today’s society as an important source of emotional meaning.
-
Facial attractiveness is of high importance for human interaction and communication, and everyday experience suggests that the mere aspect of a face elicits spontaneous appraisal of attractiveness. However, little is known about the time course of brain responses related to this process. In the present study, event-related brain potentials were recorded during attractiveness classification of facial portraits that were standardized with respect to facial expression. The faces were either preceded by another face of high or low attractiveness or by an affectively neutral object. Attractive as opposed to non-attractive target faces elicited an early posterior negativity (EPN; ∼250 ms) and a late parietal positivity (LPC; 400-600 ms), which were not modulated by affectively congruent prime faces. Elevated LPC activity had previously been shown in response to attractive versus non-attractive faces, possibly reflecting task-related evaluative processes. An enhanced EPN had been reported for faces with emotional compared to neutral emotional expression, and related to facilitated selection of emotional information. Extending these findings, our study is the first to report an attractiveness-related ERP modulation prior to the LPC, suggesting that appraising facial attractiveness starts already at processing stages associated with stimulus selection.
-
We used facial EMG to examine reactions to the attractiveness of natural (faces) and artificial (abstract patterns) stimuli under long and short presentation durations. Attractive stimuli produced strong activations of the M. zygomaticus major muscle, indicating positive affective reactions; and unattractive stimuli produced strong activations of the M. corrugator supercili muscle, indicating negative affective reactions. Fluency effects, indicated by stronger activations of the M. zygomaticus major under the longer presentation duration were, however, only found for the abstract patterns. Moreover, the abstract patterns also were associated with more consistent activations over time than the faces, suggesting differences in the processes underlying the evaluation of faces and patterns. We discuss these results in terms of differences in appraisal processes between the two classes of stimuli—the greater biological, social, and sociosexual significance of faces trigger more complex appraisals than the abstract patterns.