Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory

Schindler S, Zell E, Botsch M, Kißler J (2017)
Scientific Reports 7(1): 45003.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
OA 1.80 MB
Abstract / Bemerkung
Cartoon characters are omnipresent in popular media. While few studies have scientifically investigated their processing, in computer graphics, efforts are made to increase realism. Yet, close approximations of reality have been suggested to evoke sometimes a feeling of eeriness, the “uncanny valley” effect. Here, we used high-density electroencephalography to investigate brain responses to professionally stylized happy, angry, and neutral character faces. We employed six face-stylization levels varying from abstract to realistic and investigated the N170, early posterior negativity (EPN), and late positive potential (LPP) event-related components. The face-specific N170 showed a u-shaped modulation, with stronger reactions towards both most abstract and most realistic compared to medium-stylized faces. For abstract faces, N170 was generated more occipitally than for real faces, implying stronger reliance on structural processing. Although emotional faces elicited highest amplitudes on both N170 and EPN, on the N170 realism and expression interacted. Finally, LPP increased linearly with face realism, reflecting activity increase in visual and parietal cortex for more realistic faces. Results reveal differential effects of face stylization on distinct face processing stages and suggest a perceptual basis to the uncanny valley hypothesis. They are discussed in relation to face perception, media design, and computer graphics.
Erscheinungsjahr
2017
Zeitschriftentitel
Scientific Reports
Band
7
Ausgabe
1
Art.-Nr.
45003
ISSN
2045-2322
Finanzierungs-Informationen
Open-Access-Publikationskosten wurden durch die Deutsche Forschungsgemeinschaft und die Universität Bielefeld gefördert.
Page URI
https://pub.uni-bielefeld.de/record/2909407

Zitieren

Schindler S, Zell E, Botsch M, Kißler J. Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports. 2017;7(1): 45003.
Schindler, S., Zell, E., Botsch, M., & Kißler, J. (2017). Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports, 7(1), 45003. doi:10.1038/srep45003
Schindler, Sebastian, Zell, Eduard, Botsch, Mario, and Kißler, Johanna. 2017. “Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory”. Scientific Reports 7 (1): 45003.
Schindler, S., Zell, E., Botsch, M., and Kißler, J. (2017). Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports 7:45003.
Schindler, S., et al., 2017. Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports, 7(1): 45003.
S. Schindler, et al., “Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory”, Scientific Reports, vol. 7, 2017, : 45003.
Schindler, S., Zell, E., Botsch, M., Kißler, J.: Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports. 7, : 45003 (2017).
Schindler, Sebastian, Zell, Eduard, Botsch, Mario, and Kißler, Johanna. “Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory”. Scientific Reports 7.1 (2017): 45003.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:18:44Z
MD5 Prüfsumme
bcf7151563d9fa4c374731442d985c55


4 Zitationen in Europe PMC

Daten bereitgestellt von Europe PubMed Central.

Modulation of face- and emotion-selective ERPs by the three most common types of face image manipulations.
Schindler S, Bruchmann M, Bublatzky F, Straube T., Soc Cogn Affect Neurosci 14(5), 2019
PMID: 30972417
Subthalamic nucleus detects unnatural android movement.
Ikeda T, Hirata M, Kasaki M, Alimardani M, Matsushita K, Yamamoto T, Nishio S, Ishiguro H., Sci Rep 7(1), 2017
PMID: 29259217

74 References

Daten bereitgestellt von Europe PubMed Central.

The Human Face as a Dynamic Tool for Social Communication.
Jack RE, Schyns PG., Curr. Biol. 25(14), 2015
PMID: 26196493
Mechanisms of face perception.
Tsao DY, Livingstone MS., Annu. Rev. Neurosci. 31(), 2008
PMID: 18558862

AUTHOR UNKNOWN, 1998
What is "special" about face perception?
Farah MJ, Wilson KD, Drain M, Tanaka JN., Psychol Rev 105(3), 1998
PMID: 9697428
Understanding the recognition of facial identity and facial expression.
Calder AJ, Young AW., Nat. Rev. Neurosci. 6(8), 2005
PMID: 16062171
The distributed human neural system for face perception.
Haxby JV, Hoffman EA, Gobbini MI., Trends Cogn. Sci. (Regul. Ed.) 4(6), 2000
PMID: 10827445
Universal and cultural differences in facial expression of emotion. In
AUTHOR UNKNOWN, 1972
An argument for basic emotions
AUTHOR UNKNOWN, 1992
The many faces of Maleficent
AUTHOR UNKNOWN, 2014
The uncanny valley [from the field]
AUTHOR UNKNOWN, 2012
Expanding the aesthetic possibilities for humanoid robots
AUTHOR UNKNOWN, 2005
Subjective ratings of robot video clips for human likeness, familiarity, and eeriness: An exploration of the uncanny valley
AUTHOR UNKNOWN, 2006
Evaluating the perceptual realism of animated facial expressions
AUTHOR UNKNOWN, 2008
Render me real?: investigating the effect of render style on the perception of animated virtual humans
AUTHOR UNKNOWN, 2012
The tipping point of animacy. How, when, and where we perceive life in a face.
Looser CE, Wheatley T., Psychol Sci 21(12), 2010
PMID: 21097720
A review of empirical evidence on different uncanny valley hypotheses: support for perceptual mismatch as one road to the valley of eeriness
AUTHOR UNKNOWN, 2015

AUTHOR UNKNOWN, 2014
To stylize or not to stylize? The effect of shape and material stylization on the perception of computer-generated faces
AUTHOR UNKNOWN, 2015
The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces
AUTHOR UNKNOWN, 2007
TMS evidence for the involvement of the right occipital face area in early face processing.
Pitcher D, Walsh V, Yovel G, Duchaine B., Curr. Biol. 17(18), 2007
PMID: 17764942
The fusiform face area is not sufficient for face recognition: evidence from a patient with dense prosopagnosia and no occipital face area.
Steeves JK, Culham JC, Duchaine BC, Pratesi CC, Valyear KF, Schindler I, Humphrey GK, Milner AD, Goodale MA., Neuropsychologia 44(4), 2005
PMID: 16125741
The fusiform face area: a module in human extrastriate cortex specialized for face perception.
Kanwisher N, McDermott J, Chun MM., J. Neurosci. 17(11), 1997
PMID: 9151747
MEG/EEG sources of the 170-ms response to faces are co-localized in the fusiform gyrus.
Deffke I, Sander T, Heidenreich J, Sommer W, Curio G, Trahms L, Lueschow A., Neuroimage 35(4), 2007
PMID: 17363282
Electrophysiological Studies of Face Perception in Humans.
Bentin S, Allison T, Puce A, Perez E, McCarthy G., J Cogn Neurosci 8(6), 1996
PMID: 20740065
N170–An index of categorical face perception? An ERP study of human, nonhuman primate, and dog faces
AUTHOR UNKNOWN, 2011
Neural responses to cartoon facial attractiveness: An event-related potential study.
Lu Y, Wang J, Wang L, Wang J, Qin J., Neurosci Bull 30(3), 2014
PMID: 24526658
When memory meets beauty: Insights from event-related potentials.
Marzi T, Viggiano MP., Biol Psychol 84(2), 2010
PMID: 20109520
Face coding is bilateral in the female brain.
Proverbio AM, Riva F, Martin E, Zani A., PLoS ONE 5(6), 2010
PMID: 20574528
N170 sensitivity to facial expression: A meta-analysis.
Hinojosa JA, Mercado F, Carretie L., Neurosci Biobehav Rev 55(), 2015
PMID: 26067902
Early cortical processing of natural and artificial emotional faces differs between lower and higher socially anxious persons
AUTHOR UNKNOWN, 2009
Human brain spots emotion in non humanoid robots.
Dubal S, Foucher A, Jouvent R, Nadel J., Soc Cogn Affect Neurosci 6(1), 2010
PMID: 20194513
The facilitated processing of threatening faces: an ERP analysis.
Schupp HT, Ohman A, Junghofer M, Weike AI, Stockburger J, Hamm AO., Emotion 4(2), 2004
PMID: 15222855
Social and emotional relevance in face processing: happy faces of future interaction partners enhance the late positive potential
AUTHOR UNKNOWN, 2014
Emotion and attention: event-related brain potential studies.
Schupp HT, Flaisch T, Stockburger J, Junghofer M., Prog. Brain Res. 156(), 2006
PMID: 17015073
Selective visual attention to emotion.
Schupp HT, Stockburger J, Codispoti M, Junghofer M, Weike AI, Hamm AO., J. Neurosci. 27(5), 2007
PMID: 17267562
Emotion and the processing of symbolic gestures: an event-related brain potential study.
Flaisch T, Hacker F, Renner B, Schupp HT., Soc Cogn Affect Neurosci 6(1), 2010
PMID: 20212003
The selective processing of briefly presented affective pictures: an ERP analysis.
Schupp HT, Junghofer M, Weike AI, Hamm AO., Psychophysiology 41(3), 2004
PMID: 15102130
Don't look at me in anger! Enhanced processing of angry faces in anticipation of public speaking.
Wieser MJ, Pauli P, Reicherts P, Muhlberger A., Psychophysiology 47(2), 2009
PMID: 20030758
Brain potentials in affective picture processing: covariation with autonomic arousal and affective report.
Cuthbert BN, Schupp HT, Bradley MM, Birbaumer N, Lang PJ., Biol Psychol 52(2), 2000
PMID: 10699350
Temporal dissociation in the brain processing of pain and anger faces with different intensities of emotional expression.
Gonzalez-Roldan AM, Martinez-Jauand M, Munoz-Garcia MA, Sitges C, Cifre I, Montoya P., Pain 152(4), 2011
PMID: 21296497
Affective picture processing: an integrative review of ERP findings.
Olofsson JK, Nordin S, Sequeira H, Polich J., Biol Psychol 77(3), 2007
PMID: 18164800
Emotional scenes elicit more pronounced self-reported emotional experience and greater EPN and LPP modulation when compared to emotional faces
AUTHOR UNKNOWN, 2013
Facial attractiveness modulates early and late event-related brain potentials.
Werheid K, Schacht A, Sommer W., Biol Psychol 76(1-2), 2007
PMID: 17681418
Mind perception: real but not artificial faces sustain neural activity beyond the N170/VPP.
Wheatley T, Weinberg A, Looser C, Moran T, Hajcak G., PLoS ONE 6(3), 2011
PMID: 21483856
Artificial faces are harder to remember
AUTHOR UNKNOWN, 2015
How Well Do Computer-Generated Faces Tap Face Expertise?
AUTHOR UNKNOWN, 2015
Neural correlates of facilitations in face learning by selective caricaturing of facial shape or reflectance.
Itz ML, Schweinberger SR, Schulz C, Kaufmann JM., Neuroimage 102 Pt 2(), 2014
PMID: 25173417
Faces forming traces: neurophysiological correlates of learning naturally distinctive and caricatured faces.
Schulz C, Kaufmann JM, Kurt A, Schweinberger SR., Neuroimage 63(1), 2012
PMID: 22796993
Facing good and evil: early brain signatures of affective biographical knowledge in face recognition
AUTHOR UNKNOWN, 2011
Knowledge scale effects in face recognition: an electrophysiological investigation.
Abdel Rahman R, Sommer W., Cogn Affect Behav Neurosci 12(1), 2012
PMID: 21979895
Electrophysiological correlates of face-evoked person knowledge.
Taylor J, Shehzad Z, McCarthy G., Biol Psychol 118(), 2016
PMID: 27241517
Response properties of the human fusiform face area.
Tong F, Nakayama K, Moscovitch M, Weinrib O, Kanwisher N., Cogn Neuropsychol 17(1), 2000
PMID: 20945183
Neural mechanisms underlying selective attention to threat.
Bishop SJ., Ann. N. Y. Acad. Sci. 1129(), 2008
PMID: 18591476
Understanding evaluation of faces on social dimensions.
Todorov A, Said CP, Engell AD, Oosterhof NN., Trends Cogn. Sci. (Regul. Ed.) 12(12), 2008
PMID: 18951830
Understanding face recognition
AUTHOR UNKNOWN, 1986
Event-related brain potentials distinguish processing stages involved in face perception and recognition
AUTHOR UNKNOWN, 2000
Measuring the physical in physical attractiveness: Quasi-experiments on the sociobiology of female facial beauty
AUTHOR UNKNOWN, 1986
Unveiling the biometric potential of finger-based ECG signals.
Lourenco A, Silva H, Fred A., Comput Intell Neurosci 2011(), 2011
PMID: 21837235
Artifact correction of the ongoing EEG using spatial filters based on artifact and brain signal topographies
AUTHOR UNKNOWN, 2002
Electromagnetic source reconstruction for group studies.
Litvak V, Friston K., Neuroimage 42(4), 2008
PMID: 18639641
Unveiling the biometric potential of finger-based ECG signals.
Lourenco A, Silva H, Fred A., Comput Intell Neurosci 2011(), 2011
PMID: 21837235

AUTHOR UNKNOWN, 1988
Perceived communicative context and emotional content amplify visual word processing in the fusiform gyrus.
Schindler S, Wegrzyn M, Steppacher I, Kissler J., J. Neurosci. 35(15), 2015
PMID: 25878274
Construction of a 3D probabilistic atlas of human cortical structures.
Shattuck DW, Mirza M, Adisetiyo V, Hojatkashani C, Salamon G, Narr KL, Poldrack RA, Bilder RM, Toga AW., Neuroimage 39(3), 2007
PMID: 18037310
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®
Quellen

PMID: 28332557
PubMed | Europe PMC

Suchen in

Google Scholar