Abstract
Recognition of identity and of emotional facial expressions of individuals are both based on processing of the human face. While most studies show these abilities to be dissociated, some others find evidence of a connection. One possible explanation for these contradictory results comes from neurological evidence, which points to identity recognition being mostly based on holistic processing, while emotion recognition seems to be based on both an explicit, fine-grained process, and an implicit, mostly-holistic one. Our main hypothesis, that would explain the contradictory findings, is that holistic implicit emotion recognition, specifically, would be related to identity recognition, while explicit emotion recognition would be a process separate to identity recognition. To test this hypothesis, we employed an experimental paradigm in which spatial frequencies of visual stimuli are manipulated so that automatic, holistic-based, implicit emotion recognition influences perceived friendliness of unfamiliar faces. We predicted the effect to be related to identity recognition ability, since they both require holistic face processing. After a successful replication study, we employed the paradigm with 140 participants, measuring also identity recognition ability and explicit emotion recognition ability. Results showed that the effect is not moderated by these two variables (p = .807 and .373, respectively), suggesting that the independence of identity and emotion recognition holds even when considering, specifically, implicit emotion recognition.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data and material
Data are available upon request to the authors.
Code availability
R codes are included in the supplemental materials.
Notes
Actors’ gender was balanced. As an exploratory analysis, we checked whether actor gender was associated with perceived friendliness, and we found no significant results. As this was not the focus of the study, we did not include this variable in the models.
References
Adolphs R, Tranel D, Damasio H, Damasio A (1995) Fear and the human amygdala. J Neurosci 15:5879–5891. https://doi.org/10.1523/JNEUROSCI.15-09-05879.1995
Aguado L, Serrano-Pedraza I, Rodríguez S, Román FJ (2010) Effects of spatial frequency content on classification of face gender and expression. Span J Psychol 13:525–537. https://doi.org/10.1017/S1138741600002225
Albonico A, Malaspina M, Daini R (2017) Italian normative data and validation of two neuropsychological tests of face recognition: Benton Facial Recognition Test and Cambridge Face Memory Test. Neurol Sci 38:1637–1643. https://doi.org/10.1007/s10072-017-3030-6
Avidan G, Tanzer M, Behrmann M (2011) Impaired holistic processing in congenital prosopagnosia. Neuropsychologia 49:2541–2552. https://doi.org/10.1016/j.neuropsychologia.2011.05.002
Baron-Cohen S, Ring HA, Wheelwright S et al (1999) Social intelligence in the normal and autistic brain: an fMRI study. Eur J Neurosci 11:1891–1898. https://doi.org/10.1046/j.1460-9568.1999.00621.x
Baudouin J-Y, Gilibert D, Sansone S, Tiberghien G (2000) When the smile is a cue to familiarity. Memory 8:285–292. https://doi.org/10.1080/09658210050117717
Behrmann M, Avidan G (2005) Congenital prosopagnosia: face-blind from birth. Trends Cogn Sci 9:180–187. https://doi.org/10.1016/j.tics.2005.02.011
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B 57:289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
Bentin S, Degutis JM, D’Esposito M, Robertson LC (2007) Too many trees to see the forest: performance, event-related potential, and functional magnetic resonance imaging manifestations of integrative congenital prosopagnosia. J Cogn Neurosci 19:132–146. https://doi.org/10.1162/jocn.2007.19.1.132
Bodamer J (1947) Die Prosop-Agnosie. Arch Für Psychiatr Und Nervenkrankheiten Ver Mit Zeitschrift Für Die Gesamte Neurol Und Psychiatr 179:6–53. https://doi.org/10.1007/BF00352849
Bowles DC, McKone E, Dawel A et al (2009) Diagnosing prosopagnosia: effects of ageing, sex, and participant–stimulus ethnic match on the Cambridge Face Memory Test and Cambridge Face Perception Test. Cogn Neuropsychol 26:423–455. https://doi.org/10.1080/02643290903343149
Braun CMJ, Denault C, Cohen H, Rouleau I (1994) Discrimination of facial identity and facial affect by temporal and frontal lobectomy patients. Brain Cogn 24:198–212. https://doi.org/10.1006/brcg.1994.1011
Bruce V, Young A (1986) Understanding face recognition. Br J Psychol 77:305–327. https://doi.org/10.1111/j.2044-8295.1986.tb02199.x
Bukach CM, Bub DN, Gauthier I, Tarr MJ (2006) Perceptual expertise effects are not all or none: spatially limited perceptual expertise for faces in a case of prosopagnosia. J Cogn Neurosci 18:48–63. https://doi.org/10.1162/089892906775250094
Campbell R, Brooks B, de Haan E, Roberts T (1996) Dissociating face processing skills: decisions about lip read speech, expression, and identity. Q J Exp Psychol Sect A 49:295–314. https://doi.org/10.1080/713755619
Comparelli A, Corigliano V, De Carolis A et al (2013) Emotion recognition impairment is present early and is stable throughout the course of schizophrenia. Schizophr Res 143:65–69. https://doi.org/10.1016/j.schres.2012.11.005
D’Argembeau A, Van der Linden M (2007) Facial expressions of emotion influence memory for facial identity in an automatic way. Emotion 7:507–515. https://doi.org/10.1037/1528-3542.7.3.507
Daini R, Comparetti CM, Ricciardelli P (2014) Behavioral dissociation between emotional and non-emotional facial expressions in congenital prosopagnosia. Front Hum Neurosci 8:1–11. https://doi.org/10.3389/fnhum.2014.00974
DeGutis JM, Chiu C, Grosso ME, Cohan S (2014) Face processing improvements in prosopagnosia: successes and failures over the last 50 years. Front Hum Neurosci. https://doi.org/10.3389/fnhum.2014.00561
De-Wit L, Wagemans J (2013) Individual differences in local and global perceptual organization. In: Oxford handbook of perceptual organization, pp 713–735
Downing PE, Chan AWY, Peelen MV et al (2006) Domain specificity in visual cortex. Cereb Cortex 16:1453–1461. https://doi.org/10.1093/cercor/bhj086
Duchaine BC, Nakayama K (2006) The Cambridge Face Memory Test: results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants. Neuropsychologia 44:576–585. https://doi.org/10.1016/j.neuropsychologia.2005.07.001
Duchaine BC, Parker H, Nakayama K (2003) Normal recognition of emotion in a prosopagnosic. Perception 32:827–838. https://doi.org/10.1068/p5067
Duchaine BC, Yovel G, Butterworth EJ, Nakayama K (2006) Prosopagnosia as an impairment to face-specific mechanisms: elimination of the alternative hypotheses in a developmental case. Cogn Neuropsychol 23:714–747. https://doi.org/10.1080/02643290500441296
Etcoff NL (1984) Selective attention to facial identity and facial emotion. Neuropsychologia 22:281–295. https://doi.org/10.1016/0028-3932(84)90075-7
Farah MJ, Wilson KD, Drain M, Tanaka JN (1998) What is “special” about face perception? Psychol Rev 105:482–498. https://doi.org/10.1037/0033-295X.105.3.482
Flevaris AV, Martínez A, Hillyard SA (2014) Attending to global versus local stimulus features modulates neural processing of low versus high spatial frequencies: An analysis with event-related brain potentials. Front Psychol. https://doi.org/10.3389/fpsyg.2014.00277
Gauthier I, Curby KM, Skudlarski P, Epstein RA (2005) Individual differences in FFA activity suggest independent processing at different spatial scales. Cogn Affect Behav Neurosci 5:222–234. https://doi.org/10.3758/CABN.5.2.222
George MS, Ketter TA, Gill DS et al (1993) Brain regions involved in recognizing facial emotion or identity: an oxygen-15 PET study. J Neuropsychiatry Clin Neurosci 5:384–394. https://doi.org/10.1176/jnp.5.4.384
Gobbini MI, Haxby JV (2006) Neural response to the visual familiarity of faces. Brain Res Bull 71:76–82. https://doi.org/10.1016/j.brainresbull.2006.08.003
Goeleven E, De Raedt R, Leyman L, Verschuere B (2008) The Karolinska Directed Emotional Faces: a validation study. Cogn Emot 22:1094–1118. https://doi.org/10.1080/02699930701626582
Goffaux V, Rossion B (2006) Faces are “spatial”–holistic face perception is supported by low spatial frequencies. J Exp Psychol Hum Percept Perform 32:1023–1039. https://doi.org/10.1037/0096-1523.32.4.1023
Grill-Spector K, Sayres R, Ress D (2006) High-resolution imaging reveals highly selective nonface clusters in the fusiform face area. Nat Neurosci 9:1177–1185. https://doi.org/10.1038/nn1745
Hall JA (1978) Gender effects in decoding nonverbal cues. Psychol Bull 85:845–857. https://doi.org/10.1037/0033-2909.85.4.845
Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4:223–233. https://doi.org/10.1016/S1364-6613(00)01482-0
Hughes HC, Fendrich R, Reuter-Lorenz PA (1990) Global versus local processing in the absence of low spatial frequencies. J Cogn Neurosci 2:272–282. https://doi.org/10.1162/jocn.1990.2.3.272
Judd CM, Westfall J, Kenny DA (2017) Experiments with more than one random factor: designs, analytic models, and statistical power. Annu Rev Psychol 68:601–625. https://doi.org/10.1146/annurev-psych-122414-033702
Kätsyri J, Saalasti S, Tiippana K et al (2008) Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome. Neuropsychologia 46:1888–1897. https://doi.org/10.1016/j.neuropsychologia.2008.01.005
Kepner MD, Neimark ED (1984) Test–retest reliability and differential patterns of score change on the Group Embedded Figures Test. J Pers Soc Psychol 46:1405–1413. https://doi.org/10.1037/0022-3514.46.6.1405
Krolak-Salmon P, Hénaff M-A, Vighetto A et al (2004) Early amygdala reaction to fear spreading in occipital, temporal, and frontal cortex. Neuron 42:665–676. https://doi.org/10.1016/S0896-6273(04)00264-8
Laeng B, Profeti I, Sæther L (2010) Invisible expressions evoke core impressions. Emotion 10:573–586. https://doi.org/10.1037/a0018689
Lander K, Metcalfe S (2007) The influence of positive and negative facial expressions on face familiarity. Memory 15:63–69. https://doi.org/10.1080/09658210601108732
Leibenluft E, Gobbini MI, Harrison T, Haxby JV (2004) Mothers’ neural activation in response to pictures of their children and other children. Biol Psychiatry 56:225–232. https://doi.org/10.1016/j.biopsych.2004.05.017
Maurer D, O’Craven KM, Le Grand R et al (2007) Neural correlates of processing facial identity based on features versus their spacing. Neuropsychologia 45:1438–1451. https://doi.org/10.1016/j.neuropsychologia.2006.11.016
McConachie HR (1976) Developmental prosopagnosia. A single case report. Cortex 12:76–82. https://doi.org/10.1016/S0010-9452(76)80033-0
McKone E, Hall A, Pidcock M et al (2011) Face ethnicity and measurement reliability affect face recognition performance in developmental prosopagnosia: evidence from the Cambridge Face Memory Test-Australian. Cogn Neuropsychol 28:109–146. https://doi.org/10.1080/02643294.2011.616880
Meaux E, Vuilleumier P (2016) Facing mixed emotions: analytic and holistic perception of facial emotion expressions engages separate brain networks. Neuroimage. https://doi.org/10.1016/j.neuroimage.2016.07.004
Minnebusch DA, Suchan B, Ramon M, Daum I (2007) Event-related potentials reflect heterogeneity of developmental prosopagnosia. Eur J Neurosci 25:2234–2247. https://doi.org/10.1111/j.1460-9568.2007.05451.x
Narumoto J, Okada T, Sadato N et al (2001) Attention to emotion modulates fMRI activity in human right superior temporal sulcus. Cogn Brain Res 12:225–231. https://doi.org/10.1016/S0926-6410(01)00053-2
Oliva A, Torralba A, Schyns PG (2006) Hybrid images. In: ACM SIGGRAPH 2006 Papers on - SIGGRAPH ’06. ACM Press, New York, New York, USA, p 527
Oliva A, Schyns PG (1997) Coarse blobs or fine edges? Evidence that information diagnosticity changes the perception of complex visual stimuli. Cogn Psychol 34:72–107. https://doi.org/10.1006/cogp.1997.0667
Palermo R, Rivolta D, Wilson CE, Jeffery L (2011a) Adaptive face space coding in congenital prosopagnosia: typical figural aftereffects but abnormal identity aftereffects. Neuropsychologia 49:3801–3812. https://doi.org/10.1016/j.neuropsychologia.2011.09.039
Palermo R, Willis ML, Rivolta D et al (2011b) Impaired holistic coding of facial expression and facial identity in congenital prosopagnosia. Neuropsychologia 49:1226–1235. https://doi.org/10.1016/j.neuropsychologia.2011.02.021
Paradiso S (1998) The emotional brain: the mysterious underpinnings of emotional life. Am J Psychiatry 155:570–570. https://doi.org/10.1176/ajp.155.4.570
Passarelli M, Masini M, Bracco F et al (2018) Development and validation of the Facial Expression Recognition Test (FERT). Psychol Assess 30:1479–1490. https://doi.org/10.1037/pas0000595
Peirce JW (2007) PsychoPy—psychophysics software in Python. J Neurosci Methods 162:8–13. https://doi.org/10.1016/j.jneumeth.2006.11.017
Peirce JW (2008) Generating stimuli for neuroscience using PsychoPy. Front Neuroinform. https://doi.org/10.3389/neuro.11.010.2008
Prete G, Capotosto P, Zappasodi F et al (2015a) The cerebral correlates of subliminal emotions: an electroencephalographic study with emotional hybrid faces. Eur J Neurosci 42:2952–2962. https://doi.org/10.1111/ejn.13078
Prete G, D’Ascenzo S, Laeng B et al (2015b) Conscious and unconscious processing of facial expressions: evidence from two split-brain patients. J Neuropsychol 9:45–63. https://doi.org/10.1111/jnp.12034
Prete G, Laeng B, Tommasi L (2018) Modulating adaptation to emotional faces by spatial frequency filtering. Psychol Res. https://doi.org/10.1007/s00426-016-0830-x
Ramon M, Busigny T, Rossion B (2010) Impaired holistic processing of unfamiliar individual faces in acquired prosopagnosia. Neuropsychologia 48:933–944. https://doi.org/10.1016/j.neuropsychologia.2009.11.014
Richler JJ, Cheung OS, Gauthier I (2011) Holistic processing predicts face recognition. Psychol Sci 22:464–471. https://doi.org/10.1177/0956797611401753
Rossion B, Dricot L, Goebel R, Busigny T (2011) Holistic face categorization in higher order visual areas of the normal and prosopagnosic brain: toward a non-hierarchical view of face perception. Front Hum Neurosci. https://doi.org/10.3389/fnhum.2010.00225
Russell R, Duchaine B, Nakayama K (2009) Super-recognizers: people with extraordinary face recognition ability. Psychon Bull Rev 16:252–257. https://doi.org/10.3758/PBR.16.2.252
Satterthwaite FE (1946) An approximate distribution of estimates of variance components. Biom Bull 2:110. https://doi.org/10.2307/3002019
Schiltz C, Rossion B (2006) Faces are represented holistically in the human occipito-temporal cortex. Neuroimage 32:1385–1394. https://doi.org/10.1016/j.neuroimage.2006.05.037
Schlegel K, Grandjean D, Scherer KR (2014) Introducing the Geneva Emotion Recognition Test: an example of Rasch-based test development. Psychol Assess 26:666–672. https://doi.org/10.1037/a0035246
Schwartz CE, Wright CI, Shin LM et al (2003) Differential amygdalar response to novel versus newly familiar neutral faces: a functional MRI probe developed for studying inhibited temperament. Biol Psychiatry 53:854–862. https://doi.org/10.1016/S0006-3223(02)01906-6
Schwarzer G, Huber S, Grüter M et al (2007) Gaze behaviour in hereditary prosopagnosia. Psychol Res 71:583–590. https://doi.org/10.1007/s00426-006-0068-0
Schweinberger SR, Soukup GR (1998) Asymmetric relationships among perceptions of facial identity, emotion, and facial speech. J Exp Psychol Hum Percept Perform 24:1748–1765. https://doi.org/10.1037/0096-1523.24.6.1748
Surguladze SA, Brammer MJ, Keedwell P et al (2005) A differential pattern of neural response toward sad versus happy facial expressions in major depressive disorder. Biol Psychiatry 57:201–209. https://doi.org/10.1016/j.biopsych.2004.10.028
Tanaka JW, Simonyi D (2016) The “parts and wholes” of face recognition: a review of the literature. Q J Exp Psychol 69:1876–1889. https://doi.org/10.1080/17470218.2016.1146780
Tanzer M, Freud E, Ganel T, Avidan G (2013) General holistic impairment in congenital prosopagnosia: evidence from Garner’s speeded-classification task. Cogn Neuropsychol 30:429–445. https://doi.org/10.1080/02643294.2013.873715
Torfs K, Vancleef K, Lafosse C et al (2014) The Leuven Perceptual Organization Screening Test (L-POST), an online test to assess mid-level visual perception. Behav Res Methods 46:472–487. https://doi.org/10.3758/s13428-013-0382-6
Turati C, Di Giorgio E, Bardi L, Simion F (2010) Holistic face processing in newborns, 3-month-old infants, and adults: evidence from the composite face effect. Child Dev 81:1894–1905. https://doi.org/10.1111/j.1467-8624.2010.01520.x
Vancleef K, Acke E, Torfs K et al (2015) Reliability and validity of the Leuven Perceptual Organization Screening Test (L-POST). J Neuropsychol 9:271–298. https://doi.org/10.1111/jnp.12050
Vuilleumier P, Armony JL, Driver J, Dolan RJ (2003) Distinct spatial frequency sensitivities for processing faces and emotional expressions. Nat Neurosci 6:624–631. https://doi.org/10.1038/nn1057
Wenger MJ, Townsend JT (2000) Spatial frequencies in short-term memory for faces: a test of three frequency-dependent hypotheses. Mem Cognit 28:125–142. https://doi.org/10.3758/BF03211581
Westfall J, Kenny DA, Judd CM (2014) Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. J Exp Psychol Gen 143:2020–2045. https://doi.org/10.1037/xge0000014
Winston JS, Henson RNA, Fine-Goulden MR, Dolan RJ (2004) fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. J Neurophysiol 92:1830–1839. https://doi.org/10.1152/jn.00155.2004
Witkin H, Oltman P, Raskin E, Karp SA (2002) Group embedded figures test manual. Consulting Psychologists Press, Palo Alto, CA
Young AW, McWeeny KH, Hay DC, Ellis AW (1986) Matching familiar and unfamiliar faces on identity and expression. Psychol Res 48:63–68. https://doi.org/10.1007/BF00309318
Young AW, Newcombe F, de Haan EHF et al (1993) Face perception after brain injury. Brain 116:941–959. https://doi.org/10.1093/brain/116.4.941
Young AW, Hellawell D, Hay DC (2013) Configurational information in face perception. Perception 42:1166–1178. https://doi.org/10.1068/p160747n
Funding
No funding was received for this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval
The study received ethical approval from the Ethics Committee of [removed for blind review].
Consent to participate
All participants provided informed consent prior to the participation to the study.
Consent for publication
All participants provided consent for the publication of anonymized data and results.
Conflicts of interest
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Handling editor: Bruno Laeng (University of Oslo); Reviewers: Tetsuto Minami (Toyohashi University of Technology) and a second researcher who prefers to remain anonymous.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Passarelli, M., Masini, M., Chiorri, C. et al. Implicit evidence on the dissociation of identity and emotion recognition. Cogn Process 23, 79–90 (2022). https://doi.org/10.1007/s10339-021-01061-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10339-021-01061-2