Skip to main content

Representation and Integration of Faces and Vocalizations in the Primate Ventral Prefrontal Cortex

  • Chapter
  • First Online:
Integrating Face and Voice in Person Perception

Abstract

The integration of facial gestures and vocal signals is an essential process in social communication. Facial and vocal signals provide an abundant source of information that we use in our everyday interactions to communicate our intentions and obtain emotional and cognitive information from others. Face–voice integration relies on several brain regions, including language regions in the ventral frontal lobe. Neuroimaging has made great strides in describing activity in temporal and frontal regions during speech processing, but we have relatively little understanding of the cellular mechanisms that underlie face–voice integration in the frontal lobe. Much of the neurophysiology research into the cellular details of face and voice processing has been focused on nonhuman primates in an attempt to characterize the neural circuit involved in social communication. While much of this research has elaborated on these sensory processes in primary and secondary cortical areas, more recent research has embarked upon how higher order cortical areas like the prefrontal cortex process face and voice information. This chapter will focus on the role of the ventrolateral prefrontal cortex in the processing and integration of face and vocal information in nonhuman primates. We will first describe studies on face-responsive cells in the nonhuman primate cortex, including inferotemporal cortex and the STS and finally face processing in PFC. This will be followed by auditory responses in PFC. Finally, we will examine the integration of faces and voices by single cells in the primate prefrontal cortex and their potential role in recognition and social communication.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adachi, I., Chou, D. P., & Hampton, R. R. (2009). Thatcher effect in monkeys demonstrates conservation of face perception across primates. Current Biology, 19(15), 1270–1273.

    PubMed  CAS  Google Scholar 

  • Albright, T. D., Desimone, R., & Gross, C. G. (1984). Columnar organization of directionally selective cells in visual area MT of the macaque. Journal of Neurophysiology, 51, 16–31.

    PubMed  CAS  Google Scholar 

  • Altmann, S. A. (1962). A field study of the sociobiology of rhesus monkeys, Macaca mulatta. Annals of the New York Academy of Sciences, 102, 338–435.

    PubMed  CAS  Google Scholar 

  • Andrew, R. J. (1963). Evolution of facial expression. Science (New York, NY), 142, 1034–1041.

    CAS  Google Scholar 

  • Averbeck, B. B., & Romanski, L. M. (2004). Principal and independent components of macaque vocalizations: Constructing stimuli to probe high-level sensory processing. Journal of Neurophysiology, 91, 2897–2909.

    PubMed  Google Scholar 

  • Averbeck, B. B., & Romanski, L. M. (2006). Probabilistic encoding of vocalizations in macaque ventral lateral prefrontal cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 26, 11023–11033.

    CAS  Google Scholar 

  • Azuma, M., & Suzuki, H. (1984). Properties and distribution of auditory neurons in the dorsolateral prefrontal cortex of the alert monkey. Brain Research, 298, 343–346.

    PubMed  CAS  Google Scholar 

  • Barbas, H. (1988). Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey. Journal of Comparative Neurology, 276, 313–342.

    PubMed  CAS  Google Scholar 

  • Barbas, H. (1992). Architecture and cortical connections of the prefrontal cortex in the rhesus monkey. Advances in Neurology, 57, 91–115 [review].

    PubMed  CAS  Google Scholar 

  • Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977). Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Experimental Neurology, 57, 849–872.

    PubMed  CAS  Google Scholar 

  • Bodner, M., Kroger, J., & Fuster, J. M. (1996). Auditory memory cells in dorsolateral prefrontal cortex. Neuroreport, 7, 1905–1908.

    PubMed  CAS  Google Scholar 

  • Broca, P. (1861). Remarques su le siege defaulte de langage articule suivies d’une observation d’aphemie (perte de la parole). Bulletin De La Societe’ d’Anthropologie, 2, 330–337.

    Google Scholar 

  • Bruce, C. J., & Goldberg, M. E. (1985). Primate frontal eye fields. I. Single neurons discharging before saccades. Journal of Neurophysiology, 53(3), 603–635.

    PubMed  CAS  Google Scholar 

  • Buckner, R. L., Raichle, M. E., & Petersen, S. E. (1995). Dissociation of human prefrontal cortical areas across different speech production tasks and gender groups. Journal of Neurophysiology, 74(5), 2163–2173.

    PubMed  CAS  Google Scholar 

  • Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001). Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. NeuroImage, 14(2), 427–438.

    PubMed  CAS  Google Scholar 

  • Chavis, D. A., & Pandya, D. N. (1976). Further observations on corticofrontal connections in the rhesus monkey. Brain Research, 117, 369–386.

    PubMed  CAS  Google Scholar 

  • Dahl, C. D., Logothetis, N. K., Bulthoff, H. H., & Wallraven, C. (2010). The thatcher illusion in humans and monkeys. Proceedings of the Royal Society: Biological Sciences, 277(1696), 2973–2981.

    Google Scholar 

  • Darwin, C. (1872). The expression of the emotions in man and animals. London: John Murray.

    Google Scholar 

  • Demb, J. B., Desmond, J. E., Wagner, A. D., Vaidya, C. J., Glover, G. H., & Gabrieli, J. D. (1995). Semantic encoding and retrieval in the left inferior prefrontal cortex: A functional MRI study of task difficulty and process specificity. Journal of Neuroscience, 15(9), 5870–5878.

    PubMed  CAS  Google Scholar 

  • DeSouza, W. C., Eifuku, S., Tamura, R., Nishijo, H., & Ono, T. (2005). Differential characteristics of face neuron responses within the anterior superior temporal sulcus of macaques. Journal of Neurophysiology, 94, 1252–1266.

    Google Scholar 

  • Diehl, M. M., Bartlow-Kang, J., Sugihara, T., & Romanski, L. M. (2008). Distinct temporal lobe projections to auditory and visual regions in the ventral prefrontal cortex support face and vocalization processing. Society for Neuroscience Abstracts, 34.

    Google Scholar 

  • Dittrich, W. (1990). Representation of faces in longtailed macaques (Macaca fascicularis). Ethology, 85, 265–278.

    Google Scholar 

  • Dolan, R. J., Fletcher, P., Morris, J., Kapur, N., Deakin, J. F., & Frith, C. D. (1996). Neural activation during covert processing of positive emotional facial expressions. NeuroImage, 4(3 Pt 1), 194–200.

    PubMed  CAS  Google Scholar 

  • Eifuku, S., De Souza, W. C., Tamura, R., Nishijo, H., & Ono, T. (2004). Neuronal correlates of face identification in the monkey anterior temporal cortical areas. Journal of Neurophysiology, 91, 358–371.

    PubMed  Google Scholar 

  • Eifuku, S., Nakata, R., Sugimori, M., Ono, T., & Tamura, R. (2010). Neural correlates of associative face memory in the anterior inferior temporal cortex of monkeys. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 30(45), 15085–15096.

    CAS  Google Scholar 

  • Eliades, S. J., & Wang, X. (2005). Dynamics of auditory-vocal interaction in monkey auditory cortex. Cerebral Cortex (New York, NY: 1991), 15(10), 1510–1523.

    Google Scholar 

  • Fecteau, S., Armony, J. L., Joanette, Y., & Belin, P. (2005). Sensitivity to voice in human prefrontal cortex. Journal of Neurophysiology, 94, 2251–2254.

    PubMed  Google Scholar 

  • Fiez, J. A., Raife, E. A., Balota, D. A., Schwarz, J. P., Raichle, M. E., & Petersen, S. E. (1996). A positron emission tomography study of the short-term maintenance of verbal information. Journal of Neuroscience, 16, 808–822.

    PubMed  CAS  Google Scholar 

  • Freedman, D. J., & Miller, E. K. (2008). Neural mechanisms of visual categorization: Insights from neurophysiology. Neuroscience and Biobehavioral Reviews, 32(2), 311–329.

    PubMed  Google Scholar 

  • Friederici, A. D., Ruschemeyer, S. A., Hahne, A., & Fiebach, C. J. (2003). The role of left inferior frontal and superior temporal cortex in sentence comprehension: Localizing syntactic and semantic processes. Cerebral Cortex, 13, 170–177.

    PubMed  Google Scholar 

  • Funahashi, S., Bruce, C. J., & Goldman-Rakic, P. S. (1989). Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. Journal of Neurophysiology, 61, 1–19.

    Google Scholar 

  • Funahashi, S., Chafee, M. V., & Goldman-Rakic, P. S. (1993). Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature, 365(6448), 753–756.

    PubMed  CAS  Google Scholar 

  • Fuster, J. M. (2001). The prefrontal cortex—An update: Time is of the essence. Neuron, 30(2), 319–333.

    PubMed  CAS  Google Scholar 

  • Fuster, J. M., Bauer, R. H., & Jervey, J. P. (1982). Cellular discharge in the dorsolateral prefrontal cortex of the monkey in cognitive tasks. Experimental Neurology, 77, 679–694.

    PubMed  CAS  Google Scholar 

  • Gabrieli, J. D. E., Poldrack, R. A., & Desmond, J. E. (1998). The role of left prefrontal cortex in language and memory. Proceedings of the National Academy of Sciences of the United States of America, 95, 906–913.

    PubMed  CAS  Google Scholar 

  • Gifford, G. W., III, Maclean, K. A., Hauser, M. D., & Cohen, Y. E. (2005). The neurophysiology of functionally meaningful categories: Macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations. Journal of Cognitive Neuroscience, 17, 1471–1482.

    PubMed  Google Scholar 

  • Goldman, P. S., & Rosvold, H. E. (1970). Localization of function within the dorsolateral prefrontal cortex of the rhesus monkey. Experimental Neurology, 27, 291–304.

    PubMed  CAS  Google Scholar 

  • Goldman-Rakic, P. S. (1996a). The prefrontal landscape: Implications of functional architecture for understanding human mentation and the central executive. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 351, 1445–1453 [review] [72 refs].

    PubMed  CAS  Google Scholar 

  • Goldman-Rakic, P. S. (1996b). Regional and cellular fractionation of working memory. Proceedings of the National Academy of Sciences of the United States of America, 93(24), 13473–13480.

    PubMed  CAS  Google Scholar 

  • Gothard, K. M., Erickson, C. A., & Amaral, D. G. (2004). How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task? Animal Cognition, 7(1), 25–36.

    PubMed  Google Scholar 

  • Gross, C. G. (1963). A comparison of the effects of partial and total lateral frontal lesions on test performance by monkeys. Journal of Comparative Physiological Psychology, 56, 41–47.

    Google Scholar 

  • Gross, C. G. (1994). How inferior temporal cortex became a visual area. Cerebral Cortex, 5, 455–469.

    Google Scholar 

  • Gross, C. G., Bender, D. B., & Rocha-Miranda, C. E. (1969). Visual receptive fields of neurons in inferotemporal cortex of the monkey. Science, 166, 1303–1306.

    PubMed  CAS  Google Scholar 

  • Gross, C. G., & Weiskrantz, L. (1962). Evidence for dissociation of impairment on auditory discrimination and delayed response following lateral frontal lesions in monkeys. Experimental Neurology, 5, 453–476.

    PubMed  CAS  Google Scholar 

  • Guo, K., Robertson, R. G., Mahmoodi, S., Tadmor, Y., & Young, M. P. (2003). How do monkeys view faces? A study of eye movements. Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale, 150(3), 363–374.

    PubMed  Google Scholar 

  • Hackett, T. A., Stepniewska, I., & Kaas, J. H. (1998). Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys. Journal of Comparative Neurology, 394, 475–495.

    PubMed  CAS  Google Scholar 

  • Hackett, T. A., Stepniewska, I., & Kaas, J. H. (1999). Prefrontal connections of the parabelt auditory cortex in macaque monkeys. Brain Research, 817, 45–58.

    PubMed  CAS  Google Scholar 

  • Haith, M. M., Bergman, T., & Moore, M. J. (1977). Eye contact and face scanning in early infancy. Science (New York, NY), 198(4319), 853–855.

    CAS  Google Scholar 

  • Hasselmo, M. E., Rolls, E. T., & Baylis, G. C. (1989). The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural Brain Research, 32, 203–218.

    PubMed  CAS  Google Scholar 

  • Hauser, M. D. (1996). The evolution of communication. Cambridge, MA: MIT Press.

    Google Scholar 

  • Hauser, M. D., & Marler, P. (1993). Food associated calls in rhesus macaques (Macaca mulatta). I. Socioecological factors. Behavioral Ecology, 4, 194–205.

    Google Scholar 

  • Hein, G., Doehrmann, O., Muller, N. G., Kaiser, J., Muckli, L., & Naumer, M. J. (2007). Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 27(30), 7881–7887.

    CAS  Google Scholar 

  • Hinde, R. A., & Rowell, T. E. (1962). Communication by postures and facial expressions in the rhesus monkey (Macaca mulatta). Proceedings of the Zoological Society of London, 138, 1–21.

    Google Scholar 

  • Homae, F., Hashimoto, R., Nakajima, K., Miyashita, Y., & Sakai, K. L. (2002). From perception to sentence comprehension: The convergence of auditory and visual information of language in the left inferior frontal cortex. NeuroImage, 16(4), 883–900.

    PubMed  Google Scholar 

  • Iidaka, T., Omori, M., Murata, T., Kosaka, H., Yonekura, Y., Okada, T., et al. (2001). Neural interaction of the amygdala with the prefrontal and temporal cortices in the processing of facial expressions as revealed by fMRI. Journal of Cognitive Neuroscience, 13(8), 1035–1047.

    PubMed  CAS  Google Scholar 

  • Ishai, A., Pessoa, L., Bikle, P. C., & Ungerleider, L. G. (2004). Repetition suppression of faces is modulated by emotion. Proceedings of the National Academy of Sciences of the United States of America, 101(26), 9827–9832.

    PubMed  CAS  Google Scholar 

  • Ishai, A., Schmidt, C. F., & Boesiger, P. (2005). Face perception is mediated by a distributed cortical network. Brain Research Bulletin, 67(1–2), 87–93.

    PubMed  Google Scholar 

  • Ito, S. I. (1982). Prefrontal unit activity of macaque monkeys during auditory and visual reaction time tasks. Brain Research, 247, 39–47.

    PubMed  CAS  Google Scholar 

  • Ito, M., Tamura, H., Fujita, I., & Tanaka, K. (1995). Size and position invariance of neuronal responses in monkey inferotemporal cortex. Journal of Neurophysiology, 73(1), 218–226.

    PubMed  CAS  Google Scholar 

  • Jones, J. A., & Callan, D. E. (2003). Brain activity during audiovisual speech perception: An fMRI study of the McGurk effect. Neuroreport, 14(8), 1129–1133.

    PubMed  Google Scholar 

  • Kaas, J. H., & Hackett, T. A. (1998). Subdivisions of auditory cortex and levels of processing in primates. Audiology & Neurotology, 3, 73–85 [review] [66 refs].

    CAS  Google Scholar 

  • Kesler-West, M. L., Andersen, A. H., Smith, C. D., Avison, M. J., Davis, C. E., Kryscio, R. J., et al. (2001). Neural substrates of facial emotion processing using fMRI. Brain Research. Cognitive Brain Research, 11(2), 213–226.

    PubMed  CAS  Google Scholar 

  • Kim, J. N., & Shadlen, M. N. (1999). Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nature Neuroscience, 2(2), 176–185.

    PubMed  Google Scholar 

  • Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry, 59(9), 809–816.

    PubMed  Google Scholar 

  • Kojima, S., & Goldman-Rakic, P. S. (1984). Functional analysis of spatially discriminative neurons in prefrontal cortex of rhesus monkey. Brain Research, 291, 229–240.

    PubMed  CAS  Google Scholar 

  • LoPresti, M. L., Schon, K., Tricarico, M. D., Swisher, J. D., Celone, K. A., & Stern, C. E. (2008). Working memory for social cues recruits orbitofrontal cortex and amygdala: A functional magnetic resonance imaging study of delayed matching to sample for emotional expressions. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 28(14), 3718–3728.

    CAS  Google Scholar 

  • Maestripieri, D., & Wallen, K. (1997). Affiliative and submissive communication in rhesus macaques. Primates, 38(2), 127–138.

    Google Scholar 

  • Marinkovic, K., Trebon, P., Chauvel, P., & Halgren, E. (2000). Localised face processing by the human prefrontal cortex: Face-selective intracerebral potentials and post-lesion deficits. Cognitive Neuropsychology, 17(1), 187–199.

    PubMed  CAS  Google Scholar 

  • Marriott, B. M., & Salzen, E. A. (1978). Facial expressions in captive squirrel monkeys (Saimiri sciureus). Folia Primatologica; International Journal of Primatology, 29(1), 1–18.

    PubMed  CAS  Google Scholar 

  • McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.

    PubMed  CAS  Google Scholar 

  • Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167–202.

    PubMed  CAS  Google Scholar 

  • Miller, B. T., & D’Esposito, M. (2005). Searching for “the top” in top-down control. Neuron, 48(4), 535–538.

    PubMed  CAS  Google Scholar 

  • Miller, C., Diauro, A., Pistorio, A., Hendry, S. H., & Wang, X. (2010). Vocalization induced cFos expression in marmoset cortex. Frontiers in Integrative Neuroscience, 4, 128.

    PubMed  Google Scholar 

  • Miller, E. K., Erickson, C. A., & Desimone, R. (1996). Neural mechanisms of visual working memory in prefrontal cortex of the macaque. Journal of Neuroscience, 16, 5154–5167.

    PubMed  CAS  Google Scholar 

  • Miyashita, Y. (1993). Inferior temporal cortex: Where visual perception meets memory. Annual Review of Neuroscience, 16, 245–263.

    PubMed  CAS  Google Scholar 

  • Moeller, S., Freiwald, W. A., & Tsao, D. Y. (2008). Patches with links: A unified system for processing faces in the macaque temporal lobe. Science (New York, NY), 320(5881), 1355–1359.

    CAS  Google Scholar 

  • Mohler, C. W., Goldberg, M. E., & Wurtz, R. H. (1973). Visual receptive fields of frontal eye field neurons. Brain Research, 61, 385–389.

    PubMed  CAS  Google Scholar 

  • Morel, A., Garraghty, P. E., & Kaas, J. H. (1993). Tonotopic organization, architectonic fields, and connections of auditory cortex in macaque monkeys. Journal of Comparative Neurology, 335, 437–459.

    PubMed  CAS  Google Scholar 

  • Nahm, F. K., Perret, A., Amaral, D. G., & Albright, T. D. (1997). How do monkeys look at faces? Journal of Cognitive Neuroscience, 9(5), 611.

    Google Scholar 

  • Naumer, M. J., Doehrmann, O., Muller, N. G., Muckli, L., Kaiser, J., & Hein, G. (2009). Cortical plasticity of audio-visual object representations. Cerebral Cortex (New York, NY: 1991), 19(7), 1641–1653.

    Google Scholar 

  • Newman, J. D., & Lindsley, D. F. (1976). Single unit analysis of auditory processing in squirrel monkey frontal cortex. Experimental Brain Research, 25(2), 169–181.

    CAS  Google Scholar 

  • Niki, H., & Watanabe, M. (1976). Prefrontal unit activity and delayed response: Relation to cue location versus direction of response. Brain Research, 105(1), 79–88.

    PubMed  CAS  Google Scholar 

  • Nomura, M., Ohira, H., Haneda, K., Iidaka, T., Sadato, N., Okada, T., et al. (2004). Functional association of the amygdala and ventral prefrontal cortex during cognitive evaluation of facial expressions primed by masked angry faces: An event-related fMRI study. NeuroImage, 21(1), 352–363.

    PubMed  Google Scholar 

  • O’Scalaidhe, S. P., Wilson, F. A., & Goldman-Rakic, P. S. (1997). Areal segregation of face-processing neurons in prefrontal cortex. Science, 278, 1135–1138.

    Google Scholar 

  • O’Scalaidhe, S. P. O., Wilson, F. A. W., & Goldman-Rakic, P. G. R. (1999). Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: Evidence for intrinsic specialization of neuronal coding. Cerebral Cortex, 9, 459–475.

    Google Scholar 

  • Ojanen, V., Mottonen, R., Pekkola, J., Jaaskelainen, I. P., Joensuu, R., Autti, T., et al. (2005). Processing of audiovisual speech in broca’s area. NeuroImage, 25, 333–338.

    PubMed  Google Scholar 

  • Pandya, D. N., Hallett, M., & Kmukherjee, S. K. (1969). Intra- and interhemispheric connections of the neocortical auditory system in the rhesus monkey. Brain Research, 14, 49–65.

    PubMed  CAS  Google Scholar 

  • Pandya, D. N., & Kuypers, H. G. (1969). Cortico-cortical connections in the rhesus monkey. Brain Research, 13, 13–36.

    PubMed  CAS  Google Scholar 

  • Parr, L. A., Dove, T., & Hopkins, W. D. (1998). Why faces may be special: Evidence of the inversion effect in chimpanzees. Journal of Cognitive Neuroscience, 10(5), 615–622.

    PubMed  CAS  Google Scholar 

  • Parr, L. A., & Heintz, M. (2006). The perception of unfamiliar faces and houses by chimpanzees: Influence of rotation angle. Perception, 35(11), 1473–1483.

    PubMed  Google Scholar 

  • Parr, L. A., & Heintz, M. (2009). Facial expression recognition in rhesus monkeys, Macaca mulatta. Animal Behaviour, 77(6), 1507–1513.

    PubMed  Google Scholar 

  • Parr, L. A., Winslow, J. T., & Hopkins, W. D. (1999). Is the inversion effect in rhesus monkeys face specific? Animal Cognition, 2, 123–129.

    Google Scholar 

  • Parron, C., & Fagot, J. (2007). Baboons (Papio papio) spontaneously process the first-order but not second-order configural properties of faces. American Journal of Primatology, 70(5), 415–422.

    PubMed  Google Scholar 

  • Partan, S. (2002). Single and multichannel signal composition: Facial expressions and vocalizations of rhesus macaques (Macaca mulatta). Behaviour, 139(8), 993–1027.

    Google Scholar 

  • Perrett, D. I., Hietanen, J. K., Oram, M. W., & Benson, P. J. (1992). Organization and functions of cells responsive to faces in the temporal cortex. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 335(1273), 23–30.

    PubMed  CAS  Google Scholar 

  • Perrett, D. I., Mistlin, A. J., & Chitty, A. J. (1987). Visual neurones responsive to faces. Trends in Neurosciences, 10(9), 358–364.

    Google Scholar 

  • Perrett, D. I., Rolls, E. T., & Caan, W. (1982). Visual neurones responsive to faces in the monkey temporal cortex. Experimental Brain Research, 47, 329–342.

    CAS  Google Scholar 

  • Perrett, D. I., Smith, P. A., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D., et al. (1985). Visual cells in the temporal cortex sensitive to face view and gaze direction. Proceedings of the Royal Society of London. Series B, Containing Papers of a Biological Character Royal Society (Great Britain), 223(1232), 293–317.

    CAS  Google Scholar 

  • Petrides, M., & Pandya, D. N. (1988). Association fiber pathways to the frontal cortex from the superior temporal region in the rhesus monkey. Journal of Comparative Neurology, 273, 52–66.

    PubMed  CAS  Google Scholar 

  • Petrides, M., & Pandya, D. N. (2002). Comparative cytoarchitectonic analysis of the human and the macaque ventrolateral prefrontal cortex and corticocortical connection patterns in the monkey. The European Journal of Neuroscience, 16(2), 291–310.

    PubMed  CAS  Google Scholar 

  • Pigarev, I. N., Rizzolatti, G., & Schandolara, C. (1979). Neurons responding to visual stimuli in the frontal lobe of macaque monkeys. Neuroscience Letters, 12, 207–212.

    PubMed  CAS  Google Scholar 

  • Poldrack, R. A., Wagner, A. D., Prull, M. W., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. E. (1999). Functional specialization for semantic and phonological processing in the left inferior prefrontal cortex. NeuroImage, 10, 15–35.

    PubMed  CAS  Google Scholar 

  • Pourtois, G., Schwartz, S., Seghier, M. L., Lazeyras, F., & Vuilleumier, P. (2006). Neural systems for orienting attention to the location of threat signals: An event-related fMRI study. NeuroImage, 31(2), 920–933.

    PubMed  Google Scholar 

  • Quintana, J., & Fuster, J. M. (1992). Mnemonic and predictive functions of cortical neurons in a memory task. Neuroreport, 3(8), 721–724.

    PubMed  CAS  Google Scholar 

  • Quintana, J., Yajeya, J., & Fuster, J. M. (1988). Prefrontal representation of stimulus attributes during delay tasks. I. Unit activity in cross-temporal integration of sensory and sensory-motor information. Brain Research, 474, 211–221.

    PubMed  CAS  Google Scholar 

  • Rainer, G., Asaad, W. F., & Miller, E. K. (1998). Selective representation of relevant information by neurons in the primate prefrontal cortex. Nature, 393, 577–579.

    PubMed  CAS  Google Scholar 

  • Rao, S. C., Rainer, G., & Miller, E. K. (1997). Integration of what and where in the primate prefrontal cortex. Science (New York, NY), 276(5313), 821–824.

    CAS  Google Scholar 

  • Rauschecker, J. P., Tian, B., & Hauser, M. (1995). Processing of complex sounds in the macaque nonprimary auditory cortex. Science, 268(5207), 111–114.

    PubMed  CAS  Google Scholar 

  • Redican, W. K. (1975). Facial expressions in nonhuman primates. In L. Rosenblum (Ed.), Primate behavior (pp. 103–194). New York, NY: Acedemic.

    Google Scholar 

  • Rizzolatti, G., Scandolara, C., Matelli, M., & Gentilucci, M. (1981). Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses. Behavioural Brain Research, 2(2), 147–163.

    PubMed  CAS  Google Scholar 

  • Rolls, E. T. (1996). The orbitofrontal cortex. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 351(1346), 1433–1443 [discussion 1443–1444].

    PubMed  CAS  Google Scholar 

  • Rolls, E. T., Critchley, H. D., Browning, A. S., & Inoue, K. (2006). Face-selective and auditory neurons in the primate orbitofrontal cortex. Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale, 170(1), 74–87.

    PubMed  Google Scholar 

  • Rolls, E. T., & Tovee, M. J. (1995). Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. Journal of Neurophysiology, 73(2), 713–726.

    PubMed  CAS  Google Scholar 

  • Romanski, L. M. (2004). Domain specificity in the primate prefrontal cortex. Cognitive, Affective, & Behavioural Neuroscience, 4, 421–429.

    Google Scholar 

  • Romanski, L. M. (2007). Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex. Cerebral Cortex, 17, i61–i69.

    PubMed  Google Scholar 

  • Romanski, L. M., & Averbeck, B. B. (2009). The primate cortical auditory system and neural representation of conspecific vocalizations. Annual Review of Neuroscience, 32, 315–346.

    PubMed  CAS  Google Scholar 

  • Romanski, L. M., Averbeck, B. B., & Diltz, M. (2005). Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. Journal of Neurophysiology, 93(2), 734–747.

    PubMed  Google Scholar 

  • Romanski, L. M., Bates, J. F., & Goldman-Rakic, P. S. (1999). Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey. Journal of Comparative Neurology, 403, 141–157.

    PubMed  CAS  Google Scholar 

  • Romanski, L. M., & Diehl, M. M. (2011). Neurons responsive to face-view in the primate ventrolateral prefrontal cortex. Neuroscience, 189, 223–235.

    PubMed  CAS  Google Scholar 

  • Romanski, L. M., & Goldman-Rakic, P. S. (2002). An auditory domain in primate prefrontal cortex. Nature Neuroscience, 5, 15–16.

    PubMed  CAS  Google Scholar 

  • Romanski, L. M., Tian, B., Fritz, J., Mishkin, M., Goldman-Rakic, P. S., & Rauschecker, J. P. (1999). Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nature Neuroscience, 2(12), 1131–1136.

    PubMed  CAS  Google Scholar 

  • Rosenfeld, S. A., & Van Hoesen, G. W. (1979). Face recognition in the rhesus monkey. Neuropsychologia, 17(5), 503–509.

    PubMed  CAS  Google Scholar 

  • Russ, B. E., Ackelson, A. L., Baker, A. E., & Cohen, Y. E. (2008). Coding of auditory-stimulus identity in the auditory non-spatial processing stream. Journal of Neurophysiology, 99(1), 87–95.

    PubMed  Google Scholar 

  • Sergerie, K., Lepage, M., & Armony, J. L. (2005). A face to remember: Emotional expression modulates prefrontal activity during memory formation. NeuroImage, 24(2), 580–585.

    PubMed  Google Scholar 

  • Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.

    Google Scholar 

  • Stevens, A. A., Goldman-Rakic, P. S., Gore, J. C., Fulbright, R. K., & Wexler, B. E. (1998). Cortical dysfunction in schizophrenia during auditory word and tone working memory demonstrated by functional magnetic resonance imaging. Archives of General Psychiatry, 55(12), 1097–1103.

    PubMed  CAS  Google Scholar 

  • Stromswold, K., Caplan, D., Alpert, N., & Rauch, S. (1996). Location of syntactic comprehension by positron emission tomography. Brain Language. 52(3), 452–473.

    CAS  Google Scholar 

  • Sugase, Y., Yamane, S., Ueno, S., & Kawano, K. (1999). Global and fine information coded by single neurons in the temporal visual cortex. Nature, 400(6747), 869–873.

    PubMed  CAS  Google Scholar 

  • Sugihara, T., Diltz, M. D., Averbeck, B. B., & Romanski, L. M. (2006). Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 26, 11138–11147.

    CAS  Google Scholar 

  • Tanaka, K. (1996). Inferotemporal cortex and object vision. Annual Review of Neuroscience, 19, 109–139.

    PubMed  CAS  Google Scholar 

  • Tanaka, K., Saito, H., Fukada, Y., & Moriya, M. (1991). Coding visual images of objects in the inferotemporal cortex of the macaque monkey. Journal of Neurophysiology, 66(1), 170–189.

    PubMed  CAS  Google Scholar 

  • Tanila, H., Carlson, S., Linnankoski, I., & Kahila, H. (1993). Regional distribution of functions in dorsolateral prefrontal cortex of the monkey. Behavioural Brain Research, 53, 63–71.

    PubMed  CAS  Google Scholar 

  • Tanila, H., Carlson, S., Linnankoski, I., Lindroos, F., & Kahila, H. (1992). Functional properties of dorsolateral prefrontal cortical neurons in awake monkey. Behavioral Brain Research, 47, 169–180.

    CAS  Google Scholar 

  • Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983). The orbitofrontal cortex: Neuronal activity in the behaving monkey. Experimental Brain Research, 49, 93–115.

    CAS  Google Scholar 

  • Tian, B., Reser, D., Durham, A., Kustov, A., & Rauschecker, J. P. (2001). Functional specialization in rhesus monkey auditory cortex. Science, 292, 290–293.

    PubMed  CAS  Google Scholar 

  • Tomonaga, M. (1999). Inversion effect in perception of human faces in a chimpanzee (Pan troglodytes). Primates, 40(3), 417–438. doi:10.1007/BF02557579.

    Google Scholar 

  • Tomonaga, M. (2007). Visual search for orientation of faces by a chimpanzee (Pan troglodytes): Face-specific upright superiority and the role of facial configural properties. Primates, 48(1), 1–12. doi:10.1007/s10329-006-0011-4.

    PubMed  Google Scholar 

  • Tsao, D. Y., Schweers, N., Moeller, S., & Freiwald, W. A. (2008). Patches of face-selective cortex in the macaque frontal lobe. Nature Neuroscience, 11(8), 877–879.

    PubMed  CAS  Google Scholar 

  • Ungerleider, L. G., & Mishkin, M. (1982). Two cortical visual systems. In D. J. Ingle, M. A. Goodale, & R. J. W. Mansfield (Eds.), Analysis of visual behavior (pp. 549–586). Cambridge, MA: MIT Press.

    Google Scholar 

  • Vaadia, E., Benson, D. A., Hienz, R. D., & Goldstein, M. H., Jr. (1986). Unit study of monkey frontal cortex: Active localization of auditory and of visual stimuli. Journal of Neurophysiology, 56, 934–952.

    PubMed  CAS  Google Scholar 

  • van Hooff, J. A. (1962). Facial expressions in higher primates. Symposium of the Zoological Society of London, 8, 97–125.

    Google Scholar 

  • Vinette, C., Gosselin, F., & Schyns, P. G. (2004). Spatio-temporal dynamics of face recognition in a flash: It’s in the eyes. Cognitive Science, 28(2), 289–301.

    Google Scholar 

  • Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2001). Effects of attention and emotion on face processing in the human brain. An event-related fMRI study. Neuron, 30(3), 829–841.

    PubMed  CAS  Google Scholar 

  • Watanabe, M. (1986). Prefrontal unit activity during delayed conditional Go/No-go discrimination in the monkey. I. Relation to the stimulus. Brain Research, 382(1), 1–14.

    PubMed  CAS  Google Scholar 

  • Watanabe, M. (1992). Frontal units of the monkey coding the associative significance of visual and auditory stimuli. Experimental Brain Research, 89, 233–247.

    CAS  Google Scholar 

  • Webster, M. J., Bachevalier, J., & Ungerleider, L. G. (1994). Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cerebral Cortex, 4, 470–483.

    PubMed  CAS  Google Scholar 

  • Weigel, R. M. (1979). The facial expressions of the brown capuchin monkey (Cebus apella). Behaviour, 68(3/4), 250–276.

    Google Scholar 

  • Weiskrantz, L., & Mishkin, M. (1958). Effects of temporal and frontal cortical lesions on auditory discrimination in monkeys. Brain; A Journal of Neurology, 80, 406–414.

    Google Scholar 

  • Werner, S., & Noppeney, U. (2010). Distinct functional contributions of primary sensory and association areas to audiovisual integration in object categorization. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 30(7), 2662–2675.

    CAS  Google Scholar 

  • Wilson, F. A., O’Scalaidhe, S. P., & Goldman-Rakic, P. S. (1993). Dissociation of object and spatial processing domains in primate prefrontal cortex. Science, 260, 1955–1958.

    PubMed  CAS  Google Scholar 

  • Xu, J., Gannon, P. J., Emmorey, K., Smith, J. F., & Braun, A. R. (2009). Symbolic gestures and spoken language are processed by a common neural system. Proceedings of the National Academy of Sciences of the United States of America, 106(49), 20664–20669.

    PubMed  CAS  Google Scholar 

  • Xu, G. Q., Lan, Y., Huang, D. F., Rao, D. Z., Pei, Z., Chen, L., et al. (2010). Visuospatial attention deficit in patients with local brain lesions. Brain Research, 1322, 153–159.

    PubMed  CAS  Google Scholar 

  • Yamane, S., Kaji, S., & Kawano, K. (1988). What facial features activate face neurons in the inferotemporal cortex of the monkey? Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale, 73(1), 209–214.

    PubMed  CAS  Google Scholar 

  • Zatorre, R. J., Meyer, E., Gjedde, A., & Evans, A. C. (1996). PET studies of phonetic processing of speech: Review, replication, and reanalysis. Cerebral Cortex, 6(1), 21–30.

    PubMed  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lizabeth M. Romanski Ph.D. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Diehl, M.M., Romanski, L.M. (2013). Representation and Integration of Faces and Vocalizations in the Primate Ventral Prefrontal Cortex. In: Belin, P., Campanella, S., Ethofer, T. (eds) Integrating Face and Voice in Person Perception. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3585-3_3

Download citation

Publish with us

Policies and ethics