Skip to main content

Automated Annotation of Valence and Arousal During Cognitive Activity

  • Conference paper
  • First Online:
Bioengineering and Biomedical Signal and Image Processing (BIOMESIP 2021)

Abstract

We present an automated annotation method, which infers emotional arousal and valence tags based on physiological signals. This is performed with the help of binary detectors trained to recognize high/low arousal or passive/negative valence. The arousal and valence detectors were created from representative datasets containing evoked emotional reactions to widely used audio-visual stimuli. Next, these detectors were used to annotate physiological signals collected during different types of cognitive activity in the context of acute stress scenarios. We show that the automatically generated tags are correlated with work efficiency during various cognitive activities. The availability of such an automated annotation method would facilitate future studies on the influence of individual differences concerning work performance and the ability to cope with acute stress and cognitive overload. Such functionality could be essential for creating adaptive human-machine interfaces that account for the person’s current emotions, cognitive load, and acute stress level.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Conway, D., Dick, I., Li, Z., Wang, Y., Chen, F.: The effect of stress on cognitive load measurement. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8120, pp. 659–666. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40498-6_58

    Chapter  Google Scholar 

  2. Wu, D., et al.: Optimal arousal identification and classification for affective computing using physiological signals: virtual reality Stroop task. IEEE Trans. Affect. Comput. 1(2), 109–118 (2010)

    Article  Google Scholar 

  3. Petrucci, M., Pecchinenda, A.: The role of cognitive control mechanisms in selective attention towards emotional stimuli. Cogn. Emot. 31(7), 1480–1492 (2017)

    Article  Google Scholar 

  4. Yerkes, R.M., Dodson, J.D.: The relation of strength of stimulus to rapidity of habit-formation. J. Comp. Neurol. Psychol. 18(5), 459–482 (1908)

    Article  Google Scholar 

  5. Russell, J.A.: A circumplex model of affect. J Pers Soc Psychol. 39, 1161–1178 (1980)

    Article  Google Scholar 

  6. Mukundan, C.R., Kacker, P.: Emotional Arousal - The Driving Force of Life. J. Psychol. Clin. Psychiatry 9, 00505 (2018)

    Google Scholar 

  7. Megalakaki, O., Ballenghein, U., Baccino, T.: Effects of valence and emotional intensity on the comprehension and memorization of texts. Front. Psychol. 10, 179–186 (2019)

    Article  Google Scholar 

  8. Ben-Haim, M.S., Williams, P., Howard, Z., Mama, Y., Eidels, A., Algom, D.: The emotional Stroop task: assessing cognitive performance under exposure to emotional content. J. Vis. Exp. JoVE 112, 53720 (2016)

    Google Scholar 

  9. Markova, V., Ganchev, T. Kalinkov, K.: CLAS: a database for cognitive load, affect and stress recognition. In: 2019 International Conference on Biomedical Innovations and Applications (BIA), Varna, Bulgaria, pp. 1–4 (2019)

    Google Scholar 

  10. Kalinkov, K., Markova, V., Ganchev, T.: Front-end processing of physiological signals for the automated detection of high-arousal negative valence conditions. In: 2019 X National Conference with International Participation (ELECTRONICA), Sofia, Bulgaria, pp. 1–4 (2019)

    Google Scholar 

  11. Koelstra, S., et al.: DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)

    Article  Google Scholar 

  12. Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): affective ratings of pictures and instruction manual. Technical Report A-8. University of Florida, Gainesville, FL. (2008)

    Google Scholar 

  13. Kalinkov, K., Ganchev, T., Markova, V.: Adaptive feature selection through fisher discriminant ratio. In: 2019 International Conference on Biomedical Innovations and Applications (BIA), Varna, Bulgaria, pp. 1–4 (2019)

    Google Scholar 

Download references

Acknowledgements

This research was supported by the Bulgarian National Science Fund (BNSF), with grant agreement FNI № KP-06-PN37/18, entitled “Investigation on intelligent human-machine interaction interfaces, capable of recognising high-risk emotional and cognitive conditions”.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Valentina Markova .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Markova, V., Ganchev, T., Markov, M. (2021). Automated Annotation of Valence and Arousal During Cognitive Activity. In: Rojas, I., Castillo-Secilla, D., Herrera, L.J., Pomares, H. (eds) Bioengineering and Biomedical Signal and Image Processing. BIOMESIP 2021. Lecture Notes in Computer Science(), vol 12940. Springer, Cham. https://doi.org/10.1007/978-3-030-88163-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-88163-4_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-88162-7

  • Online ISBN: 978-3-030-88163-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics