Skip to main content
SpringerLink
Log in

Audiovisual Communication

  • Chapter
  • First Online:
Quality of Experience

Part of the book series: T-Labs Series in Telecommunication Services ((TLABS))

Abstract

Audiovisual communication has expanded rapidly over the last years on computers and mobile devices. This chapter discusses the key aspects of Quality of Experience of the audiovisual communication. We will give an introduction to audiovisual communication and explain technical elements and perceptual features which relate to the Quality of Experience. Main subjective and instrumental quality assessment methods will be presented. Finally, we specifically discuss a few key aspects impacting quality, namely, time-varying quality perception, audiovisual quality integration as well as the impact of overall delay and audiovisual synchrony, and give an outlook for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.corp.att.com/attlabs/reputation/timeline/70picture.html

  2. 2.

    http://www.telegeography.com/press/press-releases/2013/02/13/the-bell-tolls-for-telcos/index.html

  3. 3.

    http://tools.ietf.org/html/rfc5389,http://tools.ietf.org/html/rfc5766, and http://tools.ietf.org/html/rfc5245.

  4. 4.

    The channel usage refers to the extent to which subjects utilize a channel to transmit information relevant to carry out scenario-related tasks.

  5. 5.

    The 11-point ACR scale has end-points which are verbally defined as anchoring points.

  6. 6.

    http://www.itu.int/en/ITU-T/publications/Pages/recs.aspx

  7. 7.

    http://standards.ieee.org/findstds/standard/269-2010.html

  8. 8.

    http://www.its.bldrdoc.gov/vqeg/vqeg-home.aspx

  9. 9.

    This means that a loudspeaker of a device reproduces the sound from the other participant without a necessity to keep the device at the ear.

References

  1. Aldridge R, Davidoff J, Ghanbari M, Hands D, Pearson D (1995) Recency effect in the subjective assessment of digitally-coded television pictures. In: Image processing and its applications, pp 336–339

    Google Scholar 

  2. Ariely D (1998) Combining experiences over time: the effects of duration, intensity changes and on-line measurements on retrospective pain evaluations. J Behav Decis Making 11:19–45

    Article  Google Scholar 

  3. Beerends FE (1999) The influence of video quality on perceived audio quality and vice versa. J Audio Eng Soc 47(5):355–362

    Google Scholar 

  4. Belmudez B, Lewcio B, Möller S (2013) Call quality prediction for audiovisual time-varying impairments using simulated conversational structures. In: To appear in Acta Acustica united with Acustica

    Google Scholar 

  5. Clark AD (2001) Modeling the effects of burst packet loss and recency on subjective voice quality. In: Internet telephony workshop, pp 123–127

    Google Scholar 

  6. Fredrickson BL, Kahneman D (1993) Duration neglect in retrospective evaluations of affective episodes. J Pers Soc Psychol 65:45–55

    Article  Google Scholar 

  7. Fredrickson BL (2000) Extracting meaning from past affective experiences: the importance of peaks, ends, and specific emotions. Cogn Emot 14(4):577–606

    Article  Google Scholar 

  8. Gros L, Chateau N (2001) Instantaneous and overall judgements for time-varying speech quality: assessments and relationships. Acta Acustica Unit Acustica 87(3):367–377

    Google Scholar 

  9. Hamberg R, De Ridder H (1999) Time-varying image quality: modeling the relation between instantaneous and overall quality. SMTPE J 108:802–811

    Google Scholar 

  10. Hands DS, Avons SE (2001) Recency and duration neglect in subjective assessment of television picture quality. Appl Cogn Psychol 15(6):639–657

    Article  Google Scholar 

  11. Hollier MP, Voelcker R (1997) Objective performance assessment: video quality as an influence on audio perception. In: Audio engineering society convention 103

    Google Scholar 

  12. ITU-R Recommendation BT.1359-1 (1998) Relative timing of sound and vision for broadcasting. International Telecommunication Union, Geneva

    Google Scholar 

  13. ITU-R Recommendation J.100 (1990) Tolerances for transmission time differences between the vision and sound components of a television signal. International Telecommunication Union, Geneva

    Google Scholar 

  14. ITU-T Contribution COM 12–61-E (1998) Study of the influence of experimental context on the relationship between audio, video and audiovisual subjective qualities. International Telecommunication Union, Geneva

    Google Scholar 

  15. ITU-T Contribution COM 12–D64-E (1998) Testing the quality of connections having time varying impairments. International Telecommunication Union, Geneva

    Google Scholar 

  16. ITU-T Recommendation G.107.1 (2011) Wideband E-model. International Telecommunication Union, Geneva

    Google Scholar 

  17. ITU-T Recommendation G.107 (2005) The E-model, a computational model for use in transmission planning. International Telecommunication Union, Geneva

    Google Scholar 

  18. ITU-T Recommendation G.1070 (2007) Opinion model for video-telephony applications. International Telecommunication Union, Geneva

    Google Scholar 

  19. ITU-T Recommendation G.114 (2003) One-way transmission delay. International Telecommunication Union, Geneva

    Google Scholar 

  20. ITU-T Recommendation P.1201 (2012) Parametric non-intrusive assessment of audiovisual media streaming quality. International Telecommunication Union, Geneva

    Google Scholar 

  21. ITU-T Recommendation J.247 (2008) Objective perceptual multimedia video quality measurement in the presence of a full reference. International Telecommunication Union, Geneva

    Google Scholar 

  22. ITU-T Recommendation J.341 (2011) Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference. International Telecommunication Union, Geneva

    Google Scholar 

  23. ITU-T Recommendation P.800 (1996) Methods for subjective determination of transmission quality. International Telecommunication Union, Geneva

    Google Scholar 

  24. ITU-T Recommendation P.805 (2007) Subjective evaluation of conversational quality. International Telecommunication Union, Geneva

    Google Scholar 

  25. ITU-T Recommendation P.863 (2011) Perceptual objective listening quality assessment. International Telecommunication Union, Geneva

    Google Scholar 

  26. ITU-T Recommendation P.910 (2008) Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, Geneva

    Google Scholar 

  27. ITU-T Recommendation P.911 (1998) Subjective audiovisual quality assessment methods for multimedia applications. International Telecommunication Union, Geneva

    Google Scholar 

  28. ITU-T Recommendation P.920 (2000) Interactive test methods for audiovisual communications. International Telecommunication Union, Geneva

    Google Scholar 

  29. Joly A, Montard N, Buttin M (2001) Audio-visual quality and interactions between television audio and video. In: 6th International symposium on signal processing and its applications 2001, vol 2

    Google Scholar 

  30. Jumisko-Pyykkö S (2008) I would like to see the subtitles and the face or at least hear the voice: effects of picture ratio and audio-video bitrate ratio on perception of quality in mobile television. Multimedia Tools Appl 36:167–184

    Article  Google Scholar 

  31. Kirk D, Sellen A, Cao X (2010) Home video communication: mediating ‘closeness’. In: Proceedings of CSCW 2010, ACM. pp 135–144

    Google Scholar 

  32. Kitawaki N, Itok K (1991) Pure delay effects on speech quality in telecommunications. IEEE J Sel Areas Commun 9(9):586–593

    Article  Google Scholar 

  33. Korhonen J, Reitel U, Myakotnukh E (2010) On the relative importance of audio and video in the presence of packet losses. In: 2nd International workshop on quality of multimedia experience (QoMEX)

    Google Scholar 

  34. Nature journal: public television in Germany, Nature, 127:391–391, 7th March 1936. http://www.nature.com/nature/journal/v137/n3462/abs/137391a0.html

  35. Pinson MH, Ingram W, Webster A (2011) Audiovisual quality components. IEEE Sig Process Mag 28(6):60–67

    Article  Google Scholar 

  36. Raake A, Schoenenberg K, Skowronek J, Egger S (2013) Predicting speech quality based on interactivity and delay. In: Proceedings of Interspeech, 25–29 August, Lyon, France

    Google Scholar 

  37. Rimell AN, Hollier MP, Voelcker RM (1998) The influence of cross-modal interaction on audio-visual speech quality perception. In: Audio engineering society convention 105

    Google Scholar 

  38. Schreiber CA, Kahneman D (2000) Determinants of the remembered utility of aversive sounds. J Exp Psychol Gen

    Google Scholar 

  39. Steinmetz R (1996) Human perception of jitter and media synchronization. IEEE J Sel Areas Commun 14(1):61–72

    Article  Google Scholar 

  40. Weiss B, Möller S, Raake A, Berger J, Ullmann R (2009) Modeling call quality for time-varying transmission characteristics using simulated conversational structures. Acta Acustica Unit Acustica 95(6):1140–1151

    Article  Google Scholar 

  41. Wickens CD (1992) Engineering psychology and human performance. HarperCollins

    Google Scholar 

  42. Winkler S, Faller C (2006) Perceived audiovisual quality of low-bitrate multimedia content. IEEE Trans Multimedia 8(5):973–980

    Article  Google Scholar 

  43. Yamagishi K, Hayashi T (2005) Analysis of psychological factors for quality assessment of interactive multimodal service. Hum Vision Electron Imaging X (SPIE) 5666(1):130–138

    Article  Google Scholar 

  44. You J, Reiter U, Hannuksela M, Gabbouj M, Perkis A (2010) Perceptual-based quality assessment for audio-visual services: a survey. Image Commun 25:482–501

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Skype Labs/Microsoft, Tallinn, Estonia

    Markus Vaalgamaa

  2. Quality and Usability Lab, Telekom Innovation Labs, TU Berlin, Berlin, Germany

    Benjamin Belmudez

Authors
  1. Markus Vaalgamaa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin Belmudez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Markus Vaalgamaa .

Editor information

Editors and Affiliations

  1. Quality and Usability Lab Telekom Innovation Laboratories, TU Berlin, Berlin, Germany

    Sebastian Möller

  2. Assessment of IP-based Applications Telekom Innovation Laboratories, TU Berlin, Berlin, Germany

    Alexander Raake

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Vaalgamaa, M., Belmudez, B. (2014). Audiovisual Communication. In: Möller, S., Raake, A. (eds) Quality of Experience. T-Labs Series in Telecommunication Services. Springer, Cham. https://doi.org/10.1007/978-3-319-02681-7_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02681-7_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02680-0

  • Online ISBN: 978-3-319-02681-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation