Abstract
The paper presents a method of reliability estimation of scores obtained in subjective quality evaluation, which was inspired by procedures used in between-laboratory tests for determination of repeatability and reproducibility of measurement methods. The proposed use of Madel’s k and h statistics enables for significant decrease of MOS standard deviation, which is exemplified by SSCQE of compressed video results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lauterjung, J.: First results of digital video quality measurements in DVB networks, Rohde & Schwarz (January 2006)
Morris, T., Angus, K., Butt, R., Chilton, A., Dettman, P.: CQA – Subjective Video Codec Quality Analyser. BMVC 1999 Image Matching and Retrieval (1999)
ITU-T P 910 Subjective video quality assessment methods for multimedia applications (2008)
ITU-T P 911, Subjective audiovisual quality assessment methods for multimedia applications (1998)
ITU-R BT 500-12 Methodology for the subjective assessment of the Quality of Television Picture (2009)
Grega, M., Janowski, L., Leszczuk, M., Romaniak, P., Papir, Z.: Quality of experience evaluation for multimedia services. Przegląd Telekomunikacyjny i Wiadomości Telekomunikacyjne (April 2008)
Uebersax, J.: Statistical methods for rater agreement, http://ourworld.compuserve.com/homepages/jsuebersax/agree.htm
Jones, B.L., McManus, P.R.: Graphicscaling of qualitative terms. SMPTE Journal (November 1986)
Narita, N.: Graphic scaling and validity of Japanese descriptive terms used in subjective evaluation tests. SMPTE Journal (July 1993)
Virtanen, M.T., Gleiss, N., Goldstein, M.: On the use of evaluative category scales in telecommunications. In: Proc. Human Factors in Telecommunications (1995)
ISO 5725:1994, Accuracy (trueness and precision) of measurement me-thods and results
ISO/IEC Guide 43-1:1997 Proficiency testing by interlaboratory compari-sons – Part 1: Development and operation of proficiency testing schemes
ISO/IEC Guide 43-2:1997 Proficiency testing by interlaboratory compar-ison – Part 2: Selection and use of proficiency testing schemes by laboratory ac-creditation bodies
ISO/IEC 17025:2005 General requirements for the competence of testing and calibration laboratories
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Ostaszewska, A., Żebrowska-Łucyk, S. (2010). The Method of Increasing the Accuracy of Mean Opinion Score Estimation in Subjective Quality Evaluation. In: Lay-Ekuakille, A., Mukhopadhyay, S.C. (eds) Wearable and Autonomous Biomedical Devices and Systems for Smart Environment. Lecture Notes in Electrical Engineering, vol 75. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15687-8_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-15687-8_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15686-1
Online ISBN: 978-3-642-15687-8
eBook Packages: EngineeringEngineering (R0)