Skip to main content

Rating Scale Validation: An MDA Approach

  • Chapter
  • First Online:
Nonverbal Delivery in Speaking Assessment
  • 392 Accesses

Abstract

The previous chapter details a rating scale validation study in a quantitative approach. Instead of taking a bird’s-eye view from a statistical perspective, this chapter continues to validate the revised rating scale in a microscopic manner. In real practice, multimodal discourse analysis was deployed to further validate the rating scale from the perspective of associating and aligning the randomly selected candidates’ performance in nonverbal delivery with the subscores they were assigned by teacher and peer raters and the corresponding descriptors of the rating scale. It is anticipated that this qualitative validation study will further serve as a triangulation of examining the construct validity of the rating scale, particularly with a view to validating the “unconventional” dimension of Nonverbal Delivery.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The directionality of eye contact here is slightly distinguished from the AB phase, where the recipient of eye contact, such as the camera, was described. In this phase, forward eye contact means having an occurrence of eye contact with an unspecified object physically located in front of the speaker. In reverse, backward eye contact refers to the occurrence that a speaker looks at certain positions at his/her back.

  2. 2.

    Upward eye contact and downward eye contact are described as looking at the objects whose location is, respectively, above (see Frame 8.4A as an illustration) and above (see Frame 8.4B as an illustration) the horizontal vision of the speaker. They are usually synchronised with moving the speaker’s head to a higher or lower position, which might facilitate the researcher’s judgment.

  3. 3.

    As accorded with Martinec’s (2000) taxonomy, presenting functions mainly refers to those that do not generate representational or communicative meanings, such as those actions representative of the candidate’s nervousness in assessment contexts (see Section “Martinec’s Taxonomy on Actions” for more explanations).

  4. 4.

    Similar to the directionalities of eye contact described in Sect. 8.3.1.1, gestures were observed with regard to the directions of hand movement. For instance, if an occurrence of moving the hand upwards from a lower position, its directionality is judged as upward.

  5. 5.

    Hands level is judged when the location of hand(s) is considered in relation to the speaker’s head, chest, legs and waist.

References

  • Hood, S.E. 2007. Gesture and meaning making in face-to-face teaching. Paper Presented at the Semiotic Margins Conference, University of Sydney.

    Google Scholar 

  • Hood, S.E. 2011. Body language in face-to-face teaching: A focus on textual and interpersonal meaning. In Semiotic margins: Meanings in multimodalities, ed. Dreyfus, S, S. Hood and S. Stenglin, 31–52. London and New York: Continuum.

    Google Scholar 

  • Lim, F.V. 2011. A systemic functional multimodal discourse analysis approach to pedagogic discourse. Unpublished PhD thesis. Singapore: National University of Singapore.

    Google Scholar 

  • Martinec, R. 2000. Types of processes in action. Semiotica 130(3): 243–268.

    Google Scholar 

  • Martinec, R. 2001. Interpersonal resources in action. Semiotica 135(1): 117–145.

    Google Scholar 

  • Martinec, R. 2004. Gestures that co-occur with speech as a systematic resource: The realisation of experiential meanings in indexes. Social Semiotics 14(2): 193–213.

    Article  Google Scholar 

  • White, S. 1989. Backchannels across cultures: A study of Americans and Japanese. Language in Society 18: 59–76.

    Article  Google Scholar 

  • Young, R.F., and J. Lee. 2004. Identifying units in interaction: Reactive tokens in Korean and English conversations. Journal of Sociolinguistics 8(3): 380–407.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mingwei Pan .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Pan, M. (2016). Rating Scale Validation: An MDA Approach. In: Nonverbal Delivery in Speaking Assessment. Springer, Singapore. https://doi.org/10.1007/978-981-10-0170-3_8

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-0170-3_8

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-0169-7

  • Online ISBN: 978-981-10-0170-3

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics