Skip to main content

From Accessibility to Assess-Ability: An Evaluation Heuristic Based on Cognitive Engagement in Search

  • Conference paper
  • First Online:
Transforming Digital Worlds (iConference 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10766))

Included in the following conference series:

  • 5732 Accesses

Abstract

This investigation into information searching behaviour focuses on the users’ critical assessment of information when found in response to an information need, and on the cognitive aspects of search involving in the user in the assimilation of the information found. The meta analysis of a questionnaire based survey seeks to identify the constructs of the users’ assessment of information. Factor analysis of the participants’ responses identifies the assessment of the ‘cognitive relevance’ as vital in distinguishing the searcher who appears to be intent on finding information as opposed to one engaged in the relatively simple task of looking up information. The value in the development of the questionnaire designed to identify the users’ cognitive engagement in search is considered for testing the interface designed to optimize the user’s involvement in search. Turning to the question of the design of the interface itself, the heuristic of assess-ability (of the information retrieved) is proposed for use in the expert review of the search interface, and to support the user in their critical assessment and verification of the information relevancy, quality and credibility.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wilson, M.L., Kules, B., Schraefel, M.C., Shneiderman, B.: From keyword search to exploration. In: Wilson, M.L., et al. (eds.) Foundations and Trends in Web Science, pp. 1–97 (2010)

    Google Scholar 

  2. Blandford, A., Attfield, S.: Interaction with Information. Morgan & Claypool, San Rafael (2010)

    Google Scholar 

  3. Belkin, N.J., Cool, C., Stein, A., Theil, U.: Cases, scripts and information seeking strategies: on the design of interactive information retrieval systems. Expert Syst. Appl. 9, 379–395 (1995)

    Article  Google Scholar 

  4. Pirolli, P., Card, S.K.: Information foraging in information access environments. In: Proceedings of Conference on Human Factors in Computing Systems, pp. 51–58. ACM, New York (1995)

    Google Scholar 

  5. Toms, E.: Information interaction providing a framework for information architecture. J. Am. Soc. Inf. Sci. 53(10), 855–862 (2002)

    Article  Google Scholar 

  6. Johnson, F.C.: Shifting contexts: relating the user, search and system in teaching IR. In: Efthimiadis, E.N., Fernández-Luna, J., Huete, J., MacFarlane, A. (eds.) Teaching and Learning in Information Retrieval. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22511-6_6

    Google Scholar 

  7. Hearst, M.A.: Search User Interfaces. Cambridge University Press, Cambridge (2009)

    Book  Google Scholar 

  8. Wilson, M.L., Schraefel, M.C., White, R.W.: Evaluating advanced search interfaces using established information-seeking models. JASIST 60(7), 1407–1422 (2009)

    Article  Google Scholar 

  9. Nielsen, J.: Usability 101: introduction to usability (2017). https://www.nngroup.com/articles/usability-101-introduction-to-usability/. Accessed 17 Sept 2017

  10. Moshagen, M., Thielsch, M.T.: Facets of visual aesthetics. Int. J. Hum. Comput. Stud. 68(10), 689–709 (2010)

    Article  Google Scholar 

  11. Arapakis, I., Jose, J.M., Gray, P.D.: Affective feedback: an investigation into the role of emotions in the information seeking process. ACM SIGIR, pp. 395–402 (2008)

    Google Scholar 

  12. Saracevic, T.: Relevance reconsidered. In: Proceedings of Conceptions of Library and Information Science (CoLIS 2), pp. 201–218. ACM Press, New York (1996)

    Google Scholar 

  13. Johnson, F., Rowley, J., Sbaffi, L.: Information interactions in the context of Google. J. Assoc. Inf. Sci. Technol. 67(4), 824–840 (2016)

    Article  Google Scholar 

  14. Hair, J.F., Tatham, R.L., Anderson, R.E., Black, W.: Multivariate Data Analysis, 5th edn. Prentice Hall, Uppper Saddle River (1998)

    Google Scholar 

  15. Kakol, M., Nielek, R., Wierzbicki, A.: Understanding web content credibility using the Content Credibility Corpus. Inf. Process. Manag. 53, 1043–1061 (2017)

    Article  Google Scholar 

  16. Wiki-Watch: evaluate the quality of Wikipedia’s articles. http://blog.wiki-watch.de/?p=497

  17. Lucassen, T., Schraagen, J.M.: The influence of source cues and topic familiarity on credibility evaluation. Comput. Hum. Behav. 29(4), 1387–1392 (2013)

    Article  Google Scholar 

  18. Brand-Gruwel, S., Kammerer, Y., van Meeuwen, L.: Source evaluation of domain experts and novices during web search. J. Comput. Assist. Learn. 33(3), 234–251 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Frances Johnson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Johnson, F. (2018). From Accessibility to Assess-Ability: An Evaluation Heuristic Based on Cognitive Engagement in Search. In: Chowdhury, G., McLeod, J., Gillet, V., Willett, P. (eds) Transforming Digital Worlds. iConference 2018. Lecture Notes in Computer Science(), vol 10766. Springer, Cham. https://doi.org/10.1007/978-3-319-78105-1_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-78105-1_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-78104-4

  • Online ISBN: 978-3-319-78105-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics