Skip to main content
SpringerLink
Log in

Common Visualizations: Their Cognitive Utility

  • Chapter
  • First Online:
Handbook of Human Centric Visualization

Abstract

Visualizations have numerous benefits for problem solving, sense making, decision making, learning, analytical reasoning, and other high-level cognitive activities. Research in cognitive science has demonstrated that visualizations fundamentally influence cognitive processing and the overall performance of such aforementioned activities. However, although researchers often suggest that visualizations support, enhance, and/or amplify cognition, little research has examined the cognitive utility of different visualizations in a systematic and comprehensive manner. Rather, visualization research is often focused only on low-level cognitive and perceptual issues. To design visualizations that effectively support high-level cognitive activities, a strong understanding of the cognitive effects of different visual forms is required. To examine this issue, this chapter draws on research from a number of relevant domains, including information and data visualization, visual analytics, cognitive and perceptual psychology, and diagrammatic reasoning. This chapter identifies and clarifies some important terms and discusses the current state of research and practice. In addition, a number of common visualizations are identified, their cognitive and perceptual influences are examined, and some implications for the performance of high-level cognitive activities are discussed. Readers from various fields in which a human-centered approach to visualization is necessary, such as health informatics, data and information visualization, visual analytics, journalism, education, and human-information interaction, will likely find this chapter a useful reference for research, design, and/or evaluation purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ainsworth, S.: The functions of multiple representations. Computers and Education 33(2/3), 131–152 (1999)

    Article  Google Scholar 

  2. Anselin, L., Syabri, I., Kho, Y.: GeoDa: An introduction to spatial data analysis. Geographic Analysis 38(1), 5–22 (2006)

    Article  Google Scholar 

  3. Arcavi, A.: The role of visual representations in the learning of mathematics. Educational Studies in Mathematics 52(3), 215–241 (2003)

    Article  Google Scholar 

  4. Arias-Hernandez, R., Green, T.M., Fisher, B.: From cognitive amplifiers to cognitive prostheses: Understandings of the material basis of cognition in visual analytics. Interdisciplinary science reviews 37(1), 4–18 (2012)

    Article  Google Scholar 

  5. Berendt, B., Barkowsky, T., Freksa, C., Kelter, S.: Spatial representation with aspect maps. In: C. Freksa, C. Habel, K.F. Wender (eds.) Spatial Cognition—An Interdisciplinary Approach to Representing and Processing Spatial Knowledge. Berlin: Springer.

    Google Scholar 

  6. Bertin, J.: Sémiologie Graphique. Les diagrammes, les réseaux, les cartes. With Marc Barbut [et al.]. Paris: Gauthier-Villars. (Translation 1983. Semiology of Graphics by William J. Berg.) (1967)

    Google Scholar 

  7. Blackwell, A.: Visual Representation. In M. Soegaard & R.F Dam (eds.) Encyclopedia of Human-Computer Interaction. Aarhus, Denmark: The Interaction Design Foundation. Available online at http://www.interaction-design.org/encyclopedia/visual_representation.html (2011)

  8. Card, S.K., Mackinlay, J., Shneiderman, B.: Readings in Information Visualization: Using Vision to Think. San Francisco, CA: Morgan Kauffman (1999)

    Google Scholar 

  9. Chernoff, H.: The Use of faces to represent points in k-dimensional space graphically. Journal of the American Statistical Association 68, 361–368 (1973)

    Article  Google Scholar 

  10. Cleveland, W.S., McGill, R.: Graphical perception: Theory, experimentation, and application to the development of graphical methods. Journal of the American Statistical Association 79(387), 531–554 (1984)

    Article  MathSciNet  Google Scholar 

  11. Cole, M., Derry, J.: We have met technology and it is us. In: R.J. Sternberg, D.D Preiss (eds.) Intelligence and Technology: The impact of tools on the nature and development of human abilities, 210–227. Mahwah, NJ: Lawrence Erlbaum (2005)

    Google Scholar 

  12. Collins, C., Carpendale, S., Penn, G.: DocuBurst: Visualizing document content using language structure. In: Proceedings of Eurographics/IEEE-VGTC Symposium on Visualization (EuroVis ‘09) 28(3), 1039–1046 (2009)

    Google Scholar 

  13. Cox, R.: Analytical reasoning with multiple external representations. Doctoral Dissertation, University of Edinburgh (1996)

    Google Scholar 

  14. Cox, R., Brna, P.: Supporting the use of external representations in problem solving: The need for flexible learning environments. Journal of Artificial Intelligence in Education 6(2/3), 239–302 (1995)

    Google Scholar 

  15. Egenhofer, M.J., Mark, D.M.: Naive geography. In A.U. Frank, W. Kuhn (eds.) Spatial information theory. A theoretical basis for GIS. LNCS 988, 1–15. Berlin: Springer (1995)

    Google Scholar 

  16. Elmqvist, N., Moere, A.N., Jetter, H-C., Cernea, D., Reiterer, H., Jankun-Kelly, T.J.: Fluid interaction for information visualization. Information Visualization 10(4), 327–340 (2011)

    Article  Google Scholar 

  17. Fabrikant, S.I.: Persistent problem in geographic visualization: Evidence of geovis(ual analytics) utility and usefulness. ICA Geovis Commission (ICC2011) Workshop, Paris, France (2011)

    Google Scholar 

  18. Few, S.: Data visualization for human perception. In: M. Soegaard, R.F. Dam (eds.) Encyclopedia of Human-Computer Interaction. Aarhus, Denmark: The Interaction Design Foundation. Available online at http://www.interaction-design.org/encyclopedia/data_visualization_for_human_perception.html (2010)

  19. Fischer, F., Fuchs, J., Mansmann, F.: ClockMap: Enhancing Circular Treemaps with Temporal Glyphs for Time-Series Data. In: Proceedings of the Eurographics Conference on Visualization (EuroVis 2012), 5 pp. (2012)

    Google Scholar 

  20. Fitter, M., Green, T.R.: When do diagrams make good computer languages? International Journal of Man-Machine Studies 11, 235–261 (1979)

    Article  Google Scholar 

  21. Funke, J.: Complex problem solving: A case for complex cognition? Cognitive Processing 11(2), 133–42 (2010)

    Article  Google Scholar 

  22. Green, T.M., Fisher, B.: The personal equation of complex individual cognition during visual interface interaction. In: A. Ebert, A. Dix, N. Gershon, M. Pohl (eds.) Human Aspects of Visualization, LNCS 6431, 38–57 (2011)

    Google Scholar 

  23. Green, T.M., Ribarsky, W., Fisher, B.: Building and applying a human cognition model for visual analytics. Information Visualization 8(1), 1–13 (2009)

    Article  Google Scholar 

  24. Gurr, C.A.: Effective diagrammatic communication: Syntactic, semantic and pragmatic issues. Journal of Visual Languages and Computing 10, 317–342 (1999)

    Article  Google Scholar 

  25. Guthrie, J.T., Weber, S., Kimmerly, N.: Searching documents: Cognitive processes and deficits in understanding graphs, tables, and illustrations. Contemporary Educational Psychology 18, 186–221 (1993)

    Article  Google Scholar 

  26. Harel, D.: On visual formalisms. In: J. Glasgow, N.H. Naryanan, B. Chandrasekaran (eds.) Diagrammatic Reasoning: Cognitive and Computational Perspectives, 235–271. Cambridge, MA: MIT Press (1995)

    Google Scholar 

  27. Harnad, S.: Categorical Perception: The Groundwork of Cognition. NY: Cambridge University Press (1990)

    Google Scholar 

  28. Harris, R.: Information Graphics: A Comprehensive Illustrated Reference. Atlanta, GA: Management Graphics (1999)

    Google Scholar 

  29. Healey, C.G., Enns, J.T.: Attention and visual memory in visualization and computer graphics. IEEE Transactions on Visualization and Computer Graphics 18(7), 1170–1188 (2012)

    Article  Google Scholar 

  30. Heer, J., Bostock, M., Ogievetsky, V.: A tour through the visualization zoo: A survey of powerful visualization techniques, from the obvious to the obscure. ACM Queue 8(5), 1–22 (2010)

    Google Scholar 

  31. Hutchins, E.: Cognition in the Wild. MIT Press (1995)

    Google Scholar 

  32. Illinsky, N., Steele, J.: Designing Data Visualizations. Sebastopol, CA: O’Reilly (2011)

    Google Scholar 

  33. Jarvenpaa, S., Dickson, S.: Graphics and managerial decision making: research-based guidelines. Communications of the ACM 31(6), 764–774 (1988)

    Article  Google Scholar 

  34. Johnson, C., Moorhead, R., Munzner, T., Pfister, H., Rheingans, P., Yoo, T.: NIH-NSF Visualization Research Challenges. Tech. rep., Los Alamitos, CA (2006)

    Google Scholar 

  35. Johnson, B., Shneiderman, B.: Tree-maps: A space-filling approach to the visualization of hierarchical information structures. In: Proceedings of Information Visualization, 284–291 (1991)

    Google Scholar 

  36. Johnson, J.: Designing with the Mind in Mind: Simple Guide to Understanding User Interface Design Rules. Burlington, MA: Morgan Kaufmann (2010)

    Google Scholar 

  37. Keim, D., Kohlhammer, J., Ellis, G.: Mastering The Information Age-Solving Problems with Visual Analytics (2010)

    Google Scholar 

  38. Kelleher, C., Wagener, T.: Ten guidelines for effective data visualization in scientific publications. Environmental Modelling & Software 26(6), 822–827 (2011)

    Article  Google Scholar 

  39. Kemp, M.: Visualizations. The Nature Book of Arts and Science. Berkeley, CA: University of California Press (2000)

    Google Scholar 

  40. Kirsh, D.: Thinking with external representations. AI & Society 25, 441–454 (2010)

    Article  Google Scholar 

  41. Knauff, M., Wolf, A.G.: Complex cognition: The science of human reasoning, problem-solving, and decision-making. Cognitive Processing 11(2), 99–102 (2010)

    Article  Google Scholar 

  42. Lakoff, G., Johnson, M.: Metaphors We Live By. University of Chicago Press (1996)

    Google Scholar 

  43. Lamping, J., Rao, R.: Laying out and visualising large trees using a hyperbolic space. In: Proceedings of ACM UIST ’94, 13–14 (1994)

    Google Scholar 

  44. Liben, L., Kastens, K., Stevenson, L.: Real-world knowledge through real-world maps: A developmental guide for navigating the educational terrain. Developmental Review 22, 267–322 (2002)

    Article  Google Scholar 

  45. Liu, Z., Stasko, J.T.: Mental models, visual reasoning and interaction in information visualization: A top-down perspective. IEEE transactions on visualization and computer graphics 16(6), 999–1008 (2010)

    Article  Google Scholar 

  46. MacEachren, A.M.: How Maps Work: Representation, Visualization, and Design. NY: Guilford Press (1995)

    Google Scholar 

  47. Mackinlay, J.: Automating the design of graphical presentations of relational information. ACM Transactions on Graphics 5(2), 110–141 (1986)

    Article  Google Scholar 

  48. Mahan, R.P., Wang, J., Yanchus, N., Elliot, L.R. Redden, E.S., Shattuck, R.: Iconic representation and dynamic information fidelity: Implications for decision support. U.S. Army Research Laboratory (Report ARL-CR-0580). Aberdeen Proving Ground, MD (2006)

    Google Scholar 

  49. Marchionini, G.: Information Concepts: From Books to Cyberspace Identities. Bonita Springs, FL: Morgan & Claypool (2010)

    Google Scholar 

  50. Mazza, R.: Introduction to Information Visualization. Springer, London (2009)

    Google Scholar 

  51. Nazemi, K., Breyer, M., Kuijper, A.: User-oriented graph visualization taxonomy: A data-oriented examination of visual features. In: M. Kurosu (ed.) Human Centered Design, LNCS 6776, 576–585. Berlin: Springer-Verlag (2011)

    Google Scholar 

  52. Novick, L.R., Hurley, S.M.: To matrix, network, or hierarchy: That is the question. Cognitive Psychology 42(2), 158–216 (2001)

    Article  Google Scholar 

  53. Nowell, L.T.: Graphical encoding for information visualization: Using icon color, shape, and size to convey nominal and quantitative data. Doctoral Dissertation. Virginia Polytechnic Institute and State University (1997)

    Google Scholar 

  54. O’Looney, J.A.: Beyond Maps: GIS and Decision Making in Local Government. Redlands, CA: ESRI (2000)

    Google Scholar 

  55. Palmer, S.E.: Common region: A new principle of perceptual grouping. Cognitive Psychology 24, 436–447 (1992)

    Article  Google Scholar 

  56. Palmer, S.E., Rock, I.: Rethinking perceptual organization: The role of uniform connectedness. Psychonomic Bulletin and Review 1(1), 29–55 (1994)

    Article  Google Scholar 

  57. Parsons, P., Sedig, K.: Distribution of information processing while performing complex cognitive activities with visualization tools (this volume)

    Google Scholar 

  58. Peebles, D., Cheng, P.-H.: Extending task analytic models of graph-based reasoning: A cognitive model of problem solving with cartesian graphs in ACT-R/PM. In: E. Altmann, A. Cleeremans, C. Schunn, W. Gray (eds.) Proceedings of the 2001 Fourth International Conference on Cognitive Modeling, 169–174 (2001)

    Google Scholar 

  59. Pylyshyn, Z.: Seeing and Visualizing: It’s Not What You Think. MIT Press (2003)

    Google Scholar 

  60. Ribarsky, W., Foley, J.: Next-generation data visualization tools. GVU Technical Report GIT-GVU-94-27, Georgia Institute of Technology. Retrieved from http://smartech.gatech.edu/bitstream/handle/1853/3594/94-27.pdf (1994)

  61. Robertson, G. Card, S., Mackinlay, J.: Cone trees: Animated 3D visualizations of hierarchical information. In: Proceedings of CHI ’91, 189–194 (1993)

    Google Scholar 

  62. Scaife, M., Rogers, Y.: External cognition: how do graphical representations work? International Journal of Human-Computer Studies 45(2), 185–213 (1996)

    Article  Google Scholar 

  63. Sedig, K., Parsons, P.: Interaction design for complex cognitive activities with visual representations: A pattern-based approach. AIS Transactions on Human-Computer Interaction (in press)

    Google Scholar 

  64. Sedig, K., Parsons, P., Babanski, A.: Towards a characterization of interactivity in visual analytics. Journal of Multimedia Processing and Technologies, Special Issue on Theory and Application of Visual Analytics 3(1), 12–28 (2012)

    Google Scholar 

  65. Sedig, K., Parsons, P., Dittmer, M., Haworth, R.: Human-centered interactivity of visualization tools: Micro- and macro-level considerations (this volume)

    Google Scholar 

  66. Sedig, K., Parsons, P., Dittmer, M. Ola, O.: Beyond information access: Support for complex cognitive activities in public health informatics tools. Online Journal of Public Health Informatics 4(3) (2012)

    Google Scholar 

  67. Segel, E., Heer, J.: Narrative visualization: Telling stories with data. IEEE Transactions on Visualization and Computer Graphics 16(6), 1139–1148 (2010)

    Article  Google Scholar 

  68. Shah, P., Mayer, R. E., Hegarty, M.: Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension. Journal of Educational Psychology, 91(4), 690–702 (1999)

    Article  Google Scholar 

  69. Skupin, A.: A cartographic approach to visualizing conference abstracts. IEEE Computer Graphics and Applications 22(1), 50–58 (2002)

    Article  Google Scholar 

  70. Smelcer, J., Carmel, E.: The effectiveness of different representations for managerial problem solving: Comparing tables and maps. Decision Sciences 28(2), 391–420 (1997)

    Article  Google Scholar 

  71. Spence, R.: Information Visualization: Design for Interaction. (2nd ed.). Pearson Education Limited, Essex, England (2007)

    Google Scholar 

  72. Spence, R., Parr, M.: Cognitive assessment of alternatives. Interacting with Computers 3(3), 270–282 (1991)

    Article  Google Scholar 

  73. Stasko, J., Catrambone, R., Guzdial, M., McDonald, K.: An evaluation of space-filling information visualizations for depicting hierarchical structures. International Journal of Human-Computer Studies 53, 663–694 (2000)

    Article  MATH  Google Scholar 

  74. Stenning, K., Lemon, O.: Aligning Logical and Psychological Perspectives on Diagrammatic Reasoning. Artificial Intelligence Review 15, 29–62 (2001)

    Article  MATH  Google Scholar 

  75. Sternberg, R.J., Ben-Zeev, T.: Complex Cognition: The Psychology of Human Thought. NY: Oxford University Press (2001)

    Google Scholar 

  76. Suwa, M., Tversky, B.: External representations contribute to the dynamic construction of ideas. In: M. Hegarty, B. Meyer, & N. Narayanan (eds.) Diagrammatic representation and inference, LNCS 2317, 149–160. Berlin: Springer (2002)

    Google Scholar 

  77. Thomas, J., Cook, K.: Illuminating the path: The research and development agenda for visual analytics. IEEE Press (2005)

    Google Scholar 

  78. Treisman, A.: Preattentive processing in vision. Computer Vision, Graphics, and Image Processing 31(2), 156–177 (1985)

    Article  MathSciNet  Google Scholar 

  79. Treisman, A.: Features and objects in visual processing. Scientific American 255(5), 114–125 (1986)

    Article  Google Scholar 

  80. Tukey, J.W.: Exploratory Data Analysis. Addison-Wesley (1977)

    Google Scholar 

  81. Ware, C.: Information Visualization: Perception for Design (2nd ed.). Waltham, MA: Morgan Kaufmann (2004)

    Google Scholar 

  82. Ware, C.: Information Visualization: Perception for Design (3rd ed.). Waltham, MA: Morgan Kaufmann (2012)

    Google Scholar 

  83. Wickens, C.D., Carswell, C.M.: The proximity compatibility principle: Its psychological foundation and relevance to display design. Human Factors 37(3), 473–494 (1995)

    Article  Google Scholar 

  84. Wise, J.A., Thomas, J.J., Pennock, K., Lantrip, D., Pottier, M., Schur, A., Crow, V.: Visualizing the non-visual: Spatial analysis and interaction with information from text documents. In: N. Gershon, S. Eick (eds.) Proceedings IEEE Visualization 95, 51–58 (1995)

    Google Scholar 

  85. Zacks, J., Tversky, B.: Bars and lines: A study of graphic communication. Memory and Cognition 27(6), 1073–1079 (1997)

    Google Scholar 

  86. Zhang, J.: External representations in complex information processing tasks. In: A. Kent (ed.) Encyclopedia of Library and Information Science Vol. 68, 164–180. NY: Marcel Dekker (2000)

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank the Natural Sciences and Engineering Research Council of Canada for their financial support.

Author information

Authors and Affiliations

  1. Western University, London, Canada

    Paul Parsons & Kamran Sedig

Authors
  1. Paul Parsons
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kamran Sedig
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul Parsons .

Editor information

Editors and Affiliations

  1. CSIRO ICT Centre, Marsfield, New South Wales, Australia

    Weidong Huang

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Parsons, P., Sedig, K. (2014). Common Visualizations: Their Cognitive Utility. In: Huang, W. (eds) Handbook of Human Centric Visualization. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7485-2_27

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-7485-2_27

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-7484-5

  • Online ISBN: 978-1-4614-7485-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation