Skip to main content
SpringerLink
Log in

User Interactions in Virtual Data Explorer

  • Conference paper
  • First Online:
Augmented Cognition (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13310))

Included in the following conference series:

Abstract

Cybersecurity practitioners face the challenge of monitoring complex and large datasets. These could be visualized as time-varying node-link graphs, but would still have complex topologies and very high rates of change in the attributes of their links (representing network activity). It is natural, then, that the needs of the cybersecurity domain have driven many innovations in 2D visualization and related computer-assisted decision making. Here, we discuss the lessons learned while implementing user interactions for Virtual Data Explorer (VDE), a novel system for immersive visualization (both in Mixed and Virtual Reality) of complex time-varying graphs. VDE can be used with any dataset to render its topological layout and overlay that with time-varying graph; VDE was inspired by the needs of cybersecurity professionals engaged in computer network defense (CND).

Immersive data visualization using VDE enables intuitive semantic zooming, where the semantic zoom levels are determined by the spatial position of the headset, the spatial position of handheld controllers, and user interactions (UIa) with those controllers. This spatially driven semantic zooming is quite different from most other network visualizations which have been attempted with time-varying graphs of the sort needed for CND, presenting a broad design space to be evaluated for overall user experience (UX) optimization. In this paper, we discuss these design choices, as informed by CND experts, with a particular focus on network topology abstraction with graph visualization, semantic zooming on increasing levels of network detail, and semantic zooming to show increasing levels of detail with textual labels.

The material is based upon work supported by NASA under award number 80GSFC21M0002.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Batch, A., Elmqvist, N.: The interactive visualization gap in initial exploratory data analysis. IEEE Trans. Visual Comput. Graph. 24(1), 278–287 (2018). https://doi.org/10.1109/TVCG.2017.2743990

    Article  Google Scholar 

  2. Ben-Asher, N., Gonzalez, C.: Effects of cyber security knowledge on attack detection. Comput. Hum. Behav. 48, 51–61 (2015). https://doi.org/10.1016/j.chb.2015.01.039. https://www.sciencedirect.com/science/article/pii/S0747563215000539

  3. Casallas, J.S., Oliver, J.H., Kelly, J.W., Merienne, F., Garbaya, S.: Using relative head and hand-target features to predict intention in 3d moving-target selection. In: 2014 IEEE Virtual Reality (VR), pp. 51–56 (2014). https://doi.org/10.1109/VR.2014.6802050

  4. Dübel, S., Röhlig, M., Schumann, H., Trapp, M.: 2d and 3d presentation of spatial data: a systematic review. In: 2014 IEEE VIS International Workshop on 3DVis (3DVis), pp. 11–18 (2014). https://doi.org/10.1109/3DVis.2014.7160094

  5. Elmqvist, N., Tsigas, P.: A taxonomy of 3d occlusion management for visualization. IEEE Trans. Visual Comput. Graphics 14(5), 1095–1109 (2008). https://doi.org/10.1109/TVCG.2008.59

    Article  Google Scholar 

  6. Günther, T., Franke, I.S., Groh, R.: Aughanded virtuality - the hands in the virtual environment. In: 2015 IEEE Virtual Reality (VR), pp. 327–328 (2015). https://doi.org/10.1109/VR.2015.7223428

  7. Johnson, D.M.: Introduction to and review of simulator sickness research (2005)

    Google Scholar 

  8. Kabil, A., Duval, T., Cuppens, N.: Alert characterization by non-expert users in a cybersecurity virtual environment: a usability study. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2020. LNCS, vol. 12242, pp. 82–101. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58465-8_6

    Chapter  Google Scholar 

  9. Kabil, A., Duval, T., Cuppens, N., Comte, G.L., Halgand, Y., Ponchel, C.: Why should we use 3d collaborative virtual environments for cyber security? In: 2018 IEEE Fourth VR International Workshop on Collaborative Virtual Environments (3DCVE), pp. 1–2 (2018). https://doi.org/10.1109/3DCVE.2018.8637109

  10. Kang, H.J., Shin, J.h., Ponto, K.: A comparative analysis of 3d user interaction: How to move virtual objects in mixed reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 275–284 (2020). https://doi.org/10.1109/VR46266.2020.00047

  11. Kullman, K.: Creating useful 3d data visualizations: Using mixed and virtual reality in cybersecurity (2020). https://coda.ee/MAVRIC, 3nd Annual MAVRIC Conference

  12. Kullman, K., Ben-Asher, N., Sample, C.: Operator impressions of 3d visualizations for cybersecurity analysts. In: 18th European Conference on Cyber Warfare and Security. Coimbra, Portugal (2019)

    Google Scholar 

  13. Kullman, K., Cowley, J., Ben-Asher, N.: Enhancing cyber defense situational awareness using 3d visualizations. In: 13th International Conference on Cyber Warfare and Security, Washington, DC (2018)

    Google Scholar 

  14. Kullman, K.: Virtual data explorer. https://coda.ee/

  15. Kullman, K., Buchanan, L., Komlodi, A., Engel, D.: Mental model mapping method for cybersecurity. In: HCI (2020)

    Google Scholar 

  16. Kullman, K., Engel, D.: Interactive stereoscopically perceivable multidimensional data visualizations for cybersecurity. J. Defence Secur. Technol. 4(3), 37–52 (2022). 10.46713/jdst.004.03

    Google Scholar 

  17. Lu, F., Davari, S., Lisle, L., Li, Y., Bowman, D.A.: Glanceable ar: evaluating information access methods for head-worn augmented reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 930–939 (2020). https://doi.org/10.1109/VR46266.2020.00113

  18. Miyazaki, R., Itoh, T.: An occlusion-reduced 3d hierarchical data visualization technique. In: 2009 13th International Conference Information Visualisation, pp. 38–43 (2009). https://doi.org/10.1109/IV.2009.32

  19. Munzner, T.: Visualization Analysis and Design. AK Peters Visualization Series. CRC Press (2015). https://books.google.de/books?id=NfkYCwAAQBAJ

  20. Pruett, C.: Lessons from the frontlines modern vr design patterns (2017). https://developer.oculus.com/blog/lessons-from-the-frontlines-modern-vr-design-patterns, unity North American Vision VR/AR Summit

  21. Roberts, J.C., Ritsos, P.D., Badam, S.K., Brodbeck, D., Kennedy, J., Elmqvist, N.: Visualization beyond the desktop-the next big thing. IEEE Comput. Graphics Appl. 34(6), 26–34 (2014). https://doi.org/10.1109/MCG.2014.82

    Article  Google Scholar 

  22. Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996). https://doi.org/10.1109/VL.1996.545307

  23. Whitlock, M., Smart, S., Szafir, D.A.: Graphical perception for immersive analytics. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 616–625 (2020). https://doi.org/10.1109/VR46266.2020.00084

  24. Yu, D., Liang, H.N., Fan, K., Zhang, H., Fleming, C., Papangelis, K.: Design and evaluation of visualization techniques of off-screen and occluded targets in virtual reality environments. IEEE Trans. Visual Comput. Graphics 26(9), 2762–2774 (2020). https://doi.org/10.1109/TVCG.2019.2905580

    Article  Google Scholar 

Download references

Acknowledgement

The authors thank Alexander Kott, Jennifer A. Cowley, Lee C. Trossbach, Matthew C. Ryan, Jaan Priisalu, and Olaf Manuel Maennel for their ideas and guidance. This research was partly supported by the Army Research Laboratory under Cooperative Agreement Number W911NF-17-2-0083 and in conjunction with the CCDC Command, Control, Computers, Communications, Cyber, Intelligence, Surveillance, and Reconnaissance (C5ISR) Center. The material is based upon work supported by NASA under award number 80GSFC21M0002.

Author information

Authors and Affiliations

  1. University of Maryland, Baltimore County, Baltimore, MD, 21250, USA

    Kaur Kullman & Don Engel

  2. Tallinn University of Technology, 12616, Tallinn, Estonia

    Kaur Kullman

Authors
  1. Kaur Kullman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Don Engel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kaur Kullman .

Editor information

Editors and Affiliations

  1. Soar Technology Inc., Orlando, FL, USA

    Dylan D. Schmorrow

  2. Katmai Government Services, Orlando, FL, USA

    Cali M. Fidopiastis

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kullman, K., Engel, D. (2022). User Interactions in Virtual Data Explorer. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2022. Lecture Notes in Computer Science(), vol 13310. Springer, Cham. https://doi.org/10.1007/978-3-031-05457-0_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05457-0_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05456-3

  • Online ISBN: 978-3-031-05457-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation