Skip to main content

A Civil Aircraft Cockpit Control Device Design Using Mixed Reality Device

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13318))

Included in the following conference series:

Abstract

Mixed Reality are considered enabling technologies for the Industry 4.0 paradigm. In this paper, the cockpit control device design and evaluation system based on mixed reality technology is established, which is suitable for rapid iteration in the initial stage of civil aircraft design. It can provide aircraft designers with a more efficient and realistic design environment. It also provides a user evaluation environment, allowing pilots to participate in the cockpit design at an early stage of the design. According to the operation task and operation pattern classifying of common control equipment in the cockpit, also determines the control unit from the industrial model to virtual reality model of the conversion process. The conversion process of the control device from industrial model to virtual reality model is determined. The paper also puts forward the design mode of double coordinate system based on design eye reference point and controller panel, which is suitable for the design process of civil aircraft cockpit. For the system, we also conducted a preliminary user research and analysis. The experimental and analysis results are used for the subsequent system design and upgrading. It provides useful guidance for the design of human-computer interaction interface in mixed reality environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. EN ISO 9241-210:2010-10

    Google Scholar 

  2. Wang, G.G.: Definition and review of virtual prototyping. J. Comput. Inf. Sci. Eng. 2(3), 232–236 (2002)

    Article  Google Scholar 

  3. Joyce, R., Robinson, S.K.: Evaluation of a virtual reality environment for cockpit design. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 63, no. 1, pp. 2328–2332 (2019)

    Google Scholar 

  4. IEA. Definition and Domains of Ergonomics (2000)

    Google Scholar 

  5. Yang, L.Q.: Summarization of human body molding technology development for man-machine engineering field. J. Acad. Armored Force Eng. 20(2), 59–63 (2006)

    Google Scholar 

  6. Chaffin, D.B.: Improving digital human modelling for proactive ergonomics in design. Ergonomics 48(5), 478–491 (2005). https://doi.org/10.1080/00140130400029191

  7. Mohan, D.B., Jeevitha, S., Prabhakar, G., Saluja, K.S., Biswas, P.: Estimating pilots’ cognitive load from ocular parameters through simulation and in-flight studies. J. Eye Mov. Res. 12(3) (2019)

    Google Scholar 

  8. Ramacci, C.A., Ottalevi, A., Modugno, G., Meineri, G., Berti, R.: [Behavior of central critical fusion frequency of the retina and various cardiocirculatory parameters (ECG, humeral arterial pressure and heart rate) in military jet pilots before and after operational flight]. Riv. Med. Aeronaut. Spaz. 47(1–4), 55–64 (1982)

    Google Scholar 

  9. Mohino-Herranz, I., Gil-Pita, R., Ferreira, J., Rosa-Zurera, M., Seoane, F.: Assessment of mental, emotional and physical stress through analysis of physiological signals using smartphones. Sensors 15(10), 25607–25627 (2015)

    Article  Google Scholar 

  10. Gentili, R.J., Rietschel, J.C., Jaquess, K.J., Lo, L.C., Hatfield, B.D.: Brain biomarkers based assessment of cognitive workload in pilots under various task demands. In: Conference on Proceedings of IEEE Engineering in Medicine and Biology Society (2014)

    Google Scholar 

  11. Kalawsky, R.S., Wesley, A.: The Science of Virtual Reality and Virtual Environments. Addison Wesley Longman Publishing Co., Inc., Boston (1993)

    Google Scholar 

  12. Aromaa, S., Väänänen, K.: Suitability of virtual prototypes to support human factors/ergonomics evaluation during the design. Appl. Ergon. 56, 11–18 (2016)

    Article  Google Scholar 

  13. Chen, B., Qin, X.: Composition of virtual-real worlds and intelligence integration of human-computer in mixed reality. Sci. China (Inf. Sci) 46(12), 11 (2016)

    Google Scholar 

  14. Borst, C., Volz, R.: Evaluation of a haptic mixed reality system for interactions with a virtual control panel. Presence 14(6), 677–696 (2005)

    Article  Google Scholar 

  15. Lee, L.H., Hui, P.: Interaction methods for smart glasses: a survey. IEEE Access 6, 28712–28732 (2018)

    Article  Google Scholar 

  16. Tian, G.: Research on the human factors Design principle of A380 aircraft based on Reverse engineering methods Civil Aviation Flight University of China (2013)

    Google Scholar 

  17. https://www.unrealengine.com/zh-CN/

  18. Wang, Y., Guo, X., Liu, Q., Xiao, H., Bai, Y.: Three-dimensional measurement applied in design eye point of aircraft cockpits. Aerosp. Med. Hum. Perform. 89(4), 371–376 (2018)

    Article  Google Scholar 

  19. https://mathworld.wolfram.com/SphericalCoordinates.html

  20. Caputo, A., Jacota, S., Krayevskyy, S., Pesavento, M., Giachetti, A.: XR-Cockpit: a comparison of VR and AR solutions on an interactive training station. In: ETFA 2020: IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2020 (2020)

    Google Scholar 

  21. Hattori, K., Hirai, T.: Inside-out tracking controller for VR/AR HMD using image recognition with smartphones. In: SIGGRAPH 2020: Special Interest Group on Computer Graphics and Interactive Techniques Conference (2020)

    Google Scholar 

  22. Kress, B.C., Cummings, W.J.: 11‐1: invited paper: towards the ultimate mixed reality experience: HoloLens display architecture choices. In: SID Symposium Digest of Technical Papers, vol. 48, no. 1 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Guo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guo, W., Wang, X., Deng, Z., Li, H. (2022). A Civil Aircraft Cockpit Control Device Design Using Mixed Reality Device. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer, Cham. https://doi.org/10.1007/978-3-031-06015-1_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06015-1_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06014-4

  • Online ISBN: 978-3-031-06015-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics