Abstract
With recent advances in artificial intelligence (AI) and learning based systems, industries have started to integrate AI components into their products and workflows. In areas where frequent testing and development is possible these system have proved to be quite useful such as in automotive industry where vehicle are now equipped with advanced driver-assistant systems (ADAS) capable of self-driving, route planning, and maintaining safe distances from lanes and other vehicles. However, as the safety-critical aspect of task increases, more difficult and expensive it is to develop and test AI-based solutions. Such is the case in aviation and therefore, development must happen over longer periods of time and in a step-by-step manner. This paper focuses on creating an interface between the human pilot and a potential assistant system that helps the pilot navigate through a complex flight scenario. Verbal communication and augmented reality (AR) were chosen as means of communication and the verbal communication was carried out in a wizard-of-Oz (WoOz) fashion. The interface was tested in a flight simulator and it’s usefulness was evaluated by NASA-TLX and SART questionnaires for workload and situation awareness.
N. Minaskan and C. Alban-Dromoy—These authors contributed equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Airplanes, B.C.: Statistical summary of commercial jet airplane accidents. Worldwide Operations 2008 (1959)
Amershi, S., et al.: Guidelines for human-AI interaction, May 2019. https://doi.org/10.1145/3290605.3300233
Bailey, R.E., Kramer, L.J., Kennedy, K.D., Stephens, C.L., Etherington, T.J.: An assessment of reduced crew and single pilot operations in commercial transport aircraft operations. In: 2017 IEEE/AIAA 36th Digital Avionics Systems Conference (DASC), pp. 1–15. IEEE (2017)
Bainbridge, L.: Ironies of automation. In: Analysis, Design and Evaluation of Man-Machine Systems, pp. 129–135. Elsevier (1983)
Biella, M., Wies, M., Charles, R., Maille, N., Nixon, J.: How eye tracking data can enhance human performance in tomorrow’s cockpit. results from a flight simulation study in future sky safety. In: Joint AIAA and Royal Aeronautical Society (RaeS) Fall Conference on Modeling and Simulation for ATM (2017)
Craggs, I.: Mqtt for.net. https://github.com/eclipse/paho.mqtt.m2mqtt. https://github.com/eclipse/paho.mqtt.m2mqtt
Cummings, M.L., Stimpson, A., Clamann, M.: Functional requirements for onboard intelligent automation in single pilot operations. In: AIAA Infotech@ Aerospace, p. 1652 (2016)
DeJohn, C.A., Wolbrink, A.M., Larcher, J.G.: In-flight medical incapacitation and impairment of us airline pilots: 1993 to 1998. Tech. rep, FEDERAL AVIATION ADMINISTRATION OKLAHOMA CITY OK CIVIL AEROMEDICAL INST (2004)
DeJohn, C.A., Wolbrink, A.M., Larcher, J.G.: In-flight medical incapacitation and impairment of airline pilots. Aviat. Space Environ. Med. 77(10), 1077–1079 (2006)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): Results of empirical and theoretical research, pp. 139–183 (1988). https://doi.org/10.1016/S0166-4115(08)62386-9
ICAO: Icao accident statistics. https://www.icao.int/safety/iStars/Pages/Accident-Statistics.aspx
Leigh, K.: Microsoft mixed reality toolkit. https://github.com/microsoft/mixedrealitytoolkit-unity. https://github.com/microsoft/MixedRealityToolkit-Unity
Letouzé, T., Créno, L., Diaz-Pineda, J., Dormoy, C.A., Hourlier, S., André, J.M.: Mental representation impact analysis (meria), a method for analyzing mental representations for the design of hmi. a case study in aeronautics. Le travail humain 83(1), 61–89 (2020)
Light, R.: Mosquitto mqtt broker. https://github.com/eclipse/mosquitto
Lim, Y., Gardi, A., Sabatini, R., Ramasamy, S., Kistan, T., Ezer, N., Vince, J., Bolia, R.: Avionics human-machine interfaces and interactions for manned and unmanned aircraft. Prog. Aerosp. Sci. 102, 1–46 (2018)
Matessa, M., Vu, K.P.L., Strybel, T.Z., Battiste, V., Schnell, T., Cover, M.: Using distributed simulation to investigate human-autonomy teaming. In: International Conference on Human Interface and the Management of Information. pp. 541–550. Springer (2018)
Nicholl, R.: Airline head-up display systems: human factors considerations. Available at SSRN 2384101 (2014)
Parasuraman, R., Molloy, R., Singh, I.L.: Performance consequences of automation-induced ‘complacency’. Int. J. Aviat. Psychol. 3(1), 1–23 (1993)
Shively, R.J., Lachter, J., Brandt, S.L., Matessa, M., Battiste, V., Johnson, W.W.: Why human-autonomy teaming? In: International Conference on Applied Human Factors and Ergonomics, pp. 3–11. Springer (2017)
Spitzer, C., Ferrell, U., Ferrell, T.: Digital avionics handbook. CRC Press (2017)
Taylor, R.M.: Situational awareness rating technique (sart): The development of a tool for aircrew systems design. In: Situational Awareness, pp. 111–128. Routledge (2017)
Viertler, F., Hajek, M.: Evaluation of visual augmentation methods for rotorcraft pilots in degraded visual environments. J. Am. Helicopter Soc. 62(1), 1–11 (2017)
Yang, Q., Steinfeld, A., Rosé, C., Zimmerman, J.: Re-examining whether, why, and how human-ai interaction is uniquely difficult to design. In: Proceedings of the 2020 chi Conference on Human Factors in Computing Systems, pp. 1–13 (2020)
Acknowledgements
This project has received funding from the Clean Sky 2 Joint Undertaking under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 831891. The authors would like to thank Th’eodore Letouz’e for taking care of the technical aspects of the simulator and Turkan Hentati for help with statistical analysis.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Minaskan, N., Alban-Dromoy, C., Pagani, A., Andre, JM., Stricker, D. (2022). Human Intelligent Machine Teaming in Single Pilot Operation: A Case Study. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2022. Lecture Notes in Computer Science(), vol 13310. Springer, Cham. https://doi.org/10.1007/978-3-031-05457-0_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-05457-0_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05456-3
Online ISBN: 978-3-031-05457-0
eBook Packages: Computer ScienceComputer Science (R0)