Abstract
We study high-performance Real-Time Online Interactive Applications (ROIAs), with use cases like product configurators in the Configure-Price-Quote market, e-learning, multiplayer online gaming, and digital twins of production facilities for the Industry 4.0 market. While core components of ROIAs, e.g., interactive real-time 3D rendering, still widely run on local devices, it is very desirable to run them on cloud resources to benefit from the advantages of cloud computing, e.g., better quality provided by high-performance compute resources and accessibility. In this paper, we design and implement a novel cloud service deployment architecture for ROIAs, which addresses three major challenges: meeting the high Quality of Service (QoS) requirements, auto-scalability, and resource usage optimization. Compared to previous work, our deployment approach is based on the concept of session slots that combines a high level of QoS with the economic use of resources like CPU, GPU, and memory. We describe a prototype implementation of a ROIA use case - a car configurator running on a Kubernetes cluster. Experimental evaluation demonstrates that our architecture avoids the traffic and latency bottleneck of a classical cloud load balancer, provides significantly more efficient resource usage, and can autoscale well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aly, M., Franke, M., Kretz, M., Schamel, F., Simoens, P.: Service oriented interactive media (SOIM) engines enabled by optimized resource sharing. In: 2016 IEEE Symposium on Service-Oriented System Engineering (SOSE), pp. 231–237 (2016). https://doi.org/10.1109/SOSE.2016.47
Bernstein, C.: TechTarget Homepage. https://whatis.techtarget.com/definition/lift-and-shift. Accessed 14 Mar 2021
Docker Homepage. https://www.docker.com. Accessed 20 Mar 2021
Ferris, J., Surridge, M., Glinka, F., et al.: Securing real-time on-line interactive applications in edutain@grid. In: César, E. (ed.) Euro-Par 2008. LNCS, vol. 5415, pp. 371–381. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00955-6_42
GitHub Homepage. https://github.com/kubernetes/kubernetes/blob/d1525ec808c2c2ac6987f12cc68acf0b5a776650/pkg/proxy/apis/config/types.go#L189-L194. Accessed 14 Mar 2021
Gorlatch, S., Glinka, F., Ploss, A.: Towards a scalable real-time cyberinfrastructure for online computer games. In: 2009 15th International Conference on Parallel and Distributed Systems, pp. 722–727 (2009). https://doi.org/10.1109/ICPADS.2009.94
Griffin, D., et al.: Service oriented networking. In: 2014 European Conference on Networks and Communications (EuCNC), pp. 1–5 (2014). https://doi.org/10.1109/EuCNC.2014.6882684
Kubernetes Homepage. https://kubernetes.io/docs/concepts/services-networking/service/#proxy-mode-ipvs. Accessed 14 Mar 2021
Landa, R., Araújo, J.T., Clegg, R.G., Mykoniati, E., Griffin, D., Rio, M.: The large-scale geography of Internet round trip times. In: 2013 IFIP Networking Conference, pp. 1–9 (2013)
Landa, R., Clegg, R.G., Araujo, J.T., Mykoniati, E., Griffin, D., Rio, M.: Measuring the relationships between Internet geography and RTT. In: 2013 22nd International Conference on Computer Communication and Networks (ICCCN), pp. 1–7 (2013). https://doi.org/10.1109/ICCCN.2013.6614151
Linux Virtual Server Homepage. http://kb.linuxvirtualserver.org/wiki/Least-Connection_Scheduling. Accessed 14 Mar 2021
Maini, E., Phan, T.K., Griffin, D., Rio, M.: Hierarchical service placement for demanding applications. In: 2016 IEEE Globecom Workshops (GC Wkshps), pp. 1–6 (2016). https://doi.org/10.1109/GLOCOMW.2016.7848922
Ploss, A., Glinka, F., Gorlatch, S., et al.: A case study on using RTF for developing multi-player online games. In: César, E. (ed.) Euro-Par 2008. LNCS, vol. 5415, pp. 390–400. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-00955-6_44
Sawicki, B., Chaber, B.: Efficient visualization of 3D models by web browser. Computing 95, 661–673 (2013). https://doi.org/10.1007/s00607-012-0275-z
Unkelos-Shpigel, N., Hadar, I.: A multitude of requirements and yet sole deployment architecture: predictors of successful software deployment. In: 2013 2nd International Workshop on the Twin Peaks of Requirements and Architecture (TwinPeaks), pp. 19–23 (2013). https://doi.org/10.1109/TwinPeaks.2013.6614719
Vandeputte, F., et al.: Evaluator services for optimised service placement in distributed heterogeneous cloud infrastructures. In: 2015 European Conference on Networks and Communications (EuCNC), pp. 439–444 (2015). https://doi.org/10.1109/EuCNC.2015.7194114
W3C Consortium Homepage. https://www.w3.org/TR/wsdl20/#Endpoint. Accessed 14 Mar 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Jarrous-Holtrup, S., Schamel, F., Hofer, K., Gorlatch, S. (2021). A Scalable Cloud Deployment Architecture for High-Performance Real-Time Online Applications. In: Jagode, H., Anzt, H., Ltaief, H., Luszczek, P. (eds) High Performance Computing. ISC High Performance 2021. Lecture Notes in Computer Science(), vol 12761. Springer, Cham. https://doi.org/10.1007/978-3-030-90539-2_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-90539-2_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90538-5
Online ISBN: 978-3-030-90539-2
eBook Packages: Computer ScienceComputer Science (R0)