Abstract
HTTP Adaptive Streaming (HAS) is the predominant technique to deliver video contents across the Internet with the increasing demand of its applications. With the evolution of videos to deliver more immersive experiences, such as their evolution in resolution and framerate, highly efficient video compression schemes are required to ease the burden on the delivery process. While AVC/H.264 still represents the most adopted codec, we are experiencing an increase in the usage of new generation codecs (HEVC/H.265, VP9, AV1, VVC/H.266, etc.). Compared to AVC/H.264, these codecs can either achieve the same quality besides a bitrate reduction or improve the quality while targeting the same bitrate. In this paper, we propose a Mixed-Binary Linear Programming (MBLP) model called Multi-Codec Optimization Model at the edge for Live streaming (MCOM-Live) to jointly optimize (i) the overall streaming costs, and (ii) the visual quality of the content played out by the end-users by efficiently enabling multi-codec content delivery. Given a video content encoded with multiple codecs according to a fixed bitrate ladder, the model will choose among three available policies, i.e., fetch, transcode, or skip, the best option to handle the representations. We compare the proposed model with traditional approaches used in the industry. The experimental results show that our proposed method can reduce the additional latency by up to 23% and the streaming costs by up to 78%, besides improving the visual quality of the delivered segments by up to 0.5 dB, in terms of PSNR.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
AWS calculator. https://calculator.aws/. Accessed 22 Aug 2022
Bitrate Ladder Apple. https://developer.apple.com/documentation/http_live_streaming/http_live_streaming_hls_authoring_specification_for_apple_devices. Accessed 22 Aug 2022
DASH-IF Interoperability Guidelines. https://dashif.org/docs/DASH-IF-IOP-v4.3.pdf. Accessed 22 Aug 2022
Mininet. http://mininet.org/. Accessed 22 Aug 2022
Bentaleb, A., Taani, B., Begen, A.C., Timmerer, C., Zimmermann, R.: A survey on bitrate adaptation schemes for streaming media over HTTP. IEEE Commun. Surv. Tutorials 21(1), 562–585 (2019).https://doi.org/10.1109/COMST.2018.2862938
Bienik, J., Uhrina, M., Kuba, M., Vaculik, M.: Performance of H.264, H.265, VP8 and VP9 compression standards for high resolutions. In 2016 19th International Conference on Network-Based Information Systems (NBiS), pp. 246–252 (2016)
Bross, B., et al.: Overview of the versatile video coding (VVC) standard and its applications. IEEE Trans. Circuits Syst. Video Technol. 31(10), 3736–3764 (2021)
Chen, Y.: An overview of core coding tools in the AV1 video codec. In: 2018 Picture Coding Symposium (PCS), pp. 41–45 (2018)
DASH Industry Forum (DASH-IF). dash.js javascript reference client. https://reference.dashif.org/dash.js/. Accessed 10 Aug 2020
Erfanian, A., Amirpour, H., Tashtarian, F., Timmerer, C., Hellwagner, H.: LwTE-Live: light-weight transcoding at the edge for live streaming. In Proceedings of the Workshop on Design, Deployment, and Evaluation of Network-Assisted Video Streaming, VisNEXT 2021, pp. 22–28, New York, NY, USA, Association for Computing Machinery (2021)
Ericsson. Ericsson mobility report. https://www.ericsson.com/4ad7e9/assets/local/reports-papers/mobility-report/documents/2021/ericssonmobility-report-november-2021.pdf. Accessed: 05 May 2022
Mukherjee, D.: The latest open-source video codec VP9 - an overview and preliminary results. In: 2013 Picture Coding Symposium (PCS), pp. 390–393 (2013)
Müller, C., Lederer, S., Timmerer, C.: An evaluation of dynamic adaptive streaming over HTTP in vehicular environments. In Proceedings of the 4th Workshop on Mobile Video, MoVid 2012, pp. 37–42, New York, NY, USA, Association for Computing Machinery (2012)
Pantos, R., May, W. (ed.) HTTP Live Streaming. RFC 8216. https://www.rfc-editor.org/info/rfc8216. Accessed 05 May 2022
Reznik, Y.A., Li, X., Lillevold, K.O., Jagannath, A., Greer, J.: Optimal Multi-codec adaptive bitrate streaming. In: 2019 IEEE International Conference on Multimedia Expo Workshops (ICMEW), pp. 348–353 (2019)
Sullivan, G.J., Ohm, J.-R., Han, W.-J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)
Taraghi, B., Amirpour, H., Timmerer, C.: Multi-codec ultra high definition 8K MPEG-DASH dataset. In Proceedings of the 13th ACM Multimedia Systems Conference, MMSys 2022, pp. 216–220, New York, NY, USA, Association for Computing Machinery (2022)
Taraghi, B., Nguyen, M., Amirpour, H., Timmerer, C.: INTENSE: in-depth studies on stall events and quality switches and their impact on the quality of experience in HTTP adaptive streaming. IEEE Access 9, 118087–118098 (2021)
Thang, T.C., Le, H.T., Pham, A.T., Ro, Y.M.: An evaluation of bitrate adaptation methods for HTTP live streaming. IEEE J. Sel. Areas Commun. 32(4), 693–705 (2014)
van der Hooft, J., Petrangeli, S., Wauters, T., Huysegems, R., Bostoen, T., De Turck, F.: An HTTP/2 push-based approach for low-latency live streaming with super-short segments. J. Netw. Syst. Manage. 26(1), 51–78 (2017). https://doi.org/10.1007/s10922-017-9407-2
Wang, B., Ren, F., Zhou, C.: Hybrid control-based abr: towards low-delay live streaming. In: 2019 IEEE International Conference on Multimedia and Expo (ICME), pp. 754–759 (2019)
Wiegand, T., Sullivan, GJ., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Technol,13(7), 560–576, 2003
Xie, L., Zhou, C., Zhang, X., Guo, Z.: Dynamic threshold based rate adaptation for http live streaming. In: 2017 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1–4 (2017)
Zabrovskiy, A., Feldmann, C., Timmerer, C.: A practical evaluation of video codecs for large-scale http adaptive streaming services. In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 998–1002 (2018)
Acknowledgment
The financial support of the Austrian Federal Ministry for Digital and Economic Affairs, the National Foundation for Research, Technology and Development, and the Christian Doppler Research Association, is gratefully acknowledged. Christian Doppler Laboratory ATHENA: https://athena.itec.aau.at/.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lorenzi, D., Tashtarian, F., Amirpour, H., Timmerer, C., Hellwagner, H. (2023). MCOM-Live: A Multi-Codec Optimization Model at the Edge for Live Streaming. In: Dang-Nguyen, DT., et al. MultiMedia Modeling. MMM 2023. Lecture Notes in Computer Science, vol 13834. Springer, Cham. https://doi.org/10.1007/978-3-031-27818-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-27818-1_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-27817-4
Online ISBN: 978-3-031-27818-1
eBook Packages: Computer ScienceComputer Science (R0)