Abstract
Web-based speed tests are popular among end-users for measuring their network performance. Thousands of measurement servers have been deployed in diverse geographical and network locations to serve users worldwide. However, most speed tests have opaque methodologies, which makes it difficult for researchers to interpret their highly aggregated test results, let alone leverage them for various studies.
In this paper, we propose WebTestKit, a unified and configurable framework for facilitating automatic test execution and cross-layer analysis of test results for five major web-based speed test platforms. Capturing only packet headers of traffic traces, WebTestKit performs in-depth analysis by carefully extracting HTTP and timing information from test runs. Our testbed experiments showed WebTestKit is lightweight and accurate in interpreting encrypted measurement traffic. We applied WebTestKit to compare the use of HTTP requests across speed tests and investigate the root causes for impeding the accuracy of latency measurements, which play a vital role in test server selection and throughput estimation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Available at https://github.com/CAIDA/webtestkit.
References
Ookla open datasets. https://registry.opendata.aws/speedtest-global-performance/
Speedof.me. https://speedof.me
Bauer, S., Clark, D., Lehr, W.: Understanding broadband speed measurements. In: Proceedings of the TPRC (2010)
Bauer, S., Lehr, W., Mou, M.: Improving the measurement and analysis of gigabit broadband networks. Technical report, Massachusetts Institute of Technology (2016)
Chromium. Netlog viewer. https://netlog-viewer.appspot.com/
CloudFlare. Cloudflare speed test. https://speed.cloudflare.com
Comcast. Xfinity speed test. http://speedtest.xfinity.com
Doan, T.V., Bajpai, V., Crawford, S.: A longitudinal view of Netflix: content delivery over IPv6 and content cache deployments. In: Proceedings of the IEEE INFOCOM (2020)
Fast.com. Internet speed test. https://fast.com
Feamster, N., Livingood, J.: Measuring internet speed. Commun. ACM 63(12), 72–80 (2020)
Goga, O., Teixeira, R.: Speed measurements of residential internet access. In: Taft, N., Ricciato, F. (eds.) PAM 2012. LNCS, vol. 7192, pp. 168–178. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-28537-0_17
Haselton, T.: CNBC tech guide: how to make sure you’re getting the internet speeds you pay for (2018). https://www.cnbc.com/2018/08/17/how-to-check-internet-speed.html
Høiland-Jørgensen, T., Ahlgren, B., Hurtig, P., Brunstrom, A.: Measuring latency variation in the internet. In: Proceedings of the ACM CoNEXT (2016)
HTTP Toolkit. Chrome 79+ no longer shows preflight CORS requests. https://httptoolkit.tech/blog/chrome-79-doesnt-show-cors-preflight/
Hu, N., Steenkiste, P.: Evaluation and characterization of available bandwidth probing techniques. IEEE J. Sel. A. Commun. 21(6), 879–894 (2006)
Hulu. Hulu help center: Test your internet connection. https://help.hulu.com/s/article/speed-test?language=en_US
Jain, M., Dovrolis, C.: End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput. IEEE/ACM Trans. Netw. 11(4), 537–549 (2003)
Li, W., Mok, R., Chang, R., Fok, W.: Appraising the delay accuracy in browser-based network measurement. In: Proceedings of the ACM/USENIX IMC (2013)
M Lab. Murakami. https://www.measurementlab.net/blog/murakami/. Accessed 15 July 2021
M-Lab. NDT (network diagnostic tool). https://www.measurementlab.net/tests/ndt/
Mok, R.K., Zou, H., Yang, R., Koch, T., Katz-Bassett, E., Claffy, K.: Measuring the network performance of Google Cloud platform. In: ACM IMC, Virtual Event (2021)
Netflix. Netflix help center: Internet connection speed recommendations. https://help.netflix.com/en/node/306
Ookla. About ookla. http://www.speedtest.net/en/about
Ookla. Speedtest. http://www.speedtest.net
Ookla. How does the test itself work? How is the result calculated? (2012). https://support.speedtest.net/hc/en-us/articles/203845400-How-does-the-test-itself-work-How-is-the-result-calculated-
Padhye, J., Firoiu, V., Towsley, D.F., Kurose, J.F.: Modeling TCP reno performance: a simple model and its empirical validation. IEEE/ACM Trans. Netw. 8, 133–145 (2000)
Philip, A.: Slow internet? how to figure out if it’s your problem or your service provider’s. https://www.azcentral.com/story/news/local/arizona-investigations/2018/09/06/your-internet-slow-heres-how-figure-out-whos-fault/1058007002/
Ribeiro, V.J., Riedi, R.H., Baraniuk, R.G., Navratil, J., Cottrell, L.: pathChirp: efficient available bandwidth estimation for network paths (2003)
Sivel. Cloudflare-cli. https://github.com/KNawm/speed-cloudflare-cli
Sivel. Fast-cli. https://github.com/sindresorhus/fast-cli
Sivel. Speedtest-cli. https://github.com/sivel/speedtest-cli
Sommers, J., Durairajan, R., Barford, P.: Automatic metadata generation for active measurement. In: Proceedings of the ACM IMC (2017)
Strauss, J., Katabi, D., Kaashoek, F.: A measurement study of available bandwidth estimation tools. In: Proceedings of the ACM IMC (2013)
Sundaresan, S., de Donato, W., Feamster, N., Teixeira, R., Crawford, S., Pescapé, A.: Broadband Internet performance: a view from the gateway. In: Proceedings of the ACM SIGCOMM (2011)
Sundaresan, S., Lee, D., Deng, X., Feng, Y., Dhamdhere, A.: Challenges in inferring internet congestion using throughput measurements. In: Proceedings of the ACM IMC (2017)
The Chromium Projects. NetLog: Chrome’s network logging system. https://www.chromium.org/developers/design-documents/network-stack/netlog
The Chromium Projects. The trace event profiling tool. https://www.chromium.org/developers/how-tos/trace-event-profiling-tool
The Office of the New York State Attorney General. Are you getting the internet speeds you are paying for? https://ag.ny.gov/SpeedTest
W3C. Resource Timing Level 2. https://www.w3.org/TR/resource-timing-2/. Accessed 26 June 2021
M. web docs. Cross-origin resource sharing (cors). https://developer.mozilla.org/en-US/docs/Web/HTTP/CORS#Preflighted_requests. Accessed 23 Feb 2019
WHATWG. XMLHttpRequest Living Standard. https://xhr.spec.whatwg.org
Xu, D., et al.: Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption. In: ACM SIGCOMM, Virtual Event, NY, USA (2020)
Yang, X., et al.: Fast and light bandwidth testing for internet users. In: USENIX NSDI, Virtual Event (2021)
Acknowledgment
We thank anonymous reviewers for their valuable comments. This work was supported by the Key-Area Research and Development Program of Guangdong Province (No. 2020B010164001), NSF CNS-2028506, NSF OAC-1724853, Comcast Innovation Fund, and Google Cloud credit grant.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, R., Mok, R.K.P., Wu, S., Luo, X., Zou, H., Li, W. (2022). Design and Implementation of Web-Based Speed Test Analysis Tool Kit. In: Hohlfeld, O., Moura, G., Pelsser, C. (eds) Passive and Active Measurement. PAM 2022. Lecture Notes in Computer Science, vol 13210. Springer, Cham. https://doi.org/10.1007/978-3-030-98785-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-98785-5_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98784-8
Online ISBN: 978-3-030-98785-5
eBook Packages: Computer ScienceComputer Science (R0)