Abstract
Whilst dealing with topics that are more and more influenced by physical properties of the underlying media, the networking community still lacks a culture of rigorous result verification. Indeed, as opposed to most of the science and engineering fields there are very few benchmarks to test protocols against. Furthermore, in most publications the authors do not give the community access to the raw results or details of the performed experimental procedures. Therefore it is impossible to accurately reproduce their experiments. We propose to solve this problem by extending the state of the art experiment tool OMF with a public portal. This portal, while providing the experimenter with access to experimental resources, also provides the community with a system for comprehensive experiment description and result verification. The collection of both the measurement set and the experiment’s description is done in a transparent manner for the experimenter, who can decide to publish them via the portal once the research is mature enough.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
git - The Fast Control System, http://git-scm.com/
Networking Conferences Statistics, http://www.cs.ucsb.edu/~almeroth/conf/stats/
NS3 Network Simulator, http://www.nsnam.org/
OMNet++ Simulator, http://www.omnetpp.org/
PlanetLab Testbed, http://www.planet-lab.org/
The NITLab Scheduler em, http://nitlab.inf.uth.gr/NITlab/
The OMF Testbed Control, Measurement and Management Framework, http://omf.mytestbed.net
The Orbit Measurment Library, http://oml.mytestbed.net
The R Project for Statistical Computing, www.r-project.org/
Albrecht, J., Tuttle, C., Snoeren, A.C., Vahdat, A.: PlanetLab Application Management Using Plush. ACM Operating Systems Review (2006)
Jourjon, G., Rakotoarivelo, T., Ott, M.: From Learning to Researching, Ease the Shift through Testbeds. In: Magedanz, T., Gavras, A., Thanh, N.H., Chase, J.S. (eds.) TridentCom 2010. LNICST, vol. 46, pp. 496–505. Springer, Heidelberg (2011)
Kohler, E., Handley, M., Floyd, S.: Designing DCCP: Congestion control without reliability. SIGCOMM Computer Communication Review 36(4), 27–38 (2006)
Lacage, M., Ferrari, M., Hansen, M., Turletti, T.: NEPI: Using Independent Simulators, Emulators, and Testbeds for Easy Experimentation. In: Workshop on Real Overlays and Distributed Systems (ROADS) (2009)
Lewis, R.W.: Biology: A hypothetico-deductive science. The American Biology Teacher 50, 362–366 (1988)
Mehani, O., Boreli, R., Ernst, T.: Analysis of TFRC in disconnected scenarios and performance improvements with Freeze-DCCP. In: Ott, J., Tan, K. (eds.) 4th International Workshop on Mobility in the Evolving Internet Architecture, MobiArch 2009. ACM, New York (2009)
Popper, K.R.: The Logic of Scientific Discovery. Hutchinson London (1968)
Rakotoarivelo, T., Ott, M., Seskar, I., Jourjon, G.: OMF: a control and management framework for networking testbeds. In: SOSP Workshop on Real Overlays and Distributed Systems (ROADS 2009), Big Sky, USA, p. 6 (October 2009)
Raychaudhuri, D., et al.: Overview of the ORBIT Radio Grid Testbed for Evaluation of Next-Generation Wireless Network Protocols. In: Proc. IEEE Wireless Communications and Networking Conference, WCNC (2005)
Underwood, A.: Experiments in ecology and management: their logics, functions and interpretations. Australian Journal of Ecology 15, 365–389 (1990)
White, B., Lepreau, J., Stoller, L., Ricci, R., Guruprasad, S., Newbold, M., Hibler, M., Barb, C., Joglekar, A.: An integrated experimental environment for distributed systems and networks. SIGOPS Oper. Syst. Rev. 36(SI), 255–270 (2002)
White, J., Jourjon, G., Rakatoarivelo, T., Ott, M.: Measurement Architectures for Network Experiments with Disconnected Mobile Nodes. In: Magedanz, T., Gavras, A., Thanh, N.H., Chase, J.S. (eds.) TridentCom 2010. LNICST, vol. 46, pp. 315–330. Springer, Heidelberg (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Jourjon, G., Rakotoarivelo, T., Ott, M. (2012). A Portal to Support Rigorous Experimental Methodology in Networking Research. In: Korakis, T., Li, H., Tran-Gia, P., Park, HS. (eds) Testbeds and Research Infrastructure. Development of Networks and Communities. TridentCom 2011. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 90. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29273-6_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-29273-6_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29272-9
Online ISBN: 978-3-642-29273-6
eBook Packages: Computer ScienceComputer Science (R0)