Abstract
On-line monitoring of Grid workflows is challenging since workflows are loosely coupled and highly dynamic. An efficient mechanism of automatic resource discovery is needed in order to discover new producers of workflow monitoring data fast. However, currently used Grid information systems are not suitable for this due to insufficient performance characteristics. We propose to associate the monitoring infrastructure with a P2P DHT infrastructure in order to achieve the automatic resource discovery wherein consumers of monitoring data can be notified fast about new producers. In our solution, the consumer of monitoring data can subscribe to any monitoring endpoint and the automatic resource discovery is handled transparently. We evaluate performance of the presented solution, and demonstrated a case study scenario of monitoring of a traffic management workflow.
Chapter PDF
Similar content being viewed by others
References
Aloisio, G., Cafaro, M., Epicoco, I., Fiore, S., Lezzi, D., Mirto, M., Mocavero, S.: Resource and Service Discovery in the iGrid Information Service. In: Gervasi, O., Gavrilova, M.L., Kumar, V., Laganá, A., Lee, H.P., Mun, Y., Taniar, D., Tan, C.J.K. (eds.) ICCSA 2005. LNCS, vol. 3482, pp. 1–9. Springer, Heidelberg (2005)
Astalos, J., Flis, L., Radecki, M., Ziajka, W.: Performance Improvements to BDII – Grid Information Service in EGEE. In: Proc. CGW 2007, Krakow, Poland. ACC CYFRONET AGH (2008)
Balis, B., Bubak, M., Łabno, B.: GEMINI: Generic Monitoring Infrastructure for Grid Resource and Applications. In: K-WfGrid – The Knowledge-based Workflow System for Grid Applications, Proc. CGW 2006, Krakow, vol. II, pp. 60–73 (2006)
Bubak, M., Fahringer, T., Hluchy, L., Hoheisel, A., Kitowski, J., Unger, S., Viano, G., Votis, K.: K-WfGrid Consortium: K-Wf Grid – Knowledge based Workflow system for Grid Applications. In: Proc. CGW 2004, Poland, p. 39. Academic Computer Centre CYFRONET AGH (2005) ISBN 83-915141-4-5
Cannataro, M., Talia, D., Tradigo, G., Trunfio, P., Veltri, P.: SIGMCC: a System for Sharing Meta Patient Records in a Peer-to-peer Environment. Future Generation Computer Systems 24(3), 222–234 (2008)
Cooke, A., et al.: The Relational Grid Monitoring Architecture: Mediating Information about the Grid. Journal of Grid Computing 2(4) (December 2004)
Decandia, G., et al.: Dynamo: Amazon’s Highly Available Key-value Store. In: SOSP 2007: Proceedings of twenty-first ACM SIGOPS symposium, pp. 205–220. ACM Press, New York (2007)
Fortino, G., Russo, W.: Using P2P, GRID and Agent Technologies for the Development of Content Distribution Networks. Future Generation Computer Systems 24(3), 180–190 (2008)
Foster, I.T., Iamnitchi, A.: On Death, Taxes, and the Convergence of Peer-to-Peer and Grid Computing. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 118–128. Springer, Heidelberg (2003)
Gubala, T., Harezlak, D., Bubak, M., Malawski, M.: Semantic Composition of Scientific Workflows Based on the Petri Nets Formalism. In: Proc. 2nd IEEE International Conference on e-Science and Grid Computing (Avaialble only on CD-ROM). IEEE Computer Society Press, Los Alamitos (2006)
Schopf, J.M., Pearlman, L., Miller, N., Kesselman, C., Foster, I., D’Arcy, M., Chervenak, A.: Monitoring the grid with the Globus Toolkit MDS4. Journal of Physics: Conference Series 46, 521–525 (2006)
Schopf, J.M., Raicu, I., Pearlman, L., et al.: Monitoring and discovery in a web services framework: Functionality and performance of Globus Toolkit MDS4. Technical report, Mathematics and Computer Science Division, Argonne National Laboratory (2006)
Tierney, B., Aydt, R., Gunter, D., Smith, W., Taylor, V., Wolski, R., Swany, M.: A grid monitoring architecture. Technical Report GWD-PERF-16-2, Global Grid Forum (January 2002)
Trunfio, P., Talia, D., Papadakis, H., Fragopoulou, P., Mordacchini, M., Pennanen, M., Popov, K., Vlassov, V., Haridi, S.: Peer-to-Peer resource discovery in Grids: Models and systems. Future Generation Computer Systems 23(7), 864–878 (2007)
Zhang, X., Freschl, J.L., Schopf, J.M.: Scalability analysis of three monitoring and information systems: MDS2, R-GMA, and Hawkeye. J. Parallel Distrib. Comput. 67(8), 883–902 (2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Łabno, B., Bubak, M., Baliś, B. (2008). A P2P Approach to Resource Discovery in On-Line Monitoring of Grid Workflows. In: Luque, E., Margalef, T., Benítez, D. (eds) Euro-Par 2008 – Parallel Processing. Euro-Par 2008. Lecture Notes in Computer Science, vol 5168. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85451-7_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-85451-7_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85450-0
Online ISBN: 978-3-540-85451-7
eBook Packages: Computer ScienceComputer Science (R0)