Skip to main content

BEDWE: A Decentralized Workflow Engine for Best-Effort Infrastructures

  • Conference paper
  • First Online:
Innovations and Interdisciplinary Solutions for Underserved Areas (InterSol 2018)

Abstract

We consider the problem of executing composite computing applications called workflows on top of unreliable computing infrastructures. Having in mind the situation of the electric delivery in the sub-saharan area, we propose BEDWE, a decentralized workflow engine able to dynamically assign portions of the workflow to currently live compute nodes. More precisely, in a point-to-point manner, each node can receive a part of the workflow and delegate a subpart of it to another node. This mechanism can be repeated recursively until the whole workflow is executed. BEDWE includes a mechanism to support nodes leaving the network due to power outage. We present a software prototype of BEDWE and its experimentation over the French nation-wide Grid’5000 platform.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Weerawarana, S., Curbera, F., Leymann, F., Storey, T., Ferguson, D.F.: Web Services Platform Architecture: SOAP, WSDL, WS-Policy, WS-Addressing, WS-BPEL, WS-Reliable Messaging and More. Prentice Hall PTR, Upper Saddle River (2005)

    Google Scholar 

  2. Levine, J., John, L.: Flex & Bison, 1st edn. O’Reilly Media Inc., Sebastopol (2009)

    Google Scholar 

  3. Bolze, R., et al.: Grid’5000: a large scale and highly reconfigurable experimental grid testbed. Int. J. High Perform. Comput. Appl. 20(4), 481–494 (2006)

    Article  Google Scholar 

  4. Hi-WAY: Execution of Scientific Workflows on Hadoop YARN, 21–24 March 2017

    Google Scholar 

  5. Marozzo, F., Duro, F.R., Blas, F.J.G., Carretero, J., Talia, D., Trunfio, P.: A data-aware scheduling strategy for workflow execution in clouds. Concurr. Comput. Pract. Exp. 29(24) (2017)

    Google Scholar 

  6. Wolstencroft, K., et al.: The Taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. Nucl. Acids Res. 41(Webserver–Issue), 557–561 (2013)

    Article  Google Scholar 

  7. Ludäscher, B., et al.: Scientific workflow management and the Kepler system. Concurr. Comput. Pract. Exp. 18(10), 1039–1065 (2006)

    Article  Google Scholar 

  8. Barros, A., Dumas, M., Oaks, P.: A critical overview of the web services choreography description language. BPTrends (2005)

    Google Scholar 

  9. Qiao, X., Wei, J.: A decentralized services choreography approach for business collaboration. In: International Conference on Services Computing (SCC 2006), Chicago, USA, pp. 190–197 (2006)

    Google Scholar 

  10. Micillo, R.A., Venticinque, S., Mazzocca, N., Aversa, R.: An agent-based approach for distributed execution of composite web services. In: Proceedings of the 17th IEEE International Workshops on Enabling Technologies, Rome, Italy, June 2008

    Google Scholar 

  11. Yu, W.: Consistent and decentralized orchestration of BPEL processes. In: Proceedings of the 24th ACM Symposium on Applied Computing (SAC), Honolulu, March 2009

    Google Scholar 

  12. Downes, P., Curran, O., Cunniffe, J., Shearer, A.: Distributed radiotherapy simulation with the webcom workflow system. Int. J. High Perform. Comput. Appl. 24, 213–227 (2010)

    Article  Google Scholar 

  13. Atluri, V., Chun, S.A., Mukkamala, R., Mazzoleni, P.: A decentralized execution model for inter-organizational workflows. Distrib. Parallel Databases 22(1), 55–83 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cédric Tedeschi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wallah, P., Tedeschi, C., Pazat, JL. (2018). BEDWE: A Decentralized Workflow Engine for Best-Effort Infrastructures. In: Kebe, C., Gueye, A., Ndiaye, A., Garba, A. (eds) Innovations and Interdisciplinary Solutions for Underserved Areas. InterSol 2018. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 249. Springer, Cham. https://doi.org/10.1007/978-3-319-98878-8_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-98878-8_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-98877-1

  • Online ISBN: 978-3-319-98878-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics