Skip to main content

Data-Flow Awareness in Parallel Data Processing

  • Conference paper
Intelligent Distributed Computing VI

Part of the book series: Studies in Computational Intelligence ((SCI,volume 446))

Abstract

The memory hierarchy affects the performance of task-scheduling strategies in task-based parallel environments. For data-intensive problems, the flow of data may be explicitly specified as a part of the algorithm, allowing the task scheduler to be aware of the data flow. In this paper, we describe such a task-based environment with explicit data-flow specification. We demonstrate the effect of data-flow awareness on the system performance. The results show that the explicit specification of data flow improves the quality of task scheduling.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kukanov, A., Voss, M.J.: The foundations for scalable multi-core software in Intel Threading Building Blocks. Intel. Technology Journal 11(04), 309–322 (2007)

    Article  Google Scholar 

  2. OpenMP Application Program Interface, V. 3.0, OpenMP Architecture Review Board (May 2008), http://www.openmp.org/mp-documents/spec30.pdf

  3. MPI: A Message-Passing Interface Standard, Version 2.2, Message Passing Interface Forum (September 2009), http://www.mpi-forum.org/docs/mpi-2.2/mpi22-report.pdf

  4. Bednarek, D., Dokulil, J., Yaghob, J.: The Bobox Project - Parallelization Framework and Server for Data Processing, Charles University in Prague, Tech. Rep. 2011/01 (2011)

    Google Scholar 

  5. Cermak, M., Falt, Z., Dokulil, J., Zavoral, F.: SPARQL Query Processing Using Bobox Framework. In: The 5th Int. Conf. on Advances in Semantic Processing, SEMAPRO. Xpert Publishing Services, Sliema (2011)

    Google Scholar 

  6. Bednarek, D., Dokulil, J., Yaghob, J., Zavoral, F.: Using Methods of Parallel Semi-structured Data Processing for Semantic Web. In: 3rd International Conference on Advances in Semantic Processing, pp. 44–49. Xpert Publishing Services, Sliema (2009)

    Chapter  Google Scholar 

  7. Falt, Z., Bednarek, D., Cermak, M., Zavoral, F.: On Parallel Evaluation of SPARQL Queries. In: The Fourth International Conference on Advances in Databases, Knowledge, and Data Applications DBKDA 2012. Xpert Publishing Services (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Bednárek .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bednárek, D., Dokulil, J., Yaghob, J., Zavoral, F. (2013). Data-Flow Awareness in Parallel Data Processing. In: Fortino, G., Badica, C., Malgeri, M., Unland, R. (eds) Intelligent Distributed Computing VI. Studies in Computational Intelligence, vol 446. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32524-3_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32524-3_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32523-6

  • Online ISBN: 978-3-642-32524-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics