Abstract
Metacomputing-the concurrent use of multiple networklinked computers for solving application problems-is gaining increasing popularity. Much of the early work in metacomputing focused on harnessing greater processing power than could be found at a single site or on combining heterogeneous computer architectures to exploit the best features of each for a given problem. Another compelling rationale for using metacomputing is the acquisition, manipulation, and analysis of data that are stored remotely or acquired by distant instruments. When the data to be accessed and processed are voluminous, we refer to the applications as data intensive.
Large-scale projects of this kind require leading-edge technologies in multiple fields: high-speed networking, high-performance computing, software or interactive control of programs and instruments, and data storage facilities.
This paper describes three Caltech projects that take advantage of metacomputing, are data-intensive, or both. Brief mention is also made of a few additional projects that have these characteristics and are being conducted elsewhere. The applications described include synthetic aperture radar (SAR) data processing; a user interface for controlling the access and processing of scientific data and the use of distributed archives and computers for that data; and large-scale distributed interactive simulations for synthetic theater of war. Since Caltech is not the only institution that is pursuing distributed, data-intensive metacomputing, we also provide examples of interesting projects from other sites, such as telemi croscopy at the University of California at San Diego and the Distributed Object Computation Testbed that is being developed at the San Diego Supercomputer Center.
The paper ends with a brief survey of future projects in this area and some developments that will enable the use of metacomputing to more and more distributed, data-intensive applications.
Supported in part by DARPA's Information Technology Office
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
Aloisio, G., Cafaro, M., Williams, R., and Messina, P. “A distributed web-based metacomputing environment,” in High-Performance Computing and Net working '97. Springer-Verlag, April 1997. Austria Center, Vienna.
Young, S. J., Fan, G. Y., Hessler, D., Lamont, S., Elvins, T. T., Hadida, M., Hanyzewski, G., Durkin, J. W., Hubbard, P., Kindalman, D., Wong, E., Greenberg, D., Karin, S. and Ellisman, M. H. “Implementing a Collaboratory for Digital Microscopy,” in Int. J. Supercomputing Applications, 10:2/3, 172–181, 1996.
Mercurio, P. J., Elvins, T. T., Young, S. J., Cohen, P. S., Fall, K. R. and Ellisman, M. H. “The distributed laboratory: An interactive visualization environment for electron microscopy and three-dimensional imaging,” in Comm. Assoc. Comp. Mach., 35(6): 54–63, 1992.
Messina, P. “Parallel I/O: a set of intertwined systems and applications issues.” Technical Report CACR-120, California Institute of Technology, Pasadena, CA, April 1995.
Messina, P., and Mihaly-Pauna, T. (Editors) “CASA Gigabit network testbed: Final report.” Technical Report CACR-123, California Institute of Technology, Pasadena, CA, July 1996.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Messina, P. (1997). Metacomputing and data-intensive applications. In: Masuda, T., Masunaga, Y., Tsukamoto, M. (eds) Worldwide Computing and Its Applications. WWCA 1997. Lecture Notes in Computer Science, vol 1274. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-63343-X_50
Download citation
DOI: https://doi.org/10.1007/3-540-63343-X_50
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63343-3
Online ISBN: 978-3-540-69430-4
eBook Packages: Springer Book Archive