Abstract. We propose a new approach for developing parallel I/O-and computeintensive applications on distributed memory PC. Using the CAP Computer-Aided Parallelization tool, application programmers create separately the serial program parts and express the parallel behavior of the program at a high level of abstraction. This highlevel parallel program description (CAP) is preprocessed into a compilable and executable C++ source parallel program. Low-level parallel file system components can, thanks to the CAP formalism, be combined with processing operations in order to yield efficient pipelined parallel I/O and compute intensive programs. These programs may run on multiple PC servers offering their access and processing services to clients located over the network. The applicability of the CAP tools on a real application is demonstrated with a parallel 3D tomographic image server application enabling clients to specify and access in parallel image slices having any desired position and orientation. The image slices are extracted from a 14 GByte color 3D tomographic image striped over the available set of disks. On a 5 Bi-Pentium Pro PC server comprising 60 disks, the system is able to extract in parallel, resample and visualize 4.8 512x512 colour image slices per second. At the highest load and when file caching is disabled, an aggregate I/O disk bandwidth of 104 MBytes/s has been obtained. When caching is enabled, an I/O throughput of up to 240 MBytes/s is obtained.
The Visible Human Slice Server (http://visiblehuman.epfl.ch) started offering its slicing services at the end of June 1998. From that date until the end of May, more than 280'000 slices were extracted from the Visible Man, by laymen interested in anatomy, by students and by specialists. The Slice Server is based one Bi-Pentium PC and 16 disks. It is a scaled down version of a powerful parallel server comprising 5 Bi-Pentium Pro PCs and 60 disks. The parallel server program was created thanks to a computer-aided parallelization framework, which takes over the task of creating a multi-threaded pipelined parallel program from a high-level parallel program description. On the full blown architecture, the parallel program enables the extraction and resampling of up to 5 colour slices per second. Extracting 5 slices/s requires to access the disks and extract subvolumes of the Visible Human at an aggregate throughput of 105 MB/s. The publicly accessible server enables to extract slices having any orientation. The slice position and orientation can either be specified for each slice separatly or as a position and orientation relative to a previous slice. This contribution gives a first assessment of the slice access capabilities offered by a Java applet and possible future improvements. In the very near future, the Web Slice Server will offer additional services, such as the possibility to extract ruled surfaces and to extract animations incorporating slices perpendicular to a user defined trajectory.
Abstract. We propose a new approach for developing parallel I/O-and
Imaging applications such as filtering, image transforms and compression/decompression require vast amounts of cornputing power when applied to large data sets. These applications would potentially benefit from the use of parallel processing. However, dedicated parallel computers are expensive and their processing power per node lags behind that of the most recent commodity components. Furthermore, developing parallel applications remains a difficult task : writing and debugging the application is difficult (deadlocks), programs may not be portable from one parallel architecture to the other, and performance often comes short of expectations.In order to facilitate the development of parallel applications, we propose the CAP computer-aided parallelization tool which enables application programmers to specify at a high-level of abstraction the flow of data between pipelined-parallel operations. In addition, the CAP tool supports the programmer in developing parallel imaging and storage operations. CAP enables combining efficiently parallel storage access routines and image processing sequential operations. This paper shows how processing and I/O intensive imaging applications must be implemented to take advantage of parallelism and pipelining between data access and processing. This paper's contribution is (1) to show how such implementations can be compactly specified in CAP, and (2) to demonstrate that CAP specified applications achieve the performance of custom parallel code. The paper analyzes theoretically the performance of CAP specified applications and demonstrates the accuracy of the theoretical analysis through experimental measurements.
The traditional approach to the parallelization of linear algebra algorithms such as matrix multiplication and LU factorization calls for static allocation of matrix blocks to processing elements (PEs). Such algorithms suffer from two drawbacks : they are very sensitive to load imbalances between PEs and they make it difficult to take advantage of pipelining opportunities. This paper describes dynamic versions of linear algebra algorithms, where subtasks (matrix block multiplication, matrix block LU factorization) are dynamically allocated to PEs. It analyses theoretically the performance of the dynamic algorithms. This paper's contribution is to show that the dynamicpipelined linear-algebra algorithms can be specified compactly in CAP and yet achieve good performance. CAP is a C++ language extension for the specification of parallel applications based on macro-dataflow graphs. The CAP model, based on macro-dataflow graphs, is general and supports pipelining.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.