Share this page
Share this page E-mail this page Print this page RSS feeds
Home > Publications > Efficient scheduling of scientific workflows in a high performance computing cluster
Efficient scheduling of scientific workflows in a high performance computing cluster

Provenance is increasingly recognized as being critical to the understanding and reuse of scientific datasets. Given the rapid generation of scientific data from sensors and computational model results, it is not practical to manually record provenance for data and automated techniques for provenance capture are essential. Scientific workflows provide a framework for representing computational models and complex transformations of scientific data, and present a means for tracking the operations performed to derive a dataset. The Trident Scientific Workbench is a workflow system that natively incorporates provenance capture of data derived as part of the workflow execution. The applications used as part of a Trident workflow can execute on remote computational cluster, such as a supercomputing center on in the Cloud, or on the local desktop of the researcher and provenance on data derived by the applications is seamlessly captured. Scientists also have the option to annotate the provenance metadata using domai

In: Challenges of Large Applications in Distributed Environments (CLADE)

Publisher: ACM

Details

Type: Inproceedings
Pages: 63–68
ISBN: 978-1-60558-156-9
Address: New York, NY, USA