Managing Scientific Workflows
Workflows allow scientists to harness information technologies to accelerate scientific discovery. Scientific workflows can be used to drive workflow automation, optimization, and reproducible results. We are collaborating with scientists, researchers, and Microsoft developers to advance technology to handle the multi-Terabyte datasets that rise from computer simulations and instrumentation.
Highlights
Project Trident: A Scientific Workflow Workbench
This rich set of tools can be used to author workflows visually by using a catalog of existing activities and complete workflows. The workflow workbench provides a tiered library that hides the complexity of different workflow activities and services for ease of use. Learn more...
Example Projects
- Panoramic Survey Telescope and Rapid Response System (Pan-STARRS)
Incorporates scientific workflows to automate the data pipeline to bring processed telescope detections from the world's largest digital camera into science-ready databases.
Tools and Services
- Microsoft SQL Server 2008 Data Mining Add-ins for Microsoft Office 2007
Data mining directly from Microsoft Office Excel using SQL Server 2008. - Windows HPC Server 2008 Job Scheduler
Integrated graphical and command-line interface, with functionality exposed using the Open Grid Forum's HPC Basic Profile Web service. - Windows Workflow Foundation
Programming model, engine and tools for quickly building workflow enabled applications on Windows. - Computational Science and Numerical Methods on Academic Resource Center
Publications
- Trident Workbench: A Scientific Workflow System
White paper presenting Project Trident architecture and design details - Efficient Scheduling of Scientific Workflows in a High Performance Computing Cluster. Roger S. Barga, Dan Fay, Dean Guo, Steven Newhouse, Yogesh Simmhan, Alex Szalay. Challenges of Large Applications in Distributed Environments (CLADE), 2008.
- End-to-End Scientific Data Management Using Workflows. Yogesh Simmhan. International Workshop on Scientific Workflows (SWF), 2008.
- Karma2: Provenance Management for Data-Driven Workflows. Yogesh L. Simmhan, Beth Plale, Dennis Gannon. International Journal of Web Service Research, 5(2):1-22, 2008.
Presentations and Media
- Trident Scientific Workflow For Neptune
Microsoft Research Faculty Summit 2007 - Pan-STARRS: Learning to Ride the Data Tsunami
Maria A. Nieto-Santisteban, Yogesh Simmhan, Roger Barga, et, al.
Presenter: Maria A. Nieto-Santisteban - The eScience Appliance: Provisioning an Inexpensive Bottom-Up Cyberinfrastructure
Bill Howe and Roger Barga
Presenter: Bill Howe
