DryadInc: Reusing work in large-scale computations
- Mihai Budiu ,
- Yuan Yu ,
- Michael Isard
Workshop on Hot Topics in Cloud Computing 2009 (HotCloud 09) |
Published by USENIX - Advanced Computing Systems Association
Many large-scale (cloud) computations operate on append-only, partitioned datasets. We present two incremental computation frameworks to reuse prior work in these circumstances: (1) reusing identical computations already performed on data partitions, and (2) computing just on the newly appended data and merging the new and previous results.