Cliplets: Juxtaposing still and dynamic imagery
Symposium on User Interface Software and Technology (UIST) 2012. (Best Paper Award)
Cinemagraphs and more general spatiotemporal compositions from handheld video.
We explore creating cliplets, a form of visual media that juxtaposes still image and video segments, both
spatially and temporally, to expressively abstract a moment. Much as in cinemagraphs, the tension between
static and dynamic elements in a cliplet reinforces both aspects, strongly focusing the viewer's attention.
Creating this type of imagery is challenging without professional tools and training. We develop a set of
idioms, essentially spatiotemporal mappings, that characterize cliplet elements, and use these idioms in an
interactive system to quickly compose a cliplet from ordinary handheld video. One difficulty is to avoid
artifacts in the cliplet composition without resorting to extensive manual input. We address this with
automatic alignment, looping optimization and feathering, simultaneous matting and compositing, and
Laplacian blending. A key user-interface challenge is to provide affordances to define the parameters of
the mappings from input time to output time while maintaining a focus on the cliplet being created. We
demonstrate the creation of a variety of cliplet types. We also report on informal feedback as well as a
more structured survey of users.
With cliplets, the user interactively sketches static and dynamic regions, each assigned
a uniform looping period.
Our subsequent work
Automated video looping
animates the entire scene without user assistance,
and uses combinatorial optimization to infer the optimal looping interval for each pixel.
See some nice professionally created cinemagraphs at
ACM Copyright Notice
Copyright by the Association for Computing Machinery, Inc. Permission to make digital or
hard copies of part or all of this work for personal or classroom use is granted without fee provided that
copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the
full citation on the first page. Copyrights for components of this work owned by others than ACM must be
honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to
redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications
Dept, ACM Inc., fax +1 (212) 869-0481, or firstname.lastname@example.org. The definitive version of this paper can be
found at ACM's Digital Library http://www.acm.org/dl/.