Princeton > CS Dept > PIXL > Publications Local Access 

A Mixed-Initiative Interface for Animating Static Pictures
Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), October 2018

Nora S Willett, Rubaiat H Kazi, Michael Chen,
George Fitzmaurice, Adam Finkelstein, Tovi Grossman


An example of animating a static picture using our system. (a) The original picture. (b) The user scribbles some sample objects (green) and their overall motion direction (red). (c) The resulting animation consists of kinetic textures (including all the balloons) that are spatio-temporally consistent with the source picture, with proper depth ordering and an inpainted background.

Abstract

We present an interactive tool to animate the visual elements of a static picture, based on simple sketch-based markup. While animated images enhance websites, infographics, logos, e-books, and social media, creating such animations from still pictures is difficult for novices and tedious for experts. Creating automatic tools is challenging due to ambiguities in object segmentation, relative depth ordering, and non-existent temporal information. With a few user drawn scribbles as input, our mixed initiative creative interface extracts repetitive texture elements in an image, and supports animating them. Our system also facilitates the creation of multiple layers to enhance depth cues in the animation. Finally, after analyzing the artwork during segmentation, several animation processes automatically generate kinetic textures [Kazi 2014] that are spatio-temporally coherent with the source image. Our results, as well as feedback from our user evaluation, suggest that our system effectively allows illustrators and animators to add life to still images in a broad range of visual styles.

Citation (BibTeX)

Nora S Willett, Rubaiat H Kazi, Michael Chen, George Fitzmaurice, Adam Finkelstein, and Tovi Grossman. A Mixed-Initiative Interface for Animating Static Pictures. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), October 2018.

Paper & Video
  Paper (5 MB)
  Video (24 MB)

Supplemental Materials
  View Online
  Download All (70 MB)