Project funded by Intel Research Labs (AIM program)
We are developing tools for stylized content creation, via interfaces for (1) easily sketching general free-form shapes, and then (2) directly annotating those shapes with hand-drawn strokes resembling pencil, pen, pastel, or other media. The resulting 3D scene will look much like a drawing, even as it is animated or viewed interactively. Applications of this technology include technical illustration, architecture, education, virtual reality, animation, advertising, and games – any context in which dynamic imagery is used to tell stories, communicate, explain, or inform.
The problem of generating new 3D content is especially difficult when the resulting imagery must be photorealistic. Our key observation is that with techniques of illustration, much less input may be required, even to depict complex, organic scenes. The illustrator can evoke complexity with relatively few carefully stylized strokes. While artists have applied this principle for centuries, it has been largely overlooked in 3D computer graphics. Current modeling tools do not offer many options for creating stylized 3D scenes with the visual qualities of hand-drawn animations.
In addition to simplifying the input required of a designer, there are a number of other advantages to creating stylized scenes. For example, illustrators use stylized imagery in order to focus the viewer’s attention on important features while downplaying extraneous details. Architects often prefer drawings in order to imbue a scene with a specific mood or to convey a quality of unfinishedness. Because stylized renderings are often easier to understand, they are used in contexts ranging from medical illustrations to portraits in the Wall Street Journal. Finally, stylized imagery can be more engaging, as evidenced by its prevalence in books, games, and movies targeted for children.
A recent branch of research generally described as non-photorealistic rendering (NPR) brings principles of illustration to bear in computer graphics. For an survey of NPR methods see the books by Gooch and Gooch and Strothotte and Schlechtweg or this web page by Craig Reynolds. The bulk of the effort in this area has focused on rendering algorithms. However, few tools have been developed to make these algorithms available to designers.
Our hypothesis is that giving designers direct access to NPR algorithms through a drawing interface will empower them to make complex, organic scenes more easily and quickly than can be done with conventional modeling tools. We intend to verify the hypothesis by constructing a system based on these principles and demonstrating its utility in constructing natural scenes. Our goal is to put test our prototypes in the hands of a variety of users – both novices and experts, both artists and non-artists. Please watch this page for links to downloadable software.