Jingyi Li & Michelle Nguyen

UC Berkeley's Computational Photography 2015

Paper (PDF)  /  Software

AniME (stress on the "me") is a Python pipeline which, given a user input photo, automatically generates a corresponding stylized anime portrait by template matching to a hand-drawn (by me!) library. We wanted to combine vision algorithms to generate a fun, speculative system paying homage to the media we grew up watching.

The anime technical pipeline.

Abstract

The popularity of anime (Japanese animated productions) has transcended cultural boundaries, resulting in high volumes of fan works such as personalized avatars. However, drawing aesthetically pleasing anime is a craft that takes a long time to develop. AniME (pronounced ani-mee) is a pipeline which integrates computer vision, computational photography, and data-driven frameworks to automatically generate an anime-style portrait from a user given photo. Our approach renders the corresponding lineart using landmark facial annotations, while features such as eye shape and hairstyle are obtained via template matching to a hand-drawn library of anime eyes and hairstyles. Finally, colors of the anime portraiture are determined through simple averaging and clustering of selected image patches. We validate our tool using photos of people of varying genders, ethnicities, and hair styles.