Communications of the ACM
Imaging Software Predicts How You Look With Different Hair Styles, Colors, Appearances
Given one or more photos, the Dreambit personalized image search engine allows a person to explore a variety of looks
Credit: University of Washington
Before going to the hair stylist, you can browse magazines with pictures of models and point to a style you'd like to try. Actors change appearances all the time to fit a role. Missing persons often disguise themselves by changing their hair style and color.
But can you tell how an appearance change will look without physically trying it? Or explore how a missing child might look with a changed appearance?
A new personalized image search engine called Dreambit, developed by a University of Washington computer vision researcher, lets a person see how he or she would look with a different hairstyle or color, or in a different time period, age, country, or anything else that can be queried in an image search engine.
After uploading an input photo to Dreambit, a user types in a search term — such as "curly hair," "India," or "1930s." The software's algorithms mine Internet photo collections for similar images in that category and seamlessly map the person's face onto the results.
Initial results are described in "Transfiguring Portraits," which be presented at SIGGRAPH 2016, the 43rd International Conference and Exhibition on Computer Graphics & Interactive Techniques. Plans are underway to make the system publicly available later this year.
Dreambit draws on previous research conducted at the UW and elsewhere in facial processing, recognition, three-dimensional reconstruction and age progression, combining those algorithms in a unique way to create the blended images.
The new software can also help show what a missing child or person evading the law might look like if their appearance has been purposefully disguised, or even how they would look at an advanced age if years have passed.
Developer Ira Kemelmacher-Shlizerman, UW assistant professor of computer science and engineering, and her team previously developed automated age progression software that focused only on a person's face. The new system adds varied hairstyle options and other contextual elements.
These new features enable one to imagine what a child might look five or 10 years into the future under different circumstances — with red hair, curly hair, black hair or even a shaved head.
"It's hard to recognize someone by just looking at a face, because we as humans are so biased towards hairstyles and hair colors," said Kemelmacher-Shlizerman. "With missing children, people often dye their hair or change the style so age-progressing just their face isn't enough. This is a first step in trying to imagine how a missing person's appearance might change over time."
Another potential application is to envision how a certain actor or actress might appear in a role. For example, the system can marry internet photographs of the actress Cate Blanchett and Bob Dylan to predict how she would appear playing the Dylan role in the movie "I'm Not There."
"This is a way to try on different looks or personas without actually changing your physical appearance," says Kemelmacher-Shlizerman, who co-leads the UW Graphics and Imaging Laboratory. "While imagining what you'd look like with a new hairstyle is mind blowing, it also lets you experiment with creative imaginative scenarios."
The software system analyzes the input photo and searches for a subset of internet photographs that fall into the desired category but also match the original photo's face shape, pose, and expression.
Its ability to accurately and automatically synthesize two photographs stems from the combination of algorithms that Kemelmacher-Shlizerman assembled, as well as the sheer volume of photos available on the internet.
"The key idea is to find a doppelgänger set — people who look similar enough to you that you can copy certain elements of their appearance," says Kemelmacher-Shlizerman. "And because the system has hundreds of thousands of photos to choose from, the matching results are spellbinding."
No entries found