We've often seen the digitized faces of famous actors used in video games. This process requires technologies like motion capture, which is a huge effort for everyone involved. However, at the University of Washington, researchers have developed a system that can create digital replicas of a celebrity using paparazzi photos as source, applying facial tracking algorithms to them. The result is excellent.
Many were impressed by Kevin Spacey's performance in Call of Duty: Advanced Warfare. And it's fair to call it a performance because he didn't just lend his voice to the character Jonathan Irons, but also his image. This isn't the first time this has happened, and it certainly won't be the last. Ellen Page and Willem Dafoe did the same in Beyond: Two Souls, and Nathan Fillion's appearance in Halo 5 was confirmed. Of course, the list is much longer, but I imagine a good part of the appeal of digitizing a celebrity is the technical challenge it imposes. Motion capture and laser scanning are precision technologies, but that doesn't mean they're magical solutions. On the other hand, we must consider the physical availability of the actor or actress. High-level commitments, travels to the other side of the world, and chaotic schedules can make it impossible for a specific person to participate in a video game, unless... their image comes from somewhere else.
A New Approach
That's exactly what a group of researchers at the University of Washington has achieved. In essence, the system doesn't rely on traditional motion capture, but uses photographs as a source, whether promotional or snapped in a hurry by the paparazzi of the day. The most interesting part is that each face becomes a kind of digital puppet. When applying a video to animate the scene, the celebrity can not only use their face, but also those of others. It's quite strange to hear our friend Arnold with Kevin Spacey's voice, but the system makes that trick completely viable.
Another aspect to consider is the use of images of deceased actors. The case of Furious 7 with the digital introduction of Paul Walker speaks for itself, and the $1.5 billion in box office provides strong backing. If experts manage to refine this technology, the possibility of seeing familiar old faces in video games or animated films is quite high. Even so... there's the issue of rights. As an example, the T-800 in Terminator: Salvation had Arnold's face only because the actor decided to lend his image for the CGI process. I imagine that interested celebrities will carefully study any proposal to use their image as a digital avatar if this gains more traction...
Official site: 3D Persona Project
