Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Reenactment is then achieved by fast and efficient deformation transfer between source and target. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. The source sequence is also a monocular video stream, captured live with a commodity webcam. We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). Computer Vision and Pattern Recognition (CVPR), IEEE, June 2016. You can see the results (and an explanation of the technology) in this 6.5-minute video: Bush, Vladimir Putin, and Arnold Schwarzenegger) in video clips found on YouTube. To test the system, the researchers invited subjects to puppeteer the faces of famous people (e.g. The face swap is done by tracking the facial expressions of both the subject and the target, doing a super fast “deformation transfer” between the two, warping the mouth to produce an accurate fit, and rerendering the synthesized face and blending it with real-world illumination. The result is convincing and photo-realistic. By sitting in front of an ordinary webcam, you can, in real-time, manipulate the face of someone in a target video. But the technology is getting more and more creepy: you can now hijack someone else’s face in real-time video.Ī team of researchers at the University of Erlangen-Nuremberg, Max Planck Institute for Informatics, and Stanford University are working on a project called Face2Face, which is described as “real-time face capture and reenactment of RGB videos.”īasically, they’re working on technology that lets you take over the face of anyone in a video clip. While very interesting from a technological viewpoint, the idea of ‘photoshopping” video will certainly affect journalistic ethics and the trustworthiness of video evidence.įace swap camera apps are all the rage these days, and Facebook even acquired one this month to get into the game. It can map new facial expressions real time over video. Now take a look at Face2Face: Real-time Face Capture. I have already blogged about software that allows actors facial expressions to be edited in post.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |