New video editing technique could save time and reduce costs for the film industry.
Hyeongwoo Kim from the Max Planck Institute for Informatics explains:
It works by using model-based 3D face performance capture to record the detailed movements of the eyebrows, mouth, nose, and head position of the dubbing actor in a video. It then transposes these movements onto the ‘target’ actor in the film to accurately sync the lips and facial movements with the new audio.
The research is currently at the proof-of-concept stage and is yet to work at real time, however the researchers anticipate the approach could make a real difference to the visual entertainment industry.
Professor Christian Theobalt, from the Max Planck Institute for Informatics, said:
Despite extensive post-production manipulation, dubbing films into foreign languages always presents a mismatch between the actor on screen and the dubbed voice.
Our new Deep Video Portrait approach enables us to modify the appearance of a target actor by transferring head pose, facial expressions, and eye motion with a high level of realism.
Co-author of the paper, Dr Christian Richardt, from the University of Bath’s motion capture research centre CAMERA, adds:
This technique could also be used for post-production in the film industry where computer graphics editing of faces is already widely used in today’s feature films.
A great example is ‘The Curious Case of Benjamin Button’ where the face of Brad Pitt was replaced with a modified computer graphics version in nearly every frame of the movie. This work remains a very time-consuming process, often requiring many weeks of work by trained artists.
Deep Video Portraits shows how such a visual effect could be created with less effort in the future. With our approach even the positioning of an actor’s head and their facial expression could be easily edited to change camera angles or subtly change the framing of a scene to tell the story better.
In addition, this new approach can also be used in other applications, which the authors show on their project website, for instance in video and VR teleconferencing, where it can be used to correct gaze and head pose such that a more natural conversation setting is achieved. The software enables many new creative applications in visual media production, but the authors are also aware of the potential of misuse of modern video editing technology.
Dr Michael Zollhöfer, from Stanford University, explains:
The media industry has been touching up photos with photo-editing software for many years, meaning most of us have learned to take what we see in photos with a pinch of salt. With ever improving video editing technology, we must also start being more critical about the video content we consume every day, especially if there is no proof of origin. We believe that the field of digital forensics should and will receive a lot more attention in the future to develop approaches that can automatically prove the authenticity of a video clip. This will lead to ever better approaches that can spot such modifications even if we humans might not be able to spot them with our own eyes.
To address this, the research team is using the same technology to develop in tandem neural networks trained to detect synthetically generated or edited video at high precision to make it easier to spot forgeries. The authors have no plans to make the software publicly available but state that any software implementing the many creative use cases should include watermarking schemes to clearly mark modifications.
The Latest on: Artificial intelligence
via Google News
The Latest on: Artificial intelligence
- Jeffrey Tarrant Saw Artificial Intelligence as the Future of Managing Moneyon August 16, 2019 at 12:30 pm
Even while being treated for the brain cancer that would cut his life short, Jeffrey Tarrant was searching for the next frontier in investing. He figured it would involve the use of artificial ...
- Artificial Intelligence in Computer Networks Market 2019 Global Trend, Segmentation and Opportunities Forecast To 2025on August 16, 2019 at 9:48 am
Aug 16, 2019 (Heraldkeepers) -- Wiseguyreports.Com adds "Artificial Intelligence in Computer Networks Market -Market Demand, Growth, Opportunities, Analysis of Top Key Players and Forecast to 2025" To ...
- Artificial Intelligence (AI) Robots Market with Growing CAGR in Forecast Period 2019 to 2026on August 16, 2019 at 6:30 am
Aug 16, 2019 (Global QYResearch via COMTEX) -- A new research report titled “Global Artificial Intelligence (AI) Robots Market” successfully exhibits the complete scenario of the global and an ...
- New York-based artificial intelligence unicorn co. hires 71 for Houston office, aims to hire moreon August 16, 2019 at 6:26 am
New York-based UiPath Inc., one of the world’s largest artificial intelligence-focused startups, is officially opening its Houston office Aug. 22. Marie Myers, the Houston-based CFO of UiPath and a ...
- 'Stereotyping' emotions is getting in the way of artificial intelligence. Scientists say they've discovered a better way.on August 16, 2019 at 5:07 am
If you want to understand what people are feeling, you have to look beyond surface-level cues. Technology like AI could fall short without this.
- Staying Smart: How artificial intelligence could impact companies, customers and competitionon August 16, 2019 at 4:00 am
Until recently, artificial intelligence (AI) was limited to movies and science fiction. That’s rapidly changing however as advances in computing power and the creation of massive data sets have made ...
- Artificial Intelligence Technology Solutions Receives PO for High End Retail Location Owned by Billion Dollar Real Estate Fundon August 15, 2019 at 11:10 am
RENO, NV, Aug. 15, 2019 (GLOBE NEWSWIRE) -- via NEWMEDIAWIRE – Artificial Intelligence Technology Solutions, Inc. (AITX:OTCPK), is pleased to announce that Robotic Assistance Devices (RAD), its ...
- The Skeptic's Guide To Assessing Artificial Intelligenceon August 15, 2019 at 5:32 am
Humans have a tendency to race toward the next big breakthrough. In the 1960s, we were part of a race to the moon. The early 2000s was a race for the best consumer electronics. Now we are on a race ...
- Artificial Intelligence In Fintech - Two CEOs Perspectiveson August 15, 2019 at 5:11 am
Philippe Branche: First, could you describe your company in a few words? Simon Loong: WeLab is a fintech company providing seamless digital financial services. Today, we have more than 800 employees ...
via Bing News