A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- Feed has no items.
via Bing News
The Latest on: Videos from themed text
- Crowds flock to Six Flags Great Adventure in New Jersey ready to have some fun, masks in placeon July 6, 2020 at 4:35 am
It was a case of "better late than never" for fans of a sprawling NJ theme park who showed up in force for its long-awaited opening day amid COVID-19.
- Questions surround remaining months of 2020 campaign seasonon July 5, 2020 at 5:09 pm
Let's face it, this first half of 2020 has been a flaming pile of garbage. Do you expect a new year to be fresh and hopeful and exciting? You know, it's like a blind date. We all hope 2020 was going ...
- A night to rememberon July 5, 2020 at 7:14 am
The loss of the memory of senior prom was recouped for some 2020 graduates, as they gathered at Spindletop-Gladys City Boomtown Museum on a recent Friday night for a private prom organized by West ...
- Line erroron July 5, 2020 at 12:58 am
I set the hook, and my braided line snapped. That ended my good feeling. When nothing else panned out, Shatley took us to a place where a local angler caught five bass with a total weight of about 25 ...
- Behind Twenty One Pilots’ ‘Never-Ending’ ‘Concern’ Video: Tyler Joseph and Jason Zada on Getting Inventive Amid a Lockdownon July 2, 2020 at 3:41 pm
If you ever wanted to be part of big-name artist’s music video, the barrier for entry has never been lower. Tens of thousands of fans a day have been able to insert themselves into the fast ...
- DO NOT PUBLISH What motivates Rochester employees the most? It's not what you thinkon July 1, 2020 at 4:49 pm
The Democrat and Chronicle’s 2020 Top Workplaces survey indicates that, most of all, employees want to be at a company that operates by strong values.
- Trump campaign snips and cuts Democrats' remarks in misleading ad on violenceon July 1, 2020 at 5:42 am
Since protests against police brutality broke out in response to the killing of George Floyd, President Donald Trump has declared himself the "law and order" candidate and sought to highlight ...
- Dharmendra embraces unique dancing style, shares clip from 1981 film Aas Paason June 28, 2020 at 7:31 pm
Earlier in the day, Dharmendra Deol recalled the fond memories associated with his hit flick 'Pratiggya', and shared a brief video clip of the ever-hit song from the film as the movie clocked 45 years ...
- Twenty One Pilots Launch ‘Never Ending’ Video With Steady Stream of Fan Input (Watch)on June 23, 2020 at 3:35 pm
Just when you thought that lengthy quarantining might mean you’d have a chance to get completely caught up on the Internet, Twenty One Pilots have come along to remind you that that goal ...
- All the highlights from Apple's WWDC 2020 keynoteon June 22, 2020 at 11:09 am
Welcome to the lockdown edition of Apple's WWDC, its annual developer conference. This year it's all virtual, beamed from an empty Apple Park, and free to attend but as per Cupertino tradition, Apple ...
via Bing News