A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- Feed has no items.
via Bing News
The Latest on: Videos from themed text
- How Lynne Sachs Turns Spoken Language Into Cinematic Languageon July 13, 2020 at 7:17 am
A recurring theme in Sachs’s filmography is the elliptical tension of translating spoken language into visual language. From her video travelogue ... On-screen text sporadically appears to ...
- ISIS 'still evading detection on Facebook', report sayson July 13, 2020 at 6:15 am
Facebook accounts linked to the Islamic State group (ISIS) are still finding ways to evade detection on the social media platform, a new report claims. One network's tactics included mixing its ...
- ISIS 'still evading detection on Facebook'on July 13, 2020 at 6:13 am
One network's tactics included mixing its material with content from real news outlets, such as recorded TV news output and the BBC News theme music. It also hijacked Facebook accounts, and posted ...
- Lightening round: Top teams on how they’re thriving through 2020on July 13, 2020 at 1:02 am
Inman caught up with some of the nation's top teams to ask them a few questions to learn more about what makes their team special ...
- Pictory – An easy to use tool to create videos out of texton July 12, 2020 at 5:00 pm
Add article/blog/text to Summarize • Personalise as per your preference ... You can also change the audio and select theme for your video. The Ai powered tool automatically adds a realistic voiceover ...
- Ballyhoo Promotional Products, LLC is Excited to Announce the Launch of Our New Websiteon July 10, 2020 at 8:30 am
Ballyhoo Promotional Products has launched a new website, aimed at providing a wide range of promotional products and advertising specialties to promote your company.
- Analyzing “How Google Search Works” Changes from Googleon July 8, 2020 at 2:07 pm
Google has made some new substantial changes to their “How Google Search Works” search documents for website owners. And as always when Google makes changes to important documents with impact on SEO, ...
- Here are all the ways to stream Hulu, Netflix, Amazon, and more with friendson July 8, 2020 at 6:00 am
Once you're there, send the URL to your ad-free friends and they'll be able to watch along with basic text chat. A helpful little sync button will pop up anytime someone's feed falls behind. Other ...
- Behind Twenty One Pilots’ ‘Never-Ending’ ‘Concern’ Video: Tyler Joseph and Jason Zada on Getting Inventive Amid a Lockdownon July 2, 2020 at 3:41 pm
If you ever wanted to be part of big-name artist’s music video, the barrier for entry has never been lower. Tens of thousands of fans a day have been able to insert themselves into the fast ...
- Trump campaign snips and cuts Democrats’ remarks in misleading ad on violenceon July 1, 2020 at 1:00 am
The Trump campaign tried to build on that theme by releasing an ad Saturday — tweeted by Trump — that mixes shots of mayhem with quotes that suggest that Democratic lawmakers and former vice president ...
via Bing News