A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- How to Make Compelling Q&A Videos to Build Trust in Your Brandon March 11, 2020 at 5:48 am
Video marketing continues to be a huge thing in 2020, for obvious reasons. There’s nothing quite as eye-catching as a high-quality video, and marketers can reap many benefits by repurposing ...
via Bing News
The Latest on: Videos from themed text
- 8 Best Video Editing Apps for Android in 2020on March 21, 2020 at 10:13 pm
There are multiple tracks for different media types, text elements, and backgrounds ... You can add a title at the beginning if the video is longer than ten seconds, but how it looks is based on theme ...
- How to use WhatsAppon March 21, 2020 at 10:00 am
Everything you need to know about the world's most popular messaging app, from the basics to advanced features.
- Just get through today: Sheltering in place amid a pandemicon March 20, 2020 at 7:20 pm
OAK PARK, Ill. (AP) - A week ago, I was that crazy parent. "Did you tell my friends' parents I can't hang out?" my teen protested. Yep, I basically did. Today, we are "sheltering in place," an order ...
- Windows 10 video reveals brand new interface — here’s what it’s likeon March 20, 2020 at 5:55 am
The result of the distinct shape and smoothly shaded colors over the dark (or white, if you choose the light theme ... this video, I’m not so sure about that anymore. As you can see there are two long ...
- 6 Best Basic and Free Video Editing Software Picks for 2020on March 19, 2020 at 11:01 pm
That’s when the magic starts to happen. Lumen5 uses an advanced algorithm to detect keywords in your text and cross-reference them with a library containing millions of images and video clips. The ...
- A trillion views in, Complex looks to make money from its booming TikTok audienceon March 19, 2020 at 9:00 pm
Called the Complex Tokover, the sponsorship includes brand mentions and advertiser input on the creators, content or challenges done in videos around a desired theme. The goal is to make the product a ...
- The Tokyo Footage & PR Video Collection, Offering Visual Assets for Promotions and Tourism of Tokyo, Has Been Updatedon March 18, 2020 at 12:31 am
In January 2020, new PR videos with a theme of Always Surprising were released ... v=Hm4sH—iwrsA Tokyo Tokyo Official Website: https://tokyotokyo.jp/ The original source-language text of this ...
- Crowded bars and theme parks: Why won't some people practice social distancing during coronavirus outbreak?on March 16, 2020 at 7:36 pm
As government officials plead with Americans to stay home to stop the coronavirus spread, psychologists give 3 reasons why some people don't listen.
- WhatsApp working on new self-destructing text messages feature: Reporton March 16, 2020 at 6:12 am
Similar to the Stories feature on the application, that lets users post pictures and videos for a limited period of time, this new feature will limit the timing on text and is expected to be ...
- How to make a video onlineon February 29, 2020 at 9:27 am
Use the right hand sidebar to choose the layout; you can also switch to a different colour theme if you prefer. Click on the plus sign in the middle of the screen to add a video, photo or text, or ...
via Bing News