A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- How to Write a Video Script for Your Corporate Filmon September 29, 2016 at 8:20 am
Limp, confused and messy. In other words, if you’re creating a corporate film then you’re going to need a video script. (There are exceptions; a filmed testimonial shouldn’t be scripted ...
- Poll: Have you ever tried to write a video game?on May 9, 2011 at 6:00 am
I've dabbled in writing simple quiz-style games, but I don't consider that really trying to write a video game. Have you ever put effort into developing a video game? J.Ja ...
- You Never Call! You Never Write!: A Videoon April 11, 2007 at 5:00 pm
via Bing News
The Latest on: Videos from themed text
- Budget 2020: Govt has refused to look at serious reform measures, writes P Chidambaramon February 1, 2020 at 4:29 pm
Union Budget 2020 India: It is a matter of grave doubt if the BJP government has an underlying economic philosophy at all.
- PETA shredded for Kaepernick-themed Super Bowl ad the group claims was rejected by the NFLon February 1, 2020 at 11:29 am
Animal rights organization PETA is under fire after claiming the group's Colin Kaepernick-inspired Super Bowl advertisement was rejected by FOX and the NFL because the message was "too daring." The ...
- Super Bowl 2020: Here's all the space-themed commercials so faron February 1, 2020 at 5:03 am
At the end of one of the videos, this text scrolls across the screen: "This is a fictional story ... Walmart, not to be left out of all of the intergalactic fun, will also air a space-themed ...
- TikTok Bans Pro-Life Org Live Action for Unspecified ‘Multiple Community Guidelines Violations’on January 31, 2020 at 8:53 am
Pro-life organization Live Action said that it had been permanently banned from the social-media platform TikTok “due to multiple Community Guidelines violations.” ...
- You Can Visit Britney Spears' Music Videos At This New Pop-Upon January 30, 2020 at 10:31 am
I Did It Again" video. (The Zone Los Angeles) When you're hitting the Grove, you can now head just across the street to visit a Britney Spears-themed pop-up: The Zone ... We collected data from nearly ...
- Want to Be a Great Leader? Get People to Pay Attention to Your Visual Imageson January 30, 2020 at 4:38 am
Text and audio can come naturally, to a certain extent ... Visual media include banners and billboards, cartoons, commercials, art, graphics, photos, videos, webinars, workshops, and more. If you want ...
- Snickers Super Bowl ad wants to feed Earth giant candy bar to fix world's problemson January 29, 2020 at 11:29 pm
The Snickers ad takes a cynical look at the world today: deriding men who ride scooters; people who text dirty photos; parents who name their kids after produce ... The ad ends with a couple of video ...
- What Is Modern Web Design in 2020? 20 Stunning Exampleson January 29, 2020 at 2:09 am
The design is packed with interactive features, from text and video stories to places to upload your dreams and information ... The examples above all carry a common theme, and you may see many of the ...
- RTI Continues to Spotlight ‘Resimercial’ Theme at ISEon January 27, 2020 at 8:45 am
Additionally, RTI will showcase media distribution via its VHD-4x and VHD-8x HDBaseT matrix switches and VMS-741 4K quad multi-viewer, which has seven video inputs ... “Dealers are notified via email ...
- 'Jobs at Apple' page refreshed with animated logos, new videoon January 24, 2020 at 4:42 am
In the latest version, colorful animated interpretations of the Apple logo, surrounding the text "Join Us. Be You," and a link to a promotional film. The video is a continuation of the page's theme, ...
via Bing News