A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- Experiment shows human speech generates droplets that linger in the air for more than 8 minuteson May 14, 2020 at 6:33 am
Ordinary speech can emit small respiratory droplets that linger in the air for at least eight minutes and potentially much longer, according to a study published Wednesday that could help explain ...
- Dishonored Writer's New Novel Shows a Video Game Generation Being Bornon April 29, 2020 at 5:00 pm
Pro tip for anyone wanting to write a video game: "If it's longer than a tweet, a character should The excerpt that follows main character Russell Marsh looking back to the time that he realized ...
via Bing News
The Latest on: Videos from themed text
- The U.S. Army Band: They're playing our songon May 24, 2020 at 12:24 pm
The mission of these military musicians, who performed the "Sunday Morning" theme "Abblasen," is to remind us of the power of music to connect us ...
- Making low-cost digital tools the critical solution to smallholder farmers’ needs during global criseson May 23, 2020 at 5:01 pm
Digital information-sharing tools such as audio, text and video messaging through mobile phones can prove to be highly effective in disseminating critical information to smallholder farmers during ...
- Why Players Around the World Gobbled Up Pac-Manon May 22, 2020 at 3:15 am
Born 40 years ago, the hungry little critter turned women and children into gamers, changing the industry forever ...
- Apple Highlights Global Accessibility Awareness Day With App Store Features and New Today at Apple Videoon May 21, 2020 at 6:49 am
Apple today is marking Global Accessibility Awareness Day with several new features across its sites and services to promote inclusion and access ...
- Dear Dancer: A Video Chain Letter to Move Youon May 21, 2020 at 6:08 am
That's the theme of “Dear Dancer,” a short film by KQED, which draws on crowd-sourced video clips from 16 dancers across the country. In it, you'll find the dancers moving as if a single being, with ...
- A Look Back at All of Jeffree Star’s Beauty Controversies, From Feuds to New Product Debateson May 19, 2020 at 3:58 pm
Jeffree Star has come under fire yet again, but this time, it's not for a messy Twitter feud involving a fellow member of the makeup community or an underaged Kardashian.
- RNC video takes Biden, Obama, Wasserman Schultz out of context on mail-in votingon May 14, 2020 at 1:02 pm
A new video launched by the Republican National Committee suggests Democrats are pushing a "radical plan to change our elections" through widespread mail-in voting. "This is a rad ...
- Teen creates Disney themed sidewalk chalk arton May 6, 2020 at 12:27 pm
Katie Wemhoener, 17, of Belleville created this Disney themed masterpiece ... that defines your life under COVID-19. Please text us a photo or video that captures how your life has changed.
- Trump Is Yoda in Insane Star Wars Day Campaign Videoon May 4, 2020 at 12:27 pm
President Donald Trump is Jedi Master Yoda in a new official campaign video. The Trump administration is getting in on the Star Wars Day festivities, though it's a bit on the violent side.
- 5 hot video app start-upson May 4, 2020 at 3:02 am
A common theme among many of these emerging video ... "A combination of recorded audio, video, and text is the most effective way to document and share information from a live conversation ...
via Bing News