A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text.
In a world of novice photographers and videographers, capturing a deluge of content via their smartphones and handheld devices, there is a need for an intelligent, easy-to-use tool for automating the creation of movies and video montages. To date, many quality videos still rely on professional frame-based editing tools to manipulate raw footage and produce a coherent video with a captivating storyline.
A global team of computer scientists, from Tsinghua and Beihang Universities in China, Harvard University in the US and IDC Herzliya in Israel, have developed “Write-A-Video”, a new tool that generates videos from themed text. Using words and text editing, the tool automatically determines which scenes or shots are chosen from a repository to illustrate the desired storyline. The tool enables novice users to produce quality video montages in a simple and user-friendly manner that doesn’t require professional video production and editing skills.
The team is set to present their work at ACM SIGGRAPH Asia, held Nov. 17 to 20 in Brisbane, Australia. SIGGRAPH Asia, now in its 12th year, attracts the most respected technical and creative people from around the world in computer graphics, animation, interactivity, gaming, and emerging technologies.
While existing video editing tools still demand knowledge in video processing and editing, the researchers’ new method allows novices to create videos that tell stories more naturally. Write-A-Video, say the researchers, allows users to create a video montage by simply editing the text that accompanies the video. For example, adding or deleting text, and moving sentences around convert to video-editing operations, such as finding corresponding shots, cutting and rearranging shots, and creating a final video montage result.
“Write-A-Video uses current advances in automatic video understanding and a unique user interface to allow more natural and simpler video creation,” says Professor Ariel Shamir, Dean of the Efi Arazi School of Computer Science at IDC Herzliya. “With our tool, the user provides input mostly in the form of editing of text. The tool automatically searches for semantically matching candidate shots from a video repository, and then uses an optimization method to assemble the video montage by cutting and reordering the shots automatically.”
“Write-A-Video also allows users to explore visual styles for each scene using cinematographic idioms generating, for example, faster or slower paced movies, less or more content movements, etc.” explains Dr. Miao Wang from Beihang University.
When selecting candidate shots from the video repository, the method also considers the aesthetic appeal of the shots, choosing those that are ideally lit, that are well focused and are not blurry or unstable. “At any point, the user can render the movie and preview the video montage result with an accompanying voice-over narration.” says Professor Shi-Min Hu from Tsinghua University.
The team’s research shows that intelligent digital tools combining the abilities of humans and algorithms together can assist users in the creative process. “Our work demonstrates the potential of automatic visual-semantic matching in idiom-based computational editing, offering an intelligent way to make video creation more accessible to non-professionals,” says Shamir.
For the study, the approach was tested on various pieces of themed text and video repositories, with quantitative evaluation and user studies. Users without any video editing experience could produce satisfactory videos using the Write-A-Video tool, sometimes even faster than professionals utilizing frame-based editing software. At SIGGRAPH Asia, the team will demonstrate the Write-A-Video application and showcase a variety of examples of text-to-video productions.
The Latest on: Write-A-Video
- Feed has no items.
via Bing News
The Latest on: Videos from themed text
- Twenty One Pilots Launch ‘Never Ending’ Video With Steady Stream of Fan Input (Watch)on June 23, 2020 at 2:39 pm
Just when you thought that lengthy quarantining might mean you’d have a chance to get completely caught up on the Internet, Twenty One Pilots have come along to remind you that that goal ...
- All the highlights from Apple's WWDC 2020 keynoteon June 22, 2020 at 11:09 am
Welcome to the lockdown edition of Apple's WWDC, its annual developer conference. This year it's all virtual, beamed from an empty Apple Park, and free to attend but as per Cupertino tradition, Apple ...
- The latest money scams you should be aware ofon June 21, 2020 at 4:06 am
Scams are on the rise in the UK as fraudsters exploit the COVID-19 crisis to decieve Brits and steal their money and personal information.
- Covid-themed Father's Day cards drive record sales as families stay connected in lockdownon June 19, 2020 at 11:16 am
Moonpig has set sales records while John Lewis saw demand soar by 400 per cent on last year Covid themed Father's Day cards have proven popular after online stores have seen sales records in lockdown.
- Louisville commits forming bond for future successon June 19, 2020 at 9:57 am
From the moment that Aaron Gunn and Victoine Brown became the first two to announce for Louisville in March, each new addition has become part of an effort to attract others to follow their lead. The ...
- Tyga Drops New "Vacation" Video and Launches Conteston June 19, 2020 at 6:55 am
Tyga's latest visual feast is accompanied by the launch of a trip contest for those who've been on the front lines of COVID-19 and/or social justice efforts.
- Smoke Plumes Rise From Bighorn Fire in Arizona’s Pima Countyon June 17, 2020 at 9:45 pm
The Bighorn Fire burning in the Santa Catalina Mountains northwest of Tucson, Arizona, had grown to more than 31,000 acres as of June 18, according to reports. A lightning strike ignited the fire on ...
- [VIDEO] Two Guys Recreate Harry Potter Theme Using Washing Machineon June 15, 2020 at 7:10 pm
The lockdown period has brought out a lot of people’s creative sides. The perfect example would be a recreation of the Harry Potter theme music using a washing machine. Yes, it may sound ...
- Pete Evans shares bizarre Star Wars-themed videoon June 8, 2020 at 10:56 pm
The Stars Wars-themed video appeared to be from social media star Jo Yi. Jo is a psychiatrist who calls himself the 'street MD'. He promotes 'wellness from a street perspective' and shares his ...
- NASA Astronaut Calls Out ‘Propaganda’ in Space-Themed Trump Ad That Broke NASA Ruleson June 6, 2020 at 5:08 am
The video has now been replaced by text that reads, “This video has been removed by the uploader.” In the now-removed campaign video, filled with hyperbole and low-brow appeals to American ...
via Bing News