Compositions created using database of well-known pop, classical and jazz artists
A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning.
Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.
Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.
“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer at Georgia Tech. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”
Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.
“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”
Shimon was created by Bretan’s advisor, Gil Weinberg, director of Georgia Tech’s Center for Music Technology.
“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”
Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.
Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example.
“They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.”
Shimon’s debut as a solo composer was featured in a video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June. It’s the latest project within Weinberg’s lab. He and his students have also created a robotic prosthesis for a drummer, a robotic third arm for all drummers, and an interactive robotic companion that plays music from a phone and dances to the beat.
The Latest on: Music robot
- Super Robot Wars DD Gets New Gameplay Via Ongoing Beta on December 14, 2018 at 4:10 pm
Super Robot Wars DD, the latest mobile spinoff that features more ... The gameplay shows off some of original unit Daedalion’s attacks and music, how the general gameplay flow is like, and more. Durin... […]
- Anki's Vector, the adorable mini robot, is getting Alexa on December 14, 2018 at 8:27 am
The fully autonomous robot, which rolled into homes in November ... You can ask Alexa to turn up the heat or other basic functions, but you can't stream music, call contacts or access its Kindle and A... […]
- Russia’s Most Advanced Robot Boris is Actually a Man in a Robot Suit on December 14, 2018 at 4:03 am
Or a robot. The Guardian reports that Russia24 praised Boris as ... Part Two (Final) Headwave TAG Helmet Music and Navigation System Reviewed […]
- German LIECTROUX Humanoid Dance Robot Debuts In The 26th Intelligent Robot Carnival on December 14, 2018 at 2:06 am
a group of humanoid dance robots perform various dances with music. Whether it is dynamic street dance, light and beautiful ballet or characteristic ethnic dance, humanoid dance robot can achieve perf... […]
- Anki's cute Vector robot will soon get Alexa integration on December 13, 2018 at 11:38 pm
The robot will switch modes and will show a blue ring on its screen ... But it still can't replace your Echo speaker: Anki said you still can't use Alexa on Vector to stream music, call contacts and t... […]
- Consumer robots are dead; long live Alexa on December 13, 2018 at 11:28 am
Well, over the past four years we have seen the rise of headless robots. We know them as smart speakers like Amazon Echo and Google Home. Whereas Jibo and Kuri could play music, answer some questions ... […]
- Robot with a neck? High-tech bot turns out to be guy in a costume on December 13, 2018 at 11:10 am
"I understand mathematics well, but I want to learn more, like how to draw and write music," Boris said. The Proyektoria presenter didn't say the robot was real, but in a report Tuesday, Russia-24 sta... […]
- Robot Successfully Delivers Coral Babies to Great Barrier Reef on December 13, 2018 at 9:21 am
More on Geek.com: Walmart Is Testing ‘Flippy’ the Robot Fry Cook Jimmy Fallon, Sophia the Robot Make Oddly Beautiful Music Together Intel Falcon 8+ Drones Find New Calling as Bridge Inspectors […]
- Postmates' Quest to Build the Delivery Robot of the Future on December 13, 2018 at 6:00 am
Painted it in bright colors, found more cute music to play. Then someone sketched up Serve, more like a child-sized shopping cart, and they knew they had it right. Creating an anthropomorphic robot is ... […]
- Save $125 on an Alexa-enabled smart robot vacuum — and more of today's best deals from Amazon on December 12, 2018 at 10:07 am
It also features Amazon's Alexa smart assistant, so you can use your voice to pause videos, play music, open apps, or check the weather. Amazon Fire HD 10 Tablet with Alexa Hands-Free 32GB, $99.99 (Or... […]
via Google News and Bing News