Compositions created using database of well-known pop, classical and jazz artists
A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning.
Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.
Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.
“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer at Georgia Tech. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”
Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.
“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”
Shimon was created by Bretan’s advisor, Gil Weinberg, director of Georgia Tech’s Center for Music Technology.
“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”
Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.
Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example.
“They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.”
Shimon’s debut as a solo composer was featured in a video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June. It’s the latest project within Weinberg’s lab. He and his students have also created a robotic prosthesis for a drummer, a robotic third arm for all drummers, and an interactive robotic companion that plays music from a phone and dances to the beat.
The Latest on: Music robot
KLM's new airport robot Care-E will guide you to the gate
on July 12, 2018 at 1:30 am
World-famous Armenian violinist Sergey Khachatryan will open the 12th Yerevan International Music Festival on 10 September. Aram... At least 27 people have been killed in the city of Sanandaj, Iran, a... […]
'The Future of Music: Computer or Composer'
on July 11, 2018 at 1:49 pm
Could a robot be the next Mozart or Lin-Manuel Miranda? Can algorithms coexist usefully with human rhythms and rhymes? This is the topic of "The Future of Music: Computer or Composer," the latest in t... […]
Temi’s personal home robot adding ‘Ok Google’ & Assistant, launching this year for $1,499
on July 11, 2018 at 10:15 am
This robot can come to you wherever you are in the house and in-turn follow you to continue a video call or play music. Another useful feature is a wireless charging tray on the device’s rear so that ... […]
Insane Robots Xbox One review: Simple formula with a deep experience
on July 10, 2018 at 1:04 pm
Aside from the excellent gameplay, the visuals, sound design and music for Insane Robots is amazing. Each robot character is creatively drawn and animated, then given a unique personality which gets r... […]
temi Robot Selects Newsight's NSI3000 CMOS Image Sensor for the temi Personal Robot 3D Vision System
on July 10, 2018 at 12:59 pm
temi is a personal robot that aims to become an essential addition to every ... control of all smart home devices, enjoyment of music and videos from any room in the home, a vastly superior AI assista... […]
4 can't-miss live music events in NYC this weekend
on July 10, 2018 at 7:39 am
If you love live music, there's no time like the present when it comes to ... When: Friday, July 13, 7-10 p.m. Where: (Le) Poisson Rouge, 158 Bleecker St. Don't miss the nearly sold-out robot-powered ... […]
There's Spooky Plasma Music Traveling From Saturn to its Weirdest Moon
on July 10, 2018 at 5:53 am
Two weeks before Cassini, a robot probe, destroyed itself in a controlled dive into Saturn's whirling atmosphere, it heard the gas giant sing to its weirdest moon. When Cassini passed between Saturn a... […]
Save up to $140 on Alexa-enabled smart robot vacuums — and more of today's best deals from around the web
on July 9, 2018 at 9:54 am
Robot vacuums can help keep your home tidy in between chores ... Secret sales like this rarely happen, so you don't want to miss out. Amazon Music Unlimited is a paid music-streaming service that has ... […]
Big Clapper is a $4,500 robot that will applaud you until the day you die
on July 9, 2018 at 8:00 am
You can get it to clap basic rhythms, clap on demand, clap along with music, or program it to say whatever you like using an accompanying app. The robot’s eyes are also designed in a way that makes it ... […]
Union workers picket in Las Vegas, worried about pay, security and robots taking their jobs
on July 6, 2018 at 11:45 pm
Robots have slowly been elevating their profile in Las Vegas ... sense of nervousness — noting that Paddock had scoped out Life is Beautiful, an outdoor music and art festival downtown, as a possible ... […]
via Google News and Bing News