Compositions created using database of well-known pop, classical and jazz artists
A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning.
Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.
Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.
“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer at Georgia Tech. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”
Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.
“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”
Shimon was created by Bretan’s advisor, Gil Weinberg, director of Georgia Tech’s Center for Music Technology.
“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”
Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.
Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example.
“They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.”
Shimon’s debut as a solo composer was featured in a video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June. It’s the latest project within Weinberg’s lab. He and his students have also created a robotic prosthesis for a drummer, a robotic third arm for all drummers, and an interactive robotic companion that plays music from a phone and dances to the beat.
The Latest on: Music robot
- Riverside-area students show off their skills with robots on April 17, 2019 at 6:53 pm
Middle school students made their robots avoid obstacles, play music and perform other feats Wednesday, April 17. It was part of a robotics and STEM celebration at Riverside’s Arizona Middle School in ... […]
- Dressy Bessy Announce More Tour Date, Brooklyn Vegan Premieres Music Video on April 17, 2019 at 10:33 am
A full list of dates is below. Today, Brooklyn Vegan premiered the video for "Tiny Lil Robots" (watch/share), the album's second single. Of the track, band member Tammy Eaolm shares, "Inspired my ... […]
- Review: Alan Parsons Live Project proves it's the music itself that counts most on April 17, 2019 at 10:27 am
Daneel Olivaw, who as a robot programmed to care witnessed pretty ... depth always outlasts flash — they’ll be playing his music on Mars and beyond long after the rest of us with our silly ... […]
- We’ve been warned about AI and music for over 50 years, but no one’s prepared on April 17, 2019 at 8:30 am
“I think courts and our general instinct would say, ‘Well, if an algorithm is only fed Beyoncé songs and the output is a piece of music, it’s a robot. It clearly couldn’t have added anything to this, ... […]
- Team of robot dogs haul a truck in latest Boston Dynamics video on April 17, 2019 at 6:44 am
“Ten robot dog power. It's kinda like horsepower but with a helping of skynet.“ “When AI takes over, they’re going use this as evidence to condemn us all.“ “Can you please add Star Wars' Imperial ... […]
- Watch a Squad of Headless Robot Dogs Haul a Truck, Military-Style on April 17, 2019 at 4:59 am
The robot, currently in production, is to be sold to interested parties, so don’t be surprised if sooner or later one pops up next door, doing God knows what. The Perversion of the Fast and the ... […]
- Behind the Music interview: Under the Silver Lake’s Disasterpeace on April 16, 2019 at 7:39 am
Behind the Music is an ongoing series that seeks to interview ... but catchy soundtracks to games like Shoot Many Robots, Hyper Light Drifter, and the notorious Fez, which has the chiptune ... […]
- Robot Butlers, Botox Stations And Instantly Changing Paint: The Life Of A Luxury Homebuyer on April 15, 2019 at 9:37 am
The property’s residents enjoy full-time robot butlers—tech-enabled helpers that can bring food and drinks, speak different languages, play music or even just engage in conversation. They also ... […]
- Raves, robots and writhing bodies: how electronic music rewired the world on April 14, 2019 at 10:00 pm
Pyramid selling … Daft Punk introduce dance music to a US rock audience at the 2006 Coachella festival. Photograph: Karl Walter/Getty “Maybe we gravitate to electronic music because it’s not too ... […]
- From Bad Robot receptionist to Sundance darling: What rising-star writer-director J.D. Dillard learned from J.J. Abrams about storytelling on April 10, 2019 at 3:11 am
Dillard is clearly past his days as a receptionist or amateur sous chef at Bad Robot, but he somehow just can’t stay away. He was recently ask to shoot a music video for a new artist signed to Bad ... […]
via Google News and Bing News