Compositions created using database of well-known pop, classical and jazz artists
A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab at the Georgia Institute of Technology. The pieces are generated using artificial intelligence and deep learning.
Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.
Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.
“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer at Georgia Tech. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”
Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.
“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”
Shimon was created by Bretan’s advisor, Gil Weinberg, director of Georgia Tech’s Center for Music Technology.
“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”
Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.
Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example.
“They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.”
Shimon’s debut as a solo composer was featured in a video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June. It’s the latest project within Weinberg’s lab. He and his students have also created a robotic prosthesis for a drummer, a robotic third arm for all drummers, and an interactive robotic companion that plays music from a phone and dances to the beat.
The Latest on: Music robot
Intel Drones Entertain At Coachella Valley Music Festival
on April 18, 2018 at 11:32 pm
Yes, the robots are here, and they are coming for us ... “Coachella is two weekends full of different kinds of music, abstract art and the latest technology, making it the perfect event for drone light shows,” said Natalie Cheung, general manager ... […]
You can help a cyborg drummer get a new, improved robot arm so he can tour
on April 18, 2018 at 2:14 pm
When it comes to robot technology that has the ability to genuinely change ... and thinking he would never again be able to play music. Thanks to researchers at Georgia Tech, however, he was been kitted out with a robotic arm prototype that lets him ... […]
Why You Should Treat Your Business Like a Robot-Car: 4 Keys to Surviving Radical Change
on April 18, 2018 at 9:00 am
Related: Ford Made a Robot Butt to Test Its Car Seats ... but also scans its passenger for his or her mood, knows what music to put on to suit that mood and is always trying to get better at finding the right match. Now, imagine that same car connecting ... […]
Why You Should Be Watching Mr. Robot
on April 17, 2018 at 10:58 pm
Supported by an incredible soundtrack that captures the tone and essence of the show in every episode, Mr. Robot creates energetic scenes through its various ranges of music. Each scene is emphasised by brilliant choices of song during the most sombre and ... […]
DT Daily: Tesla pauses Model 3 production to untangle robot assembly lines
on April 17, 2018 at 1:35 pm
After Tesla CEO Elon Musk recently lamented his, perhaps, over-reliance on automation (or, as we call them: robots) to build his cars ... from apps to Apple Music to Apple TV content. Now, it looks like Cupertino is going to get into the news business ... […]
A&R Meets AI: Why Your Next Label Rep Could Be A Robot
on April 17, 2018 at 7:23 am
While record label talent scouting may have seemed like one bastion of the industry that was safe from artificial intelligence, Warner Music Group clearly feels differently, having recently acquired Sodatone, a startup which uses technology to identify ... […]
Spotify is updating its free music streaming tier to make it more like the paid tier
on April 11, 2018 at 11:58 am
One of the ways that Spotify became the most popular music streaming app in the world was by opening ... $20 Wi-Fi extender, $99 robot vacuum, more While the desktop, browser and tablet versions of Spotify’s app are all nearly identical to the paid ... […]
Listen to an Exclusive 'Lost in Space' Music Track: "Will and The Robot"
on April 11, 2018 at 6:51 am
Here’s what composer Christopher Lennertz had to say about this selection. “This is my favorite sequence in the pilot, where Will and the robot not only meet but form a true bond in the midst of a harrowing adventure. Zack [the showrunner] wanted it to ... […]
Will Walmart's Robots Make Investors Money?
on April 9, 2018 at 5:56 am
The robots, developed by start-up Bossa Nova Robotics, have a simple task that has nothing to do with jazzy Brazilian music. The machines autonomously navigate around stores and scan shelves with a tower fitted with cameras. After gathering and processing ... […]
Killer Robots, Begone! This Doctor's Androids Come in Peace
on April 5, 2018 at 12:20 pm
Let's talk about a couple of your robot case studies. Back in 2008, we took our Bandit robot, a humanoid torso on a mobile platform, to perform music-recognition cognitive games for Alzheimer's patients at the Silverado network of elder care facilities. […]
via Google News and Bing News