Meet Shimon, the Robot That Uses AI to Write and Play Its Own Music Compositions

Advertisement
By Indo-Asian News Service | Updated: 19 June 2017 17:24 IST
Highlights
  • Shimon can write and play its own music compositions using AI
  • It has four arms and eight sticks can play harmonies and chords
  • Its debut as a solo composer was featured in a 30-minute video

Photo Credit: Georgia Tech

In a first, researchers have developed a robot that can write and play its own music compositions using artificial intelligence and deep learning.

The robot - named Shimon - with four arms and eight sticks can play harmonies and chords on marimba. It also thinks much more like a human musician, focussing less on the next note, and more on the overall structure of the composition.

Advertisement

The researchers from Georgia Institute of Technology in the US fed the robot with nearly 5,000 complete songs - from Beethoven to the Beatles to Lady Gaga to Miles Davis - and more than two million motifs, riffs and licks of music.

Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans were involved in either the composition or the performance of the music.

Advertisement

"Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece," Mason Bretan, doctoral student at the Georgia Institute of Technology, said in a statement.

"Shimon's compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments," he added.

Advertisement

As long as the researchers feed it a different seed, the robot produces something different each time -- music that the researchers cannot predict.

In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.

Advertisement

This leap in Shimon's musical quality is because it is using deep learning, which is enabling it to create a more structured and coherent composition, the researchers said.

Shimon's debut as a solo composer was featured in a 30-minute video clip in the Consumer Electronic Show (CES) keynote and will have its first live performance at the Aspen Ideas Festival at the end of June, the researchers said.

 

Get your daily dose of tech news, reviews, and insights, in under 80 characters on Gadgets 360 Turbo. Connect with fellow tech lovers on our Forum. Follow us on X, Facebook, WhatsApp, Threads and Google News for instant updates. Catch all the action on our YouTube channel.

Further reading: Shimon, Robots, Robotics, Science
Advertisement
Popular Mobile Brands
  1. Vivo V80 FE Confirmed to Launch Soon Globally: See Specifications
  1. OpenAI Expands ChatGPT for Academic Researchers Programme to India With Free Plus Access
  2. Xiaomi 18 Pro Max, Xiaomi 18 Pro Launched Globally With Privacy Display, Dual 200-Megapixel Cameras: Price, Features
  3. OpenAI Brings Computer-Use AI Agents to Healthcare for Medical Records and Insurance Workflows
  4. Pump.fun Adds Prediction Markets as It Looks Beyond Memecoin Trading
  5. Sony Rolls Out New PS5 System Software Update With 'Security Fixes' Ahead of GTA 6 Launch
  6. Gemini Users Can Now Save Their Chat History Without Opting in to AI Model Training
  7. Ex-Robinhood Engineer Admits Guilt in $125,000 Hyperliquid Fraud Case
  8. Oppo Find X11 Pro Max Tipped to Get Flat Screen, Quad-Curved Glass
  9. EvoFox Play V Wireless Gamepad Launched in India With Magnetic Hall 3D Joysticks for Sony’s PS5, PC and Smartphones
  10. WhatsApp Rolling Out Cloud Storage for Chat Backups on Android: Report
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2026. All rights reserved.