A wafer filled with memristors
Courtesy of UCL
Extremely energy-efficient artificial intelligence is now closer to reality after a study by UCL researchers found a way to improve the accuracy of a brain-inspired computing system
The system, which uses memristors to create artificial neural networks, is at least 1,000 times more energy efficient than conventional transistor-based AI hardware, but has until now been more prone to error.
Existing AI is extremely energy-intensive – training one AI model can generate 284 tonnes of carbon dioxide, equivalent to the lifetime emissions of five cars. Replacing the transistors that make up all digital devices with memristors, a novel electronic device first built in 2008, could reduce this to a fraction of a tonne of carbon dioxide – equivalent to emissions generated in an afternoon’s drive.
Since memristors are so much more energy-efficient than existing computing systems, they can potentially pack huge amounts of computing power into hand-held devices, removing the need to be connected to the Internet.
This is especially important as over-reliance on the Internet is expected to become problematic in future due to ever-increasing data demands and the difficulties of increasing data transmission capacity past a certain point.
In the new study, published in Nature Communications, engineers at UCL found that accuracy could be greatly improved by getting memristors to work together in several sub-groups of neural networks and averaging their calculations, meaning that flaws in each of the networks could be cancelled out.
Memristors, described as “resistors with memory”, as they remember the amount of electric charge that flowed through them even after being turned off, were considered revolutionary when they were first built over a decade ago, a “missing link” in electronics to supplement the resistor, capacitor and inductor. They have since been manufactured commercially in memory devices, but the research team say they could be used to develop AI systems within the next three years.
Memristors offer vastly improved efficiency because they operate not just in a binary code of ones and zeros, but at multiple levels between zero and one at the same time, meaning more information can be packed into each bit.
Moreover, memristors are often described as a neuromorphic (brain-inspired) form of computing because, like in the brain, processing and memory are implemented in the same adaptive building blocks, in contrast to current computer systems that waste a lot of energy in data movement.
In the study, Dr Adnan Mehonic, PhD student Dovydas Joksas (both UCL Electronic & Electrical Engineering), and colleagues from the UK and the US tested the new approach in several different types of memristors and found that it improved the accuracy of all of them, regardless of material or particular memristor technology. It also worked for a number of different problems that may affect memristors’ accuracy.
Researchers found that their approach increased the accuracy of the neural networks for typical AI tasks to a comparable level to software tools run on conventional digital hardware.
Dr Mehonic, director of the study, said: “We hoped that there might be more generic approaches that improve not the device-level, but the system-level behaviour, and we believe we found one. Our approach shows that, when it comes to memristors, several heads are better than one. Arranging the neural network into several smaller networks rather than one big network led to greater accuracy overall.”
Dovydas Joksas further explained: “We borrowed a popular technique from computer science and applied it in the context of memristors. And it worked! Using preliminary simulations, we found that even simple averaging could significantly increase the accuracy of memristive neural networks.”
Professor Tony Kenyon (UCL Electronic & Electrical Engineering), a co-author on the study, added: “We believe now is the time for memristors, on which we have been working for several years, to take a leading role in a more energy-sustainable era of IoT devices and edge computing.”
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Energy-efficient artificial intelligence
- STMicroelectronics and Schneider Electric Revealed Advanced People-Counting Solution using Artificial Intelligence on STM32 Microcontrolleron November 21, 2020 at 6:14 am
STMicroelectronics (NYSE: STM), a global semiconductor leader serving customers across the spectrum of electronics applications, and Schneider Electric, the leader in the digital transformation of ...
- Viewpoint: The technologies powering the future of artificial intelligenceon November 19, 2020 at 8:39 am
Artificial intelligence (AI) has been an industry buzzword for years, writes Richard Walsh, head of memory at Samsung Semiconductor Europe, but he consider ...
- Smarter Artificial Intelligence Technology in a New Light-Powered Chipon November 18, 2020 at 6:34 am
Prototype tech shrinks AI to deliver brain-like functionality in one powerful device. Researchers have developed artificial intelligence technology that brings together imaging, processing, machine ...
- Atos powers Europe’s fastest supercomputer at Jülich in Germany, the most energy-efficient system in the TOP100on November 17, 2020 at 1:09 am
With 44.1 petaflops JUWELS is officially the fastest supercomputing system in EuropeParis, – Atos, a global leader in digital transformation, today announces that the supercomputing system at ...
- Capgemini Research: Artificial Intelligence set to help organizations cut greenhouse gas emissions by 16% in the next 3-5 yearson November 16, 2020 at 11:05 pm
New Delhi: Artificial Intelligence (AI ... AI use cases include improving energy efficiency, reducing dependence on fossil fuels, and optimizing processes to aid productivity. From the 800 ...
Go deeper with Google Headlines on:
Energy-efficient artificial intelligence
Go deeper with Bing News on:
Memristors powering AI
- New insights into memristive devices by combining incipient ferroelectrics and grapheneon November 20, 2020 at 7:52 am
To create memristors, switches with a memory of past events, strontium titanium oxide (STO) is often used. This material is a perovskite, whose crystal structure depends on temperature, and can become ...
- Building Memristors For Neural Netson November 18, 2020 at 4:00 pm
Memristors as well store information ... have a faint echo of the machine learning silicon developed during the 80s AI renaissance. Thirty years ago, neural nets on a chip were created by a ...
- AI And The Ghost In The Machineon November 17, 2020 at 4:00 pm
With the development of digital computers in the second half of the 20th century, these concepts were put into practice, and AI research began in earnest. Over the last 50 years, interest in AI ...
- System Bits: Nov. 15on November 14, 2020 at 4:00 pm
AI system surfs web to improve performance Of the vast wealth ... bio-polymers have been used in devices based on organic polymers and in a memristive device. Memristors can provide a bridge for ...
- Interviewing the Fetch.ai CEO About Using Multiagents and AI for Smart Citieson November 14, 2020 at 12:43 am
A Sunlight Shifted Asteroid Might Hit the Earth in 2068 with a 1200 Megaton Impact Best Cities to Connect With Boring Company Loops Memristors and HPE Machine Focused Computer Idea Seems Almost Dead ...