Neural networks using light could lead to superfast computing.
Neural networks are taking the world of computing by storm. Researchers have used them to create machines that are learning a huge range of skills that had previously been the unique preserve of humans—object recognition, face recognition, natural language processing, machine translation. All these skills, and more, are now becoming routine for machines.
So there is great interest in creating more capable neural networks that can push the boundaries of artificial intelligence even further. The focus of this work is in creating circuits that operate more like neurons, so-called neuromorphic chips. But how to make these circuits significantly faster?
Today, we get an answer of sorts thanks to the work of Alexander Tait and pals at Princeton University in New Jersey. These guys have built the world’s first photonic neuromorphic chip and show that it computes at ultrafast speeds.
Optical computing has long been the great white hope of computer science. Photons have significantly more bandwidth than electrons and so can process more data more quickly. But the advantages of optical data processing systems have never outweighed the additional cost of making them, and so they have never been widely adopted.
That has started to change in some areas of computing, such as analog signal processing, which requires the kind of ultrafast data processing that only photonic chips can provide.
Now neural networks are opening up a new opportunity for photonics. “Photonic neural networks leveraging silicon photonic platforms could access new regimes of ultrafast information processing for radio, control, and scientific computing,” say Tait and co.
At the heart of the challenge is to produce an optical device in which each node has the same response characteristics as a neuron. The nodes take the form of tiny circular waveguides carved into a silicon substrate in which light can circulate. When released this light then modulates the output of a laser working at threshold, a regime in which small changes in the incoming light have a dramatic impact on the laser’s output.
Crucially, each node in the system works with a specific wavelength of light—a technique known as wave division multiplexing. The light from all the nodes can be summed by total power detection before being fed into the laser. And the laser output is fed back into the nodes to create a feedback circuit with a non-linear character.
An important question is just how closely this non-linearity mimics neural behavior. Tait and co measure the output and show that it is mathematically equivalent to a device known as a continuous-time recurrent neural network. “This result suggests that programming tools for CTRNNs could be applied to larger silicon photonic neural networks,” they say.
That’s an important result because it means the device that Tait and co have made can immediately exploit the vast range of programming nous that has been gathered for these kinds of neural networks.
They go on to demonstrate how this can be done using a network consisting of 49 photonic nodes. They use this photonic neural network to solve the mathematical problem of emulating a certain kind of differential equation and compare it to an ordinary central processing unit.
The results show just how fast photonic neural nets can be. “The effective hardware acceleration factor of the photonic neural network is estimated to be 1,960 × in this task,” say Tait and co. That’s a speed up of three orders of magnitude.
That opens the doors to an entirely new industry that could bring optical computing into the mainstream for the first time. “Silicon photonic neural networks could represent first forays into a broader class of silicon photonic systems for scalable information processing,” say Taif and co.
Of course much depends on how well the first generation of electronic neuromorphic chips perform. Photonic neural nets will have to offer significant advantages to be widely adopted and will therefore require much more detailed characterization. Clearly, there are interesting times ahead for photonics.
Learn more: World’s First Photonic Neural Network Unveiled
The Latest on: Photonic Neural Networks
via Google News
The Latest on: Photonic Neural Networks
- Human action recognition with a large-scale brain-inspired photonic computeron November 12, 2019 at 8:16 am
In this work, we propose a photonic hardware approach. Our experimental set-up comprises off-the-shelf components and implements an easy-to-train recurrent neural network with 16,384 nodes, scalable ...
- All-Optical Neural Network Uses Parallel Computation to Speed Problem-Solvingon November 5, 2019 at 4:00 pm
Deep convolutional neural networks (DCNNs) and transfer learning are being applied ... features and functionality at a lower cost than ever before. These factors... Photonics Handbook Laser ...
- All-Optical Neural Network Uses Parallel Computation to Speed Problem-Solvingon August 30, 2019 at 9:07 am
In a step toward making the use of large-scale optical neural networks practical, researchers at The Hong Kong University of Science and Technology have demonstrated a multilayer all-optical ...
- Deep learning enables scientists to identify cancer cells in blood in millisecondson August 21, 2019 at 11:37 am
algorithms called neural networks are modeled after how the human brain works. Compared to other types of machine learning, deep learning has proven to be especially effective for recognizing and ...
- Physics + Machine Learning — Nanophotonic Neural Networkson August 19, 2019 at 7:54 pm
Most computing hardware is very computationally wasteful applied to artificial neural networks as they were designed for von Neumann (traditional) computing schemes. “One of the major problems is that ...
- With new differential detection scheme, all-optical diffractive neural networks get performance booston August 13, 2019 at 5:00 pm
A new paper in Advanced Photonics, an open-access journal co-published by SPIE and the Chinese Laser Press, demonstrates distinct improvements to the inference and generalization performance of ...
- All-optical diffractive neural network closes performance gap with electronic neural networkson August 13, 2019 at 10:46 am
A new article demonstrates distinct improvements to the inference and generalization performance of diffractive optical neural networks. A new paper in Advanced Photonics, an open-access journal ...
- All-optical diffractive neural network closes performance gap with electronic neural networkson August 13, 2019 at 6:10 am
A new paper in Advanced Photonics demonstrates distinct improvements to the inference and generalization performance of diffractive optical neural networks. One of the key improvements discussed in ...
- All-optical diffractive neural network closes performance gap with electronic neural networkson August 13, 2019 at 3:02 am
the international society for optics and photonics, and Chinese Laser Press (CLP), demonstrates distinct improvements to the inference and generalization performance of diffractive optical neural ...
via Bing News