Rice University engineers are building a flat microscope, called FlatScope TM, and developing software that can decode and trigger neurons on the surface of the brain.
Their goal as part of a new government initiative is to provide an alternate path for sight and sound to be delivered directly to the brain.
The project is part of a $65 million effort announced this week by the federal Defense Advanced Research Projects Agency (DARPA) to develop a high-resolution neural interface. Among many long-term goals, the Neural Engineering System Design (NESD) program hopes to compensate for a person’s loss of vision or hearing by delivering digital information directly to parts of the brain that can process it.
Members of Rice’s Electrical and Computer Engineering Department will focus first on vision. They will receive $4 million over four years to develop an optical hardware and software interface. The optical interface will detect signals from modified neurons that generate light when they are active. The project is a collaboration with the Yale University-affiliated John B. Pierce Laboratory led by neuroscientist Vincent Pieribone.
Current probes that monitor and deliver signals to neurons — for instance, to treat Parkinson’s disease or epilepsy — are extremely limited, according to the Rice team. “State-of-the-art systems have only 16 electrodes, and that creates a real practical limit on how well we can capture and represent information from the brain,” Rice engineer Jacob Robinson said.
Robinson and Rice colleagues Richard Baraniuk, Ashok Veeraraghavan and Caleb Kemere are charged with developing a thin interface that can monitor and stimulate hundreds of thousands and perhaps millions of neurons in the cortex, the outermost layer of the brain.
“The inspiration comes from advances in semiconductor manufacturing,” Robinson said. “We’re able to create extremely dense processors with billions of elements on a chip for the phone in your pocket. So why not apply these advances to neural interfaces?”
Kemere said some teams participating in the multi-institution project are investigating devices with thousands of electrodes to address individual neurons. “We’re taking an all-optical approach where the microscope might be able to visualize a million neurons,” he said.
That requires neurons to be visible. Pieribone’s Pierce Lab is gathering expertise in bioluminescence –think fireflies and glowing jellyfish — with the goal of programming neurons with proteins that release a photon when triggered. “The idea of manipulating cells to create light when there’s an electrical impulse is not extremely far-fetched in the sense that we are already using fluorescence to measure electrical activity,” Robinson said.
The scope under development is a cousin to Rice’s FlatCam, developed by Baraniuk and Veeraraghavan to eliminate the need for bulky lenses in cameras. The new project would make FlatCam even flatter, small enough to sit between the skull and cortex without putting additional pressure on the brain, and with enough capacity to sense and deliver signals from perhaps millions of neurons to a computer.
Alongside the hardware, Rice is modifying FlatCam algorithms to handle data from the brain interface.
“The microscope we’re building captures three-dimensional images, so we’ll be able to see not only the surface but also to a certain depth below,” Veeraraghavan said. “At the moment we don’t know the limit, but we hope we can see 500 microns deep in tissue.”
“That should get us to the dense layers of cortex where we think most of the computations are actually happening, where the neurons connect to each other,” Kemere said.
A team at Columbia University is tackling another major challenge: The ability to wirelessly power and gather data from the interface.
In its announcement, DARPA described its goals for the implantable package. “Part of the fundamental research challenge will be developing a deep understanding of how the brain processes hearing, speech and vision simultaneously with individual neuron-level precision and at a scale sufficient to represent detailed imagery and sound,” according to the agency. “The selected teams will apply insights into those biological processes to the development of strategies for interpreting neuronal activity quickly and with minimal power and computational resources.”
“It’s amazing,” Kemere said. “Our team is working on three crazy challenges, and each one of them is pushing the boundaries. It’s really exciting. This particular DARPA project is fun because they didn’t just pick one science-fiction challenge: They decided to let it be DARPA-hard in multiple dimensions.”
The Latest on: Flat microscope
- Rice scientists create flat composite with tunable optical bandgap on September 20, 2017 at 9:47 am
Scientists at Oak Ridge National Laboratory led by postdoctoral researcher Jordan Hachtel produced microscope images that identified and detailed the position of each atom in the materials. “Labs have made 2-D materials with two or three components ... […]
- Ariel Winter Fires Off On Body Shamers & The Media In Instagram Rant & It's Intense on September 19, 2017 at 7:50 am
You'll want to read all of Ariel Winter's rant about body shamers and the media because she's flat-out sick of all the negative attention ... her every fashion choice is put under a microscope. In a recent interview with The Hollywood Reporter, Winter ... […]
- This ultra-fast microscope captures 3D images of organisms in real time on September 19, 2017 at 2:37 am
The image-capture velocity of this microscope goes far beyond the capability of modern confocal instruments that capture just around five images per second. QIs-scope comes with a set of four lasers, each of which emits a flat beam of light and allows for ... […]
- A new microscope can quickly generate 3D images of living organisms on September 18, 2017 at 7:00 pm
The QIs-scope, as it's called, can take up to 200 images per second -- way more than the five per second most confocal microscopes on the market can capture now. It also comes with four lasers that each emit a flat beam, but two more can be attached to ... […]
- Researchers develop new ultra-fast 3D microscope on September 18, 2017 at 2:27 pm
This next-generation microscope can make three-dimensional images of small specimens (between 1 mm and 2 cm) through the use of a flat laser beam in near-real time, which makes it possible to monitor animals as they develop. "We can see how the heart of a ... […]
- US EIA Predicts 28% Increase In World Energy Use By 2040, Declining Role For Coal, Increased Renewables on September 18, 2017 at 9:19 am
The most important takeaway from the IEO2017 report was the EIA’s prediction that global coal use will remain flat over the next 20 years ... always the coutry most often put under the microscope — is expected to decrease by 0.6% per year, matched ... […]
- UC3M spinoff develops new ultra-fast 3-D microscope on September 18, 2017 at 8:16 am
This new-generation microscope can make three-dimensional images of small specimens (between 1mm and 2cm) through the use of a flat laser beam. And it does it practically in real time, which makes it possible to monitor animals as they develop. […]
- Booze ban proposed for Dickey Flat on September 13, 2017 at 10:46 pm
Booze-fuelled crime and disorder at Waitawheta's popular Dickey Flat campsite has prompted the Council to propose ... Pokies also in the spotlight The District's gambling rules are also under the microscope and open for feedback this month. […]
- Feeding time for beach creatures at Joppa Flats on September 8, 2017 at 12:07 am
Joppa Flats education coordinator Lisa Hutchings said the program ... “We’ll use a digital hand-held microscope and a video screen to give you a larger-than-life view of the activities, so you’ll really get to see the details,” she said. […]
- U.S. stock futures flat with Draghi, jobs and oil inventories in focus on September 7, 2017 at 5:09 am
Investing.com – Wall Street futures pointed to a flat open on Thursday as investors looked ahead ... Any remarks on the strength of the euro will also be under the microscope as the cause of what is expected to be a slight reduction to ECB inflation ... […]
via Google News and Bing News