Rice University engineers are building a flat microscope, called FlatScope TM, and developing software that can decode and trigger neurons on the surface of the brain.
Their goal as part of a new government initiative is to provide an alternate path for sight and sound to be delivered directly to the brain.
The project is part of a $65 million effort announced this week by the federal Defense Advanced Research Projects Agency (DARPA) to develop a high-resolution neural interface. Among many long-term goals, the Neural Engineering System Design (NESD) program hopes to compensate for a person’s loss of vision or hearing by delivering digital information directly to parts of the brain that can process it.
Members of Rice’s Electrical and Computer Engineering Department will focus first on vision. They will receive $4 million over four years to develop an optical hardware and software interface. The optical interface will detect signals from modified neurons that generate light when they are active. The project is a collaboration with the Yale University-affiliated John B. Pierce Laboratory led by neuroscientist Vincent Pieribone.
Current probes that monitor and deliver signals to neurons — for instance, to treat Parkinson’s disease or epilepsy — are extremely limited, according to the Rice team. “State-of-the-art systems have only 16 electrodes, and that creates a real practical limit on how well we can capture and represent information from the brain,” Rice engineer Jacob Robinson said.
Robinson and Rice colleagues Richard Baraniuk, Ashok Veeraraghavan and Caleb Kemere are charged with developing a thin interface that can monitor and stimulate hundreds of thousands and perhaps millions of neurons in the cortex, the outermost layer of the brain.
“The inspiration comes from advances in semiconductor manufacturing,” Robinson said. “We’re able to create extremely dense processors with billions of elements on a chip for the phone in your pocket. So why not apply these advances to neural interfaces?”
Kemere said some teams participating in the multi-institution project are investigating devices with thousands of electrodes to address individual neurons. “We’re taking an all-optical approach where the microscope might be able to visualize a million neurons,” he said.
That requires neurons to be visible. Pieribone’s Pierce Lab is gathering expertise in bioluminescence –think fireflies and glowing jellyfish — with the goal of programming neurons with proteins that release a photon when triggered. “The idea of manipulating cells to create light when there’s an electrical impulse is not extremely far-fetched in the sense that we are already using fluorescence to measure electrical activity,” Robinson said.
The scope under development is a cousin to Rice’s FlatCam, developed by Baraniuk and Veeraraghavan to eliminate the need for bulky lenses in cameras. The new project would make FlatCam even flatter, small enough to sit between the skull and cortex without putting additional pressure on the brain, and with enough capacity to sense and deliver signals from perhaps millions of neurons to a computer.
Alongside the hardware, Rice is modifying FlatCam algorithms to handle data from the brain interface.
“The microscope we’re building captures three-dimensional images, so we’ll be able to see not only the surface but also to a certain depth below,” Veeraraghavan said. “At the moment we don’t know the limit, but we hope we can see 500 microns deep in tissue.”
“That should get us to the dense layers of cortex where we think most of the computations are actually happening, where the neurons connect to each other,” Kemere said.
A team at Columbia University is tackling another major challenge: The ability to wirelessly power and gather data from the interface.
In its announcement, DARPA described its goals for the implantable package. “Part of the fundamental research challenge will be developing a deep understanding of how the brain processes hearing, speech and vision simultaneously with individual neuron-level precision and at a scale sufficient to represent detailed imagery and sound,” according to the agency. “The selected teams will apply insights into those biological processes to the development of strategies for interpreting neuronal activity quickly and with minimal power and computational resources.”
“It’s amazing,” Kemere said. “Our team is working on three crazy challenges, and each one of them is pushing the boundaries. It’s really exciting. This particular DARPA project is fun because they didn’t just pick one science-fiction challenge: They decided to let it be DARPA-hard in multiple dimensions.”
The Latest on: Flat microscope
- President And Mrs. Polk To Stay Buried In Nashville on February 16, 2018 at 3:13 am
As Confederate statues have come down across the South, that law has been under the microscope once again ... resting place and that it is not ADA accessible, though relatively flat and smooth sidewalks do wind their way to the tomb. […]
- Diatoms of Death: One-celled Creatures Outed as Cause of Mega-tsunamis on February 16, 2018 at 12:34 am
Yet, remarkably, they occur on nearly flat slopes of less than 3 degrees," marvels the ... Paralia sulcata diatom imaged using the University of Tasmania scanning electron microscope.Jmpost "Diatom layers are very compressible and water-rich," Urlaub ... […]
- How to see neurons in the dark on February 14, 2018 at 8:44 am
“This microscope…will profoundly increase the possibilities of ... “The system we developed is designed for looking at a relatively flat sample such as cultured cells,” Cohen said. “We are now developing a system to perform optogenetics ... […]
- Researchers use computing power to raise the bar for ultrathin metasurface cameras on February 13, 2018 at 11:34 am
and visualize it through a microscope. (UW Clean Energy Institute Photo / Matt Hagen) Imagine a camera that captures pictures on a flat surface, without any need for a glass lens. Such cameras already exist, thanks to exotic materials known as metasurfaces. […]
- Fix to prevent tip crashing in STM microscopes clears the way for progress in molecular nanotechnology on February 12, 2018 at 6:55 pm
It is not flat. Because of that, the distance between the sample and ... Measurement methods and control implications A common cause of tip-sample crashes in a Scanning Tunneling Microscope (STM) operating in constant current mode is the poor performance ... […]
- Hybrid optics bring color imaging using ultrathin metalenses into focus on February 12, 2018 at 12:00 am
A metasurface-based lens — or metalens — consists of flat microscopically patterned material surfaces ... they take up much less room than the bulky lenses of cameras and high-resolution microscopes. Metalenses are manufactured by the same type of ... […]
- Recycling in flats under the microscope on February 8, 2018 at 4:38 am
This subscription package is aimed at professionals that wants to access to critical recycling and waste management insight, latest news and valuable industry insight. Make sure your staff stay informed and remain competitive by giving them access to ... […]
- Large format printers a positive in a flat market on February 6, 2018 at 6:01 am
An analysis of the fourth quarter's fortunes from analyst house Context revealed that across Western Europe there were flat revenues and sales through distribution were down year-on-year by 4%. Revenues managed to avoid dropping because prices had risen ... […]
- Wednesday preview: GSK's results and consumer healthcare plans under the microscope on February 6, 2018 at 2:54 am
(ShareCast News) - GlaxoSmithKline's full year results will be under the microscope on Wednesday with the shares ... Looking at sales rates, UBS expects them to be "relatively flat against a high basis of comparison", with reservations per outlet per ... […]
- Advances in fabricating nanocrystalline diamonds to study materials under extreme conditions on February 6, 2018 at 1:05 am
Single-crystal gem diamond sits on microscope under laser light ... The nanocrystalline diamond looks like a tiny nubbin of material grown on top of the flat culet surface of a one-third-carat gem diamond. To construct the nubbin, the gem diamond is ... […]
via Google News and Bing News