Using a new algorithm, Stanford researchers have reconstructed the movements of individual particles of light to see through clouds, fog and other obstructions.
Like a comic book come to life, researchers at Stanford University have developed a kind of X-ray vision – only without the X-rays. Working with hardware similar to what enables autonomous cars to “see” the world around them, the researchers enhanced their system with a highly efficient algorithm that can reconstruct three-dimensional hidden scenes based on the movement of individual particles of light, or photons. In tests, detailed in a paper published Sept. 9 in Nature Communications, their system successfully reconstructed shapes obscured by 1-inch-thick foam. To the human eye, it’s like seeing through walls.
“A lot of imaging techniques make images look a little bit better, a little bit less noisy, but this is really something where we make the invisible visible,” said Gordon Wetzstein, assistant professor of electrical engineering at Stanford and senior author of the paper. “This is really pushing the frontier of what may be possible with any kind of sensing system. It’s like superhuman vision.”
This technique complements other vision systems that can see through barriers on the microscopic scale – for applications in medicine – because it’s more focused on large-scale situations, such as navigating self-driving cars in fog or heavy rain and satellite imaging of the surface of Earth and other planets through hazy atmosphere.
Supersight from scattered light
In order to see through environments that scatter light every-which-way, the system pairs a laser with a super-sensitive photon detector that records every bit of laser light that hits it. As the laser scans an obstruction like a wall of foam, an occasional photon will manage to pass through the foam, hit the objects hidden behind it and pass back through the foam to reach the detector. The algorithm-supported software then uses those few photons – and information about where and when they hit the detector – to reconstruct the hidden objects in 3D.
This is not the first system with the ability to reveal hidden objects through scattering environments, but it circumvents limitations associated with other techniques. For example, some require knowledge about how far away the object of interest is. It is also common that these systems only use information from ballistic photons, which are photons that travel to and from the hidden object through the scattering field but without actually scattering along the way.
“We were interested in being able to image through scattering media without these assumptions and to collect all the photons that have been scattered to reconstruct the image,” said David Lindell, a graduate student in electrical engineering and lead author of the paper. “This makes our system especially useful for large-scale applications, where there would be very few ballistic photons.”
In order to make their algorithm amenable to the complexities of scattering, the researchers had to closely co-design their hardware and software, although the hardware components they used are only slightly more advanced than what is currently found in autonomous cars. Depending on the brightness of the hidden objects, scanning in their tests took anywhere from one minute to one hour, but the algorithm reconstructed the obscured scene in real-time and could be run on a laptop.
“You couldn’t see through the foam with your own eyes, and even just looking at the photon measurements from the detector, you really don’t see anything,” said Lindell. “But, with just a handful of photons, the reconstruction algorithm can expose these objects – and you can see not only what they look like, but where they are in 3D space.”
Space and fog
Someday, a descendant of this system could be sent through space to other planets and moons to help see through icy clouds to deeper layers and surfaces. In the nearer term, the researchers would like to experiment with different scattering environments to simulate other circumstances where this technology could be useful.
“We’re excited to push this further with other types of scattering geometries,” said Lindell. “So, not just objects hidden behind a thick slab of material but objects that are embedded in densely scattering material, which would be like seeing an object that’s surrounded by fog.”
Lindell and Wetzstein are also enthusiastic about how this work represents a deeply interdisciplinary intersection of science and engineering.
“These sensing systems are devices with lasers, detectors and advanced algorithms, which puts them in an interdisciplinary research area between hardware and physics and applied math,” said Wetzstein. “All of those are critical, core fields in this work and that’s what’s the most exciting for me.”
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
- Global Small Animal Imaging Market Is Expected to Reach USD 1662.42 Million by 2027 : Fior Marketson October 6, 2020 at 7:10 am
As per the report published by Fior Markets, the global small animal imaging market is expected to grow from USD 974.08 million in 2019 and to reach USD 1662.42 million by 2027, growing at a CAGR of 6 ...
- Teledyne DALSA’s thermal imaging camera plays pivotal role in Nuvoola’s AI-powered elevated skin temperature screening solutionon October 6, 2020 at 5:09 am
Nuvoola's Luke AI Health Screening and Protection solution Teledyne DALSA's Calibir GXF thermal camera is a critical component within the Nuvoola Luke AI HSP solutionWATERLOO, Ontario, Oct. 06, 2020 ...
- Caring for British Columbians in the Wake of the Pandemic and Beyond: Timely Access to Medical Imagingon October 6, 2020 at 12:01 am
Radiologists are calling on all political parties to commit to the reduction of extensive wait times for life-saving medical imaging diagnostic and interventional ...
- Compact, low-cost system provides fast 3D hyperspectral imagingon October 5, 2020 at 10:12 am
Researchers report a new compact low-cost hyperspectral projector system that provides both depth information and hyperspectral images. The new system could be useful for autonomous driving systems, ...
- Increasing Applications of Mobile Medical Imaging Systems proving to be a Boon for Growth of Mobile Imaging Services Market, Opines TMRon October 5, 2020 at 4:12 am
The expanding applications of medical imaging systems in the sector of women's health, neurology, and cardiology is bringing immense growth prospects for the global mobile imaging services market. Thi ...
Go deeper with Google Headlines on:
Go deeper with Bing News on:
- Exactech Announces First European and US Surgeries Using World’s Only Intraoperative Wireless Shoulder Sensor, Equinoxe ® with VERASENSEon October 6, 2020 at 8:00 am
Exactech, a developer and producer of innovative implants, instrumentation and computer-assisted technologies for joint replacement surgery, announced ...
- Apple Wins Patent for Sensor Input Finger Devices to be used with a Future Apple Mixed Reality Headseton October 6, 2020 at 3:22 am
The U.S. Patent and Trademark Office officially published a series of 45 newly granted patents for Apple Inc. today. In this particular granted patent report, we cover Apple’s invention about a system ...
- 3D Sensors Market - Actionable Research on COVID-19 | Use of 3D Sensors in Security Systems to Boost the Market Growth | Technavioon October 5, 2020 at 11:41 pm
Technavio has announced its latest market research report titled Global 3D Sensors Market 2020-2024 (Graphic: ) The increasing use of 3D sensors in security and surveillance systems is expected to ...
- LeddarTech inc.: LeddarTech Presenting at OSA Laser Congress and ScaleUp 360° Sensor & Radar Systems Europe in October 2020on October 5, 2020 at 9:17 pm
ADAS and AD sensing technology, will be presenting and exhibiting various solutions for automotive and mobility customers at two global digital ...
- LeddarTech Presenting at OSA Laser Congress and ScaleUp 360° Sensor & Radar Systems Europe in October 2020on October 5, 2020 at 9:11 pm
LeddarTech®, a global leader in Level 1-5 ADAS and AD sensing technology, will be presenting and exhibiting various solutions ...
Go deeper with Google Headlines on: