Scientists from Nanyang Technological University, Singapore (NTU Singapore) have developed an ultrafast high-contrast camera that could help self-driving cars and drones see better in extreme road conditions and in bad weather.
Unlike typical optical cameras, which can be blinded by bright light and unable to make out details in the dark, NTU’s new smart camera can record the slightest movements and objects in real time.
The new camera records the changes in light intensity between scenes at nanosecond intervals, much faster than conventional video, and it stores the images in a data format that is many times smaller as well.
With a unique in-built circuit, the camera can do an instant analysis of the captured scenes, highlighting important objects and details.
Developed by Assistant Professor Chen Shoushun from NTU’s School of Electrical and Electronic Engineering, the new camera named Celex® is now in its final prototype phase.
“Our new camera can be a great safety tool for autonomous vehicles, since it can see very far ahead like optical cameras but without the time lag needed to analyse and process the video feed,” explained Asst Prof Chen.
“With its continuous tracking feature and instant analysis of a scene, it complements existing optical and laser cameras and can help self-driving vehicles and drones avoid unexpected collisions that usually happens within seconds.”
Asst Prof Chen unveiled the prototype of Celex® last month at the 2017 IS&T International Symposium on Electronic Imaging (EI 2017) held in the United States.
It received positive feedback from the conference attendees, many of whom are academia and top industry players.
How it works
A typical camera sensor has several millions pixels, which are sensor sites that record light information and are used to form a resulting picture.
High-speed video cameras that record up to 120 frames or photos per second generate gigabytes of video data, which are then processed by a computer in order for self-driving vehicles to “see” and analyse their environment.
The more complex the environment, the slower the processing of the video data, leading to lag times between “seeing” the environment and the corresponding actions that the self-driving vehicle has to take.
To enable an instant processing of visual data, NTU’s patent-pending camera records the changes between light intensity of individual pixels at its sensor, which reduces the data output. This avoids the needs to capture the whole scene like a photograph, thus increasing the camera’s processing speed.
The camera sensor also has a built-in processor that can analyse the flow of data instantly to differentiate between the foreground objects and the background, also known as optical flow computation. This innovation allows self-driving vehicles more time to react to any oncoming vehicles or obstacles.
The research into the sensor technology started in 2009 and it has received $500,000 in funding from the Ministry of Education Tier 1 research grant and the Singapore-MIT Alliance for Research and Technology (SMART) Proof-of-Concept grant.
The technology was also published in two academic journals published by the Institute of Electrical and Electronics Engineers (IEEE), the world’s largest technical professional organisation for the advancement of technology.
With keen interest from the industry, Asst Prof Chen and his researchers have spun off a start-up company named Hillhouse Tech to commercialise the new camera technology. The start-up is incubated by NTUitive, NTU’s innovation and enterprise company.
Asst Prof Chen expects that the new camera will be commercially ready by the end of this year, as they are already in talks with global electronic manufacturers.
Receive an email update when we add a new SMART CAMERA article.
The Latest on: Smart camera
via Google News
The Latest on: Smart camera
- Google Confirms Android Camera Security Threat: ‘Hundreds Of Millions’ Of Users Affectedon November 19, 2019 at 8:43 am
What did the researchers discover? Oh, only a way for an attacker to take control of smartphone camera apps and remotely take photos, record video, spy on your conversations by recording them as you ...
- This Home or Office Smart Camera is Less Than $45 Todayon November 14, 2019 at 5:22 am
Chances are, you have valuables. Crazy, right? Whether you tend to leave your laptop in your office overnight or you want to keep an eye on the kids when you're not at home, a security camera is a ...
- Google Crowdsource app gets gamified leaderboards and new 'Smart Camera' feature [APK Download]on November 12, 2019 at 12:49 pm
Now a new update is rolling out to further gamify the process, bringing a leaderboard for different categories of submissions, plus a whole new "Smart Camera" feature for improving real-life object ...
- Samsung Galaxy Note 10+ vs. iPhone 11 Pro Max: The Smartphone Camera Battleon November 11, 2019 at 3:26 am
But, how does the iPhone 11 Pro Max shape up when placed against Samsung Galaxy Note 10+, especially in the smartphone camera department? Samsung revealed the Galaxy Note 10+ just a month ahead of ...
- Meet Sony's New IMX686, Apple's Weapon Of Choice In Smartphone Camera Battleon November 10, 2019 at 1:00 am
The Tokyo-based company is one of the biggest suppliers of high-end camera sensors in the global market and its market-leading IMX586 sensor can be found on almost every modern smartphone on this ...
- Sony teases new IMX686 camera sensor coming to smartphone in 2020on November 8, 2019 at 11:36 am
2019 was the year when competition in the smartphone camera space became ultra serious. The megapixel wars returned once again, and now we’re seeing phones with resolutions as high as 108MP. One of ...
- Reolink Unleashed a Next-Generation Wi-Fi Pan Tilt Smart Camera, E1 Zoom, Adding 5MP, Super-HD and 3X Optical Zoomon November 8, 2019 at 9:14 am
HONG KONG, Nov. 8, 2019 /PRNewswire/ -- Reolink, a global innovator in smart-home security and camera solutions, rolled out a new 5MP, wireless, PTZ home camera, E1 Zoom. It features a 355-degree ...
- Smartphone Camera Market Upcoming Demand & Growth Prospect by key players: Sony, Infineon Technologies AG, Samsung, Microsoft Corporationon November 7, 2019 at 2:37 am
Nov 07, 2019 (HTF Market Intelligence via COMTEX) -- This intelligence report provides a comprehensive analysis of the "Global Smartphone Camera Market. This includes Investigation of past progress, ...
- 360 Smart Camera AI version with an Hisilicon chip is a reminder the brand is still alive!on November 7, 2019 at 2:30 am
360 Mobiles may be down and out at the moment but the brand still has other products lineup that is doing pretty well. The brand recently launched a True Wireless earbud, a smartwatch and now, the 360 ...
via Bing News