KAIST researchers upgraded their smart glasses with a low-power multicore processor to employ stereo vision and deep-learning algorithms, making the user interface and experience more intuitive and convenient
K-Glass, smart glasses reinforced with augmented reality (AR) that were first developed by the Korea Advanced Institute of Science and Technology (KAIST) in 2014, with the second version released in 2015, is back with an even stronger model. The latest version, which KAIST researchers are calling K-Glass 3, allows users to text a message or type in key words for Internet surfing by offering a virtual keyboard for text and even one for a piano.
Currently, most wearable head-mounted displays (HMDs) suffer from a lack of rich user interfaces, short battery lives, and heavy weight. Some HMDs, such as Google Glass, use a touch panel and voice commands as an interface, but they are considered merely an extension of smartphones and are not optimized for wearable smart glasses. Recently, gaze recognition was proposed for HMDs including K-Glass 2, but gaze is insufficient to realize a natural user interface (UI) and experience (UX), such as user’s gesture recognition, due to its limited interactivity and lengthy gaze-calibration time, which can be up to several minutes.
As a solution, Professor Hoi-Jun Yoo and his team from the Electrical Engineering Department recently developed K-Glass 3 with a low-power natural UI and UX processor to enable convenient typing and screen pointing on HMDs with just bare hands. This processor is composed of a pre-processing core to implement stereo vision, seven deep-learning cores to accelerate real-time scene recognition within 33 milliseconds, and one rendering engine for the display.
The stereo-vision camera, located on the front of K-Glass 3, works in a manner similar to three dimension (3D) sensing in human vision. The camera’s two lenses, displayed horizontally from one another just like depth perception produced by left and right eyes, take pictures of the same objects or scenes and combine these two different images to extract spatial depth information, which is necessary to reconstruct 3D environments. The camera’s vision algorithm has an energy efficiency of 20 milliwatts on average, allowing it to operate in the Glass more than 24 hours without interruption.
The research team adopted deep-learning-multi core technology dedicated for mobile devices to recognize user’s gestures based on the depth information. This technology has greatly improved the Glass’s recognition accuracy with images and speech, while shortening the time needed to process and analyze data. In addition, the Glass’s multi-core processor is advanced enough to become idle when it detects no motion from users. Instead, it executes complex deep-learning algorithms with a minimal power to achieve high performance.
Professor Yoo said, “We have succeeded in fabricating a low-power multi-core processer that consumes only 126.1 milliwatts of power with a high efficiency rate. It is essential to develop a smaller, lighter, and low-power processor if we want to incorporate the widespread use of smart glasses and wearable devices into everyday life. K-Glass 3’s more intuitive UI and convenient UX permit users to enjoy enhanced AR experiences such as a keyboard or a better, more responsive mouse.”
Learn more: K-Glass 3 offers users a keyboard to type text
The Latest on: Smart glasses
via Google News
The Latest on: Smart glasses
- Vuzix Blade Smart Glasses Now Provide a Visual Hands-Free Assistant for DJI Droneson July 21, 2019 at 7:53 am
ROCHESTER, N.Y: Vuzix Corporation (NASDAQ: VUZI), (Vuzix or, the Company), a leading supplier of Smart Glasses and Augmented Reality (AR) technology and products announces the availability of the DJI ... […]
- Apple's Reportedly Throws in the Towel on AR Glasseson July 15, 2019 at 5:24 pm
Liquid crystalline on a silicon wafer (LCoS) displays are currently used in Microsoft HoloLens and DAQRI Smart Glasses (pictured above and are only capable of showing one color at a time. To show a ... […]
- Active Smart Glasses Market Segmentation by Qualitative and Quantitative Research Incorporating Impact of Economic and Non-Economic Aspects by 2026on July 15, 2019 at 8:49 am
New York, NY -- (SBWIRE) -- 07/15/2019 -- Incorporated with Info-graphics, charts, 35 tables and 55 figures, this 117-page research report "Active Smart Glasses Market Size, Type Analysis, Application ... […]
- Vuzix Blade Smart Glasses Now Support Popular Peer-to-Peer Video Calling Appson July 12, 2019 at 7:33 am
- Facebook Messenger Lite, WhatsApp and IMO are among those now supported - Blade's forward-facing camera easily enables 'see what I see' handsfree functionality for users ROCHESTER, N.Y., July 12 ... […]
- The global smart glasses market at a CAGR of over 167% during the forecast periodon July 11, 2019 at 5:13 am
Global Smart Glasses Market: About this market Smart glasses use AR technology that blends digital content with the physical world. They function like helmet-mounted display but are sleeker than them ... […]
- Smart glass recognizes images without sensors, circuits or power sourceon July 11, 2019 at 2:07 am
Image recognition is ubiquitous these days, but to perform this near-magic feat, it needs a lot of clever, coordinated bits - lenses, sensors, software, microchips and a power-source to run it all. ... […]
- Wow, Lucyd Made a Pair of Smart Glasses We’d Actually Wearon July 10, 2019 at 3:30 pm
Since Google Glass debuted in 2013, smart glasses have been an on-again, off-again product in the tech world. They were supposed to revolutionize the way we live and operate, and yet, they only turned ... […]
- Amazing smart glass can recognize numbers, no added tech requiredon July 10, 2019 at 10:03 am
Thanks to Apple’s impressive array of depth-sensing 3D sensors, the newer model iPhones let you unlock them using facial recognition. But what if it didn’t take on-board processing to carry ... […]
- Smart Glass Could Offer a New Route to Machine Visionon July 9, 2019 at 10:38 am
A new type of smart glass, developed by a team at the University of Wisconsin-Madison, leverages optical reflection to recognize images without requiring sensors, circuits, internet connection, or ... […]
- Forget smart glasses, smart glass is the futureon July 8, 2019 at 8:28 am
Researchers have developed a form of 'smart' glass capable of recognising images and numbers without the need for sensors, circuits or external power sources. A team at the University of ... […]
via Bing News