KAIST researchers upgraded their smart glasses with a low-power multicore processor to employ stereo vision and deep-learning algorithms, making the user interface and experience more intuitive and convenient
K-Glass, smart glasses reinforced with augmented reality (AR) that were first developed by the Korea Advanced Institute of Science and Technology (KAIST) in 2014, with the second version released in 2015, is back with an even stronger model. The latest version, which KAIST researchers are calling K-Glass 3, allows users to text a message or type in key words for Internet surfing by offering a virtual keyboard for text and even one for a piano.
Currently, most wearable head-mounted displays (HMDs) suffer from a lack of rich user interfaces, short battery lives, and heavy weight. Some HMDs, such as Google Glass, use a touch panel and voice commands as an interface, but they are considered merely an extension of smartphones and are not optimized for wearable smart glasses. Recently, gaze recognition was proposed for HMDs including K-Glass 2, but gaze is insufficient to realize a natural user interface (UI) and experience (UX), such as user’s gesture recognition, due to its limited interactivity and lengthy gaze-calibration time, which can be up to several minutes.
As a solution, Professor Hoi-Jun Yoo and his team from the Electrical Engineering Department recently developed K-Glass 3 with a low-power natural UI and UX processor to enable convenient typing and screen pointing on HMDs with just bare hands. This processor is composed of a pre-processing core to implement stereo vision, seven deep-learning cores to accelerate real-time scene recognition within 33 milliseconds, and one rendering engine for the display.
The stereo-vision camera, located on the front of K-Glass 3, works in a manner similar to three dimension (3D) sensing in human vision. The camera’s two lenses, displayed horizontally from one another just like depth perception produced by left and right eyes, take pictures of the same objects or scenes and combine these two different images to extract spatial depth information, which is necessary to reconstruct 3D environments. The camera’s vision algorithm has an energy efficiency of 20 milliwatts on average, allowing it to operate in the Glass more than 24 hours without interruption.
The research team adopted deep-learning-multi core technology dedicated for mobile devices to recognize user’s gestures based on the depth information. This technology has greatly improved the Glass’s recognition accuracy with images and speech, while shortening the time needed to process and analyze data. In addition, the Glass’s multi-core processor is advanced enough to become idle when it detects no motion from users. Instead, it executes complex deep-learning algorithms with a minimal power to achieve high performance.
Professor Yoo said, “We have succeeded in fabricating a low-power multi-core processer that consumes only 126.1 milliwatts of power with a high efficiency rate. It is essential to develop a smaller, lighter, and low-power processor if we want to incorporate the widespread use of smart glasses and wearable devices into everyday life. K-Glass 3’s more intuitive UI and convenient UX permit users to enjoy enhanced AR experiences such as a keyboard or a better, more responsive mouse.”
Learn more: K-Glass 3 offers users a keyboard to type text
The Latest on: Smart glasses
via Google News
The Latest on: Smart glasses
- Glasses-wearing cat at Pa. optician’s office helps kids get used to eyewearon November 19, 2019 at 6:45 am
An optician wearing glasses isn’t so unusual. But a cat wearing glasses stands out just a bit ... I learned pretty early on that she was smart, and that she liked a particular treat that we got. I had ...
- Electrochromic Glass Market Price, Share, Size Value, Top 5 Manufacturers, Segments, Regions Overview, Future Plans and Growth by Forecast 2023on November 19, 2019 at 1:28 am
For instance, View Incorporation has raised USD 200 million for the development of electrochromic smart glass in 2017. European electrochromic glass market is mainly driven by the developed automobile ...
- Pro Football Hall of Fame offers ‘smart glasses’ for deaf communityon November 18, 2019 at 4:50 pm
CANTON, Ohio - The Pro Football Hall of Fame and SignGlasses LLC have teamed up to help the deaf and hard-of-hearing community through special smart glasses offered in the Hall. The glasses, which ...
- Smart Glasses, Smart Designer Babies And The Future Of Workon November 17, 2019 at 7:54 am
Will prospective parents be able to chose heterosexual babies? We’re getting ahead of ourselves, tinkering with things we do not understand. Being clever enough to manufacture smart glasses that read ...
- The next 10 years of Apple will include self-driving cars, computer glasses, and — yes — a much faster iPhoneon November 16, 2019 at 5:47 am
Apple has dominated the last decade in tech, and it has no plans of slowing down in the next 10 years.
- Apple Smart Glasses May Be Coming, But Not Until 2022 Or 2023on November 13, 2019 at 4:46 pm
The meeting was led by Apple VP Mike Rockwell who said that the aim is to release an AR headset in, wait for it, 2022, and then follow up with AR glasses a year after, in 2023. Oh my, that’s a long ...
- Big tech racing to replace smartphones with smart glasseson November 11, 2019 at 5:17 pm
Big tech companies are racing for their next big business: getting you to set down your iPhone and pick up a pair of smart glasses. But these things can take time, and the switch won’t happen right ...
- There's a race to replace our iPhones with smart glasses we wear everywhereon November 11, 2019 at 1:28 pm
The next big trend in technology will be smart glasses we wear everywhere. Microsoft, Snap, Facebook, Google, Apple and Amazon are all working on computers we wear on our faces that may replace our ...
- Apple's smart glasses said to launch in 2023, three years later than originally expectedon November 11, 2019 at 11:36 am
There's currently a race to get to the point where AR can fit inside a small enough product that it can be worn like normal glasses and without a big bulky headset. The hope is that AR can be the next ...
- Apple smart glasses roadmap leaks and there’s good news and badon November 11, 2019 at 6:40 am
While reasonably successful, ARKit’s true worth was always seen as a precursor to a set of augmented reality glasses from Apple. Most recently, suggestions that it could be as soon as 2020 when the ...
via Bing News