KAIST researchers upgraded their smart glasses with a low-power multicore processor to employ stereo vision and deep-learning algorithms, making the user interface and experience more intuitive and convenient
K-Glass, smart glasses reinforced with augmented reality (AR) that were first developed by the Korea Advanced Institute of Science and Technology (KAIST) in 2014, with the second version released in 2015, is back with an even stronger model. The latest version, which KAIST researchers are calling K-Glass 3, allows users to text a message or type in key words for Internet surfing by offering a virtual keyboard for text and even one for a piano.
Currently, most wearable head-mounted displays (HMDs) suffer from a lack of rich user interfaces, short battery lives, and heavy weight. Some HMDs, such as Google Glass, use a touch panel and voice commands as an interface, but they are considered merely an extension of smartphones and are not optimized for wearable smart glasses. Recently, gaze recognition was proposed for HMDs including K-Glass 2, but gaze is insufficient to realize a natural user interface (UI) and experience (UX), such as user’s gesture recognition, due to its limited interactivity and lengthy gaze-calibration time, which can be up to several minutes.
As a solution, Professor Hoi-Jun Yoo and his team from the Electrical Engineering Department recently developed K-Glass 3 with a low-power natural UI and UX processor to enable convenient typing and screen pointing on HMDs with just bare hands. This processor is composed of a pre-processing core to implement stereo vision, seven deep-learning cores to accelerate real-time scene recognition within 33 milliseconds, and one rendering engine for the display.
The stereo-vision camera, located on the front of K-Glass 3, works in a manner similar to three dimension (3D) sensing in human vision. The camera’s two lenses, displayed horizontally from one another just like depth perception produced by left and right eyes, take pictures of the same objects or scenes and combine these two different images to extract spatial depth information, which is necessary to reconstruct 3D environments. The camera’s vision algorithm has an energy efficiency of 20 milliwatts on average, allowing it to operate in the Glass more than 24 hours without interruption.
The research team adopted deep-learning-multi core technology dedicated for mobile devices to recognize user’s gestures based on the depth information. This technology has greatly improved the Glass’s recognition accuracy with images and speech, while shortening the time needed to process and analyze data. In addition, the Glass’s multi-core processor is advanced enough to become idle when it detects no motion from users. Instead, it executes complex deep-learning algorithms with a minimal power to achieve high performance.
Professor Yoo said, “We have succeeded in fabricating a low-power multi-core processer that consumes only 126.1 milliwatts of power with a high efficiency rate. It is essential to develop a smaller, lighter, and low-power processor if we want to incorporate the widespread use of smart glasses and wearable devices into everyday life. K-Glass 3’s more intuitive UI and convenient UX permit users to enjoy enhanced AR experiences such as a keyboard or a better, more responsive mouse.”
Learn more: K-Glass 3 offers users a keyboard to type text
The Latest on: Smart glasses
via Google News
The Latest on: Smart glasses
- In San Diego, ‘Smart’ Streetlights Spark Surveillance Reformon August 6, 2020 at 10:52 am
Camera-equipped street lamps were supposed to gather traffic data; instead, their video footage went to police. Now lawmakers are pushing back.
- 6 Smart Pivots Inspired by the Pandemicon August 6, 2020 at 2:02 am
Plastic workout domes, a French-pastry vending machine, a two-stool mobile pub: Business success during Covid-19 requires embracing innovative ideas and tolerating risk.
- Fabrication advance: Spray-on clear coatings for cheaper smart windowson August 5, 2020 at 6:37 am
A simple method for making clear coatings that can block heat and conduct electricity could radically cut the cost of energy-saving smart windows and heat-repelling glass. The spray-on coatings ...
- Best smart speaker of 2020: Echo Dot, Nest Mini and moreon August 4, 2020 at 5:02 pm
Amazon, Google and Apple all make good smart speakers. The competition between these tech giants only pushes them to keep getting better. Amazon helped popularize smart h ...
- I’ve worn Alexa-enabled glasses for two weeks. They’re driving me bananas.on August 4, 2020 at 4:24 am
I’ve been living with its latest talking artificial intelligence product, called the Echo Frames, for two weeks. They’re glasses with tiny speakers and a microphone so you can have your own private ...
- Chinese AR start-up Rokid eyes industrial applications after success with temperature-reading smart glasseson July 30, 2020 at 3:00 pm
Hangzhou-based Rokid expands end-use applications for second generation product after its temperature-detecting smart glasses helped limit the spread of Covid-19 ...
- Niantic won’t make its own Pokemon GO smart glasseson July 30, 2020 at 1:42 pm
Pokemon GO developer Niantic may be creating a set of augmented reality smart glasses, but it has no intention of building them itself, the company has confirmed. Niantic had announced last December ...
- Smart Glasses to Become Dumb Glasses a Month After Google Buys Companyon July 30, 2020 at 10:10 am
Canadian smart glasses maker North announced it was bought by Google on June 30, and now its $600 Focals will be non-functional as of July 31. The company is offering full refunds.
- Google offers refunds after smart glasses stop workingon July 29, 2020 at 7:45 am
Smart glasses company North has told customers that their $600 (£460) purchases will stop working in a few days' time. The Canadian company, recently purchased by Google, says its Focals glasses will ...
- A high-tech array of travel tools: ‘Smart’ health cards, temperature-reading glasses and moreon July 28, 2020 at 10:44 am
The travel industry is well acquainted with artificial intelligence: customer service chatbots, predictive search engines and automated check-in services like self-service bag drops are becoming de ...
via Bing News