Professor Otmar Hilliges and his staff at ETH Zurich have developed a new app enabling users to operate their smartphone with gestures. This development expands the range of potential interactions with such devices.
It does seem slightly odd at first: you hold the phone in one hand, and move the other in the air above its built-in camera making gestures that resemble sign language. Sometimes you move your index finger to the left, sometimes to the right. You can spread out your fingers, or imitate a pair of pliers or the firing of a pistol. These gestures are not, however, intended for communicating with deaf people; they are for controlling your smartphone.
By mimicking the firing of a pistol, for example, a user can switch to another browser tab, change the map’s view from satellite to standard, or shoot down enemy planes in a game. Spreading out your fingers magnifies a section of a map or scrolls the page of a book forwards.
All this gesturing wizardry is made possible by a new type of algorithm developed by Jie Song, a Master’s student in the working group headed by by Otmar Hilliges, Professor of Computer Science. The researchers presented the app to an audience of industry professionals at the UIST symposium in Honolulu, Hawaii.
Intelligent programming uses computer memory
The program uses the smartphone’s built-in camera to register its environment. It does not evaluate depth or colour. The information it does register – the shape of the gesture, the parts of the hand – is reduced to a simple outline that is classified according to stored gestures. The program then executes the command associated with the gesture it observes. The program also recognises the hand’s distance from the camera and warns the user when the hand is either too close or too far away.
“Many movement-recognition programs need plenty of processor and memory power”, explains Hilliges, adding that their new algorithm uses a far smaller portion of computer memory and is thus ideal for smartphones. He believes the application is the first of its kind that can run on a smartphone. The app’s minimal processing footprint means it could also run on smart watches or in augmented-reality glasses.
The Latest on: Gesture interface
via Google News
The Latest on: Gesture interface
- Custom Android UI is future of better experienceson August 18, 2019 at 3:31 am
It also offers a number of useful performance optimisations such as iPhone XS-style gesture interface. EMUI: Chinese tech giant develops this custom UI for its Huawei and Honor line-up of smartphones.
- Touchless Gesture Controls on Phones? Think Biggeron August 12, 2019 at 4:00 am
Parthiban certainly isn’t the only one thinking bigger is better when it comes to gestures. In May, researchers from Carnegie Mellon University (including Chris Harrison, the director of the Future ...
- Google provides the reasons for their new navigation gestures in Android Qon August 9, 2019 at 3:33 pm
Go edge-to-edge to enable your app to draw across the entire screen Handle any visual overlaps with the system user interface (i.e. navigation bar) Resolve any gesture conflicts with the system ...
- Samsung Galaxy Note 10 Works Hard to Attract Business Userson August 9, 2019 at 9:08 am
Even without the gestures ability, however ... The Samsung DeX PC to Phone interface is how Samsung envisions Note 10 users moving data between their devices. First introduced in the Galaxy 8, DeX ...
- Hate Android Q's new gesture navigation? Tough, says Google, it's for your own goodon August 9, 2019 at 4:18 am
The company says it's decided to focus on gestures because they can be faster and feel 'more natural', they're less likely to be triggered accidentally, and they mean apps don't have operating system ...
- Android Q's big navigation change: Here's why it makes sense, says Googleon August 9, 2019 at 2:54 am
Seemingly small user interface (UI) changes are difficult, but they become big when they affect over a billion people who rely on their Android phones to communicate and do business online. But ...
- Android Q’s back gesture controversy, explainedon August 8, 2019 at 11:00 am
That gesture now maps to back, though Google has tried to make ... It was also predictable because, generally speaking, the internet hates interface change. Twitter’s web redesign is just the latest ...
- Automotive Human Machine Interface (HMI) Market to Reach $50.61 Billion by 2026on August 7, 2019 at 10:25 am
Table 1 Global Automotive Human Machine Interface Market Outlook, By Region (2016-2026) ($MN) Table 2 Global Automotive Human Machine Interface Market Outlook, By Product (2016-2026) ($MN) Table 3 ...
- Samsung Galaxy Note 10 will support air gestures through stylus, feature list leak revealson August 6, 2019 at 2:36 pm
Air gestures on next-generation S Pen can be used to "take hands ... and feature a digital version of its signature rotating bezel user interface. With a starting price of $279.99 (40mm version) and ...
- Top 5 smartphone user interfaces based on ease of use and experienceon August 6, 2019 at 2:07 am
Its design implementation is consistent, making the interface and apps feel part of the package. Importantly, it makes using big-screen smartphones easy by enabling interaction gestures and bringing ...
via Bing News