Imagine changing the channel of your TV simply by moving your cup of tea, adjusting the volume on a music player by rolling a toy car, or rotating a spatula to pause a cookery video on your tablet.
New gesture control technology that can turn everyday objects into remote controls could revolutionise how we interact with televisions, and other screens – ending frustrating searches for remotes that have slipped down the side of sofa cushions.
In a paper – ‘Matchpoint: Spontaneous spatial coupling of body movement for touchless pointing’ – which will be presented at the UIST2017 conference in Quebec City this October, researchers from Lancaster University show a novel technique that allows body movement, or movement of objects, to be used to interact with screens.
The ‘Matchpoint’ technology, which only requires a simple webcam, works by displaying moving targets that orbit a small circular widget in the corner of the screen. These targets correspond to different functions – such as volume, changing channel or viewing a menu. The user synchronises the direction of movement of the target, with their hand, head or an object, to achieve what researchers call ‘spontaneous spatial coupling’, which activates the desired function.
Unlike existing gesture control technology, the software does not look for a specific body part it has been trained to identify – such as a hand. Lancaster’s technology looks for rotating movement so it doesn’t require calibration, or the software to have prior knowledge of objects. This provides much more flexibility and ease for the user as it works even while hands are full, and while stood or slouching on the sofa.
Users also do not need to learn specific commands to activate different functions, as is the case with some gesture controlled televisions on the market, and the user is able to decouple at will.
When selecting volume adjustment or channel selection, sliders appear. The user moves their hand, head, or object, in the required direction indicated by the slider to change the volume or to find the desired channel.
As well as televisions, the technology can also be used with other screens. For example, YouTube tutorials, such as mending bikes or baking cakes, could be easily paused and rewound on tablet computers without users having to put down tools or mixing bowls.
Multiple pointers can be created to allow more than one user to point at drawings or pictures on interactive whiteboards simultaneously. Matchpoint also allows users to manipulate images on whiteboards by using two hands to zoom in and out, and rotate images.
In addition to short-term couplings, users can also link stationary objects to controls, which even when left for prolonged periods will retain their control function. For example, a mug sat on a table could change a track on a music player when moved left or right, and a rolling toy car could be used to adjust volume. Objects can lose their coupling with controls simply by removing them from the camera’s field of view.
Christopher Clarke, PhD student at Lancaster University’s School of Computing and Communications, and developer of the technology, said: “Spontaneous spatial coupling is a new approach to gesture control that works by matching movement instead of asking the computer to recognise a specific object.
“Our method allows for a much more user-friendly experience where you can change channels without having to put down your drink, or change your position, whether that is relaxing on the sofa or standing in the kitchen following a recipe.
“Everyday objects in the house can now easily become remote controls so there are no more frantic searches for remote controls when your favourite programme is about to start on another channel, and now everyone in the room has the ‘remote’. You could even change the channel with your pet cat.”
Researchers believe Matchpoint is also suitable to be used as an accessibility tool for people who are unable to use traditional pointers, such as remote controls and a mouse and keyboard.
The Latest on: Gesture control
- Hyundai Mobis New Technology Allows Driver to Control Navigation System with Hand Gestures in the Air on December 16, 2018 at 4:52 pm
A Hyundai Mobis engineer demonstrates 'virtual space touch technology' to be presented at 2019 CES. Hyundai Mobis announced on Dec. 16 that it will show new technology related to future cars, includin... […]
- It Is Time India Responds To Pakistan's Gesture on December 14, 2018 at 9:43 am
Further, another site of historic and religious significance to the Kashmiri Pandits, Sharada Peeth, across the Line of Control has found itself under the spotlight again. Alongside Kashmiri ... […]
- Dusun Promotes Android TV Remote Control and Gamepad for Voice-Controlled Entertainment Systems on December 11, 2018 at 5:17 am
gesture recognition, and virtual reality control Dusun's wireless human-computer interaction solutions include IR, RF (Bluetooth BLE, ZigBee/RF4CE, 2,4G, WiFi), voice control, air-mouse and touch alon... […]
- AI is helping people regain mobility and control over their lives on December 11, 2018 at 3:17 am
This is mounted to the wheelchair and is subsequently used to stream data taken from the facial gestures of its user. In turn, AI algorithms process that data in real time, and it’s this that allows t... […]
- Smart Homes Market by HVAC Control, Security & Access Control, Smart Kitchen, Smart Appliances and Industry Insights by 2023 on December 10, 2018 at 12:17 pm
Favorable government regulations are being implemented in several countries across the globe and next generation technologies, such as 3D gesture-based remote control in the home entertainment will pr... […]
- Automotive Gesture Recognitions (AGRS) Market Global Industry Analysis, Size, Share, Growth, Trends and Forecast 2018-2025 on December 10, 2018 at 7:01 am
Gesture Recognition, Proximity Sensors Drive Advances in Automotive Infotainment. At a time when social media interactivity is also making its way into cars, an evolution of the instrument control pan... […]
- US undersecretary of state for arms control: Creating a flexible, effective foreign policy tool on December 9, 2018 at 7:32 pm
In a gesture that is emblematic of our defense trade relationship ... As undersecretary of state for arms control and international security, that is a tenet I continue to observe in action — from the ... […]
- Control Your Smart Home Devices With Your Gesture on December 5, 2018 at 11:19 pm
Welle introduces a new way of controlling your Smart Home Appliances. Moreover, this technology makes it possible to turn up the volume from a remote location by making a simple clockwise movement on ... […]
- Dusun Electron Ltd. Announces Far-Field Voice Control Solution for Hands-Free Interactive Experience on December 4, 2018 at 7:38 am
gesture recognition, and virtual reality control. Dusun’s wireless human-computer interaction solutions include IR, RF (Bluetooth BLE, ZigBee/RF4CE, 2,4G, Wi-Fi), voice control, air-mouse and touch al... […]
- Xi Jinping pledges to control drug that killed 29,000 Americans last year on December 3, 2018 at 2:37 pm
Shanghai |China has agreed to list the powerful synthetic opioid fentanyl as a "controlled substance" in a move that the White House called a "wonderful humanitarian gesture ... difficult for the Unit... […]
via Google News and Bing News