RSL system based on transfer learning
A deep-learning powered single-strained electronic skin sensor can capture human motion from a distance. The single strain sensor placed on the wrist decodes complex five-finger motions in real time with a virtual 3D hand that mirrors the original motions.
The deep neural network boosted by rapid situation learning (RSL) ensures stable operation regardless of its position on the surface of the skin.
Conventional approaches require many sensor networks that cover the entire curvilinear surfaces of the target area. Unlike conventional wafer-based fabrication, this laser fabrication provides a new sensing paradigm for motion tracking.
The research team, led by Professor Sungho Jo from the School of Computing, collaborated with Professor Seunghwan Ko from Seoul National University to design this new measuring system that extracts signals corresponding to multiple finger motions by generating cracks in metal nanoparticle films using laser technology. The sensor patch was then attached to a user’s wrist to detect the movement of the fingers.
The concept of this research started from the idea that pinpointing a single area would be more efficient for identifying movements than affixing sensors to every joint and muscle. To make this targeting strategy work, it needs to accurately capture the signals from different areas at the point where they all converge, and then decoupling the information entangled in the converged signals. To maximize users’ usability and mobility, the research team used a single-channeled sensor to generate the signals corresponding to complex hand motions.
The rapid situation learning (RSL) system collects data from arbitrary parts on the wrist and automatically trains the model in a real-time demonstration with a virtual 3D hand that mirrors the original motions. To enhance the sensitivity of the sensor, researchers used laser-induced nanoscale cracking.
This sensory system can track the motion of the entire body with a small sensory network and facilitate the indirect remote measurement of human motions, which is applicable for wearable VR/AR systems.
The research team said they focused on two tasks while developing the sensor. First, they analyzed the sensor signal patterns into a latent space encapsulating temporal sensor behavior and then they mapped the latent vectors to finger motion metric spaces.
Professor Jo said, “Our system is expandable to other body parts. We already confirmed that the sensor is also capable of extracting gait motions from a pelvis. This technology is expected to provide a turning point in health-monitoring, motion tracking, and soft robotics.”
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
- NBA's transaction window opens: Best free agents available, tracking signed playerson June 23, 2020 at 9:24 am
Teams are permitted to bring 17 total players to Orlando -- up to 15 players on standard contacts and two additional two-way players. Playoff rosters will also consist of 17 players: 13 active and ...
- VSB approves motion to review role of police in schools, but opposes suspending school liaison officer programon June 23, 2020 at 5:58 am
The Vancouver School Board has approved a motion to review the role of Vancouver Police Department and RCMP in the city's schools.
- Tracking The Tropics: Subtropical Depression 4 Forms Well Offshore Of East Coaston June 22, 2020 at 2:12 pm
Subtropical Depression 4 has formed well offshore of the East Coast and is forecast to move away from land. At 5 pm. Monday, the center of the subtropical depression was about 310 miles southeast of ...
- Apple’s ARKit 4 introduces new depth capabilities and expands face tracking to more deviceson June 22, 2020 at 1:41 pm
Apple announced ARKit 4.0 during its 2020 Worldwide Developers Conference, bringing a slate of augmented reality improvements.
- watchOS 7 announced with sleep tracking and rebranded Fitness appon June 22, 2020 at 11:53 am
You’ll need at least an iPhone 6S or later running iOS 14 to support watchOS 7. Sleep tracking is perhaps one of the most requested features since the Apple Watch was first introduced back in 2015.
Go deeper with Google Headlines on:
Go deeper with Bing News on:
Rapid situation learning system
- Lives do matter in Rapid Cityon June 7, 2020 at 7:04 pm
We cannot easily accommodate every need or understand every single situation that our ... leading, and learning alongside this incredible Rapid City community I’ve been given the chance to ...
- Politics Report: Police Reforms Suddenly Advanceon June 6, 2020 at 6:10 am
“There is a larger conversation about structural racism, racism in our institutions and in our systems,” she said ... “I have to say, this situation is feeling very familiar to me. This was where we ...
- Lessons from Chinese Companies’ Response to Covid-19on June 5, 2020 at 5:13 am
The pandemic led to a rapid, widespread adoption of the platform ... played an important role in responding to the evolving situation. IT streamlined cancellation requests by developing ...
- Special Ed Students Have Lost Many Services. Here’s How SEL Strategies Can Help.on June 4, 2020 at 1:26 pm
The necessary and rapid move to distance learning in response to the COVID-19 pandemic has been disabling for our education system. All teachers and students ... while also supporting his comfort by ...
- One small reason to be optimistic after a week of protestson June 3, 2020 at 9:46 pm
Social media streams, meanwhile, are filled with white Americans learning about the power of ... reveal disapproval of Trump's handling of the situation, as well as deep skepticism that he is ...