Researchers’ new method enables identifying a person through walls from candidate video footage, using only WiFi.
Researchers in the lab of UC Santa Barbara professor Yasamin Mostofi have enabled, for the first time, determining whether the person behind a wall is the same individual who appears in given video footage, using only a pair of WiFi transceivers outside.
This novel video-WiFi cross-modal gait-based person identification system, which they refer to as XModal-ID (pronounced Cross-Modal-ID), could have a variety of applications, from surveillance and security to smart homes. For instance, consider a scenario in which law enforcement has a video footage of a robbery. They suspect that the robber is hiding inside a house. Can a pair of WiFi transceivers outside the house determine if the person inside the house is the same as the one in the robbery video? Questions such as this have motivated this new technology.
“Our proposed approach makes it possible to determine if the person behind the wall is the same as the one in video footage, using only a pair of off-the-shelf WiFi transceivers outside,” said Mostofi. “This approach utilizes only received power measurements of a WiFi link. It does not need any prior WiFi or video training data of the person to be identified. It also does not need any knowledge of the operation area.”
The proposed methodology and experimental results will appear at the 25th International Conference on Mobile Computing and Networking (MobiCom) on October 22. The project was funded by a pair of grants from the National Science Foundation that focus on through-wall imaging and occupancy assessment.
In the team’s experiments, one WiFi transmitter and one WiFi receiver are behind walls, outside a room where a person is walking. The transmitter sends a wireless signal whose received power is measured by the receiver. Then, given video footage of a person from another area — and by using only such received wireless power measurements — the receiver can determine whether the person behind the wall is the same person seen in the video footage.
This innovation builds on previous work in the Mostofi Lab, which has pioneered sensing with everyday radio frequency signals such as WiFi since 2009.
“However, identifying a person through walls, from candidate video footage, is a considerably challenging problem,” said Mostofi. Her lab’s success in this endeavor is due to the new proposed methodology they developed.
“The way each one of us moves is unique. But how do we properly capture and compare the gait information content of the video and WiFi signals to establish if they belong to the same person?”
The researchers have proposed a new way that, for the first time, can translate the video gait content to the wireless domain.
“Our approach is multi-disciplinary, drawing from areas of both wireless communications and vision,” said Chitra Karanam, one of three Ph.D. students on the project. Given some video footage, the team first utilized a human mesh recovery algorithm to extract the 3D mesh describing the outer surface of the human body as a function of time. They then used Born electromagnetic wave approximation to simulate the RF signal that would have been generated if this person was walking in a WiFi area.
Next they employed their time-frequency processing approach to extract key gait features from both the real WiFi signal (that was measured behind the wall) and the video-based simulated signal. The two signals are then compared to determine if the person in the WiFi area is the same person in the video.
The researchers’ processing pipeline involves a series of mathematical functions, including Short-time Fourier transform and Hermite functions, in order to get the spectrogram of the received signal. “A spectrogram carries the frequency-time content of the signal, which implicitly carries the gait information of the person,” explained Belal Korany, another Ph.D. student involved in the effort.
Several important gait features are then extracted from both spectrograms and properly compared to declare if the person in the video is behind the wall.
“We have tested this technology extensively on our campus,” said Herbert Cai, the third Ph.D. student on the project. The lab has tested their new technology on 1,488 WiFi-video pairs, drawn from a pool of eight people, and in three different behind-wall areas, and achieved an overall accuracy of 84% in correctly identifying the person behind the wall.
Learn more: Your Video Can ID You Through Walls
The Latest on: Identification system
via Google News
The Latest on: Identification system
- Trending News: Chromatography Systems Market Is Projected to Grow at a Substantial Rate by 2027on November 30, 2020 at 4:48 am
Research Dive –:The global Chromatography Systems Market has registered for $9739.4 million in 2018, according to a new report published by Research Dive. The market is anticipated to reach $16014.9 ...
- Sybil Attack Identification for Crowdsourced Navigation: A Self-Supervised Deep Learning Approachon November 29, 2020 at 9:28 am
Crowdsourced navigation is becoming the prevalent automobile navigation solution with the widespread adoption of smartphones over the past decade, which supports a plethora of intelligent ...
- Tulsa World editorial: Oklahoma’s election system made us proud, but we can make it even betteron November 27, 2020 at 9:00 pm
While other states were painfully slowed by inefficiency and rules that seemed designed to inhibit progress, our state was fast, organized, accurate and verifiable, the editorial says. None of that ...
- Australia’s tax office to invest in ‘selfie’ identification technologyon November 27, 2020 at 9:32 am
The Australian Tax Office (ATO) expects to add electronic identity verification, based on a combination of user-submitted selfies and documents, to Australia’s myGovID system by mid-2021. An ATO ...
- AFIS (Automated Fingerprint Identification System) Market Grow At Exceptional Rate During 2020 To 2026on November 27, 2020 at 7:23 am
Market Growth Status and Outlook 2020-2027 ResearchMoz offers the latest published report on Global AFIS (Automated Fingerprint Identification System) Market analysis and forecast 2020–2027 delivering ...
- Improved system of animal identification-registration comes online in Georgiaon November 26, 2020 at 6:31 am
A new, improved system of animal identification and registration which contains information about cattle in Georgia and their owners is now fully functional, announces the Food and Agriculture ...
- Positive material identification Market Size growing at 15.60% CAGR by 2027on November 26, 2020 at 3:53 am
Global Positive material identification Market Report added at Market Study Report LLC offers industry size, share, growth, trends and forecast analysis up to 2027. Positive material identification ...
- Automatic Identification and Data Capture Market Forecast to 2027 - Global COVID-19 Impact and Analysis by Offering, Product, Industry Vertical - ResearchAndMarkets.comon November 25, 2020 at 12:25 pm
The "Automatic Identification and Data Capture Market Forecast to 2027 - COVID-19 Impact and Global Analysis by Offering, Product, Industry Vertical" report has been added to ResearchAndMarkets.com's ...
- X-Ray Security Screening System Market Revenue to Cross USD 4 Bn by 2026: Global Market Insights, Inc.on November 25, 2020 at 12:00 am
Major X-ray security screening system market players include Astrophysics Inc., Autoclear LLC, Adani Systems Inc., Analogic Corporation, GILARDONI S.p.A., Smiths Detection Group Ltd. (SMITHS Group PLC ...
- Automatic Identification and Data Capture Market Forecast to 2027 - COVID-19 Impact and Global Analysis by Offering, Product, Industry Verticalon November 23, 2020 at 3:56 pm
Reportlinker.com announces the release of the report "Automatic Identification and Data Capture Market Forecast to 2027 - ...
via Bing News