A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
- Sample size matters in multisensory integration studies on September 20, 2018 at 8:33 am
Researchers at Baylor College of Medicine have examined this problem in the field of multisensory integration to understand ... studies with sample sizes of 20 individuals overestimate true effects an... […]
- Visual Effects Firm Vividthree Heads for Singapore IPO on September 20, 2018 at 2:44 am
Singapore-based digital effects company Vividthree Holdings ... “The Future of Us,” a futuristic multi-sensory experiential exhibition. The company say that most of the fresh cash will be ... […]
- 10 mistakes you're making when ordering drinks on a flight on September 18, 2018 at 9:20 am
For even the most relaxed travelers, air travel can be seriously stressful — from the effects on your body to delays and ... researchers at Cornell University found that "the multisensory properties o... […]
- Full-Body VR Experience ‘The Void’ Adds Nine New Locations on June 6, 2018 at 2:35 pm
Minneapolis; New York; Philadelphia; Santa Monica, Calif.; and Washington, D.C. “The Void” combines state-of-the-art VR technology, physical stages, and multi-sensory effects (including touch and smel... […]
- New ‘4D goggles’ allow wearers to experience objects from video content on February 9, 2018 at 4:04 am
The device can be synchronised with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence. ... […]
- Florida Aquarium to open multi-sensory 4D theater on Sunday on September 28, 2017 at 3:26 am
Starting Sunday, visitors at the Florida Aquarium will have a new 4-D theater experience in the aquarium's outdoor plaza that will combine 3-D digital film with a variety of multisensory effects. Loca... […]
- Multisensory effects on somatosensation: a trimodal visuo-vestibular-tactile interaction on September 15, 2017 at 7:21 pm
Single number count for article citations from each service's database (may vary by service). The citations counts are reliant on the availability of the individual APIs from Web of Science, CrossRef, ... […]
- Get ideas with free backyard pond, garden tours on August 10, 2017 at 9:14 am
Visitors to the area's only exclusive outdoor Water & Garden Showcase can enjoy the multisensory effects of water, plants in bloom and other new landscape elements. A freewill offering at each event s... […]
- Woman passing out on Flight of Passage at Disney’s Animal Kingdom among latest theme park injury reports on July 18, 2017 at 8:16 am
A 31-year-old woman felt dizzy and briefly passed out on the 3-D Flight of Passage attraction at the new Pandora — the World of Avatar at Disney’s Animal Kingdom ... but with more multisensory effects ... […]
- Your guide to Pandora, Disney's new 'Avatar'-inspired land on May 23, 2017 at 11:50 am
The attraction is like a reconfigured version of Soarin’, but with more multisensory effects and no dangling feet. In a departure from usual Disney practices, there is no signage indicating the two ri... […]
via Google News and Bing News