A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
Dorney Park highlights sensory-friendly services with Autism Awareness Week
on July 17, 2018 at 8:55 pm
One Cirque Imagine Show at the Good Time Theater will be shown at a lower decibel level and there will be no major lighting effects. There's also a multi-sensory room where parents can go in case they ... […]
Photo Flash: First Look at The Vaults' Immersive Show SOUNDS AND SORCERY CELEBRATING DISNEY FANTASIA
on July 17, 2018 at 7:52 am
Sounds and Sorcery celebrating Disney FANTASIA is a modern, innovative multi-sensory show that brings to life the ... elaborate set designs and dazzling lighting effects. Arrive at your destination un... […]
Illusory resizing of the painful knee is analgesic in symptomatic knee osteoarthritis
on July 17, 2018 at 1:25 am
This proof-of-concept study in people with painful knee osteoarthritis (OA) aimed to determine if: (i) visuotactile illusions that manipulate perceived knee size are analgesic; (ii) cumulative analges... […]
Multisensory interventions cut pain in preterm infant eye exams
on June 2, 2018 at 5:00 am
(HealthDay)—The addition of multisensory pain-reducing interventions to topical anesthetic (TA) reduces pain in eye examinations of preterm infants, according to research published online June 1 in Pe... […]
Multisensory experiences enhance sales and feeling of comfort in shops and restaurants
on May 30, 2018 at 5:00 am
According to research, the combination of food, lighting, colours, furniture, table setting, atmosphere, sound and environment create a multisensory experience that has an effect on consumers' behavio... […]
Music, unique environment part of multi-sensory project at King's Grant
on November 6, 2017 at 4:10 am
It’s the Dietrich Multi-Sensory Room at King’s Grant ... A person is brought into the room and sits in a comfortable chair, facing the mirrors, special effects and a variety of objects. A trained staf... […]
Multisensory effects on somatosensation: a trimodal visuo-vestibular-tactile interaction
on September 15, 2017 at 7:21 pm
Single number count for article citations from each service's database (may vary by service). The citations counts are reliant on the availability of the individual APIs from Web of Science, CrossRef, ... […]
How virtual reality pushed AR Rahman towards 'multi-sensory' filmmaking
on May 14, 2017 at 4:24 pm
Now it’s Rahman’s turn to make his directorial debut with Le Musk, which is being touted as the world’s first virtual reality “multi-sensory” feature film ... Of course, visual effects (VFX) and compu... […]
Multi-sensory 4DX cinema experience with wind and lightning effects coming to Cineworld Ipswich next month
on May 18, 2016 at 4:41 pm
The 4DX auditorium will stimulate all five senses through high-tech motion seats and special effects such as wind, fog, rainstorm, lightning, bubbles, water, rain and scents. Available in both 2D and ... […]
Development of multisensory integration from the perspective of the individual neuron
on July 17, 2014 at 5:00 pm
A synergy between unisensory subregions of the association cortex drives multisensory integration capabilities in the mature superior colliculus. Figure 5: Deactivating the association cortex in early ... […]
via Google News and Bing News