A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
via Google News
The Latest on: Multisensory effects
- The Urban (Un) Seen “Artificial Intelligence as Future Space” / Bettina Zerza for the Shenzhen Biennale (UABB) 2019on January 19, 2020 at 1:13 am
Today, there is greater emphasis on lifestyle as architecture indulges in idiosyncratic shape-making and aimless aesthetic effects. Twenty-first century architecture can find ... The installation’s ...
- Age-related sensory decline mediates the Sound-Induced Flash Illusion: Evidence for reliability weighting models of multisensory perceptionon December 18, 2019 at 2:17 am
We tested multisensory processes in a large sample ... As described, the former two of these mediators followed the predicted pattern of effects, whereby better visual acuity resulted in weaker ...
- Clair Solutions and Elation meet high standards at Paradise Club in Times Squareon December 13, 2019 at 10:51 am
Following the multi-sensory “Devouring” cabaret show ... The designer calls the Artiste DaVinci the “artistic workhorse” of the rig, used for pattern projection, color washes, aerial effects, and as ...
- Towards Multi-modal Interfaceson December 1, 2019 at 9:41 pm
Humans are multisensory beings and make sense of the ... taste since taste often requires people to consume something, the effects of which can be hard to control for, while designing for larger ...
- Free festival to transform Wembley Park into winter wonderlandon November 2, 2019 at 8:45 am
Straight from Nevada’s Burning Man festival, visitors can experience Sonic Runway, the acclaimed multisensory installation ... while observing the effects of sound at Burning Man in 2002.
- Visual and somatosensory information contribute to distortions of the body modelon September 19, 2019 at 2:10 am
Coherent with the multisensory nature of body representations ... If the same visual-based pattern of distortions shapes our mental representations, it follows that different body parts should ...
- Context-specific modulation of intrinsic coupling modes shapes multisensory processingon April 10, 2019 at 11:00 am
Intrinsically generated patterns of coupled neuronal activity are associated ... predicted stimulus-related multisensory effects. We found that prestimulus functional connectivity affects both ...
- The benefits of sewing and crafting for mental healthon January 8, 2019 at 3:11 am
Today’s research is less optimistic about the long-term effects of color ... The great thing about crafting is that it’s multi-sensory too. For instance, if you are sewing with super soft ...
- Fireflies thwart bat attack with multisensory warningson August 22, 2018 at 12:24 pm
We demonstrate that these nocturnal predators learn to avoid noxious fireflies using either vision or echolocation and that bats learn faster when integrating information from both sensory ...
via Bing News