A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
via Google News
The Latest on: Multisensory effects
- How to light up your Christmas garden to Kew standardson November 20, 2020 at 11:00 pm
Lighting artists come from all over the world to display their skills at London’s Christmas at Kew, (4 December-21 January 2021), and they are available for commission. For the entertainment of you ...
- El Paso Children's Museum unveils plans for interactive exhibitson November 19, 2020 at 2:00 pm
Children will take an educational journey through the Anything’s Possible Climber, which will take them to the museum’s four levels.
- 10th edition of ŻiguŻajg more accessible than everon November 19, 2020 at 12:55 am
With an all-online festival, every show has been stripped down and thoroughly analysed from a sensory standpoint so that, ultimately, the viewers get to enjoy a multisensory immersive and ...
- Architecture Newson November 16, 2020 at 5:34 am
Each practice then contracted a distinct intervention within its formerly domestic spaces: a kitchen was transformed into a mobile threshold; a bedroom into a hermetic multi-sensory chamber ...
- New Neuroscience Faculty 2020on October 31, 2020 at 11:35 am
Dr. Radulovic completed her MD and PhD degrees at University of Belgrade, Serbia, working on the effects of stress on immunological ... of interneurons that control the integration of multisensory ...
- VTech Shares their Top Toy Picks for Holiday 2020on October 28, 2020 at 5:12 am
This soft, plush animal invites cuddles while providing lots of sensory stimulation with multiple textures and bright patterns. This toy's 45+ songs ... phrases and songs, and deliver multi-sensory ...
- Hypnosis Experts Cast Doubt on Famous Psychological Experimentson October 21, 2020 at 4:50 am
But this approach suffers from exactly the same problem, Lush argues, citing a study he has run showing that people give the same pattern ... then move up to multisensory effects, such as the ...
- Current Projectson October 21, 2017 at 12:09 am
Characterizing such temporal stages and defining their functional significance is crucial to understand the neurophysiological processes that govern multisensory integration ... unhealthy sleep ...
- Projects Aided by the HCPon March 2, 2016 at 9:56 pm
Atypical integration of multisensory inputs has been suggested as a major component ... one fundamental way in which these individuals stave off the negative effects of cognitive aging is by ...
via Bing News