A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
via Google News
The Latest on: Multisensory effects
- Context-specific modulation of intrinsic coupling modes shapes multisensory processing on April 10, 2019 at 11:24 am
Intrinsically generated patterns of coupled neuronal activity are associated ... predicted stimulus-related multisensory effects. We found that prestimulus functional connectivity affects both ... […]
- How the Brain Links Gestures, Perception, and Meaning on March 31, 2019 at 4:01 am
Manuela Macedonia had only recently finished her master’s degree in linguistics when she noticed a recurring pattern among the students to ... Even abstract concepts like “delight” have multisensory ... […]
- Interior design of the future will seem like magic on February 15, 2019 at 3:18 am
Such changes include not just the pattern, colour and texture of the fabric ... The human-sized hive was designed as a sticky and multi-sensory experience where people could wander about and interact ... […]
- Dementia patients responding to sensory therapy rooms on January 22, 2019 at 5:02 am
These Multi-Sensory Environments, which usually have total blackout capabilities, include lighting effects such as bubble lamps, fiber optics, mirror balls and projectors that disburse light patterns ... […]
- New research connects heat, weekends with aggressive crimes and shootings in Chicago on October 24, 2018 at 12:33 pm
“We found that most types of crime in Chicago had very distinct patterns by time of year ... can affect how you “sense” or experience a big play. “This is a multi-sensory, often split-second judgement ... […]
- Optimal multisensory integration leads to optimal time estimation on August 30, 2018 at 2:38 am
Our brain compensates sensory uncertainty by combining multisensory information derived from an event ... event is likely to have similar characteristics with the statistical patterns of previous ... […]
- Multisensory effects on somatosensation: a trimodal visuo-vestibular-tactile interaction on May 19, 2016 at 5:00 pm
Here we exploit a previously reported visuo-vestibular integration to investigate multisensory effects on tactile sensitivity in humans ... chair wearing a head-mounted display showing a pattern of ... […]
- Musicians hear songs when they read music, non-musicians seek visual patterns on September 22, 2015 at 11:16 am
Recent advances in neuroscience have allowed scientists to examine what’s termed multi-sensory integration ... MEG allows scientists to map brain activity by imaging the effects produced by neurons as ... […]
- Research Study to Document Effects of Hippotherapy on December 14, 2006 at 4:00 pm
Strong anecdotal evidence suggests that the movement of the horse provides multi-sensory input that can improve human walking ... Shurtleff, OTD/C, to study the effects of hippotherapy. The Horses and ... […]
via Bing News