A team of researchers at UC San Diego and San Diego State University has developed a pair of “4-D goggles” that allows wearers to be physically “touched” by a movie when they see a looming object on the screen, such as an approaching spacecraft.
The device was developed based on a study conducted by the neuroscientists to map brain areas that integrate the sight and touch of a looming object and aid in their understanding of the perceptual and neural mechanisms of multisensory integration.
But for the rest of us, the researchers said, it has a more practical purpose: The device can be synchronized with entertainment content, such as movies, music, games and virtual reality, to deliver immersive multisensory effects near the face and enhance the sense of presence.
The advance is described in a paper published online February 6 in the journal Human Brain Mapping by Ruey-Song Huang and Ching-fu Chen, neuroscientists at UC San Diego’s Institute for Neural Computation, and Martin Sereno, the former chair of neuroimaging at University College London and a former professor at UC San Diego, now at San Diego State University.
“We perceive and interact with the world around us through multiple senses in daily life,” said Huang, the first author of the paper. “Though an approaching object may generate visual, auditory, and tactile signals in an observer, these must be picked apart from the rest of world, originally colorfully described by William James as a ‘blooming buzzing confusion.’ To detect and avoid impending threats, it is essential to integrate and analyze multisensory looming signals across space and time and to determine whether they originate from the same sources.”
In the researchers’ experiments, subjects assessed the subjective synchrony between a looming ball (simulated in virtual reality) and an air puff delivered to the same side of the face. When the onset of ball movement and the onset of an air puff were nearly simultaneous (with a delay of 100 milliseconds), the air puff was perceived as completely out of sync with the looming ball. With a delay between 800 to 1,000 milliseconds, the two stimuli were perceived as one (in sync), as if an object had passed near the face generating a little wind.
In experiments using functional Magnetic Resonance Imaging, or fMRI, the scientists delivered tactile-only, visual-only, tactile-visual out-of-sync, and tactile-visual in-sync stimuli to either side of the subject’s face in randomized events. More than a dozen of brain areas were found to respond more strongly to lateralized multisensory stimuli than to lateralized unisensory stimuli, the scientists reported in their paper, and the response was further enhanced when the multisensory stimuli are in perceptual sync.
The Latest on: Multisensory effects
National Trauma Expert Resmaa Menakem Co-Produces “Dismembered & Unarmed” Album, Delving Into Our Current State of Pain and Rebirth In America
on April 24, 2018 at 12:57 pm
Each lyricist reflects on personal and shared experiences that speak to the realities of the effects that racism ... this book we had a conceptualization that this needed to be a multi-sensory experience that incorporated sound, vibration, sight, image, ... […]
Ditch the Mud Bath and Herbal Tea for a Day at the 'Brain Spa'
on April 24, 2018 at 9:46 am
Holly Contreras, NeuroVella Facilitator, leads me to a treatment room with a NeuroSpa zero gravity chair and selects a multi-sensory node program on her ... the detrimental effects on the brain, and nervous system, caused by stress. We know that reducing ... […]
Koshiro Hino’s ‘Geist’ summons spirits with sound and light
on April 19, 2018 at 5:12 am
His newest project, “Geist,” is a multisensory sound-and light-show that features ... Domestically, Hino focuses on his ambient and noise project YPY, playing with effects pedals and cassette tapes to explore a method of creation similar to the French ... […]
New DreamWorks Theatre, “Kung Fu Panda: The Emperor’s Quest” opening date set for June at Universal Studios Hollywood
on April 17, 2018 at 10:47 am
With cutting-edge technology at the forefront of the multi-sensory attraction ... 4K Boxer Cinema Projectors and 360 degree surround sound audio, sweeping physical effects from water to wind will empower guests to feel more like participants than ... […]
Universal Studios Hollywood Announces Its DreamWorks Theatre Featuring KUNG FU PANDA: THE EMPEROR'S QUEST Opening June 15
on April 17, 2018 at 10:25 am
With cutting-edge technology at the forefront of the multi-sensory attraction, "Kung Fu Panda ... Cinema Projectors and 360 degree surround sound audio, sweeping physical effects from water to wind will empower guests to feel more like participants ... […]
How VR is Changing the Future of Star Wars
on April 11, 2018 at 1:25 am
“It’s a multisensory experience,” Cliff Plumer ... with 4DX (which integrates moving seats and environmental effects) now being the new trend being pushed on audiences. Granted, it’s found some initial success, but there’s no indication yet ... […]
Florida Aquarium to open multi-sensory 4D theater on Sunday
on September 28, 2017 at 5:00 am
Starting Sunday, visitors at the Florida Aquarium will have a new 4-D theater experience in the aquarium's outdoor plaza that will combine 3-D digital film with a variety of multisensory effects. Located by the outdoor Splash Pad, the aquarium will be ... […]
Multisensory effects on somatosensation: a trimodal visuo-vestibular-tactile interaction
on September 15, 2017 at 7:21 pm
Single number count for article citations from each service's database (may vary by service). The citations counts are reliant on the availability of the individual APIs from Web of Science, CrossRef, and Scopus. These counts are updated daily once they ... […]
Multi-sensory 4DX cinema experience with wind and lightning effects coming to Cineworld Ipswich next month
on May 18, 2016 at 4:41 pm
The 4DX auditorium will stimulate all five senses through high-tech motion seats and special effects such as wind, fog, rainstorm, lightning, bubbles, water, rain and scents. Available in both 2D and 3D formats, 4DX, which is exclusive to Cineworld in the ... […]
via Google News and Bing News