A plastic surgery research group has developed an augmented reality system that enables them to create 3D simulations of the desired results of facial reconstructive procedures and project them over the patient’s face during surgery, reports a study in Plastic and Reconstructive Surgery–Global Open®, the official open-access medical journal of the American Society of Plastic Surgeons (ASPS).
Koichi Ueda, MD, PhD, Daisuke Mitsuno, MD, and colleagues of Osaka Medical College, Japan, report the development and initial experience with an augmented reality (AR) system for evaluation of improvements of the body surface, a key consideration in plastic surgery. Initial experience in eight cases suggests that augmented reality could be a useful guide to planning, performing and evaluating the results of facial reconstruction and other procedures.
Development and Initial Experience of Augmented Reality for Plastic Surgery
“Augmented reality is a technology that combines computer-generated images on a screen with a real object or scene,” Drs. Ueda and Mitsuno said. “We sought to develop a sophisticated yet simple and modifiable AR technique for use during plastic and reconstructive surgery.”
The researchers used a high-definition digital camera to capture 3D image of the facial surface and computed tomography scans to obtain digital information on the underlying facial bones for each patient. These digital data were then manipulated to create 3D simulations of the ideal final results. For example, in a patient with a fractured cheekbone, the reconstruction was simulated by obtaining and reversing an image of the opposite, uninjured bone.
Using a pair of commercially available smart glasses, the surgeon was able to superimpose the 3D digital simulation image of the desired appearance over the patient’s face during surgery. The group used free, open source software products to solve various technical problems, including manipulating and displaying the 3D simulations and lining them up (registration) with the surgical field.
The researchers describe their preliminary experience with AR system in eight patients undergoing reconstructive facial surgery. The AR system helped in planning and confirming reconstruction of the underlying facial bones, for example, in a patient with a congenital bone development disorder and another patient with a complex facial fracture. In all cases, the 3D simulation of the body surface provided a visual reference of the final facial appearance.
With each new case, the group made additional technical refinements to address limitations of the AR system. Although the experimental system was not actually used to guide surgery in this initial experience, it helped in visualizing the planned correction and confirming the final outcome.
“In all cases in this study, the body surface contour after the procedure and the ideal postoperative image almost coincided,” Dr. Ueda said.
The group plans further studies to confirm the benefits of using the AR system during plastic and reconstructive surgery and to refine the display method for comparing before and after images. Future innovations may include the ability to quantitatively evaluate the improvements in body surface and even to enable simple navigation of internal organs.
Drs. Ueda and Mitsuno believe AR technology could become a useful tool for teaching surgical skills.
They said, “Our findings are not only useful for body surface evaluation but also for effective evaluation of AR technology in the field of plastic surgery.”
The Latest on: Augmented Reality for Plastic Surgery
- The cutting edge: A Casper doctor treats carpal tunnel with augmented realityon November 26, 2019 at 8:45 am
He considered surgery, but the recovery time would mean he’d need to take weeks off work ... This is the first innovation married with the second. McGinley is using an augmented reality device he ...
- The OnPoint Companies Recognized for Innovation in Augmented Reality for Orthopedic and Robotic Surgeryon November 13, 2019 at 3:00 am
"We're very pleased to be recognized by BPLA for our innovations in the area of Augmented Reality and surgical guidance," said Philipp Lang, MD, Founder and CEO of the OnPoint Companies. "Orthopedic ...
- Instagram has announced that it will remove all filters that depict plastic surgeryon October 28, 2019 at 8:57 am
Filters are endless, nowadays – you can be a dog, a zombie, inside a TV box, in the Bahamas and you can even have plastic surgery. In August, Instagram started allowing users to upload their own ...
- Philadelphia Plastic Surgeon Utilizes 3D Imaging Technology for an Augmented Reality Consultationon October 23, 2019 at 11:04 am
These photos vary widely and are subjective in nature, sometimes creating false expectations for the outcome that can lead to dissatisfaction after surgery. To overcome this dissonance, Philadelphia ...
- Instagram is banning plastic-surgery effect filterson October 23, 2019 at 6:07 am
TORONTO -- Instagram is removing all augmented reality (AR) filters depicting or appearing to promote plastic surgery, following online concerns they harmed people’s mental health. These include AR ...
- Augmented Reality: Extending Real-Time Information During Surgeryon October 10, 2019 at 12:13 pm
Optical surgeons have to eyeball (yeah, I know, I just couldn’t help myself…) their work. Augmented reality can help provide information while the surgery is happening in the same way that a heads-up ...
- Surgical Theater Demonstrating Virtual and Augmented Reality Solutions for Skull Base Surgery to the Annual North American Skull Base Societyon February 14, 2019 at 2:26 am
ORLANDO, Fla., Feb. 14, 2019 /PRNewswire-PRWeb/ -- Surgical Theater brings Virtual and Augmented Reality solutions for Skull Base Surgery to the Annual NASBS Meeting in Orlando, FL from February 15-16 ...
- 'New augmented reality system to guide plastic surgery'on August 26, 2017 at 4:38 am
Researchers at Osaka Medical College in Japan reported the development and initial experience with the augmented reality (AR) system for evaluation of improvements of the body surface, a key ...
- Augmented reality technology may help guide plastic and reconstructive surgeryon August 25, 2017 at 1:10 pm
A plastic surgery research group has developed an augmented reality system that enables them to create 3-D simulations of the desired results of facial reconstructive procedures and project them over ...
via Google News and Bing News