Dutch report success with augmented reality of brain
Dutch researchers have used augmented reality to help pinpoint brain tumors before surgically removing them. They found the technique was nearly as accurate as standard neuronavigation, and it has helped improve understanding of the anatomy and efficiency during a procedure.
Information from World Neurosurg, October 2018, Vol. 118, pp. e422-e427 and reported on Health website AuntMinnie.com
The group, led by first author Dr. Fatih Incekara from Erasmus University Medical Center in Rotterdam, converted MRI scans of brain tumor patients into holograms and then overlaid these holograms directly onto the head of each patient using a type of augmented reality technology known as mixed reality. This allowed clinicians to visualize the brain and tumor of each patient right before surgery.
“This new technology proved to be pretty accurate when compared with the neuronavigation system,” Incekara told AuntMinnieEurope.com. “And surgeons reported an improved focus during surgery.”
Tumor localization
In recent decades, image-guided navigation technologies have proved highly practical and effective for use in complex neurosurgeries such as brain tumor removal, the authors noted. Current neuronavigation methods using these tools, however, are impeded by long setup times and require clinicians to repeatedly shift their gaze back and forth between 2D images on a screen and the patient.
Seeking to find a more intuitive way to plan tumor surgery, Incekara and colleagues turned to mixed reality technology — a variation of augmented reality that allows users to see and interact with virtual objects and their actual surroundings. They tested the feasibility of this approach in presurgical planning for the removal of brain tumors from 25 patients at their institution.
The group began by acquiring and then segmenting brain MRI scans of the patients. Next, they reconstructed 3D virtual models of the brain tumors with open-source software (Meshmixer, Autodesk) and used 3D-modeling software (Verto Studio) to make these virtual models compatible for use in a mixed reality device (Hololens, Microsoft).
Wearing a HoloLens headset, the neurosurgeons were able to merge the hologram of the patient’s brain and tumor with the physical head of the patient. This enabled them to determine the location of tumors and then mark the center and border of each tumor directly on the patient’s head. For comparison, the surgical team marked the center and border of the tumors on the patient’s head again, but this time using the standard neuronavigation method. They eventually removed the brain tumors based on measurements from the standard method.
Overall, the holograms of the tumor aligned well with the borders of the actual tumor. The clinicians were able to locate tumors using the mixed reality technique as precisely as they did with the conventional neuronavigation method in nine of the 25 patients (36%). The median deviation between the two techniques was 0.4 cm for the rest of the cases.
Furthermore, the surgeons claimed that using the mixed reality device during the operation enhanced their ergonomics, their understanding of the relationship between the tumor and the brain, and their attention and focus on the patient.