Preoperative 3D visualization tool.
By integrating augmented and virtual reality, our project enhances surgical planning and training, improving anatomical visualization and procedural accuracy.
The integration of traditional preceptorship with VR environments presents complementary aspects. In the in-person context, direct supervision allows for detailed observation of the procedure and immediate feedback. Under this model, residents watch, perform under supervision, and subsequently teach, fostering the development of progressive skills. In the virtual environment, the immersive experience provides a safe space for practice, allowing residents to make mistakes without patient risk and repeat procedures multiple times. This overcomes real-world limitations such as time and resource availability. Thus, combining these approaches optimizes learning and delivers more comprehensive, effective training.
In the first preoperative experiment, the liver was reconstructed in 3D, with all eight hepatic segments and their vascularization clearly identified to facilitate surgical planning. During the activity, the preceptor supervised at the computer while the residents manipulated the 3D model in VR, presenting their approaches and justifications. The feedback provided by the surgeon highlighted the residents’ successes and mistakes, promoting the improvement of their skills.
Three types of visualizations were developed to solve the problem of non-occlusion of the user’s hands in the headset, which could hinder the procedure. One version had a transparent parenchyma and vessels; another displayed a wireframe of the parenchyma, allowing for the visualization of hands alongside the virtual overlay; and a third showed only vascular structures, used when anchoring the virtual object. A second operator switched among these views as needed. The device was used mainly at the beginning of the procedure, after opening and exposing the organs, to identify the relevant vasculature. The option to raise and lower the display made it easy to check the HoloLens content, allowing the surgeon to operate with the visor up for most of the time.
Can you think of a project?
vinicius.p.arcoverde@gmail.com
vinicius.p.arcoverde@gmail.com
@arcovinicius