Safe and effective radiotherapy (RT) requires the reproduction of a specific patient posture and the precise alignment of the patient with an RT device. Any difference in these two aspects can lead to under-dosing the tumor or overdosing healthy tissues. Current methods to guide patient setup use either onboard x-ray imaging or ceiling-mounted cameras. The former increases patient dose and prolongs treatment time while the latter is limited by obstruction, poor ergonomics, and prohibitive cost. Thus, there remains a real opportunity to improve the setup process for RT, benefiting patients and expanding accessibility to advanced techniques.
To achieve this, University of Florida researchers have developed a new system for patient posture correction and alignment using mixed-reality (MixR) visualization. MixR is the blending of physical and digital environments. It is best implemented using immersive technology like the Microsoft HoloLens which use a variety of sensors to map the surroundings, track objects, and render holograms at specific locations. Notably, these attributes are enabled while a user dynamically navigates a space, thereby providing natural viewing of holograms.
By tapping into the unique features of MixR, UF researchers are developing an accurate, efficient, cost-effective, and portable system for registering a patient with an RT device by using a hologram as an intermediary. The system allows a user to simultaneously and directly view a patient and a reference hologram of their surface derived from a CT scan of their body. The hologram provides a visual reference for the exact posture needed during treatment. By matching a patient to their hologram, the correct posture is achieved while also registering the patient with the RT device. In this way, the system removes the need for expensive and restrictive external cameras and holds the promise to improve outcomes by increasing accuracy and safety while reducing setup time and imaging dose. By designing the application for a commercial off-the-shelf device like the HoloLens, the system improves portability, reduces cost, and increases accessibility for centers with limited resources.
Combinatorial imaging system using mixed reality visualization to generate 3D holograms for accurate setup of patients undergoing radiation therapy
University of Florida researchers developed an imaging system combining mixed reality and surface-guided radiation therapy to generate 3D holograms for precise patient alignment against a medical device. Clinicians can visualize a patient and a reference hologram through an optical, see-through head-mounted display, allowing them to overlay a patient image over the physical space where they will provide treatment. This system uses an inside-out tracking approach, with the tracking methods originating from sensors on the head-mounted device, enabling dynamic movement around the room.
This technology ensures the proper alignment and positioning of patients by the radiation therapist, facilitating the optimal dose of radiation received by patients. It can also simulate precise anatomical references of patient bodies to facilitate pre-surgical preparation. Additionally, it can aid patients imaging further in their treatment to determine the efficacy of the radiation therapy and their general state of health.