In recent years, research using Mixed Reality (MR) has attracted attention in the medical field, especially in radiology, where data captured by X-ray CT and MRI can be represented in 3D and combined with real space to aid diagnosis and simulate surgery. On the other hand, surface and volume rendering are mainly used for 3D rendering. It is difficult to grasp the internal structure only from the rendered data due to differences in rendering thresholds, and the information displayed is different from that of Multi-Planar Reconstruction (MPR) images as shown in 2D, so it is difficult to grasp the internal structure only from the rendered data. Also, general three-plane MPR images of sagittal, axial, and coronal sections differ from the practitioner's viewpoint when looking at the patient. This study aims to represent the 2D MPR image according to the viewpoint direction from which the practitioner views the patient and represents them in MR real-time. In the experiment, the system being proposed uses a head-mounted display (HMD) equipped with a camera see-through function that calculates the angle at which the practitioner views the patient utilizing the bed position as the central coordinate, generates MPR images from DICOM according to that angle, and displays them superimposed on the real space. As a result, the practitioner could check the internal structures of the patient's body according to their viewpoint direction with MPR images in MR.
|