  3D data from high-resolution volumetric imaging is a central resource for
diagnosis and treatment in modern medicine. While the fast development of AI
enhances imaging and analysis, commonly used visualization methods lag far
behind. Recent research used extended reality (XR) for perceiving 3D images
with visual depth perception and touch, but used restricting haptic devices.
While unrestricted touch is beneficial for volumetric data examination,
implementing natural haptic interaction with XR is challenging. The research
question is whether a multimodal XR application with intutitive haptic
interaction adds value and should be pursued. In a study, 24 expterts for
biomedical images in research and medicine. explored 3D anatomical medical
shapes with 3 applications: a multimodal virtual reality (VR) prototype using
haptic gloves, a simple VR prototype using VR controllers, and a commonly used
standard PC application. Results of the standardized questionnaires showed no
significant differences between the three application types regarding usability
and no significant difference between both VR applications regarding presence.
Participants agreed to statements that VR visualizations provide better depth
information, that using the hands instead of controllers simplifies data
exploration, that the multimodal VR prototype allows intuitive data
exploration, and that it is beneficial over traditional data examination
methods. While most participants mentioned the manual interaction as best
aspect, they also found it the most improvable. We conclude that a multimodal
XR application with improved manual interaction adds value for volumetric
biomedical data examination. We will proceed with our open-source research
project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to serve
medical education, therapeutic decisions, surgery preparations, or research
data analysis.
