  Purpose: The data which is available to surgeons before, during and after
surgery is steadily increasing in quantity as well as diversity. When planning
a patient's treatment, this large amount of information can be difficult to
interpret. To aid in processing the information, new methods need to be found
to present multi-modal patient data, ideally combining textual, imagery,
temporal and 3D data in a holistic and context-aware system. Methods: We
present an open-source framework which allows handling of patient data in a
virtual reality (VR) environment. By using VR technology, the workspace
available to the surgeon is maximized and 3D patient data is rendered in
stereo, which increases depth perception. The framework organizes the data into
workspaces and contains tools which allow users to control, manipulate and
enhance the data. Due to the framework's modular design, it can easily be
adapted and extended for various clinical applications. Results: The framework
was evaluated by clinical personnel (77 participants). The majority of the
group stated that a complex surgical situation is easier to comprehend by using
the framework, and that it is very well suited for education. Furthermore, the
application to various clinical scenarios - including the simulation of
excitation-propagation in the human atrium - demonstrated the framework's
adaptability. As a feasibility study, the framework was used during the
planning phase of the surgical removal of a large central carcinoma from a
patient's liver. Conclusion: The clinical evaluation showed a large potential
and high acceptance for the VR environment in a medical context. The various
applications confirmed that the framework is easily extended and can be used in
real-time simulation as well as for the manipulation of complex anatomical
structures.
