In 2017, the AIM Lab team of engineers developed software capable of translating digital formats of medical scans into virtual reality for medical decision making, pre-surgical planning and patient education. The idea was to eliminate the need to 3D print a physical model and reduce the time it takes to view a complete image. It was also the team's belief that VR would enable clinicians to explore and experience the anatomy in ways they’ve never been able to before.
In watching these clinicians interact with the 3D anatomy models within VR, it was noted that they were all instinctively narrating what they were seeing within the virtual space and sharing discoveries along the way. That’s when the AIM Lab realized they had created a new form of medical education.
With that came the commercial spinoff of Enduvo, a platform that allows clinical educators to build lectures in virtual reality, using nothing more than 3D anatomic models, video clips and diagrams.
The VR software is now being used by government, manufacturing and industrial customers.
Before the first cases of COVID-19 hit the United States, the AIM Lab was working with researchers from the University of Illinois College of Medicine Peoria (UICOMP) and the Jump Trading Simulation & Education Center to teach medical students and health professionals outside of the hospital or classroom.
Medical students can’t always participate in bedside rounds, assist in surgeries or learn from real-life scenarios where they have to diagnose critically-ill patients. So, the team wanted to investigate if they could give students that same experience using virtual reality.
Along with other researchers, including Dr. Teresa Riech, built two cases in VR where medical students would have to diagnose and treat an adult with an unstable heart rhythm and a child who had difficulty breathing. The team then tasked 20 volunteer learners to go through each case at their own pace.
The training also helped build students' confidence. Before the lessons, only 5% expressed complete confidence in their ability to assess and provide the right treatment. 45% reported feeling completely confident in their skills after the VR lessons, 55% of students felt somewhat confident, and no students rated themselves as 'not at all confident'. This research was presented at the Association of American Medical Colleges 2020 Annual Meeting.
Surgical oncologist Dr. Sonia Orcutt first learned about the 3D modeling capabilities of Jump AIM through her husband, a pediatric cardiologist.
“Like pediatric cardiac surgeons, we face the same challenges of not knowing what we are going to see in the operating room until we get there,” said Dr. Orcutt. “So, this piqued my interest in wanting to study the feasibility of using VR to see complex abdominal tumors for pre-surgical planning.”
Dr. Orcutt worked with the team to convert CT scans of previous surgical cases into VR and discovered that viewing the images in this technology would’ve helped her better define her operating plans. She now regularly uses VR to view complex cases where she can’t distinguish the relationship of a tumor with other structures, such as blood vessels or other major organs.
In one situation, she and her colleague were having a difficult time determining a plan of attack on a large tumor that was displacing a patient’s liver, inferior vena cava and kidney.
“When we placed our images in VR, we got a better understanding of the size and location of this tumor,” said Dr. Orcutt. “We ended up changing our incision to be a little larger, so we could have control of the blood vessels. We didn’t want to run into any significant hemorrhaging issues or anything else that was unsafe.”
Thanks to continued funding for the VR program, Dr. Orcutt is working on a formal study on whether the technology, in addition to standard imaging, improves a physician’s ability to define the extent of how much tissue should be cut out in a surgery. This can open the door to using this technology for a variety of tumors beyond the abdominal cavity.