Tangible Immersive Trauma Simulation:
Is Mixed Reality the next level of
medical skills training?
Jakob Carl Uhl; Helmut Schrom-Feiertag; Georg Regal et al.
2023
The proposed main requirements of first responders regarding
haptic multi-sensory skill training in mixed reality and the lessons
learned from the workshop aim to guide the design of training
solutions for medical training in MR which shall be addressed in
future work
Abstract
In medical simulation training two approaches are currently rather disjunct: realistic
manikins are used to teach physical skills and procedures and VR systems are used to train
situation assessment and decision making. We propose a mixed reality approach, which
allows trainees to use real tools and their hands when interacting with a physical manikin
overlaid with a responsive virtual avatar. In close exchange with first responder
organizations, we developed and evaluated an MR training scenario. In the scenario, users
can talk to injured people in a car accident, assess the threat of the environment, and utilize
real medical equipment. Participants experienced high levels of physical- and self-presence,
increased stress levels, and reported a high technology acceptance. The proposed main
requirements of first responders regarding haptic multi-sensory skill training in MR and the
lessons learned from the workshop aim to guide the design of training solutions for medical
training in MR.
Findings
For the peaks per minute this resulted in a significant F-test for both the medical experts
(F(2,10) = 9.730, p = 0.005) and the first responders (F(2,8) = 7.588, p = 0.014)
For mean peak amplitude, the F-test was significant in case of the medical experts (F(2,10)
= 8.2143, p = 0.008)
Post-hoc Tukey tests revealed a significant difference between the baseline and approach
interval (p = 0.017), but not for baseline and treatment (p = 0.094) or approach and
treatment (p = 0.645)
, The Tukey tests revealed here a significant difference between baseline and approach (p =
0.009) as well as between baseline and treatment (p = 0.012)
Scholarcy Highlights
In a matter of minutes, medical first responders must decide and act to save another
person’s life
Skill training in mixed reality (MR) and the lessons learned from the workshop aim to
guide the design of training solutions for medical training in MR
After testing the MR manikin and the different interactions we developed internally, we
conducted an expert workshop to answer our research question: would an MR manikin
in this form enable basic medical skill training and its hypotheses: how is it experienced
in terms of technology acceptance and presence? We chose a workshop format, as we
wanted the experts to have a space to try out the MR manikin and the interactions
without putting too much focus on performance in the scenario
We present the development and evaluation of a medical MR training scenario that
integrates a physical tangible manikin and physical tangible tools into a virtual accident
scenario environment. This MR training scenario allows trainees to use real tools and
their own hands when interacting with the physical manikin overlaid with a responsive
virtual agent
Participants experienced high levels of physical- and self-presence, increased stress
levels, and reported a high technology acceptance. This implies, that MR is seen as a
viable technological solution to create immersive skill training, which end-users see as a
useful tool and addition to existing training solutions
The proposed main requirements of first responders regarding haptic multi-sensory
skill training in MR and the lessons learned from the workshop aim to guide the design
of training solutions for medical training in MR which shall be addressed in future work
Scholarcy Summary
In a matter of minutes, medical first responders must decide and act to save another
person’s life.
Complementary to this practical approach to training, VR simulations have been developed
and employed to prepare medical professionals within immersive virtual environments for
the challenging situations they face in their line of work - e.g.
These virtual simulations focus on more “top-down” aspects of training medical
emergencies: assessing virtual accident sites for environmental threats, realistic
representations of patients, and learning the sequence of treatments with controller-based
interaction can accustom trainees to stressful situations and teach them the rules and steps
to coping with them.
Is Mixed Reality the next level of
medical skills training?
Jakob Carl Uhl; Helmut Schrom-Feiertag; Georg Regal et al.
2023
The proposed main requirements of first responders regarding
haptic multi-sensory skill training in mixed reality and the lessons
learned from the workshop aim to guide the design of training
solutions for medical training in MR which shall be addressed in
future work
Abstract
In medical simulation training two approaches are currently rather disjunct: realistic
manikins are used to teach physical skills and procedures and VR systems are used to train
situation assessment and decision making. We propose a mixed reality approach, which
allows trainees to use real tools and their hands when interacting with a physical manikin
overlaid with a responsive virtual avatar. In close exchange with first responder
organizations, we developed and evaluated an MR training scenario. In the scenario, users
can talk to injured people in a car accident, assess the threat of the environment, and utilize
real medical equipment. Participants experienced high levels of physical- and self-presence,
increased stress levels, and reported a high technology acceptance. The proposed main
requirements of first responders regarding haptic multi-sensory skill training in MR and the
lessons learned from the workshop aim to guide the design of training solutions for medical
training in MR.
Findings
For the peaks per minute this resulted in a significant F-test for both the medical experts
(F(2,10) = 9.730, p = 0.005) and the first responders (F(2,8) = 7.588, p = 0.014)
For mean peak amplitude, the F-test was significant in case of the medical experts (F(2,10)
= 8.2143, p = 0.008)
Post-hoc Tukey tests revealed a significant difference between the baseline and approach
interval (p = 0.017), but not for baseline and treatment (p = 0.094) or approach and
treatment (p = 0.645)
, The Tukey tests revealed here a significant difference between baseline and approach (p =
0.009) as well as between baseline and treatment (p = 0.012)
Scholarcy Highlights
In a matter of minutes, medical first responders must decide and act to save another
person’s life
Skill training in mixed reality (MR) and the lessons learned from the workshop aim to
guide the design of training solutions for medical training in MR
After testing the MR manikin and the different interactions we developed internally, we
conducted an expert workshop to answer our research question: would an MR manikin
in this form enable basic medical skill training and its hypotheses: how is it experienced
in terms of technology acceptance and presence? We chose a workshop format, as we
wanted the experts to have a space to try out the MR manikin and the interactions
without putting too much focus on performance in the scenario
We present the development and evaluation of a medical MR training scenario that
integrates a physical tangible manikin and physical tangible tools into a virtual accident
scenario environment. This MR training scenario allows trainees to use real tools and
their own hands when interacting with the physical manikin overlaid with a responsive
virtual agent
Participants experienced high levels of physical- and self-presence, increased stress
levels, and reported a high technology acceptance. This implies, that MR is seen as a
viable technological solution to create immersive skill training, which end-users see as a
useful tool and addition to existing training solutions
The proposed main requirements of first responders regarding haptic multi-sensory
skill training in MR and the lessons learned from the workshop aim to guide the design
of training solutions for medical training in MR which shall be addressed in future work
Scholarcy Summary
In a matter of minutes, medical first responders must decide and act to save another
person’s life.
Complementary to this practical approach to training, VR simulations have been developed
and employed to prepare medical professionals within immersive virtual environments for
the challenging situations they face in their line of work - e.g.
These virtual simulations focus on more “top-down” aspects of training medical
emergencies: assessing virtual accident sites for environmental threats, realistic
representations of patients, and learning the sequence of treatments with controller-based
interaction can accustom trainees to stressful situations and teach them the rules and steps
to coping with them.
