Immersive Simulation and Paramedicine Students’ Situational Awareness: A Mixed-Methods Pilot Study
Main Article Content
Abstract
Background: Situational awareness involves the ability to recognise and interpret environmental cues and utilise this to predict future events. It is an important factor in the minimisation of human error in many settings, including healthcare. It is especially relevant within paramedic practice where the situation may be highly dynamic. Simulation-based education is increasingly used within paramedicine education and has been demonstrated as effective for the development of situational awareness in healthcare professionals.
Aims: The primary aim of this study was to evaluate the level of situational awareness in undergraduate paramedicine students during an immersive simulation compared to that during a more conventional, non-immersive scenario. A secondary aim was to examine student perceptions of situational awareness, as well as their experiences of the simulations in which they participated.
Methods: Third-year paramedicine students at an Australian university participated in two simulated emergency scenarios; one in an immersive setting, and one in a non-immersive environment. The Situation Awareness Global Assessment Technique was utilised to assess their level of situational awareness at various pre-determined points in each scenario. Subsequently, semi-structured interviews were utilised to examine student perceptions of situational awareness as well as their experiences of the simulations.
Results: Overall, students (n=18) demonstrated lower levels of situational awareness in the immersive simulation compared with the non-immersive simulation. Most errors occurred in the initial stages, within the ‘recognition’ component of situational awareness. Eight students participated in follow-up interviews, with the majority expressing that the immersive nature of the simulation adversely affected their scenario management. They reported difficulty in recall of basic knowledge, disorganisation of thoughts and clinical approach, and being able to concentrate only on one thing at a time.
Conclusion: Paramedicine students in our study demonstrated lower levels of situational awareness during an immersive simulated scenario compared with a conventional non-immersive setting, particularly in the initial ‘recognition’ stage of situational awareness. As a lack of situational awareness may contribute to healthcare errors, its assessment and development must be addressed within paramedicine education. The utilisation of immersive simulation in paramedicine curricula may play an important role in this area.
Article Details
The Medical Research Archives grants authors the right to publish and reproduce the unrevised contribution in whole or in part at any time and in any form for any scholarly non-commercial purpose with the condition that all publications of the contribution include a full citation to the journal as published by the Medical Research Archives.
References
2. Weingart NS, Wilson RM, Gibberd RW, Harrison B. Epidemiology of medical error. BMJ. 2000;320(7237):774-777.
3. Peadon R, Hurley J, Hutchinson M. Hierarchy and medical error: Speaking up when witnessing an error. Safety Science. 2020;125:104648.
4. James JT. A new, evidence-based estimate of patient harms associated with hospital care. Journal of Patient Safety. 2013;9(3):122-128.
5. Hunter J, Porter M, Williams B. Towards a theoretical framework for situational awareness in paramedicine. Safety Science. 2020;122:104528.
6. Endsley MR. Design and evaluation for situation awareness enhancement. Proceedings of the Human Factors Society 32nd Annual Meeting Los Angeles, CA. 1988;32(2):97-101.
7. Endsley MR. Toward a theory of situation awareness in dynamic systems. Situational awareness: Routledge; 1995:9-42.
8. Endsley MR. Theoretical Underpinnings of Situation Awareness: A Critical Review. In: Endsley MR, Garland DJ, eds. Situation awareness analysis and measurement: Taylor & Francis Group; 2000:3-32.
9. Sneddon A, Mearns K, Flin R. Situation awareness and safety in offshore drill crews. Cognition, Technology & Work. 2006;8(4):255-267.
10. Nguyen T, Lim CP, Nguyen ND, Gordon-Brown L, Nahavandi S. A review of situation awareness assessment approaches in aviation environments. IEEE Systems Journal. 2019;13(3):3590-3603.
11. Hollands JG, Spivak T, Kramkowski EW. Cognitive load and situation awareness for soldiers: Effects of message presentation rate and sensory modality. Human Factors. 2019;61(5):763-773.
12. Levin S, Sauer L, Kelen G, et al. Situation awareness in emergency medicine. IIE Transactions on Healthcare Systems Engineering. 2012;2(2):172-180.
13. Lee SW, Kim AR, Park J, Kang HG, Seong PH. Measuring situation awareness of operating team in different main control room environments of nuclear power plants. Nuclear Engineering and Technology. 2016;48(1):153-163.
14. Schulz CM, Burden A, Posner KL, et al. Frequency and type of situational awareness errors contributing to death and brain damage: a closed claims analysis. Anesthesiology. 2017;127(2):326-337.
15. World Health Organization. Human Factors in Patient Safety: Review of Topics and Tools. 2009; https://www.who.int/patientsafety/research/methods_measures/human_factors/human_factors_review.pdf. Accessed August 17 2021.
16. Bleetman A, Sanusi S, Dale T, Brace S. Human factors and error prevention in emergency medicine. Emergency Medicine Journal. 2012;29(5):389-393.
17. Lauria MJ, Ghobrial MK, Hicks CM. Force of habit: developing situation awareness in critical care transport. Air Medical Journal. 2019;38(1):45-50.
18. Lioce L., Lopreiato J., Downing D., et al., eds. Healthcare Simulation Dictionary –Second Edition. Rockville, MD
Agency for Healthcare Research and Quality; 2020; No. Publication No. 20-0019.
19. Abelsson A, Rystedt I, Suserud BO, Lindwall L. Learning by simulation in prehospital emergency care–an integrative literature review. Scandinavian journal of caring sciences. 2016;30(2):234-240.
20. McKelvin R, McKelvin G. Immersive simulation training: Comparing the impact on midwifery and paramedic students’ confidence to perform basic life support skills. Midwifery. 2020;87:102717.
21. Paige JB, Morin KH. Simulation fidelity and cueing: A systematic review of the literature. Clinical Simulation in Nursing. 2013;9(11):e481-e489.
22. Febretti A, Nishimoto A, Thigpen T, et al. CAVE2: a hybrid reality environment for immersive simulation and information analysis. Paper presented at: The Engineering Reality of Virtual Reality 20132013.
23. Couperus K, Young S, Walsh R, et al. Immersive virtual reality medical simulation: autonomous trauma training simulator. Cureus. 2020;12(5).
24. Fritz PZ, Gray T, Flanagan B. Review of mannequin‐based high‐fidelity simulation in emergency medicine. Emergency Medicine Australasia. 2008;20(1):1-9.
25. Williams B, Song JJY. Are simulated patients effective in facilitating development of clinical competence for healthcare students? A scoping review. Advances in Simulation. 2016;1(1):1-9.
26. World Health Organization. Transforming and scaling up health professionals’ education and training. 2013; https://www.who.int/publications/i/item/transforming-and-scaling-up-health-professionals%E2%80%99-education-and-training. Accessed August 4 2021.
27. Sacks L, Krawczeski C, Axelrod D, Motonaga K, Johnson E, Ceresnak S. 384: Immersive simulation improves situational awareness of trainees in the pediatric cardiovascular ICU. Critical Care Medicine. 2016;44(12):172.
28. Batchelder A, Steel A, Mackenzie R, Hormis A, Daniels T, Holding N. Simulation as a tool to improve the safety of pre‐hospital anaesthesia–a pilot study. Anaesthesia. 2009;64(9):978-983.
29. Walshe NC, Crowley CM, O'Brien S, Browne JP, Hegarty JM. Educational Interventions to Enhance Situation Awareness: A Systematic Review and Meta-Analysis. Simulation in Healthcare. 2019;14(6):398-408.
30. Williams B, Quested A, Cooper S. Can eye-tracking technology improve situational awareness in paramedic clinical education? Open Access Emergency Medicine: OAEM. 2013;5:23.
31. Hunter J, Porter M, Williams B. What Is Known About Situational Awareness in Paramedicine? A Scoping Review. Journal of Allied Health. 2019;48(1):27E-34E.
32. Birtill M, King J, Jones D, Thyer L, Pap R, Simpson P. The use of immersive simulation in paramedicine education: a scoping review. Interactive Learning Environments. 2021:1-16.
33. Endsley MR. Situation Awareness Global Assessment Technique (SAGAT). Paper presented at: Proceedings of the IEEE 1988 National Aerospace and Electronics Conference1988.
34. Endsley MR. Direct measurement of situation awareness: Validity and use of SAGAT. In: Endsley MR, Garland DJ, eds. Situational Awareness: Routledge; 2017:129-156.
35. Endsley MR. Direct measurement of situation awareness: Validity and use of SAGAT. In: Endsley MR, Garland DJ, eds. Situation awareness analysis and measurement: Taylor & Francis Group; 2000:147-173.
36. Wei H, Zhuang D, Wanyan X, Wang Q. An experimental analysis of situation awareness for cockpit display interface evaluation based on flight simulation. Chinese Journal of Aeronautics. 2013;26(4):884-889.
37. Loft S, Bowden V, Braithwaite J, Morrell DB, Huf S, Durso FT. Situation awareness measures for simulated submarine track management. Human Factors. 2015;57(2):298-310.
38. Bolstad CA, Endsley MR. Measuring shared and team situation awareness in the army's future objective force. Paper presented at: Proceedings of the Human Factors and Ergonomics Society Annual Meeting2003.
39. Lo JC, Sehic E, Brookhuis KA, Meijer SA. Explicit or implicit situation awareness? Measuring the situation awareness of train traffic controllers. Transportation research part F: traffic psychology and behaviour. 2016;43:325-338.
40. Gardner AK, Kosemund M, Martinez J. Examining the feasibility and predictive validity of the SAGAT tool to assess situation awareness among medical trainees. Simulation in Healthcare. 2017;12(1):17-21.
41. McKenna L, Missen K, Cooper S, Bogossian F, Bucknall T, Cant R. Situation awareness in undergraduate nursing students managing simulated patient deterioration. Nurse Education Today. 2014;34(6):e27-e31.
42. Paletta L, Dini A, Murko C, et al. Towards real-time probabilistic evaluation of situation awareness from human gaze in human-robot interaction. Paper presented at: Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction2017.
43. O'Meara P, Munro G, Williams B, et al. Developing situation awareness amongst nursing and paramedicine students utilizing eye tracking technology and video debriefing techniques: a proof of concept paper. International Emergency Nursing. 2015;23(2):94-99.
44. Hunter J, Porter M, Phillips A, Evans-Brave M, Williams B. Do paramedic students have situational awareness during high-fidelity simulation? A mixed-methods pilot study. International Emergency Nursing. 2021;56:100983.
45. Hunter J, Porter M, Cody P, Williams B. Can a targeted educational approach improve situational awareness in paramedicine during 911 emergency calls? International Emergency Nursing. 2022;63:101174.
46. Durso FT, Hackworth CA, Truitt TR, Crutchfield J, Nikolic D, Manning CA. Situation awareness as a predictor of performance for en route air traffic controllers. Air Traffic Control Quarterly. 1998;6(1):1-20.
47. Endsley MR. A systematic review and meta-analysis of direct objective measures of situation awareness: a comparison of SAGAT and SPAM. Human Factors. 2021;63(1):124–150.
48. Braun V, Clarke V. Thematic analysis. American Psychological Association; 2012.
49. O'Meara P, Munro G, Williams B, et al. Developing situation awareness amongst nursing and paramedicine students utilizing eye tracking technology and video debriefing techniques: a proof of concept paper. International Emergency Nursing.23(2):94-99.
50. Jones DG, Endsley MR. Sources of situation awareness errors in aviation. Aviation, space, and environmental medicine. 1996.
51. Mills B, Carter OB-J, Rudd CJ, Claxton LA, Ross NP, Strobel NA. Effects of low-versus high-fidelity simulations on the cognitive burden and performance of entry-level paramedicine students: A mixed-methods comparison trial using eye-tracking, continuous heart rate, difficulty rating scales, video observation and interviews. Simulation in Healthcare. 2016;11(1):10-18.
52. Pollock C, Biles J. Discovering the lived experience of students learning in immersive simulation. Clinical Simulation in Nursing. 2016;12(8):313-319.
53. Endsley MR. Situation awareness. In: Salvendy G, Karwowski W, eds. Handbook of Human Factors and Ergonomics. 5 ed: John Wiley & Sons, Inc.; 2021:434-455.
54. Schulz CM, Krautheim V, Hackemann A, Kreuzer M, Kochs EF, Wagner KJ. Situation awareness errors in anesthesia and critical care in 200 cases of a critical incident reporting system. BMC Anesthesiology. 2016;16(4):1-10.
55. Endsley MR. Expertise and Situation Awareness. In: Williams AM, Kozbelt A, Ericsson KA, Hoffman RR, eds. The Cambridge Handbook of Expertise and Expert Performance. 2 ed. Cambridge: Cambridge University Press; 2018:714-742.
56. Jones DG, Endsley MR. Sources of situation awareness errors in aviation. Aviation, Space, and Environmental Medicine. 1996;67(6):507–512.