The transformative potential of virtual, augmented and mixed reality in colorectal surgery: opportunities and challenges.
Main Article Content
Ahmed Hassen Badrek-Al Amoudi
http://orcid.org/0000-0001-5265-3394
http://orcid.org/0000-0001-5265-3394
Abstract
In the past three decades, colorectal surgery has embraced a series of technological advancements focusing on precision preoperative planning, the adoption of minimally invasive laparoscopic, robotic, and endoscopic surgical techniques, and the formulation of personalized, patient-centric care. The main evidence-based drivers for such utilities are, reduction in postoperative pain and operative trauma, improvements in disease specific outcomes, the enhancement of patients’ healthcare journey, and the safeguarding of intermediate and long-term quality of life measures1,2.
Incorporation of these developments into mainstream clinical practice has presented several challenges. These include, the concerns related to patient safety, standardization of operative approach, as well as ensuring cost efficiencies and cost containment relating to surgical-care3,4. Furthermore, there are ethical, technical, and financial constraints associated with minimally invasive surgical (MIS) training, which has impacted a significant section of the existing workforce as well as new generations of surgeons5-8.
Keywords:
virtual, augmented and mixed reality in colorectal surgery, the transformative potential of virtual, augmented and mixed reality in colorectal surgery:, opportunities and challenges in the transformative potential of virtual, augmented and mixed reality in colorectal surgery
Article Details
How to Cite
AMOUDI, Ahmed Hassen Badrek-Al.
The transformative potential of virtual, augmented and mixed reality in colorectal surgery: opportunities and challenges..
Medical Research Archives, [S.l.], v. 11, n. 12, dec. 2023.
ISSN 2375-1924.
Available at: <https://esmed.org/MRA/mra/article/view/4900>. Date accessed: 16 may 2024.
doi: https://doi.org/10.18103/mra.v11i12.4900.
Section
Articles
The Medical Research Archives grants authors the right to publish and reproduce the unrevised contribution in whole or in part at any time and in any form for any scholarly non-commercial purpose with the condition that all publications of the contribution include a full citation to the journal as published by the Medical Research Archives.
References
1. Future of Surgery. futureofsurgery.rcseng. ac.uk. 2021.
2. Marescaux J, Diana M. Inventing the Future of Surgery. World J Surg. 2015; 39: 615–622. DOI 10.1007/s00268-014-2879-2
3. Cleary R, Mullard A, Ferraro J, et al. The cost of conversion in robotic and laparoscopic colorectal surgery. Surg Endosc. 2018; 32(3): 1515–1524. doi:10.1007/s00464-017-5839-8.
4. Miskovic D, Ahmed J, Bissett‐Amess R, et al. European consensus on the standardization of robotic total mesorectal excision for rectal cancer. Colorectal Disease. 2019; 21(3), 270-276.
5. Buckley C, E. Ryan N, Neary P. Virtual Reality – A New Era in Surgical Training. Virtual Reality in Psychological, Medical and Pedagogical Applications, Chapter 7. 2012: 140-166. https://doi.org/10.1111/codi.14502
6. Flynn J, Larach J, Kong J, et al. The learning curve in robotic colorectal surgery compared with laparoscopic colorectal surgery: a systematic review. Colorectal Disease. 2021; 23(11), 2806-2820. https://doi.org/10.1111/codi.15843
7. Jamali F, Soweid A, Dimassi H, et al. Evaluating the Degree of Difficulty of Laparoscopic Colorectal Surgery. Arch Surg. 2008; 143(8): 762-767. doi:10.1001/archsurg. 143.8.762.
8. Gaitanidis A, Simopoulos C, Pitiakoudis M. What to consider when designing a laparoscopic colorectal training curriculum: a review of the literature. Tech Coloproctol. 2018; 22: 151–160. DOI https://doi.org/10.1007/s10151-018-1760-y
9. Kinjoll D. Augmented Reality Market Size, Share & Trends Analysis Report By Component, By Display (HMD & Smart Glass, HUD, Handheld Devices), By Application, By Region, And Segment Forecasts. Market Research Future. November 2023: 2021-2028, https://www.grandviewresearch.com/industry-analysis/augmented-reality-market
10. Dey K. Augmented Reality in Healthcare Market Research Report By Component (Hardware and Software), By Device Type (Head-Mounted Display and Handheld Device), By Application (Fitness management, Medical training and education, and Others), And By Region (North America, Europe, Asia-Pacific, And Rest Of The World) – Market Forecast Till 2032. Market Analysis Report, Grand View Research. 2021. Report ID: 978-1-68038-820-6. https://www.linkedin.com/shareArticle, 2023
11. J. Sánchez-Margallo etal. Application of Mixed Reality in Medical Training and Surgical Planning Focused on Minimally Invasive Surgery. Front. Virtual Real. 2021; 2: 692641. doi: 10.3389/frvir.2021.692641.
12. Vávra P, Roman J, Zonča P, et al. Recent Development of Augmented Reality in Surgery: A Review. Journal of Healthcare Engineering. 2017; Article ID 4574172, 9 pages. doi: 10.3389/frvir.2021.692641.
13. Yoon J W, Chen R E, Kim E J, et al. Augmented reality for the surgeon: Systematic review. Int J Med Robotics Comput Assist Surg. 2018; 14(4): e1914. https://doi.org/10.1002/rcs.1914
14. Marescaux J, Rubino F, Arenas M, et al. Augmented-reality-assisted laparoscopic adrenalectomy. J Am Med Assoc. 2004; 292: 2214–2215.
15. Cartucho J, Shapira D, Ashrafian H, et al. Multimodal mixed reality visualisation for intraoperative surgical guidance. International Journal of Computer Assisted Radiology and Surgery. 2020; 15: 819–826. https://doi.org/10.1007/s11548-020-02165-4
16. Barsom E, Graafland M, Schijven M, et al. Systematic review on the effectiveness of augmented reality applications in medical training, Surg Endosc. 2016; 30: 4174–4183. DOI 10.1007/s00464-016-4800-6
17. Forgione A, Guraya S. The cutting‐edge training modalities and educational platforms for accredited surgical training: A systematic review. J Res Med Sci. 2017; 22: 51. DOI: 10.4103/jrms.JRMS_809_16.
18. Training with cognitive load improves performance under similar conditions in a real surgical task, G Sankaranarayanan, Am J Surg. 2020 September; 220(3): 620–629.
19. Marescaux J, Soler L. Image-guided robotic surgery. Seminars in Laparoscopic Surgery. 2004; 11(92): 113–122.
20. Yeung T. Fluorescence imaging in colorectal surgery. Surgical Endoscopy. 2021; 35: 4956-4963. https://doi.org/10.1007/s00464-021-08534-7
21. Meijer R P , Faber R A, Bijlstra O D, et al. AVOID; a phase III, randomised controlled trial using indocyanine green for the prevention of anastomotic leakage in colorectal surgery, BMJ Open. 2022; 12: e051144. doi:10.1136/bmjopen-2021-051144
22. Guerriero L, Quero G, Diana M, et al. Virtual Reality Exploration and Planning for Precision Colorectal Surgery. Dis Colon Rectum. 2018; 61: 719–723. DOI: 10.1097/ DCR.0000000000001077.
23. Lyuksemburg V, Abou-Hanna J, Marshall J, et al. Virtual Reality for Preoperative Planning in Complex Surgical Oncology: A Single-Center Experience, Journal of Surgical Research. 2023; 291: 546-556. https://doi.org/10.1016/j.jss.2023.07.00
24. Ugras G, Kanat C, Yaman Z, et al. The Effects of Virtual Reality on Preoperative Anxiety in Patients Undergoing Colorectal and Abdominal Wall Surgery: A Randomized Controlled Trial, Journal of PeriAnesthesia Nursing. 2023; 38: 277−283. https://doi.org/10.1016/j.jopan.2022.07.005
25. Liu D, Jenkins S, Sanderson P. Clinical implementation of a head‐mounted display of patient vital signs. 2009 International Symposium on Wearable Computers; 2009: IEEE. DOI: 10.1109/ISWC.2009.36
26. Monsky W, James R, Seslar S, et al. Virtual and Augmented Reality Applications in Medicine and Surgery- The Fantastic Voyage is here. Anat Physiol.2019; 9(1): 313.
27. Lee S, Huntbatch A, Pratt P, et al. In vivo and in situ image guidance and modelling in robotic assisted surgery. Mechanical Engineering Science. 2010; 224: 1421–1434. DOI: 10.1243/09544062JMES2122
28. Lenihan J, Brower M. Web-connected surgery: using the inter- net for teaching and proctoring of live robotic surgeries. J Robotic Surg. 2012; 6(01): 47–52. DOI: https://doi.org/10.1007/s11701-011-0304-5
29. Miskovic D, Ni M, Wyles S, et al. Learning Curve and Case Selection in Laparoscopic Colorectal Surgery: Systematic Review and International Multicenter Analysis of 4852 Cases. Dis Colon Rectum. 2012; 55(12): 1300-1310. DOI: 10.1097/DCR.0b013e31826ab4dd
30. Schlachta C, Mamazza J, Seshadri P, et al. Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum. 2001; 44: 217–222. https://doi.org/10.1007/BF02234296
31. Leblanc F, Champagne B, Augestad K, et al. A Comparison of Human Cadaver and Augmented Reality Simulator Models for Straight Laparoscopic Colorectal Skills Acquisition Training, J Am Coll Surg. 2010; 211: 250–255. doi:10.1016/j.jamcollsurg.2010.04.002
32. Shanmugan S, Leblanc F, Senagore A, et al. Virtual Reality Simulator Training for Laparoscopic Colectomy: What Metrics Have Construct Validity? Dis Colon Rectum. 2014; 57: 210-214. Doi: 10.1097/DCR.00000000000 00031.
33. Brockmeyer P, Wiechens B, Schliephake H. The Role of Augmented Reality in the Advancement of Minimally Invasive Surgery Procedures: A Scoping Review. Bioengineering. 2023; 10: 501. https://doi.org/10.3390/
34. de Valk K, Handgraaf H, Deken M et al. A zwitterionic near-infrared fluorophore for real-time ureter identification during laparoscopic abdominopelvic surgery, Nature Communications. 2019; 10: 3118. https://doi.org/10.1038/s41467-019-11014-1
35. Yeung T, Volpi D, Tullis I, et al. Identifying Ureters In Situ Under Fluorescence During Laparoscopic and Open Colorectal Surgery. Ann Surg. 2016; 263; e1-e2. DOI: 10.1097/ SLA.0000000000001513.
36. Harlaa N, Koller M, de Jongh S, et al. Molecular fluorescence-guided surgery of peritoneal carcinomatosis of colorectal origin: a single-centre feasibility study. Lancet Gastroenterol Hepatol. 2016; 1: 283–90. http://dx.doi.org/10.1016/
37. Peltrini R, Podda M, Castiglioni S, et al. Intraoperative use of indocyanine green fluorescence imaging in rectal cancer surgery: The state of the art. World J Gastroenterol. 2021; 27(38): 6374-6386. DOI: 10.3748/wjg.v27.i38.6374.
38. Volonté F, Pugin F, Buchs N, et al. Console-Integrated Stereoscopic OsiriX 3D Volume-Rendered Images for da Vinci Colorectal Robotic Surgery. Surgical Innovation. 2013; 20(2): 158–163. DOI: 10.1177/1553350612446353.
39. Quero G, Mascagni P, Kolbinger F, Artificial Intelligence in Colorectal Cancer Surgery: Present and Future Perspectives. Cancers.2022; 14: 3803. https://doi.org/10.3390/
40. Mirnezami R, Ahmed A. et al. Surgery 3.0, artificial intelligence and the next-generation surgeon. BJS. 2018; 105: 463–465. DOI: 10.1002/bjs.10860
2. Marescaux J, Diana M. Inventing the Future of Surgery. World J Surg. 2015; 39: 615–622. DOI 10.1007/s00268-014-2879-2
3. Cleary R, Mullard A, Ferraro J, et al. The cost of conversion in robotic and laparoscopic colorectal surgery. Surg Endosc. 2018; 32(3): 1515–1524. doi:10.1007/s00464-017-5839-8.
4. Miskovic D, Ahmed J, Bissett‐Amess R, et al. European consensus on the standardization of robotic total mesorectal excision for rectal cancer. Colorectal Disease. 2019; 21(3), 270-276.
5. Buckley C, E. Ryan N, Neary P. Virtual Reality – A New Era in Surgical Training. Virtual Reality in Psychological, Medical and Pedagogical Applications, Chapter 7. 2012: 140-166. https://doi.org/10.1111/codi.14502
6. Flynn J, Larach J, Kong J, et al. The learning curve in robotic colorectal surgery compared with laparoscopic colorectal surgery: a systematic review. Colorectal Disease. 2021; 23(11), 2806-2820. https://doi.org/10.1111/codi.15843
7. Jamali F, Soweid A, Dimassi H, et al. Evaluating the Degree of Difficulty of Laparoscopic Colorectal Surgery. Arch Surg. 2008; 143(8): 762-767. doi:10.1001/archsurg. 143.8.762.
8. Gaitanidis A, Simopoulos C, Pitiakoudis M. What to consider when designing a laparoscopic colorectal training curriculum: a review of the literature. Tech Coloproctol. 2018; 22: 151–160. DOI https://doi.org/10.1007/s10151-018-1760-y
9. Kinjoll D. Augmented Reality Market Size, Share & Trends Analysis Report By Component, By Display (HMD & Smart Glass, HUD, Handheld Devices), By Application, By Region, And Segment Forecasts. Market Research Future. November 2023: 2021-2028, https://www.grandviewresearch.com/industry-analysis/augmented-reality-market
10. Dey K. Augmented Reality in Healthcare Market Research Report By Component (Hardware and Software), By Device Type (Head-Mounted Display and Handheld Device), By Application (Fitness management, Medical training and education, and Others), And By Region (North America, Europe, Asia-Pacific, And Rest Of The World) – Market Forecast Till 2032. Market Analysis Report, Grand View Research. 2021. Report ID: 978-1-68038-820-6. https://www.linkedin.com/shareArticle, 2023
11. J. Sánchez-Margallo etal. Application of Mixed Reality in Medical Training and Surgical Planning Focused on Minimally Invasive Surgery. Front. Virtual Real. 2021; 2: 692641. doi: 10.3389/frvir.2021.692641.
12. Vávra P, Roman J, Zonča P, et al. Recent Development of Augmented Reality in Surgery: A Review. Journal of Healthcare Engineering. 2017; Article ID 4574172, 9 pages. doi: 10.3389/frvir.2021.692641.
13. Yoon J W, Chen R E, Kim E J, et al. Augmented reality for the surgeon: Systematic review. Int J Med Robotics Comput Assist Surg. 2018; 14(4): e1914. https://doi.org/10.1002/rcs.1914
14. Marescaux J, Rubino F, Arenas M, et al. Augmented-reality-assisted laparoscopic adrenalectomy. J Am Med Assoc. 2004; 292: 2214–2215.
15. Cartucho J, Shapira D, Ashrafian H, et al. Multimodal mixed reality visualisation for intraoperative surgical guidance. International Journal of Computer Assisted Radiology and Surgery. 2020; 15: 819–826. https://doi.org/10.1007/s11548-020-02165-4
16. Barsom E, Graafland M, Schijven M, et al. Systematic review on the effectiveness of augmented reality applications in medical training, Surg Endosc. 2016; 30: 4174–4183. DOI 10.1007/s00464-016-4800-6
17. Forgione A, Guraya S. The cutting‐edge training modalities and educational platforms for accredited surgical training: A systematic review. J Res Med Sci. 2017; 22: 51. DOI: 10.4103/jrms.JRMS_809_16.
18. Training with cognitive load improves performance under similar conditions in a real surgical task, G Sankaranarayanan, Am J Surg. 2020 September; 220(3): 620–629.
19. Marescaux J, Soler L. Image-guided robotic surgery. Seminars in Laparoscopic Surgery. 2004; 11(92): 113–122.
20. Yeung T. Fluorescence imaging in colorectal surgery. Surgical Endoscopy. 2021; 35: 4956-4963. https://doi.org/10.1007/s00464-021-08534-7
21. Meijer R P , Faber R A, Bijlstra O D, et al. AVOID; a phase III, randomised controlled trial using indocyanine green for the prevention of anastomotic leakage in colorectal surgery, BMJ Open. 2022; 12: e051144. doi:10.1136/bmjopen-2021-051144
22. Guerriero L, Quero G, Diana M, et al. Virtual Reality Exploration and Planning for Precision Colorectal Surgery. Dis Colon Rectum. 2018; 61: 719–723. DOI: 10.1097/ DCR.0000000000001077.
23. Lyuksemburg V, Abou-Hanna J, Marshall J, et al. Virtual Reality for Preoperative Planning in Complex Surgical Oncology: A Single-Center Experience, Journal of Surgical Research. 2023; 291: 546-556. https://doi.org/10.1016/j.jss.2023.07.00
24. Ugras G, Kanat C, Yaman Z, et al. The Effects of Virtual Reality on Preoperative Anxiety in Patients Undergoing Colorectal and Abdominal Wall Surgery: A Randomized Controlled Trial, Journal of PeriAnesthesia Nursing. 2023; 38: 277−283. https://doi.org/10.1016/j.jopan.2022.07.005
25. Liu D, Jenkins S, Sanderson P. Clinical implementation of a head‐mounted display of patient vital signs. 2009 International Symposium on Wearable Computers; 2009: IEEE. DOI: 10.1109/ISWC.2009.36
26. Monsky W, James R, Seslar S, et al. Virtual and Augmented Reality Applications in Medicine and Surgery- The Fantastic Voyage is here. Anat Physiol.2019; 9(1): 313.
27. Lee S, Huntbatch A, Pratt P, et al. In vivo and in situ image guidance and modelling in robotic assisted surgery. Mechanical Engineering Science. 2010; 224: 1421–1434. DOI: 10.1243/09544062JMES2122
28. Lenihan J, Brower M. Web-connected surgery: using the inter- net for teaching and proctoring of live robotic surgeries. J Robotic Surg. 2012; 6(01): 47–52. DOI: https://doi.org/10.1007/s11701-011-0304-5
29. Miskovic D, Ni M, Wyles S, et al. Learning Curve and Case Selection in Laparoscopic Colorectal Surgery: Systematic Review and International Multicenter Analysis of 4852 Cases. Dis Colon Rectum. 2012; 55(12): 1300-1310. DOI: 10.1097/DCR.0b013e31826ab4dd
30. Schlachta C, Mamazza J, Seshadri P, et al. Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum. 2001; 44: 217–222. https://doi.org/10.1007/BF02234296
31. Leblanc F, Champagne B, Augestad K, et al. A Comparison of Human Cadaver and Augmented Reality Simulator Models for Straight Laparoscopic Colorectal Skills Acquisition Training, J Am Coll Surg. 2010; 211: 250–255. doi:10.1016/j.jamcollsurg.2010.04.002
32. Shanmugan S, Leblanc F, Senagore A, et al. Virtual Reality Simulator Training for Laparoscopic Colectomy: What Metrics Have Construct Validity? Dis Colon Rectum. 2014; 57: 210-214. Doi: 10.1097/DCR.00000000000 00031.
33. Brockmeyer P, Wiechens B, Schliephake H. The Role of Augmented Reality in the Advancement of Minimally Invasive Surgery Procedures: A Scoping Review. Bioengineering. 2023; 10: 501. https://doi.org/10.3390/
34. de Valk K, Handgraaf H, Deken M et al. A zwitterionic near-infrared fluorophore for real-time ureter identification during laparoscopic abdominopelvic surgery, Nature Communications. 2019; 10: 3118. https://doi.org/10.1038/s41467-019-11014-1
35. Yeung T, Volpi D, Tullis I, et al. Identifying Ureters In Situ Under Fluorescence During Laparoscopic and Open Colorectal Surgery. Ann Surg. 2016; 263; e1-e2. DOI: 10.1097/ SLA.0000000000001513.
36. Harlaa N, Koller M, de Jongh S, et al. Molecular fluorescence-guided surgery of peritoneal carcinomatosis of colorectal origin: a single-centre feasibility study. Lancet Gastroenterol Hepatol. 2016; 1: 283–90. http://dx.doi.org/10.1016/
37. Peltrini R, Podda M, Castiglioni S, et al. Intraoperative use of indocyanine green fluorescence imaging in rectal cancer surgery: The state of the art. World J Gastroenterol. 2021; 27(38): 6374-6386. DOI: 10.3748/wjg.v27.i38.6374.
38. Volonté F, Pugin F, Buchs N, et al. Console-Integrated Stereoscopic OsiriX 3D Volume-Rendered Images for da Vinci Colorectal Robotic Surgery. Surgical Innovation. 2013; 20(2): 158–163. DOI: 10.1177/1553350612446353.
39. Quero G, Mascagni P, Kolbinger F, Artificial Intelligence in Colorectal Cancer Surgery: Present and Future Perspectives. Cancers.2022; 14: 3803. https://doi.org/10.3390/
40. Mirnezami R, Ahmed A. et al. Surgery 3.0, artificial intelligence and the next-generation surgeon. BJS. 2018; 105: 463–465. DOI: 10.1002/bjs.10860