Agreement between an Expert in Physiological Interpretation of Cardiotocographs (CTG) and the Tweris Mini CTG Artificial intelligence (AI) App in recognizing and managing different types of fetal hypoxic stress and abnormal CTG patterns

Main Article Content

Mareva Gillon Luka Velemir Nemanja Kovacev Nikola Zivkovic Edwin Chandraharan

Abstract

Introduction: Tweris Mini is a visual analysis Artificial Intelligence (AI) application designed to detect different types of fetal hypoxic stress, and common abnormal fetal heart rate patterns on Cardiotocograph (CTG) images. It is based on the classification system recommended by the International Expert Consensus Guidelines on Physiological Interpretation of Cardiotocograph published by over 50 CTG experts from more than 20 countries.


Objective: This study aims to evaluate the degree of agreement between the expert who pioneered the physiological interpretation of Cardiotocograph in 2006, and was on the editorial board of the international expert consensus guidelines, and the Tweris Mini App in classifying different types of fetal hypoxic stress and abnormal Cardiotocograph patterns, along with their proposed management.


Materials & Methods: A total of 100 anonymized CTG traces were randomly selected, representing no hypoxia (NH) and various types of fetal hypoxic stress: chronic (C), gradually evolving compensated (GC), gradually evolving decompensated (GD), subacute (S), and acute (A). Specific abnormal CTG patterns, including atypical sinusoidal (AS), typical sinusoidal (TS), and ZigZag (ZZ) patterns. The expert classified the traces and provided the following management recommendations: continue labour (CO), reduce stress (RS), or expedite birth (EB). Two independent obstetricians used the Tweris Mini App to classify the same CTG traces and the recommended management by the Tweris Mini AI App. The Cohen Kappa was used for statistical analysis to determine the level of agreement.


Results: The overall degree of agreement between the Tweris Mini App and the expert was 94%, with complete (100%) agreement relating to acute hypoxic stress, ZigZag and atypical sinusoidal (Poole Shark Teeth) patterns. The Cohen Kappa statistic for diagnostic agreement was 0.92 (95% CI: 0.83-0.99, p<.001). The agreement between the Tweris Mini App and the expert regarding the recommended management reached 98%. The Cohen Kappa statistic for management was 0.96 (95% CI: 0.94-0.98, p<.001.


Conclusion: There was excellent agreement (>90%) between the Tweris Mini App and the expert, who pioneered Physiological Interpretation of CTG in both diagnosing different types of fetal hypoxic stress and recommending optimum management. Our findings suggest that the Tweris AI Mini App has a high reliability to be used as diagnosis & decision support tool in clinical practice.

Keywords: cardiotocograph (CTG); physiological CTG interpretation; artificial intelligence (AI); types of hypoxic stress Tweris Mini App (TMA); ZigZag pattern.

Article Details

How to Cite
GILLON, Mareva et al. Agreement between an Expert in Physiological Interpretation of Cardiotocographs (CTG) and the Tweris Mini CTG Artificial intelligence (AI) App in recognizing and managing different types of fetal hypoxic stress and abnormal CTG patterns. Medical Research Archives, [S.l.], v. 13, n. 4, apr. 2025. ISSN 2375-1924. Available at: <https://esmed.org/MRA/mra/article/view/6484>. Date accessed: 15 may 2025. doi: https://doi.org/10.18103/mra.v13i4.6484.
Section
Research Articles

References

1. Fetal monitoring in labour. NICE Guideline [NG 229]. 2022. (https://www.nice.org.uk/guidance/ng229).

2. Ayres-De-Campos D, Spong CY, Chandraharan E. FIGO Intrapartum Fetal Monitoring Expert Consensus Panel. FIGO consensus guidelines on intrapartum fetal monitoring: cardiotocography. Int J Gynaecol Obstet 2015;131:13–24.

3. American College of Obstetricians and Gynecologists ACOG practice bulletin No 106: intrapartum fetal heart rate monitoring: nomenclature, interpretation, and general management principles. Obstet Gynecol 2009;114:192-202.

4. Alfirevic Z, Devane D, Gyte GM, Cuthbert A. Continuous cardiotocography (CTG) as a form of electronic fetal monitoring (EFM) for fetal assessment during labour. Cochrane Database Syst Rev 2017; 2:CD006066.

5. Zullo F, Di Mascio D, Raghuraman N, Wagner S, Brunelli R, Giancotti A, Mendez-Figueroa H, Cahill AG, Gupta M, Berghella V, Blackwell SC, Chauhan SP. Three-tiered fetal heart rate interpretation system and adverse neonatal and maternal outcomes: a systematic review and meta-analysis. Am J Obstet Gynecol. 2023 Oct;229 (4):377-387.

6. Clark SL, Hankins GD. Temporal and demographic trends in cerebral palsy—fact and fiction. Am J Obstet Gynecol 2003;188:628-33.

7. Nelson KB, Dambrosia JM, Ting TY, Grether JK. Uncertain value of electronic fetal monitoring in predicting cerebral palsy. N Engl J Med 1996;334: 613-8.

8. Bernardes J, Costa-Pereira A, Ayres-de-Campos D, van Geijn HP, Pereira-Leite L. Evaluation of interobserver agreement of cardiotocograms. Int J Gynaecol Obstet 1997;57:33–7.

9. Blackwell SC, Grobman WA, Antoniewicz L, Hutchinson M, Gyamfi Bannerman C. Interobserver and intraobserver reliability of the NICHD 3-tier fetal heart rate interpretation system. Am J Obstet Gynecol 2011;205:378.e1–5.

10. Rei M, Tavares S, Pinto P, et al. Interobserver agreement in CTG interpretation using the 2015 FIGO guidelines for intrapartum fetal monitoring. Eur J Obstet Gynecol Reprod Biol 2016;205:27–31.

11. Beaulieu MD, Fabia J, Leduc B, et al. The reproducibility of intrapartum cardiotocogram assessments. Can Med Assoc J 1982;127: 214–6.

12. Santo S, Ayres-de-Campos D, Costa-Santos C, et al. Agreement and accuracy using the FIGO, ACOG and NICE cardiotocography interpretation guidelines. Acta Obstet Gynecol Scand 2017;96: 166–75.

13. Santo S, Ayres-de-Campos D. Human factors affecting the interpretation of fetal heart rate tracings: an update. Curr Opin Obstet Gynecol 2012;24:84–8.

14. Hruban L, Spilka J, Chudacek V, et al. Agreement on intrapartum cardiotocogram recordings between expert obstetricians. J Eval Clin Pract 2015; 21: 694–702.

15. Sabiani L, Le Dû R, Loundou A, et al. Intra- and interobserver agreement among obstetric experts in court regarding the review of abnormal fetal heart rate tracings and obstetrical management. Am J Obstet Gynecol 2015;213:856.e1-8.

16. Ayres-de-Campos D, Arteiro D, Costa-Santos C, Bernardes J. Knowledge of adverse neonatal outcome alters clinicians’ interpretation of the intrapartum cardiotocograph. BJOG 2011;118: 978-84.

17. Chandraharan E Intrapartum care: An urgent need to question historical practices and ‘non-evidence’-based, illogical foetal monitoring guidelines to avoid patient harm. Journal of Patient Safety and Risk Management. 2019; 24(5): 210-217.

18. Chandraharan E, Tahan ME, Pereira S. Each fetus matters: an urgent paradigm shift is needed to move away from the rigid “CTG Guideline Stickers” so as to individualize intrapartum fetal heart rate monitoring and to improve perinatal outcomes. Obstet Gynecol Int J 2016;5:00168.

19. Chandraharan E. Updated NICE Cardiotocograph (CTG) guideline: Is it suspicious or
pathological?. J Clin Med Surgery. 2023; 3(2): 1129.

20. Clark SL, Hamilton EF, Garite TJ, et al. The limits of electronic fetal heart rate monitoring in the prevention of neonatal metabolic acidemia. Am J Obstet Gynocol 2017; 216: 163.e1–163.e6.

21. Sartwelle TP, Johnston JC, Arda B, Zebenigus M. Cerebral palsy, cesarean sections, and electronic fetal monitoring: All the light we cannot see. Clinical Ethics. 2019;14(3):107-114.

22. Nelson KB, Sartwelle TP, Rouse DJ. Electronic fetal monitoring, cerebral palsy, and caesarean section: assumptions versus evidence. BMJ. 2016 Dec 1;355:i6405.

23. Chandraharan E. Physiological Interpretation of Cardiotocograph: Does the Emerging Scientific Evidence Suggest a Reversal in the “Thunder and Lightning” Phenomenon?. J Clin Med Surgery. 2023; 3(1): 1098.

24. Jia YJ, Ghi T, Pereira S, Gracia Perez-Bonfils A, Chandraharan E. Pathophysiological interpretation of fetal heart rate tracings in clinical practice. Am J Obstet Gynecol. 2023 Jun;228(6):622-644.

25. Chandraharan E. Handbook of CTG interpretation: from patterns to physiology. Cambridge, United Kingdom: Cambridge University Press; 2017.

26. Doria V, Papageorghiou AT, Gustafsson A, Ugwumadu A, Farrer K, Arulkumaran S. Review of the first 1502 cases of ECG-ST waveform analysis during labour in a teaching hospital. BJOG. 2007 Oct; 114(10): 1202-1207.

27. Chandraharan E. Fetal Electrocardiograph (ST-Analyser or STAN): Is it time for the Requiem?. J Clin Med Surgery. 2023; 3(2): 1111.

28. Chandraharan E, Arulkumaran S. Prevention of birth asphyxia: responding appropriately to cardiotocograph (CTG) traces. Best Pract Res Clin Obstet Gynaecol 2007;21:609–24.

29. Chandraharan E. Rational Approach to electronic fetal monitoring in all resource settings. SL J Obst & Gynaecol 2010; 32: 77-84

30. McDonnell S, Chandraharan E, The Pathophysiology of CTGs and Types of Intrapartum Hypoxia, Current Women`s Health Reviews 2013; 9(3).

31. Pinas A, Chandraharan E. Continuous cardiotocography during labour: analysis, classification and management. Best Pract Res Clin Obstet Gynaecol 2016;30:33–47.

32. Chandraharan E, Preti M, Lowe V, Archer A, Ugwumadu A, Arulkumaran S. Effectiveness of ‘George’s Intrapartum Monitoring Strategy’ on Operative Delivery and Perinatal Outcomes at a Teaching Hospital in London: a 5 Year Experience. Book of Abstracts. COGI Conference, Vienna, 2013.

33. Pereira S, Chandraharan E. Recognition of chronic hypoxia and pre-existing foetal injury on the cardiotocograph (CTG): urgent need to think beyond the guidelines. Porto Biomed J 2017;2: 124–9.

34. Oikonomou M, Chandraharan E. Fetal heart rate monitoring in labor: from pattern recognition to fetal physiology. Minerva Obstet Gynecol 2021; 73:19–33.

35. Griffiths K, Gupta N, Chandraharan E. Intrapartum fetal surveillance: a physiological approach,Obstetrics, Gynaecology & Reproductive Medicine, Volume 32, Issue 8, 2022,Pages 179-187.

36. Bolten M, Chandraharan E. The Significance of ‘Non-Significant’ Meconium Stained Amniotic Fluid (MSAF): Colour versus Contents. J Adv Med Med Res. 2019. doi:10.9734/jammr/2019/v30i530192

37. Physiological interpretation of CTG: From Knowledge to Practice. Volumes 1-3. Glob Acad Med Edu Train, London, UK. KDP. 2022 (https://www.amazon.co.uk/s?k=chandraharan&crid=1VKO4VCPZJ5IV&sprefix=chandraharan%2Caps%2C310&ref=nb_sb_noss_1)

38. Yanamandra N, Chandraharan E. Saltatory and sinusoidal fetal heart rate (FHR) patterns and significance of FHR ‘overshoots’. Curr Wom Health Rev. 2013;9:1e8

39. Al Fahdi B & Chandraharan E. True vs Spurious Intrapartum Fetal Heart Rate Accelerations on the Cardiotocograph (CTG): An Urgent Need for Caution. Glob J Reprod Med. 2020; 7 (5): 5556 722. DOI: 10.19080/GJORM.2019.07.555722.

40. Afors K, Chandraharan E. Use of continuous electronic fetal monitoring in a preterm fetus: clinical dilemmas and recommendations for practice. J Pregnancy. 2011;2011:848794.

41. Saeed F, Abeysuriya S, Chandraharan E. Erroneous Recording of Maternal Heart Rate as Fetal Heart Rate During Second Stage of Labour: Isn’t it Time to Stop this? J Biomed Res Environ Sci. 2021 May 11; 2(5): 315-319. doi: 10.37871/jbres1233.

42. Nurani R, Chandraharan E, Lowe V, Ugwumadu A, Arulkumaran S. Misidentification of maternal heart rate as fetal on cardiotocography during the second stage of labor: the role of the fetal electrocardiograph. Acta Obstet Gynecol Scand. 2012 Dec;91(12):1428-32. doi: 10.1111/j.1600-0412.2012.01511.x. Epub 2012 Sep 18.

43. Ingram C, Gupta N, Mustafa S, Singh M, Chandraharan E. Impact of Physiological CTG Guidelines on Intrapartum Hypoxic injuries and brain cooling. World Congress of the Royal College of Obstetricians and Gynaecologists (RCOG) 2021.

44. Jia YJ, Ghi T, Pereira S, Gracia Perez-Bonfils A, Chandraharan E. Pathophysiological interpretation of fetal heart rate tracings in clinical practice. Am J Obstet Gynecol. 2023 Jun;228(6): 622-644.

45. Reeves K, Scully R, Dutta A, Bullen-Bull R, Singh M, Chandraharan E. Training and support on Physiological CTG Interpretation: Does it reduce the hypoxic encephalopathy (HIE) rate? European Congress on Intrapartum Care. 2021.

46. Chandraharan E, Evans SA, Krueger D, Pereira S, Skivens S, et al. (2018) Physiological CTG interpretation. Intrapartum Fetal Monitoring Guideline. https://physiological-ctg.com/guideline.html.

47. Zamora Del Pozo C, Chóliz Ezquerro M, Mejía I, Díaz de Terán Martínez-Berganza E, Esteban LM, Rivero Alonso A, Castán Larraz B, Andeyro García M, Savirón Cornudella R. Diagnostic capacity and interobserver variability in FIGO, ACOG, NICE and Chandraharan cardiotocographic guidelines to predict neonatal acidemia. J Matern Fetal Neonatal Med. 2022 Dec;35(25):8498-8506.

48. Ghi T, Di Pasquo E, Dall’Asta A, et al. Intrapartum fetal heart rate between 150 and 160 bpm at or after 40 weeks and labor outcome. Acta Obstet Gynecol Scand 2021;100:548–54.

49. Preti M, Chandraharan E. Importance of fetal heart rate cycling during the interpretation of the cardiotocograph (CTG). Int J Gynecol Reprod Sci 2018;1:10–2.

50. Pereira S, Lau K, Modestini C, Wertheim D, Chandraharan E. Absence of fetal heart rate cycling on the intrapartum cardiotocograph (CTG) is associated with intrapartum pyrexia and lower Apgar scores. J Matern Fetal Neonatal Med. 2021 Jun 22:1-6.

51. Gracia-Perez-Bonfils A, Martinez-Perez O, Llurba E, Chandraharan E. Fetal heart rate changes on the cardiotocograph trace secondary to maternal COVID-19 infection. Eur J Obstet Gynecol Reprod Biol. 2020 Sep;252:286-293.

52. di Pasquo E, Commare A, Masturzo B, Paolucci S, Cromi A, Montersino B, Germano CM, Attini R, Perrone S, Pisani F, Dall'Asta A, Fieni S, Frusca T, Ghi T. Short-term morbidity and types of intrapartum hypoxia in the newborn with metabolic acidaemia: a retrospective cohort study. BJOG. 2022 Oct;129(11):1916-1925.

53. Descourvieres L, Ghesquiere L, Drumez E, Martin C, Sauvage A, Subtil D, Houfflin-Debarge V, Garabedian C. Types of intrapartum hypoxia in the newborn at term with metabolic acidemia: A retrospective study. Acta Obstet Gynecol Scand. 2022 Nov;101(11):1276-1281.

54. Yatham SS, Whelehan V, Archer A, Chandraharan E. Types of intrapartum hypoxia on the cardiotocograph (CTG): do they have any relationship with the type of brain injury in the MRI scan in term babies? J Obstet Gynaecol. 2020 Jul; 40(5):688-693.

55. Pereira S, Patel R, Zaima A, Tvarozkova K, Chisholm P, Kappelou O, Evanson J, Chandraharan E, Wertheim D, Shah DK. Physiological CTG categorization in types of hypoxia compared with MRI and neurodevelopmental outcome in infants with HIE. J Matern Fetal Neonatal Med. 2022 Dec; 35(25):9675-9683.

56. Chandraharan E. Physiological Interpretation of Cardiotocograph: Does the Emerging Scientific Evidence Suggest a Reversal in the “Thunder and Lightning” Phenomenon?. J Clin Med Surgery. 2023; 3(1): 1098.

57. Jia YJ, Chen X, Cui HY, Whelehan V, Archer A, Chandraharan E. Physiological CTG interpretation: the significance of baseline fetal heart rate changes after the onset of decelerations and associated perinatal outcomes. J Matern Fetal Neonatal Med. 2021 Jul;34(14):2349-2354.

58. Gracia-Perez-Bonfils A, Vigneswaran K, Cuadras D, Chandraharan E. Does the saltatory pattern on cardiotocograph (CTG) trace really exist? The ZigZag pattern as an alternative definition and its correlation with perinatal outcomes. J Matern Fetal Neonatal Med. 2019 Nov 13:1-9.

59. Galli L, Dall'Asta A, Whelehan V, Archer A, Chandraharan E. Intrapartum cardiotocography patterns observed in suspected clinical and subclinical chorioamnionitis in term fetuses. J Obstet Gynaecol Res. 2019 Dec;45(12):2343-2350. doi: 10.1111/jog.14133. Epub 2019 Oct 16.

60. Sukumaran S, Pereira V, Mallur S, Chandraharan E. Cardiotocograph (CTG) changes and maternal and neonatal outcomes in chorioamnionitis and/or funisitis confirmed on histopathology. Eur J Obstet Gynecol Reprod Biol. 2021 May;260:183-188. doi: 10.1016/j.ejogrb.20 21.03.029. Epub 2021 Mar 30.

61. di Pasquo E, Fieni S, Chandraharan E, Dall'Asta A, Morganelli G, Spinelli M, Bettinelli ML, Aloe R, Russo A, Galli L, Perrone S, Ghi T. Correlation between intrapartum CTG findings and interleukin-6 levels in the umbilical cord arterial blood: A prospective cohort study. Eur J Obstet Gynecol Reprod Biol. 2024 Mar;294:128-134.

62. Ghi T, Fieni S, Ramirez Zegarra R, Pereira S, Dall'Asta A, Chandraharan E. Relative uteroplacental insufficiency of labor. Acta Obstet Gynecol Scand. 2024 Oct;103(10):1910-1918.

63. Chandraharan E, Kahar Y, Pereira S, Fieni S, Ghi T. Rational approach to fetal heart rate monitoring and management during the second stage of labor. Eur J Obstet Gynecol Reprod Biol. 2025 Feb;305:159-169.

64. Chandraharan E, Evans SA, Krueger D, Pereira S, Skivens S, et al. (2018) Physiological CTG interpretation. Intrapartum Fetal Monitoring Guideline. https://physiological-ctg.com/guideline.html.

65. Chandraharan E, Pereira S, Ghi T, Gracia Perez-Bonfils A, Fieni S, Jia YJ, Griffiths K, Sukumaran S, Ingram C, Reeves K, Bolten M, Loser K, Carreras E, Suy A, Garcia-Ruiz I, Galli L, Zaima A. International expert consensus statement on physiological interpretation of cardiotocograph (CTG): First revision (2024). Eur J Obstet Gynecol Reprod Biol. 2024 Oct 2;302:346-355.

66. Chandraharan E, Griffiths K, Edmonsdon M, et al. Physiological interpretation of cardiotocograph (CTG): Inter-observer and “Observer-AI” agreements in recognising types of fetal hypoxic stress. Medical Research Archives, [S.l.], v. 12, n. 11, nov. 2024. ISSN 2375-1924.

67. Figueras F, Albela S, Bonino S, et al. Visual analysis of antepartum fetal heart rate tracings: inter- and intra-observer agreement and impact of knowledge of neonatal outcome. J Perinat Med 2005;33:241–5.

68. Reif P, Schott S, Boyon C, et al. Does knowledge of fetal outcome influence the interpretation of intrapartum cardiotocography and subsequent clinical management? A multicentre European study. BJOG 2016.

69. Zain HA, Wright JW, Parrish GE, Diehl SJ. Interpreting the fetal heart rate tracing. Effect of knowledge of neonatal outcome. J Reprod Med 1998;43:367–70.

70. Berglund S, Grunewald C, Pettersson H, Cnattingius S. Severe asphyxia due to delivery-related malpractice in Sweden 1990-2005. BJOG. 2008 Feb;115(3):316-23.

71. Jonsson M, Nordén SL, Hanson U. Analysis of malpractice claims with a focus on oxytocin use in labour. Acta Obstet Gynecol Scand. 2007;86(3): 315-9.

72. Andreasen S, Backe B, Øian P. Claims for compensation after alleged birth asphyxia: a nationwide study covering 15 years. Acta Obstet Gynecol Scand. 2014 Feb;93(2):152-8.

73. Evers AC, Brouwers HA, Nikkels PG, Boon J, VAN Egmond-Linden A, Groenendaal F, Hart C, Hillegersberg J, Snuif YS, Sterken-Hooisma S, Bisschop CN, Westerhuis ME, Bruinse HW, Kwee A. Substandard care in delivery-related asphyxia among term infants: prospective cohort study. Acta Obstet Gynecol Scand. 2013 Jan;92(1):85-93.

74. Anderson A. Ten years of maternity claims: an analysis of the NHS Litigation Authority data—key findings. Clin Risk 2013;19:24-31 10.1177/135 6262213486434.

75. Wise J. Litigation in maternity care is rising, says National Audit Office. BMJ 2013;347:f6737.

76. Donn SM, Chiswick ML, Fanaroff JM. Medico-legal implications of hypoxic-ischemic birth injury. Semin Fetal Neonatal Med 2014;19:317-21.

77. The Early Notification scheme progress report: collaboration and improved experience for families. NHS Resolution, September 2019. https://resolution.nhs.uk/wp-content/uploads/2019/09/NHS-Resolution-Early-Notification-report.pdf

78. Royal College of Obstetricans and Gynaecologists. Each baby Counts: key messages from 2015. London: RCOG. 2016. (https://www.rcog.org.uk/media/3fopwy41/each-baby-counts-2015-full-report.pdf).

79. Royal College of Obstetricians and Gynaecologists. Each Baby Counts: 2018 Progress Report. London: RCOG. 2018. (https://www.rcog.org.uk/media/dswjqyin/each-baby-counts-re¬port-2018-11-12.pdf).

80. Royal College of Obstetricians and Gynaecologists. Each Baby Counts: 2019 Progress Report. London: RCOG. 2020. (https://www.rcog.org.uk/media/qhzlelnc/each-baby-counts-2019-progress-report.pdf).

81. Royal College of Obstetricians and Gynaecologists. Each Baby Counts: 2020 Final Progress Report. London: RCOG. 2021.

82. NHS Resolution. Annual Report & Accounts 2023/24. Published on 23 July 2024.
https://resolution.nhs.uk/wp-content/uploads/2024/07/NHS-Resolution-Annual-report-and-accounts_23-24_Access.pdf

83. INFANT Collaborative Group. Computerised interpretation of fetal heart rate during labour (INFANT): a randomised controlled trial. Lancet 2017 Apr 29;389(10080):1719-29.

84. Nunes I, Ayres-de-Campos D, Ugwumadu A, et al. Fetal monitoring and alert (FM-ALERT) study group. Central fetal monitoring with and without computer analysis: A randomized controlled trial. Obstet Gynecol 2017 Jan;129(1):83-90.