A Quasi-Experiment to Evaluate the Effectiveness of Telebehavioral versus In-Person Counseling in Rural Texas

Main Article Content

Whitney R. Garney Trey W. Armstrong Carly E. McCord Krystal T. Simmons Mandy Spadine Wolever Emma McWhorter Kristen M. Garcia

Abstract

Introduction: Rural residents experience mental health disparities when compared to urban communities due to complex factors. Telehealth is one way to bridge the gap, but existing research on telebehavioral health effectiveness is sparse for rural communities, especially when comparing telehealth to in person services.


Methods: To investigate if telebehavioral health outcomes were similar to traditional in-person counseling, evaluators designed a quasi-experiment to detect differences in behavioral health outcomes between a group of rural residents who received services via video conference or telephone and a second group who received in-person services.


Results: Regarding depression outcomes, PHQ9 scores were higher than the clinical level at baseline (in-person: 11.39, telehealth: 13.22) and decreased over time. Scores for the in-person group, on average, fell below clinical level at 8 weeks and telehealth groups scores, on average fell below clinical level at 12 weeks. Similarly, regarding anxiety outcomes, both groups started above the clinical level for GAD7 scores at baseline (in-person: 10.00, telehealth: 12.34). On average, scores for the in-person group dropped below the clinical level at 4 weeks while scores for the telehealth group, on average, dropped below the clinical level at 8 weeks or later.


Discussion: This study provides evidence in support of telebehavioral health services, specifically in reference to depression and anxiety concerns. Both telehealth and in-person groups showed improvement in terms of having positive rates of overall improvement, low occurrence of reliable deterioration, and a growth model showing scores starting above the clinical level and falling across treatment. This study supports the conclusion that telebehavioral health services can be reliable used to treat depression and anxiety, similar to in person care.

Keywords: behavioral health, telehealth, quantitative analysis, service modality

Article Details

How to Cite
GARNEY, Whitney R. et al. A Quasi-Experiment to Evaluate the Effectiveness of Telebehavioral versus In-Person Counseling in Rural Texas. Medical Research Archives, [S.l.], v. 13, n. 12, dec. 2025. ISSN 2375-1924. Available at: <https://esmed.org/MRA/mra/article/view/7170>. Date accessed: 02 jan. 2026. doi: https://doi.org/10.18103/mra.v13i12.7170.
Section
Research Articles

References

1. Schroeder S, Roberts H, Heitkamp T, Clarke B, Gotham HJ, Franta E. Rural mental health care during a global health pandemic: Addressing and supporting the rapid transition to tele-mental health. Journal of Rural Mental Health. 2021;45 (1):1-13. doi:10.1037/rmh0000169

2. Wilson W, Bangs A, Hatting T. Future of Rural Behavioral Health. NRHA Policy Papers [online]. Published online 2015. Accessed July 31, 2025. https://www.ruralhealth.us/getmedia/01d32ac2-da4c-45a7-b4d8-368accbd6682/The-Future-of-Rural-Behavioral-Health_Feb-2015.pdf

3. Myers CR. Using Telehealth to Remediate Rural Mental Health and Healthcare Disparities. Issues in Mental Health Nursing. 2019;40(3):233-239. doi:10.1080/01612840.2018.1499157

4. Health Resources and Services Administration. Designated health professional shortage areas statistics: First quarter of fiscal year 2022 designated HPSA quarterly summary. Published online 2022.

5. Hilty DM, Ferrer DC, Parish MB, Johnston B, Callahan EJ, Yellowlees PM. The Effectiveness of Telemental Health: A 2013 Review. Telemedicine and e-Health. 2013;19(6):444-454. doi:10.1089/ tmj.2013.0075

6. Madigan S, Racine N, Cooke JE, Korczak DJ. COVID-19 and telemental health: Benefits, challenges, and future directions. Canadian Psychology / Psychologie canadienne. 2021;62(1):5-11. doi:10. 1037/cap0000259

7. Ralston AL, Holt NR, Hope DA. Tele-mental health with marginalized communities in rural locales: Trainee and supervisor perspectives. Journal of Rural Mental Health. 2020;44(4):268-273. doi:10.1037/rmh0000142

8. Costa M, Reis G, Pavlo A, Bellamy C, Ponte K, Davidson L. Tele-Mental Health Utilization Among People with Mental Illness to Access Care During the COVID-19 Pandemic. Community Ment Health J. 2021;57(4):720-726. doi:10.1007/s10597-021-00789-7

9. Norwood C, Moghaddam NG, Malins S, Sabin‐Farrell R. Working alliance and outcome effectiveness in videoconferencing psychotherapy: A systematic review and noninferiority meta‐analysis. Clin Psychology and Psychoth. 2018;25(6):797-808. doi: 10.1002/cpp.2315

10. Lin T, Heckman TG, Anderson T. The efficacy of synchronous teletherapy versus in-person therapy: A meta-analysis of randomized clinical trials. Clinical Psychology: Science and Practice. 2022;29(2):167-178. doi:10.1037/cps0000056

11. Lamb T, Pachana NA, Dissanayaka N. Update of Recent Literature on Remotely Delivered Psychotherapy Interventions for Anxiety and Depression. Telemedicine and e-Health. 2019;25 (8):671-677. doi:10.1089/tmj.2018.0079

12. Tuerk PW, Keller SM, Acierno R. Treatment for Anxiety and Depression via Clinical Videoconferencing: Evidence Base and Barriers to Expanded Access in Practice. FOC. 2018;16(4):363-369. doi:10.1176/ appi.focus.20180027

13. Acierno R, Gros DF, Ruggiero KJ, et al. BEHAVIORAL ACTIVATION AND THERAPEUTIC EXPOSURE FOR POSTTRAUMATIC STRESS DISORDER: A NONINFERIORITY TRIAL OF TREATMENT DELIVERED IN PERSON VERSUS HOME-BASED TELEHEALTH: Research Article: BATE Telehealth. Depress Anxiety. 2016;33(5):415-423. doi:10.1002/da.22476

14. Knowlton CN, Nelson KG. PTSD telehealth treatments for veterans: Comparing outcomes from in-person, clinic-to-clinic, and home-based telehealth therapies. Journal of Rural Mental Health. 2021;45(4):243-255. doi:10.1037/rmh0000190

15. Luxton DD, Pruitt LD, Wagner A, Smolenski DJ, Jenkins-Guarnieri MA, Gahm G. Home-based telebehavioral health for U.S. military personnel and veterans with depression: A randomized controlled trial. Journal of Consulting and Clinical Psychology. 2016;84(11):923-934. doi:10.1037/ccp0000135

16. Morland LA, Mackintosh MA, Rosen CS, et al. TELEMEDICINE VERSUS IN-PERSON DELIVERY OF COGNITIVE PROCESSING THERAPY FOR WOMEN WITH POSTTRAUMATIC STRESS DISORDER: A RANDOMIZED NONINFERIORITY TRIAL: Research Article: Telemental Health for Women with PTSD. Depress Anxiety. 2015;32(11):811-820. doi:10.10 02/da.22397

17. Yuen EK, Gros DF, Price M, et al. Randomized Controlled Trial of Home‐Based Telehealth Versus In‐Person Prolonged Exposure for Combat‐Related PTSD in Veterans: Preliminary Results. J Clin Psychol. 2015;71(6):500-512. doi:10.1002/jclp.22168

18. Flückiger C, Del Re AC, Munder T, Heer S, Wampold BE. Enduring effects of evidence-based psychotherapies in acute depression and anxiety disorders versus treatment as usual at follow-up — A longitudinal meta-analysis. Clinical Psychology Review. 2014;34(5):367-375. doi:10.1016/j.cpr.2014.05.001

19. Laidlaw K, Davidson K, Toner H, et al. A randomised controlled trial of cognitive behaviour therapy vs treatment as usual in the treatment of mild to moderate late life depression. Int J Geriat Psychiatry. 2008;23(8):843-850. doi:10.1002/gps.1993

20. Wampold BE, Budge SL, Laska KM, et al. Evidence-based treatments for depression and anxiety versus treatment-as-usual: A meta-analysis of direct comparisons. Clinical Psychology Review. 2011;31(8):1304-1312. doi:10.1016/j.cpr.2011.07.012

21. Alegría M, Ludman E, Kafali EN, et al. Effectiveness of the Engagement and Counseling for Latinos (ECLA) Intervention in Low-income Latinos. Medical Care. 2014;52(11):989-997. doi:1 0.1097/MLR.0000000000000232

22. Khatri N, Marziali E, Tchernikov I, Sheppard N. Comparing telehealth-based and clinic-based group cognitive behavioral therapy for adults with depression and anxiety: a pilot study. CIA. Published online May 2014:765. doi:10.2147/ CIA.S57832

23. Stubbings DR, Rees CS, Roberts LD, Kane RT. Comparing In-Person to Videoconference-Based Cognitive Behavioral Therapy for Mood and Anxiety Disorders: Randomized Controlled Trial. J Med Internet Res. 2013;15(11):e258. doi:10.2196/jmir.2564

24. Griffiths L, Blignault I, Yellowlees P. Telemedicine as a means of delivering cognitive-behavioural therapy to rural and remote mental health clients. J Telemed Telecare. 2006;12(3):136-140. doi:10.1258/135763306776738567

25. McCord CE, Saenz JJ, Armstrong TW, Elliott TR. Training the next generation of counseling psychologists in the practice of telepsychology. Counselling Psychology Quarterly. 2015;28(3):324-344. doi:10.1080/09515070.2015.1053433

26. Garney WR, McCord CE, Walsh MV, Alaniz AB. Using an Interactive Systems Framework to Expand Telepsychology Innovations in Underserved Communities. Scientifica. 2016;2016:1-8. doi:10.1 155/2016/4818053

27. McCord CE, Console K, Jackson K, et al. Telepsychology training in a public health crisis: a case example. Counselling Psychology Quarterly. 2021;34(3-4):608-623. doi:10.1080/09515070.2020.1782842

28. McCord C, Ullrich F, Merchant KAS, et al. Comparison of in-person vs. telebehavioral health outcomes from rural populations across America. BMC Psychiatry. 2022;22(1):778. doi:10.1186/s12 888-022-04421-0

29. Jacobson NS, Truax P. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology. 1991;59(1):12-19. doi:10. 1037/0022-006X.59.1.12

30. Armstrong TW, McCord CE, Stickley MM, George N, Elliott TR. Assessing depression outcomes in teletherapy for underserved residents in Central Texas: Telehealth’s move to treatment-as-usual. Journal of Rural Mental Health. 2022;46 (4):225-236. doi:10.1037/rmh0000215

31. Gilbody S, Richards D, Brealey S, Hewitt C. Screening for Depression in Medical Settings with the Patient Health Questionnaire (PHQ): A Diagnostic Meta-Analysis. J GEN INTERN MED. 2007;22(11): 1596-1602. doi:10.1007/s11606-007-0333-y

32. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606-613. doi:10.1046/j.1525-1497.2001.016009606.x

33. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Arch Intern Med. 2006;166 (10):1092. doi:10.1001/archinte.166.10.1092

34. Molfenter T, Heitkamp T, Murphy AA, Tapscott S, Behlman S, Cody OJ. Use of Telehealth in Mental Health (MH) Services During and After COVID-19. Community Ment Health J. 2021;57(7): 1244-1251. doi:10.1007/s10597-021-00861-2

35. Mulvaney-Day N, Dean D, Miller K, Camacho-Cook J. Trends in Use of Telehealth for Behavioral Health Care During the COVID-19 Pandemic: Considerations for Payers and Employers. Am J Health Promot. 2022;36(7):1237-1241. doi:10.1177 /08901171221112488e

36. The Telehealth Policy Cliff: Preparing for October 1, 2025. National Consortium of Telehealth Resource Centers. September 26, 2025. https://telehealthresourcecenter.org/resources/the-telehealth-policy-cliff-preparing-for-october-1-2025/

37. Parity: Policy Look up. Center for Connected Health Policy. National Telehealth Policy Resource Center. https://www.cchpca.org/topic/parity/

Most read articles by the same author(s)