Measuring Psychosis: A Review of Widely Used Clinical Outcome Assessments in Clinical Trials
Article Sidebar
Published
Feb 27, 2024
Downloads
Download data is not yet available.
Submit your own article
Register as an author to reserve your spot in the next issue of the Medical Research Archives.
Author RegistrationJoin the Society
The European Society of Medicine is more than a professional association. We are a community. Our members work in countries across the globe, yet are united by a common goal: to promote health and health equity, around the world.
Join Europe’s leading medical society and discover the many advantages of membership, including free article publication.
MembershipMain Article Content
Abstract
Accurate diagnosis and assessment of symptoms is essential to the appropriate treatment and management of individuals with psychotic disorders. It also plays a pivotal role in research, ensuring that enrolled subjects meet study-specific inclusion requirements and that their progress is accurately tracked throughout the study. Clinical outcome assessments are standardized instruments designed specifically to measure symptoms and their impact on a patient’s life and functioning. These instruments can be used to diagnose, categorize, and track symptom severity, and to measure the functional impact of disease on a patient’s quality of life. Clinical outcome assessments play a pivotal role in advancing our understanding and treatment of schizophrenia and other psychotic disorders, providing the ability to evaluate the safety and efficacy of emerging treatments and interventions. In this review article we provide an overview of the most widely used clinical outcome assessments in schizophrenia and other psychotic disorders research with a focus on clinical trials, and delve into the specific instruments commonly used to diagnose, measure symptom severity, and assess cognitive ability. A brief description of each instrument and its role in clinical outcome assessment is provided, along with advantages and limitations in implementation. Additionally, the clinician’s perspective on the administration and scoring of these scales is included, where relevant. The goal is to familiarize new clinicians and researchers with the available assessment tools, highlighting the advantages, limitations, and any other relevant information that can aid in the selection of the appropriate measurement tools for their patients and studies. Finally, we briefly discuss our view on the future of clinical outcome assessments in schizophrenia and other psychotic disorders research and clinical trials.
Article Details
How to Cite
ECHEVARRIA, Barbara; KLEIN, Hans; OPLER, Mark G..
Measuring Psychosis: A Review of Widely Used Clinical Outcome Assessments in Clinical Trials.
Medical Research Archives, [S.l.], v. 12, n. 2, feb. 2024.
ISSN 2375-1924.
Available at: <https://esmed.org/MRA/mra/article/view/4884>. Date accessed: 23 nov. 2024.
doi: https://doi.org/10.18103/mra.v12i2.4884.
Section
Review Articles
The Medical Research Archives grants authors the right to publish and reproduce the unrevised contribution in whole or in part at any time and in any form for any scholarly non-commercial purpose with the condition that all publications of the contribution include a full citation to the journal as published by the Medical Research Archives.
References
1. Walton MK, Powers JH 3rd, Hobart J, et al. Clinical outcome assessments: conceptual foundation-report of the ISPOR clinical outcomes assessment - emerging good practices for Outcomes Research Task Force. Value Health. 2015;18(6):741-752. doi: 10.1016/j.jval.2015.08.006
2. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22-57.
3. First MB, Williams JBW, Karg RS, Spitzer RL. Structured Clinical Interview for DSM-5—Research Version (SCID-5 for DSM-5, Research Version; SCID-5-RV). Arlington, VA, American Psychiatric Association, 2015.
4. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, Text Revision (DSM-5-TR). American Medical Association; 2022.
5. World Health Organization (WHO). The ICD-10 classification of mental and behavioural disorders. World Health Organization; 1993
6. Gjerden P. Criteria-based diagnostics generate excessive and incorrect diagnoses. Tidsskr Nor Laegeforen. 2015;135(16):1437. doi: 10.4045/tidsskr.15.0727
7. Shabani A, Masoumian S, Zamirinejad S, et al. Psychometric properties of Structured Clinical Interview for DSM-5 Disorders-Clinician Version (SCID-5-CV). Brain Behav. 2021;11(5):e01894. doi: 10.1002/brb3.1894
8. Osório FL, Loureiro SR, Hallak JEC, et al. Clinical validity and intrarater and test-retest reliability of the Structured Clinical Interview for DSM-5 - Clinician Version (SCID-5-CV). Psychiatry Clin Neurosci. 2019;73(12):754-760. doi: 10.1111/pcn.12931
9. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13(2):261-276. doi: 10.1093/schbul/13.2.261
10. Marder SR, Davis JM, Chouinard G. The effects of risperidone on the five dimensions of schizophrenia derived by factor analysis: combined results of the North American trials [published correction appears in J Clin Psychiatry 1998 Apr;59(4):200]. J Clin Psychiatry. 1997;58(12):538-546. doi: 10.4088/jcp.v58n1205
11. Hopkins SC, Ogirala A, Loebel A, Koblan KS. Transformed PANSS factors intended to reduce pseudospecificity among symptom domains and enhance understanding of symptom change in antipsychotic-treated patients with schizophrenia. Schizophr Bull. 2018;44(3):593-602. doi: 10.1093/schbul/sbx101
12. Opler LA, Kay SR, Lindenmayer JP, Fiszbein A. SCI- PANSS. Toronto: Multi-Health Systems Inc; 1992.
13. Khan A, Yavorsky C, Liechti S, et al. A Rasch model to test the cross-cultural validity in the positive and negative syndrome scale (PANSS) across six geo-cultural groups. BMC Psychol. 2013;1(1):5. doi: 10.1186/2050-7283-1-5
14. Kay SR, Opler LA, Lindenmayer JP. Reliability and validity of the positive and negative syndrome scale for schizophrenics. Psychiatry Res. 1988;23(1):99-110. doi: 10.1093/ schbul/13.2.261
15. Santor DA, Ascher-Svanum H, Lindenmayer JP, Obenchain RL. Item response analysis of the Positive and Negative Syndrome Scale. BMC Psychiatry. 2007;7:66. doi: 10.1186/1471-244X-7-66
16. Lindström E, Wieselgren IM, von Knorring L. Interrater reliability of the Structured Clinical Interview for the Positive and Negative Syndrome Scale for schizophrenia. Acta Psychiatr Scand. 1994;89(3):192-195. doi: 10.1111/j.1600-0447.1994.tb08091.x
17. Bentsen H, Munkvold O, Notland TH, et al. The interrater reliability of the Positive and Negative Syndrome Scale (PANSS). Int J Methods Psychiatr Res. 1996;6(4):227-235.
18. Nielsen CM, Kølbæk P, Dines D, Opler M, Correll CU, Østergaard SD. Are informants required to obtain valid ratings on the Positive and Negative Syndrome Scale (PANSS)?. Schizophrenia (Heidelb). 2023;9(1):54. doi: 10.1038/s41537-023-00378-5
19. Opler MGA, Yavorsky C, Daniel DG. Positive and Negative Syndrome Scale (PANSS) training: challenges, solutions, and future directions. Innov Clin Neurosci. 2017;14(11-12):77-81.
20. Østergaard SD, Lemming OM, Mors O, Correll CU, Bech P. PANSS-6: a brief rating scale for the measurement of severity in schizophrenia. Acta Psychiatr Scand. 2016;133(6):436-444.
21. Nielsen CM, Kølbæk P, Dines D, et al. Validation of ratings on the six-item Positive and Negative Syndrome Scale obtained via the Simplified Negative and Positive Symptoms Interview among outpatients with schizophrenia. J Psychopharmacol. 2022;36(11):1208-1217. doi: 10.1177/02698811221131992
22. Kølbæk P, Dines D, Holm T, et al. Clinical validation of ratings on the six-item Positive and Negative Syndrome Scale obtained via the Simplified Negative and Positive Symptoms Interview. J Psychopharmacol. 2021;35(9): 1081-1090. doi: 10.1177/0269881121 99689
23. Østergaard SD, Foldager L, Mors O, Bech P, Correll CU. The validity and sensitivity of PANSS-6 in the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) study. Schizophr Bull. 2018;44(2):453-462. doi: 10.1093/schbul/sbx076
24. Overall JE, Gorham DR. The Brief Psychiatric Rating Scale. Psychol Rep. 1962;10:799-812. doi: 10.2466/pr0.1962.10.3.799
25. Overall JE, Gorham DR. Brief Psychiatric Rating Scale (BPRS): recent developments in ascertainment and scaling. Psychopharmacol Bull. 1988;24(1):97-99.
26. Ventura J, Lukoff D, Nuechterlein KH, Liberman RP, Green M, Shaner A. Appendix 1: Brief Psychiatric Rating Scale (BPRS) Expanded version (4.0) scales, anchor points and administration manual. Int J Methods Psychiatr Res. 1993;3:227-244.
27. Hofmann AB, Schmid HM, Jabat M, et al. Utility and validity of the Brief Psychiatric Rating Scale (BPRS) as a transdiagnostic scale. Psychiatry Res. 2022;314:114659. doi: 10.1016/j.psychres.2022.114659
28. Zanello A, Berthoud L, Ventura J, Merlo MC. The Brief Psychiatric Rating Scale (version 4.0) factorial structure and its sensitivity in the treatment of outpatients with unipolar depression. Psychiatry Res. 2013;210(2):626-633. doi: 10.1016/j.psychres.2013.07.001
29. Rhoades HM, Overall JE. The semistructured BPRS interview and rating guide. Psychopharmacol Bull. 1988;24(1):101-104.
30. Schooler NR. Precursors to the PANSS: the BPRS and its progenitors. Innov Clin Neurosci. 2017;14(11-12):10-11.
31. Andreasen NC. Scale for the Assessment of Positive Symptoms (SAPS). 1986. Accessed November 15, 2023. https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft48377-000
32. Andreasen NC. The Scale for the Assessment of Negative Symptoms (SANS): conceptual and theoretical foundations. Br J Psychiatry Suppl. 1989;(7):49-58.
33. The Parkinson Study Group. Low-dose clozapine for the treatment of drug-induced psychosis in Parkinson’s disease. N Engl J Med. 1999;340(10):757-763. doi: 10.1056/NEJM199903113401003
34. Isaacson SH, Coate B, Norton J, Stankovic S. Blinded SAPS-PD assessment after 10 weeks of pimavanserin treatment for Parkinson's disease psychosis. J Parkinsons Dis. 2020;10(4):1389-1396. doi: 10.3233/JPD-202047
35. Isaacson SH, Ballard CG, Kreitzman DL, et al. Efficacy results of pimavanserin from a multi-center, open-label extension study in Parkinson's disease psychosis patients. Parkinsonism Relat Disord. 2021;87:25-31. doi: 10.1016/j.parkreldis.2021.04.012
36. Kirkpatrick B, Fenton WS, Carpenter WT Jr, Marder SR. The NIMH-MATRICS consensus statement on negative symptoms. Schizophr Bull. 2006;32(2):214-219. doi: 10.1093/schbul/ sbj053
37. Kumari S, Malik M, Florival C, Manalai P, Sonje S. An assessment of five (PANSS, SAPS, SANS, NSA-16, CGI-SCH) commonly used symptoms rating scales in schizophrenia and comparison to newer scales (CAINS, BNSS). J Addict Res Ther. 2017;8(3):324. doi: 10.4172/2155-6105.1000324
38. Alphs LD, Summerfelt A, Lann H, Muller RJ. The negative symptom assessment: a new instrument to assess negative symptoms of schizophrenia. Psychopharmacol Bull. 1989;25(2):159-163.
39. Axelrod BN, Goldman RS, Alphs LD. Validation of the 16-item Negative Symptom Assessment. J Psychiatr Res. 1993;27(3):253-258. doi: 10.1016/0022-3956(93)90036-2
40. Eckert SL, Diamond PM, Miller AL, Velligan DI, Funderburg LG, True JE. A comparison of instrument sensitivity to negative symptom change. Psychiatry Res. 1996;63(1):67-75. doi: 10.1016/0165-1781(96)02870-3
41. Rekhi G, Alphs L, Ang MS, Lee J. Clinical utility of the Negative Symptom Assessment-16 in individuals with schizophrenia. Eur Neuropsychopharmacol. 2019;29(12):1433-1441. doi: 10.1016/j.euroneuro.2019.10.009
42. Velligan DI, Lopez L, Castillo DA, Manaugh B, Milam AC, Miller AL. Interrater reliability of using brief standardized outcome measures in a community mental health setting. Psychiatr Serv. 2011;62(5):558-560. doi: 10.1176/ps.62.5.pss6205_0558
43. Daniel DG, Alphs L, Cazorla P, Bartko JJ, Panagides J. Training for assessment of negative symptoms of schizophrenia across languages and cultures: comparison of the NSA-16 with the PANSS Negative Subscale and Negative Symptom factor. Clin Schizophr Relat Psychoses. 2011;5(2):87-94. doi: 10.3371/CSRP.5.2.5
44. Blanchard JJ, Kring AM, Horan WP, Gur R. Toward the next generation of negative symptom assessments: the collaboration to advance negative symptom assessment in schizophrenia. Schizophr Bull. 2011;37(2):291-299. doi: 10.1093/schbul/sbq104
45. Alphs L, Morlock R, Coon C, van Willigenburg A, Panagides J. The 4-item Negative Symptom Assessment (NSA-4) instrument: a simple tool for evaluating negative symptoms in schizophrenia following brief training. Psychiatry (Edgmont). 2010;7(7):26-32.
46. Alphs L, Morlock R, Coon C, Cazorla P, Szegedi A, Panagides J. Validation of a 4-item Negative Symptom Assessment (NSA-4): a short, practical clinical tool for the assessment of negative symptoms in schizophrenia. Int J Methods Psychiatr Res. 2011;20(2):e31-e37. doi: 10.1002/mpr.339
47. Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP. The Clinical Assessment Interview for Negative Symptoms (CAINS): final development and validation. Am J Psychiatry. 2013;170(2):165-172. doi: 10.1176/appi.ajp.2012.12010109
48. Kirkpatrick B, Strauss GP, Nguyen L, et al. The Brief Negative Symptom Scale: psychometric properties. Schizophr Bull. 2011;37(2):300-305. doi: 10.1093/schbul/sbq059
49. Carpenter WT, Blanchard JJ, Kirkpatrick B. New standards for negative symptom assessment. Schizophr Bull. 2016;42(1):1-3. doi: 10.1093/schbul/sbv160
50. Strauss GP, Keller WR, Buchanan RW, et al. Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale. Schizophr Res. 2012;142(1-3):88-92. doi: 10.1016/j.schres.2012.10.012
51. Li SB, Liu C, Zhang JB, et al. Revisiting the latent structure of negative symptoms in schizophrenia: evidence from two second-generation clinical assessments [published correction appears in Schizophr Res. 2023 Feb;252:206-207]. Schizophr Res. 2022;248:131-139. doi: 10.1016/j.schres.2022.08.016
52. Strauss GP, Gold JM. A psychometric comparison of the Clinical Assessment Interview for Negative Symptoms and the Brief Negative Symptom Scale. Schizophr Bull. 2016;42(6):1384-1394. doi: 10.1093/schbul/sbw046
53. Strauss GP, Horan WP, Kirkpatrick B, et al. Deconstructing negative symptoms of schizophrenia: avolition-apathy and diminished expression clusters predict clinical presentation and functional outcome. J Psychiatr Res. 2013;47(6):783-790. doi: 10.1016/j.jpsychires.2013.01.015
54. Kirkpatrick B, Buchanan RW, Ross DE, Carpenter WT Jr. A separate disease within the syndrome of schizophrenia. Arch Gen Psychiatry. 2001;58(2):165-171. doi: 10.1001/archpsyc.58.2.165
55. Strauss GP, Keller WR, Buchanan RW, et al. Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale. Schizophr Res. 2012;142(1-3):88-92. doi: 10.1016/j.schres.2012.10.012
56. Guy W. Clinical Global Impressions Scale (CGI). 1976. Accessed November 15, 2023, https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft48216-000
57. Haro JM, Kamath SA, Ochoa S, et al. The Clinical Global Impression-Schizophrenia scale: a simple instrument to measure the diversity of symptoms present in schizophrenia. Acta Psychiatr Scand Suppl. 2003;(416):16-23. doi: 10.1034/j.1600-0447.107.s416.5.x
58. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR). American Psychiatric Association; 2000.
59. Aas IH. Global Assessment of Functioning (GAF): properties and frontier of current knowledge. Ann Gen Psychiatry. 2010;9:20. doi: 10.1186/1744-859X-9-20
60. Morosini PL, Magliano L, Brambilla L, Ugolini S, Pioli R. Development, reliability and acceptability of a new version of the DSM-IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social functioning. Acta Psychiatr Scand. 2000;101(4):323-329.
61. Kane J, Canas F, Kramer M, et al. Treatment of schizophrenia with paliperidone extended-release tablets: a 6-week placebo-controlled trial. Schizophr Res. 2007;90(1-3):147-161. doi: 10.1016/j.schres.2006.09.012
62. Patrick DL, Burns T, Morosini P, et al. Reliability, validity and ability to detect change of the clinician-rated Personal and Social Performance scale in patients with acute symptoms of schizophrenia. Curr Med Res Opin. 2009;25(2):325-338. doi: 10.1185/03007990802611919
63. Nasrallah H, Morosini P, Gagnon DD. Reliability, validity and ability to detect change of the Personal and Social Performance scale in patients with stable schizophrenia. Psychiatry Res. 2008;161(2):213-224. doi: 10.1016/j.psychres.2007.11.012
64. Jelastopulu E, Giourou E, Merekoulias G, Mestousi A, Moratis E, Alexopoulos EC. Correlation between the Personal and Social Performance scale (PSP) and the Positive and Negative Syndrome Scale (PANSS) in a Greek sample of patients with schizophrenia. BMC Psychiatry. 2014;14:197. doi: 10.1186/1471-244X-14-197
65. White S, Dominise C, Naik D, Killaspy H. The reliability of the Personal and Social Performance scale - informing its training and use. Psychiatry Res. 2016;243:312-317. doi: 10.1016/j.psychres.2016.06.047
66. Heinrichs DW, Hanlon TE, Carpenter WT Jr. The Quality of Life Scale: an instrument for rating the schizophrenic deficit syndrome. Schizophr Bull. 1984;10(3):388-398. doi:10.1093/ schbul/10.3.388
67. Addington D, Addington J, Maticka-Tyndale E, Joyce J. Reliability and validity of a depression rating scale for schizophrenics. Schizophr Res. 1992;6(3):201-208. doi: 10.1016/0920-9964(92)90003-n
68. Addington D, Addington J, Maticka-Tyndale E. Assessing depression in schizophrenia: the Calgary Depression Scale. Br J Psychiatry Suppl. 1993;(22):39-44.
69. Kim SW, Kim SJ, Yoon BH, et al. Diagnostic validity of assessment scales for depression in patients with schizophrenia. Psychiatry Res. 2006;144(1):57-63. doi: 10.1016/j.psychres.2005.10.002
70. Harvey PD, Bosia M, Cavallaro R, et al. Cognitive dysfunction in schizophrenia: An expert group paper on the current state of the art. Schizophr Res Cogn. 2022;29:100249. doi: 10.1016/j.scog.2022.100249
71. Keefe RS, Eesley CE, Poe MP. Defining a cognitive function decrement in schizophrenia. Biol Psychiatry. 2005;57(6):688-691. doi: 10.1016/j.biopsych.2005.01.003
72. Marder SR. The NIMH-MATRICS project for developing cognition-enhancing agents for schizophrenia. Dialogues Clin Neurosci. 2006;8(1):109-113. doi: 10.31887/DCNS. 2006.8.1/smarder
73. Nuechterlein KH, Green MF, Kern RS, et al. The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. Am J Psychiatry. 2008;165(2):203-213. doi: 10.1176/appi.ajp.2007.07010042
74. Buchanan RW, Davis M, Goff D, et al. A summary of the FDA-NIMH-MATRICS workshop on clinical trial design for neurocognitive drugs for schizophrenia. Schizophr Bull. 2005;31(1):5-19. doi: 10.1093/schbul/ sbi020
75. August SM, Kiwanuka JN, McMahon RP, Gold JM. The MATRICS Consensus Cognitive Battery (MCCB): clinical and cognitive correlates. Schizophr Res. 2012;134(1):76-82. doi: 10.1016/j.schres.2011.10.015
76. Keefe RS, Fox KH, Harvey PD, Cucchiaro J, Siu C, Loebel A. Characteristics of the MATRICS Consensus Cognitive Battery in a 29-site antipsychotic schizophrenia clinical trial. Schizophr Res. 2011;125(2-3):161-168. doi: 10.1016/j.schres.2010.09.015
77. Georgiades A, Davis VG, Atkins AS, et al. Psychometric characteristics of the MATRICS Consensus Cognitive Battery in a large pooled cohort of stable schizophrenia patients. Schizophr Res. 2017;190:172-179. doi: 10.1016/j.schres.2017.03.040
78. Eack SM, Greeno CG, Pogue-Geile MF, Newhill CE, Hogarty GE, Keshavan MS. Assessing social-cognitive deficits in schizophrenia with the Mayer-Salovey-Caruso Emotional Intelligence Test. Schizophr Bull. 2010;36(2):370-380. doi: 10.1093/schbul/ sbn091
79. Hellemann GS, Green MF, Kern RS, Sitarenios G, Nuechterlein KH. Developing an international scoring system for a consensus-based social cognition measure: MSCEIT-managing emotions. Psychol Med. 2017;47(14):2494-2501. doi:10.1017/S0033291717001052
80. Pinkham AE, Harvey PD, Penn DL. Social cognition psychometric evaluation: results of the final validation study. Schizophr Bull. 2018;44(4):737-748. doi: 10.1093/schbul/ sbx117
81. Brunet-Gouet E, Decaix-Tisserand C, Urbach M, et al. Outcome prediction with a social cognitive battery: a multicenter longitudinal study. NPJ Schizophr. 2021;7(1):30. doi: 10.1038/s41537-021-00160-5
82. Hajdúk M, Achim AM, Brunet-Gouet E, Mehta UM, Pinkham AE. How to move forward in social cognition research? Put it into an international perspective. Schizophr Res. 2020;215:463-464. doi: 10.1016/j.schres.2019.10.001
83. Keefe RS, Poe M, Walker TM, Harvey PD. The relationship of the Brief Assessment of Cognition in Schizophrenia (BACS) to functional capacity and real-world functional outcome. J Clin Exp Neuropsychol. 2006;28(2):260-269. doi: 10.1080/13803390500360539
84. Green MF, Nuechterlein KH, Gold JM, et al. Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiatry. 2004;56(5):301-307. doi: 10.1016/ j.biopsych.2004.06.023
85. Keefe RS, Poe M, Walker TM, Kang JW, Harvey PD. The Schizophrenia Cognition Rating Scale: an interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. Am J Psychiatry. 2006;163(3):426-432. doi: 10.1176/appi. ajp.163.3.42
86. Keefe RS, Davis VG, Spagnola NB, et al. Reliability, validity and treatment sensitivity of the Schizophrenia Cognition Rating Scale. Eur Neuropsychopharmacol. 2015;25(2):176-184. doi: 10.1016/j.euroneuro.2014.06.009
87. Balzan RP, Neaves A, Denson LA, Liu D, Galletly C. Cognitive deficit awareness in schizophrenia: absent, intact, or somewhere in-between?. Cogn Neuropsychiatry. 2014;19(6):471-484. doi: 10.1080/13546805.2014.909311
88. Keefe RSE, Davis VG, Atkins AS, et al. Validation of a computerized test of functional capacity. Schizophr Res. 2016;175(1-3):90-96. doi: 10.1016/j.schres.2016.03.038
89. Green MF, Schooler NR, Kern RS, et al. Evaluation of functionally meaningful measures for clinical trials of cognition enhancement in schizophrenia. Am J Psychiatry. 2011;168(4):400-407. doi: 10.1176/appi. ajp.2010.10030414
90. Nahum M, Lee H, Fisher M, et al. Online social cognition training in schizophrenia: a double-blind, randomized, controlled multi-site clinical trial. Schizophr Bull. 2021;47(1):108-117. doi: 10.1093/schbul/sbaa085
91. Atkins AS, Khan A, Ulshen D, et al. Assessment of instrumental activities of daily living in older adults with subjective cognitive decline using the Virtual Reality Functional Capacity Assessment Tool (VRFCAT). J Prev Alzheimers Dis. 2018;5(4):216-234. doi: 10.14283/jpad.2018.28
92. Patterson TL, Goldman S, McKibbin CL, Hughs T, Jeste DV. UCSD Performance-Based Skills Assessment: development of a new measure of everyday functioning for severely mentally ill adults. Schizophr Bull. 2001;27(2):235-245. doi: 10.1093/oxfordjournals.schbul.a006870
93. Patterson TL, Moscona S, McKibbin CL, Davidson K, Jeste DV. Social skills performance assessment among older patients with schizophrenia. Schizophr Res. 2001;48(2-3):351-360. doi: 10.1016/s0920-9964(00)00109-2
94. Patterson TL, Lacro J, McKibbin CL, Moscona S, Hughs T, Jeste DV. Medication management ability assessment: results from a performance-based measure in older outpatients with schizophrenia. J Clin Psychopharmacol. 2002;22(1):11-19. doi: 10.1097/00004714-200202000-00003
95. Horan WP, Depp CA, Hurst S, et al. Qualitative analysis of the content validity of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) in schizophrenia: a multi-stakeholder perspective. Schizophr Bull. 2023;, sgad012. doi: 10.1093/schizbullopen/sgad012
96. Gupta M, Holshausen K, Gou L, Bowie C. Measuring negative symptom change in schizophrenia: considering alternatives to self-report. Expert Rev Neurother. 2014;14(8):911-922. doi: 10.1586/14737175.2014.935341
97. Ho BC, Flaum M, Hubbard W, Arndt S, Andreasen NC. Validity of symptom assessment in psychotic disorders: information variance across different sources of history. Schizophr Res. 2004;68(2-3):299-307. doi: 10.1016/ j.schres.2003.07.006
98. Kobak KA, Engelhardt N, Williams JB, Lipsitz JD. Rater training in multicenter clinical trials: issues and recommendations. J Clin Psychopharmacol. 2004;24(2):113-117. doi: 10.1097/01.jcp.0000116651.91923.54
99. Cohen AS, Alpert M, Nienow TM, Dinzeo TJ, Docherty NM. Computerized measurement of negative symptoms in schizophrenia. J Psychiatr Res. 2008;42(10):827-836. doi: 10.1016/ j.jpsychires.2007.08.008
100. Strauss GP, Zamani-Esfahlani F, Raugh IM, Luther L, Sayama H. Network analysis of discrete emotional states measured via ecological momentary assessment in schizophrenia [published online ahead of print, 2023 Jun 6]. Eur Arch Psychiatry Clin Neurosci. 2023;10.1007/s00406-023-01623-9. doi: 10.1007/s00406-023-01623-9
2. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22-57.
3. First MB, Williams JBW, Karg RS, Spitzer RL. Structured Clinical Interview for DSM-5—Research Version (SCID-5 for DSM-5, Research Version; SCID-5-RV). Arlington, VA, American Psychiatric Association, 2015.
4. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, Text Revision (DSM-5-TR). American Medical Association; 2022.
5. World Health Organization (WHO). The ICD-10 classification of mental and behavioural disorders. World Health Organization; 1993
6. Gjerden P. Criteria-based diagnostics generate excessive and incorrect diagnoses. Tidsskr Nor Laegeforen. 2015;135(16):1437. doi: 10.4045/tidsskr.15.0727
7. Shabani A, Masoumian S, Zamirinejad S, et al. Psychometric properties of Structured Clinical Interview for DSM-5 Disorders-Clinician Version (SCID-5-CV). Brain Behav. 2021;11(5):e01894. doi: 10.1002/brb3.1894
8. Osório FL, Loureiro SR, Hallak JEC, et al. Clinical validity and intrarater and test-retest reliability of the Structured Clinical Interview for DSM-5 - Clinician Version (SCID-5-CV). Psychiatry Clin Neurosci. 2019;73(12):754-760. doi: 10.1111/pcn.12931
9. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13(2):261-276. doi: 10.1093/schbul/13.2.261
10. Marder SR, Davis JM, Chouinard G. The effects of risperidone on the five dimensions of schizophrenia derived by factor analysis: combined results of the North American trials [published correction appears in J Clin Psychiatry 1998 Apr;59(4):200]. J Clin Psychiatry. 1997;58(12):538-546. doi: 10.4088/jcp.v58n1205
11. Hopkins SC, Ogirala A, Loebel A, Koblan KS. Transformed PANSS factors intended to reduce pseudospecificity among symptom domains and enhance understanding of symptom change in antipsychotic-treated patients with schizophrenia. Schizophr Bull. 2018;44(3):593-602. doi: 10.1093/schbul/sbx101
12. Opler LA, Kay SR, Lindenmayer JP, Fiszbein A. SCI- PANSS. Toronto: Multi-Health Systems Inc; 1992.
13. Khan A, Yavorsky C, Liechti S, et al. A Rasch model to test the cross-cultural validity in the positive and negative syndrome scale (PANSS) across six geo-cultural groups. BMC Psychol. 2013;1(1):5. doi: 10.1186/2050-7283-1-5
14. Kay SR, Opler LA, Lindenmayer JP. Reliability and validity of the positive and negative syndrome scale for schizophrenics. Psychiatry Res. 1988;23(1):99-110. doi: 10.1093/ schbul/13.2.261
15. Santor DA, Ascher-Svanum H, Lindenmayer JP, Obenchain RL. Item response analysis of the Positive and Negative Syndrome Scale. BMC Psychiatry. 2007;7:66. doi: 10.1186/1471-244X-7-66
16. Lindström E, Wieselgren IM, von Knorring L. Interrater reliability of the Structured Clinical Interview for the Positive and Negative Syndrome Scale for schizophrenia. Acta Psychiatr Scand. 1994;89(3):192-195. doi: 10.1111/j.1600-0447.1994.tb08091.x
17. Bentsen H, Munkvold O, Notland TH, et al. The interrater reliability of the Positive and Negative Syndrome Scale (PANSS). Int J Methods Psychiatr Res. 1996;6(4):227-235.
18. Nielsen CM, Kølbæk P, Dines D, Opler M, Correll CU, Østergaard SD. Are informants required to obtain valid ratings on the Positive and Negative Syndrome Scale (PANSS)?. Schizophrenia (Heidelb). 2023;9(1):54. doi: 10.1038/s41537-023-00378-5
19. Opler MGA, Yavorsky C, Daniel DG. Positive and Negative Syndrome Scale (PANSS) training: challenges, solutions, and future directions. Innov Clin Neurosci. 2017;14(11-12):77-81.
20. Østergaard SD, Lemming OM, Mors O, Correll CU, Bech P. PANSS-6: a brief rating scale for the measurement of severity in schizophrenia. Acta Psychiatr Scand. 2016;133(6):436-444.
21. Nielsen CM, Kølbæk P, Dines D, et al. Validation of ratings on the six-item Positive and Negative Syndrome Scale obtained via the Simplified Negative and Positive Symptoms Interview among outpatients with schizophrenia. J Psychopharmacol. 2022;36(11):1208-1217. doi: 10.1177/02698811221131992
22. Kølbæk P, Dines D, Holm T, et al. Clinical validation of ratings on the six-item Positive and Negative Syndrome Scale obtained via the Simplified Negative and Positive Symptoms Interview. J Psychopharmacol. 2021;35(9): 1081-1090. doi: 10.1177/0269881121 99689
23. Østergaard SD, Foldager L, Mors O, Bech P, Correll CU. The validity and sensitivity of PANSS-6 in the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) study. Schizophr Bull. 2018;44(2):453-462. doi: 10.1093/schbul/sbx076
24. Overall JE, Gorham DR. The Brief Psychiatric Rating Scale. Psychol Rep. 1962;10:799-812. doi: 10.2466/pr0.1962.10.3.799
25. Overall JE, Gorham DR. Brief Psychiatric Rating Scale (BPRS): recent developments in ascertainment and scaling. Psychopharmacol Bull. 1988;24(1):97-99.
26. Ventura J, Lukoff D, Nuechterlein KH, Liberman RP, Green M, Shaner A. Appendix 1: Brief Psychiatric Rating Scale (BPRS) Expanded version (4.0) scales, anchor points and administration manual. Int J Methods Psychiatr Res. 1993;3:227-244.
27. Hofmann AB, Schmid HM, Jabat M, et al. Utility and validity of the Brief Psychiatric Rating Scale (BPRS) as a transdiagnostic scale. Psychiatry Res. 2022;314:114659. doi: 10.1016/j.psychres.2022.114659
28. Zanello A, Berthoud L, Ventura J, Merlo MC. The Brief Psychiatric Rating Scale (version 4.0) factorial structure and its sensitivity in the treatment of outpatients with unipolar depression. Psychiatry Res. 2013;210(2):626-633. doi: 10.1016/j.psychres.2013.07.001
29. Rhoades HM, Overall JE. The semistructured BPRS interview and rating guide. Psychopharmacol Bull. 1988;24(1):101-104.
30. Schooler NR. Precursors to the PANSS: the BPRS and its progenitors. Innov Clin Neurosci. 2017;14(11-12):10-11.
31. Andreasen NC. Scale for the Assessment of Positive Symptoms (SAPS). 1986. Accessed November 15, 2023. https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft48377-000
32. Andreasen NC. The Scale for the Assessment of Negative Symptoms (SANS): conceptual and theoretical foundations. Br J Psychiatry Suppl. 1989;(7):49-58.
33. The Parkinson Study Group. Low-dose clozapine for the treatment of drug-induced psychosis in Parkinson’s disease. N Engl J Med. 1999;340(10):757-763. doi: 10.1056/NEJM199903113401003
34. Isaacson SH, Coate B, Norton J, Stankovic S. Blinded SAPS-PD assessment after 10 weeks of pimavanserin treatment for Parkinson's disease psychosis. J Parkinsons Dis. 2020;10(4):1389-1396. doi: 10.3233/JPD-202047
35. Isaacson SH, Ballard CG, Kreitzman DL, et al. Efficacy results of pimavanserin from a multi-center, open-label extension study in Parkinson's disease psychosis patients. Parkinsonism Relat Disord. 2021;87:25-31. doi: 10.1016/j.parkreldis.2021.04.012
36. Kirkpatrick B, Fenton WS, Carpenter WT Jr, Marder SR. The NIMH-MATRICS consensus statement on negative symptoms. Schizophr Bull. 2006;32(2):214-219. doi: 10.1093/schbul/ sbj053
37. Kumari S, Malik M, Florival C, Manalai P, Sonje S. An assessment of five (PANSS, SAPS, SANS, NSA-16, CGI-SCH) commonly used symptoms rating scales in schizophrenia and comparison to newer scales (CAINS, BNSS). J Addict Res Ther. 2017;8(3):324. doi: 10.4172/2155-6105.1000324
38. Alphs LD, Summerfelt A, Lann H, Muller RJ. The negative symptom assessment: a new instrument to assess negative symptoms of schizophrenia. Psychopharmacol Bull. 1989;25(2):159-163.
39. Axelrod BN, Goldman RS, Alphs LD. Validation of the 16-item Negative Symptom Assessment. J Psychiatr Res. 1993;27(3):253-258. doi: 10.1016/0022-3956(93)90036-2
40. Eckert SL, Diamond PM, Miller AL, Velligan DI, Funderburg LG, True JE. A comparison of instrument sensitivity to negative symptom change. Psychiatry Res. 1996;63(1):67-75. doi: 10.1016/0165-1781(96)02870-3
41. Rekhi G, Alphs L, Ang MS, Lee J. Clinical utility of the Negative Symptom Assessment-16 in individuals with schizophrenia. Eur Neuropsychopharmacol. 2019;29(12):1433-1441. doi: 10.1016/j.euroneuro.2019.10.009
42. Velligan DI, Lopez L, Castillo DA, Manaugh B, Milam AC, Miller AL. Interrater reliability of using brief standardized outcome measures in a community mental health setting. Psychiatr Serv. 2011;62(5):558-560. doi: 10.1176/ps.62.5.pss6205_0558
43. Daniel DG, Alphs L, Cazorla P, Bartko JJ, Panagides J. Training for assessment of negative symptoms of schizophrenia across languages and cultures: comparison of the NSA-16 with the PANSS Negative Subscale and Negative Symptom factor. Clin Schizophr Relat Psychoses. 2011;5(2):87-94. doi: 10.3371/CSRP.5.2.5
44. Blanchard JJ, Kring AM, Horan WP, Gur R. Toward the next generation of negative symptom assessments: the collaboration to advance negative symptom assessment in schizophrenia. Schizophr Bull. 2011;37(2):291-299. doi: 10.1093/schbul/sbq104
45. Alphs L, Morlock R, Coon C, van Willigenburg A, Panagides J. The 4-item Negative Symptom Assessment (NSA-4) instrument: a simple tool for evaluating negative symptoms in schizophrenia following brief training. Psychiatry (Edgmont). 2010;7(7):26-32.
46. Alphs L, Morlock R, Coon C, Cazorla P, Szegedi A, Panagides J. Validation of a 4-item Negative Symptom Assessment (NSA-4): a short, practical clinical tool for the assessment of negative symptoms in schizophrenia. Int J Methods Psychiatr Res. 2011;20(2):e31-e37. doi: 10.1002/mpr.339
47. Kring AM, Gur RE, Blanchard JJ, Horan WP, Reise SP. The Clinical Assessment Interview for Negative Symptoms (CAINS): final development and validation. Am J Psychiatry. 2013;170(2):165-172. doi: 10.1176/appi.ajp.2012.12010109
48. Kirkpatrick B, Strauss GP, Nguyen L, et al. The Brief Negative Symptom Scale: psychometric properties. Schizophr Bull. 2011;37(2):300-305. doi: 10.1093/schbul/sbq059
49. Carpenter WT, Blanchard JJ, Kirkpatrick B. New standards for negative symptom assessment. Schizophr Bull. 2016;42(1):1-3. doi: 10.1093/schbul/sbv160
50. Strauss GP, Keller WR, Buchanan RW, et al. Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale. Schizophr Res. 2012;142(1-3):88-92. doi: 10.1016/j.schres.2012.10.012
51. Li SB, Liu C, Zhang JB, et al. Revisiting the latent structure of negative symptoms in schizophrenia: evidence from two second-generation clinical assessments [published correction appears in Schizophr Res. 2023 Feb;252:206-207]. Schizophr Res. 2022;248:131-139. doi: 10.1016/j.schres.2022.08.016
52. Strauss GP, Gold JM. A psychometric comparison of the Clinical Assessment Interview for Negative Symptoms and the Brief Negative Symptom Scale. Schizophr Bull. 2016;42(6):1384-1394. doi: 10.1093/schbul/sbw046
53. Strauss GP, Horan WP, Kirkpatrick B, et al. Deconstructing negative symptoms of schizophrenia: avolition-apathy and diminished expression clusters predict clinical presentation and functional outcome. J Psychiatr Res. 2013;47(6):783-790. doi: 10.1016/j.jpsychires.2013.01.015
54. Kirkpatrick B, Buchanan RW, Ross DE, Carpenter WT Jr. A separate disease within the syndrome of schizophrenia. Arch Gen Psychiatry. 2001;58(2):165-171. doi: 10.1001/archpsyc.58.2.165
55. Strauss GP, Keller WR, Buchanan RW, et al. Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale. Schizophr Res. 2012;142(1-3):88-92. doi: 10.1016/j.schres.2012.10.012
56. Guy W. Clinical Global Impressions Scale (CGI). 1976. Accessed November 15, 2023, https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft48216-000
57. Haro JM, Kamath SA, Ochoa S, et al. The Clinical Global Impression-Schizophrenia scale: a simple instrument to measure the diversity of symptoms present in schizophrenia. Acta Psychiatr Scand Suppl. 2003;(416):16-23. doi: 10.1034/j.1600-0447.107.s416.5.x
58. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR). American Psychiatric Association; 2000.
59. Aas IH. Global Assessment of Functioning (GAF): properties and frontier of current knowledge. Ann Gen Psychiatry. 2010;9:20. doi: 10.1186/1744-859X-9-20
60. Morosini PL, Magliano L, Brambilla L, Ugolini S, Pioli R. Development, reliability and acceptability of a new version of the DSM-IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social functioning. Acta Psychiatr Scand. 2000;101(4):323-329.
61. Kane J, Canas F, Kramer M, et al. Treatment of schizophrenia with paliperidone extended-release tablets: a 6-week placebo-controlled trial. Schizophr Res. 2007;90(1-3):147-161. doi: 10.1016/j.schres.2006.09.012
62. Patrick DL, Burns T, Morosini P, et al. Reliability, validity and ability to detect change of the clinician-rated Personal and Social Performance scale in patients with acute symptoms of schizophrenia. Curr Med Res Opin. 2009;25(2):325-338. doi: 10.1185/03007990802611919
63. Nasrallah H, Morosini P, Gagnon DD. Reliability, validity and ability to detect change of the Personal and Social Performance scale in patients with stable schizophrenia. Psychiatry Res. 2008;161(2):213-224. doi: 10.1016/j.psychres.2007.11.012
64. Jelastopulu E, Giourou E, Merekoulias G, Mestousi A, Moratis E, Alexopoulos EC. Correlation between the Personal and Social Performance scale (PSP) and the Positive and Negative Syndrome Scale (PANSS) in a Greek sample of patients with schizophrenia. BMC Psychiatry. 2014;14:197. doi: 10.1186/1471-244X-14-197
65. White S, Dominise C, Naik D, Killaspy H. The reliability of the Personal and Social Performance scale - informing its training and use. Psychiatry Res. 2016;243:312-317. doi: 10.1016/j.psychres.2016.06.047
66. Heinrichs DW, Hanlon TE, Carpenter WT Jr. The Quality of Life Scale: an instrument for rating the schizophrenic deficit syndrome. Schizophr Bull. 1984;10(3):388-398. doi:10.1093/ schbul/10.3.388
67. Addington D, Addington J, Maticka-Tyndale E, Joyce J. Reliability and validity of a depression rating scale for schizophrenics. Schizophr Res. 1992;6(3):201-208. doi: 10.1016/0920-9964(92)90003-n
68. Addington D, Addington J, Maticka-Tyndale E. Assessing depression in schizophrenia: the Calgary Depression Scale. Br J Psychiatry Suppl. 1993;(22):39-44.
69. Kim SW, Kim SJ, Yoon BH, et al. Diagnostic validity of assessment scales for depression in patients with schizophrenia. Psychiatry Res. 2006;144(1):57-63. doi: 10.1016/j.psychres.2005.10.002
70. Harvey PD, Bosia M, Cavallaro R, et al. Cognitive dysfunction in schizophrenia: An expert group paper on the current state of the art. Schizophr Res Cogn. 2022;29:100249. doi: 10.1016/j.scog.2022.100249
71. Keefe RS, Eesley CE, Poe MP. Defining a cognitive function decrement in schizophrenia. Biol Psychiatry. 2005;57(6):688-691. doi: 10.1016/j.biopsych.2005.01.003
72. Marder SR. The NIMH-MATRICS project for developing cognition-enhancing agents for schizophrenia. Dialogues Clin Neurosci. 2006;8(1):109-113. doi: 10.31887/DCNS. 2006.8.1/smarder
73. Nuechterlein KH, Green MF, Kern RS, et al. The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. Am J Psychiatry. 2008;165(2):203-213. doi: 10.1176/appi.ajp.2007.07010042
74. Buchanan RW, Davis M, Goff D, et al. A summary of the FDA-NIMH-MATRICS workshop on clinical trial design for neurocognitive drugs for schizophrenia. Schizophr Bull. 2005;31(1):5-19. doi: 10.1093/schbul/ sbi020
75. August SM, Kiwanuka JN, McMahon RP, Gold JM. The MATRICS Consensus Cognitive Battery (MCCB): clinical and cognitive correlates. Schizophr Res. 2012;134(1):76-82. doi: 10.1016/j.schres.2011.10.015
76. Keefe RS, Fox KH, Harvey PD, Cucchiaro J, Siu C, Loebel A. Characteristics of the MATRICS Consensus Cognitive Battery in a 29-site antipsychotic schizophrenia clinical trial. Schizophr Res. 2011;125(2-3):161-168. doi: 10.1016/j.schres.2010.09.015
77. Georgiades A, Davis VG, Atkins AS, et al. Psychometric characteristics of the MATRICS Consensus Cognitive Battery in a large pooled cohort of stable schizophrenia patients. Schizophr Res. 2017;190:172-179. doi: 10.1016/j.schres.2017.03.040
78. Eack SM, Greeno CG, Pogue-Geile MF, Newhill CE, Hogarty GE, Keshavan MS. Assessing social-cognitive deficits in schizophrenia with the Mayer-Salovey-Caruso Emotional Intelligence Test. Schizophr Bull. 2010;36(2):370-380. doi: 10.1093/schbul/ sbn091
79. Hellemann GS, Green MF, Kern RS, Sitarenios G, Nuechterlein KH. Developing an international scoring system for a consensus-based social cognition measure: MSCEIT-managing emotions. Psychol Med. 2017;47(14):2494-2501. doi:10.1017/S0033291717001052
80. Pinkham AE, Harvey PD, Penn DL. Social cognition psychometric evaluation: results of the final validation study. Schizophr Bull. 2018;44(4):737-748. doi: 10.1093/schbul/ sbx117
81. Brunet-Gouet E, Decaix-Tisserand C, Urbach M, et al. Outcome prediction with a social cognitive battery: a multicenter longitudinal study. NPJ Schizophr. 2021;7(1):30. doi: 10.1038/s41537-021-00160-5
82. Hajdúk M, Achim AM, Brunet-Gouet E, Mehta UM, Pinkham AE. How to move forward in social cognition research? Put it into an international perspective. Schizophr Res. 2020;215:463-464. doi: 10.1016/j.schres.2019.10.001
83. Keefe RS, Poe M, Walker TM, Harvey PD. The relationship of the Brief Assessment of Cognition in Schizophrenia (BACS) to functional capacity and real-world functional outcome. J Clin Exp Neuropsychol. 2006;28(2):260-269. doi: 10.1080/13803390500360539
84. Green MF, Nuechterlein KH, Gold JM, et al. Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiatry. 2004;56(5):301-307. doi: 10.1016/ j.biopsych.2004.06.023
85. Keefe RS, Poe M, Walker TM, Kang JW, Harvey PD. The Schizophrenia Cognition Rating Scale: an interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. Am J Psychiatry. 2006;163(3):426-432. doi: 10.1176/appi. ajp.163.3.42
86. Keefe RS, Davis VG, Spagnola NB, et al. Reliability, validity and treatment sensitivity of the Schizophrenia Cognition Rating Scale. Eur Neuropsychopharmacol. 2015;25(2):176-184. doi: 10.1016/j.euroneuro.2014.06.009
87. Balzan RP, Neaves A, Denson LA, Liu D, Galletly C. Cognitive deficit awareness in schizophrenia: absent, intact, or somewhere in-between?. Cogn Neuropsychiatry. 2014;19(6):471-484. doi: 10.1080/13546805.2014.909311
88. Keefe RSE, Davis VG, Atkins AS, et al. Validation of a computerized test of functional capacity. Schizophr Res. 2016;175(1-3):90-96. doi: 10.1016/j.schres.2016.03.038
89. Green MF, Schooler NR, Kern RS, et al. Evaluation of functionally meaningful measures for clinical trials of cognition enhancement in schizophrenia. Am J Psychiatry. 2011;168(4):400-407. doi: 10.1176/appi. ajp.2010.10030414
90. Nahum M, Lee H, Fisher M, et al. Online social cognition training in schizophrenia: a double-blind, randomized, controlled multi-site clinical trial. Schizophr Bull. 2021;47(1):108-117. doi: 10.1093/schbul/sbaa085
91. Atkins AS, Khan A, Ulshen D, et al. Assessment of instrumental activities of daily living in older adults with subjective cognitive decline using the Virtual Reality Functional Capacity Assessment Tool (VRFCAT). J Prev Alzheimers Dis. 2018;5(4):216-234. doi: 10.14283/jpad.2018.28
92. Patterson TL, Goldman S, McKibbin CL, Hughs T, Jeste DV. UCSD Performance-Based Skills Assessment: development of a new measure of everyday functioning for severely mentally ill adults. Schizophr Bull. 2001;27(2):235-245. doi: 10.1093/oxfordjournals.schbul.a006870
93. Patterson TL, Moscona S, McKibbin CL, Davidson K, Jeste DV. Social skills performance assessment among older patients with schizophrenia. Schizophr Res. 2001;48(2-3):351-360. doi: 10.1016/s0920-9964(00)00109-2
94. Patterson TL, Lacro J, McKibbin CL, Moscona S, Hughs T, Jeste DV. Medication management ability assessment: results from a performance-based measure in older outpatients with schizophrenia. J Clin Psychopharmacol. 2002;22(1):11-19. doi: 10.1097/00004714-200202000-00003
95. Horan WP, Depp CA, Hurst S, et al. Qualitative analysis of the content validity of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) in schizophrenia: a multi-stakeholder perspective. Schizophr Bull. 2023;, sgad012. doi: 10.1093/schizbullopen/sgad012
96. Gupta M, Holshausen K, Gou L, Bowie C. Measuring negative symptom change in schizophrenia: considering alternatives to self-report. Expert Rev Neurother. 2014;14(8):911-922. doi: 10.1586/14737175.2014.935341
97. Ho BC, Flaum M, Hubbard W, Arndt S, Andreasen NC. Validity of symptom assessment in psychotic disorders: information variance across different sources of history. Schizophr Res. 2004;68(2-3):299-307. doi: 10.1016/ j.schres.2003.07.006
98. Kobak KA, Engelhardt N, Williams JB, Lipsitz JD. Rater training in multicenter clinical trials: issues and recommendations. J Clin Psychopharmacol. 2004;24(2):113-117. doi: 10.1097/01.jcp.0000116651.91923.54
99. Cohen AS, Alpert M, Nienow TM, Dinzeo TJ, Docherty NM. Computerized measurement of negative symptoms in schizophrenia. J Psychiatr Res. 2008;42(10):827-836. doi: 10.1016/ j.jpsychires.2007.08.008
100. Strauss GP, Zamani-Esfahlani F, Raugh IM, Luther L, Sayama H. Network analysis of discrete emotional states measured via ecological momentary assessment in schizophrenia [published online ahead of print, 2023 Jun 6]. Eur Arch Psychiatry Clin Neurosci. 2023;10.1007/s00406-023-01623-9. doi: 10.1007/s00406-023-01623-9