Clinical Validity of Subjective Clinical Prognosis in First Episode Psychosis Schizophrenia Patients: An Analysis of Data from the European First Episode Schizophrenia Trial (EUFEST) Study
Received 18 January 2020
Accepted for publication 22 April 2020
Published 18 May 2020 Volume 2020:16 Pages 1279—1284
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Dr Roger Pinder
Valentin Petre Matei,1 Alexandra Ioana Mihăilescu,1,2 Iuliana Raluca Gheorghe,3 Ruxandra Grigoraş,4 Andrei Crasan,5 Alina Roșca,1,6 Ovidiu Popa-Velea2
1Clinical Hospital of Psychiatry “Alexandru Obregia”, Bucharest, Romania; 2Department of Medical Psychology, Faculty of Medicine, “Carol Davila” University of Medicine and Pharmacy, Bucharest, Romania; 3Department of Marketing and Medical Technology, Faculty of Medicine, “Carol Davila” University of Medicine and Pharmacy, Bucharest, Romania; 4Voila Psychiatric Hospital, Câmpina, Romania; 5The City Hospital of Curtea De Argeş, Curtea De Argeș, Romania; 6Department of Psychiatry, Faculty of Medicine, “Carol Davila” University of Medicine and Pharmacy, Bucharest, Romania
Correspondence: Iuliana Raluca Gheorghe Email [email protected]
Purpose: This study examined the validity of subjective clinical prognosis (SCP), a commonly used clinical tool, in first episode psychosis patients included in the European First Episode Schizophrenia Trial (EUFEST) study.
Patients and Methods: The study comprised 455 patients from the EUFEST trial (mean age 25.92, SD=5.45; 188 (41.31%) women, 267 (58.69%) men). SCP was classified into three mutually exclusive groups: “good prognosis” (GP) (n=265), “average prognosis” (AP) (n=131), and “poor prognosis” (PP) (n=59). The validity of the SCP was assessed by investigating the differences between the SCP groups and completer or responder status of the patients, during 1 year of the trial.
Results: The proportion of completers was significantly higher in the GP group (64.4%) compared to the AP group (25.6%) (OR=1.62, 95% CI=1.062– 2.476, p< 0.031) and the PP group (10%) (OR=2.17, 95% CI=1.226– 3.853, p< 0.009) throughout the whole duration of the trial. In what concerns responsiveness, a significantly higher number of responders were registered in the GP group compared to the AP and the PP groups in the first three months of treatment, but this outcome did not persist afterwards.
Conclusion: In terms of its predictive value at first episode schizophrenic patients, SCP seems to be reliable for treatment completion, but has a limited utility in what concerns responsiveness to treatment. This finding suggests the necessity of creating a prediction model potentially including, besides SCP, other measurement-based variables.
Keywords: anti-psychotics, first episode psychosis, prognosis, schizophrenia
Prognosis in Medicine represents a substantially important concept for all stakeholders involved in the medical process: patients, patients’ families, clinicians, and policymakers.1–5 In the current medical practice, dominated by the shift to a veritable patient-oriented industry,6 prognosis has also changed, becoming increasingly based on objective determinants.7–10 Although the imperatives of “efficacy, effectiveness and efficiency”11 are also prevalent in the domain of mental health, measure-based prognostic instruments are not commonly used in the routine management of patients.7,8 Subjective clinical prognosis (SCP) is still being frequently utilized, possibly because of the high importance played by individual cognitions,9 emotions,10 or the scientific and therapeutic culture where the clinician developed professionally.12–15 Personal clinical experience in Psychiatry plays an important role16 and could, in its turn, impact the SCP.
Knowing more about SCP’s influence on the clinical psychiatric judgment process is important for improving the quality of care. Once established, SCP may influence planning and the allocation of health services, decisions regarding the duration and intensity of treatment, and the type of communication developed with patients and their families,17 particularly in severe conditions, such as schizophrenia.18,19 Moreover, the decisions related to the treatment of mental or comorbid somatic diseases may be influenced by SCP.18 In this sense, psychiatrists may be inclined towards expressing less hope to patients and their families, if the SCP is poor.20,21
Examining the validity of SCP in such circumstances could be very informative, especially in first episode psychosis patients, where the prognosis may have high variability, from rapid and stable remission to severe and chronic deterioration of health status. In this respect, current literature is scarce, with virtually no trials having investigated the validity of SCP in this particular group of patients. Considering this knowledge gap, the aim of the current study was to assess SCP and its predictive value in first episode schizophrenia patients being part of a large trial, with the twofold intention to collect valuable scientific information and to offer valuable cues for using this prognostic tool in the current care. In this study, we focused on data gathered from EUFEST - the first independently designed trans-European schizophrenia treatment trial. The choice of this trial was largely determined by its high representative potential (due to the large number of subjects involved, its long duration, and multicentricity).22 Additionally, the conditions for running the EUFEST trial resemble the general clinical circumstances in Europe, making the conclusions of this study relevant for European specialists in mental health, and having potential applicability in local care facilities as well.
Patients and Methods
To assess SCP and its clinical validity in first episode schizophrenia patients, we examined the concordance between the patients’ SCP at the baseline and the patients’ outcome during 1 year of the trial. The analysis was separately conducted for the two criteria considered relevant in the SCP: the number of patients completing the trial and their responsiveness to the treatment.
The EUFEST Trial Design
The European First Episode Schizophrenia Trial (EUFEST)23 was a randomized, open treatment trial comparing the effectiveness of five antipsychotics (haloperidol, amisulpride, olanzapine, quetiapine and ziprasidone) in 498 patients with a first episode of psychosis. A total of 50 centers located in 13 European countries and Israel participated in the trial. To be eligible for inclusion in the EUFEST, patients (18–40 years of age) had to meet the Diagnostic and Statistical Manual of Mental Disorders (4th Edition)24 criteria for schizophrenia, schizophreniform, or schizoaffective disorder, as confirmed by the Mini International Neuropsychiatric Interview Plus.25 To expand study generalizability, the EUFEST trial also included patient groups that are often excluded in efficacy trials (ie, patients with substance misuse and patients who could not participate in blinded trials, for safety or other reasons). The primary outcome measure was all-cause treatment discontinuation, while the continuation of treatment across 12 months was the secondary outcome. After randomization, the patients were evaluated bi-weekly for the first 3 months, and then at 3, 6 and 9 months of treatment.
In the current study, we included all patients meeting the EUFEST inclusion criteria, diagnosed with schizophrenia, schizophreniform, and schizoaffective disorder diagnosis and experiencing their first psychotic episode and about whom we had valid information at the baseline.
From the 498 patients included in the EUFEST trial,28 455 with valid data at baseline were recruited for the study (Table 1). They were divided, according to their initial evaluation at baseline, into three distinct SCP groups: good prognosis (GP), average prognosis (AP) and poor prognosis (PP). At the moment of their inclusion in the EUFEST trial, all study participants received information on the study objectives and an invitation to participate. Decision to participate in the study was endorsed through a written informed consent form. The trial complied with the Declaration of Helsinki and was approved by the Institutional Review Boards of participating centers. The Julius Centre for Health Sciences and Primary Care monitored the trial, according to the ICH-GCP guidelines.29
Table 1 Socio-Demographic Factors and Affiliation to Prognosis Groups
Data Collection and Instruments
Baseline data included information about (a) the socio-demographic characteristics of patients (age, gender, years of education, marital status, occupation and living status); (b) their clinical status (symptoms, global assessment of functioning, depression, quality of life), and (c) their cognitive functioning. To collect data pertaining to (b), the following instruments were applied: Positive and Negative Syndrome Scale [PANSS],30 Global Assessment of Functioning [GAF] scale,31,32 Calgary Depression Scale for Schizophrenia [CDSS],33 Manchester Short Assessment of Quality of Life scale (MANSA).34 For (c), a battery of additional tests were applied, including Trail-Making A (TMA) and Flexibility Index, also known as Trail Making-B (TMB),35 Wechsler Adult Intelligence Scale III-The Digit-Symbol Coding (WAIS-III),36 Purdue pegboard test,37 evaluating motor speed and motor coordination, Rey Auditory Verbal Learning Test – learning index (RAVLT-SC) and Rey Auditory Verbal Learning Test – secondary memory-delayed recall (RAVLT-DC).38 All these tests were administered again at 1, 3, 6, 9 and 12 months, according to the EUFEST protocol.
Subjective clinical prognosis (SCP) was evaluated at Baseline (0 months), by assigning each patient to one of the following categories: “Best”, “Good”, “Above average”, “Average”, “Below average”, “Bad”, and “Worst”, as recommended by the EUFEST protocol. Subsequently, as the number of patients categorized in certain groups was too low to allow a reliable statistical analysis, the first three groups (“Best”, “Good”, and “Above average”) and the final three groups (“Below average”, “Bad”, and “Worst”) were merged into two new categories, labeled “Good prognosis” (GP) and “Poor prognosis” (PP). The “Average prognosis” group suffered no changes (AP).
In order to fulfill the objectives of the study, affiliation to the GP, AP and PP prognosis groups was considered the independent variable, having a binary nominal value of Yes or No, while responsiveness and study completion were the dependent variables. Responsiveness was measured according to the PANSS manual,30 with tests performed at baseline, 1, 3, 6, 9, and 12 months after the treatment initiation. Considering that the minimum PANSS score is 30, the percentage of reduction in symptom scores was calculated using the following formula: percentage of reduction in symptom scores = [(PANSSbaseline − 30) – (PANSSfollow-up − 30)] × 100/(PANSS baseline − 30). Patients who improved by at least 50% from baseline were considered to be responders and the remaining patients, non-responders.39 Regarding completion status, patients who were able to reach the end of the 12-month period were considered “study completers”, while those who discontinued treatment were labeled as “non-completers”. Both responsiveness and completion statuses were interpreted as binary nominal values (Yes or No), reflecting the patient status in each group.
To measure SCP validity, we tested the associations between the prognosis groups (GP, AP, and PP), as independent variables, and the status of completer and responder, respectively, as dependent variables, using Chi-square tests, odds ratio (OR) and confidence intervals (CI). All statistical tests were run at a level of statistical significance p< 0.05.
Among the 455 patients considered for the study [GP: 265 (58.2%), AP: 131 (28.8%), PP: 59 (13%)], 253 (55.6%) were completers and 202 (44.4%) non-completers. In the completers group, 163 patients (64.4%) had been assigned to the GP group, 65 (25.6%) to the AP group, and 25 (10%) patients to the PP group. The number of completers was significantly higher in the GP group compared to the AP group (OR = 1.62, 95% CI = 1.062 to 2.476, p =0.03). This statistical significance was also met when comparing GPs with PPs (OR = 2.17, 95% CI = 1.226 to 3.853, p = 0.009). This suggests that, in terms of completeness, SCP shows a good predictive value for treatment follow-up
Treatment responsiveness was asserted if a patient had a PANSS score reduction higher than 50% at the end of the 12-month trial. Two hundred and sixty-five patients were considered responders and 190 non-responders (Table 2). When comparing the GP group and the AP group, there were significant differences in the 1st (OR = 1.55, 95% CI = 1.08 to 2.22, p =0.01) and 3rd months of treatment (OR = 1.43, 95% CI = 1.15 to 1.78, p =0.001), whereas when comparing the GP group and the PP group, there were significant differences in the 1st (OR = 3.40, 95% CI = 1.56 to 7.40, p =0.001), 3rd (OR = 1.43, 95% CI = 1.04 to 1.96, p =0.01), 9th (OR = 1.84, 95% CI = 1.06 to 3.20, p =0.04) and 12th (OR = 1.45, 95% CI = 1.11 to 1.90, p =0.001) months of treatment. When comparing the AP and the PP groups, significant differences were observed only for the 12th month of treatment (OR = 1.34, 95% CI = 1.01 to 1.78, p =0.02). These results suggest that in terms of responsiveness, the SCP can be considered reliable in the first 3 months of treatment; however, clinicians should not extensively rely afterwards on this instrument and complement it with other clinical tools for patient evaluation.
Table 2 Associations Between Prognosis Groups and the Number of Responders, by Visit
This study assessed SCP and its clinical validity in first episode schizophrenia patients. Concerning this objective, clinicians seemed to be more optimistic than expected, with the majority of patients being assigned to the “Good prognosis” (GP) group (58.2%) and “Average prognosis” (AP) (28.8%) group. The characteristics of the study population in the EUFEST patients (generally young, with first episode psychosis, without substance use disorder, antipsychotic naive or treated less than 2 weeks with antipsychotic medication) may have contributed to directing many clinicians towards an optimistic prognosis. Although the outcome of these patients may not be favorable, only 13% of patients were considered to have a poor prognosis (PP) at baseline. The patients included in the GP group were mostly females, employed, better educated, had lower PANSS scores and better cognitive functioning, quality of life and global functionality.
Regarding SCP validity per se, this has been separately assessed in two directions: completeness and responsiveness to treatment. Concerning completeness, this can be asserted at the end of the 12-month period, as patients in the GP group outperformed patients in both AP and PP groups, and patients in the AP group outperformed those in the PP group. Still, regarding responsiveness, significant differences across the whole trial were only met between the GP and the PP groups; in contrast, they were limited only to the first three trial months, when comparing the GP and the AP groups and only to the last evaluation (at the 12th month), when comparing the AP and the PP groups Taking into account that discriminative value is an important factor in the assessment of the validity of a prognostic tool,40 we can conclude that SCP has a good validity in predicting the completer status, but has a limited validity in predicting the responder status of first episode schizophrenic patients.
Regarding this study outcome, one element which needs to be considered is represented by the impact of other factors on responsiveness, which could account for a part of its fluctuations. Variables such as the effects on responsiveness brought by a certain type of psychosocial intervention, or by the unstable functionality of the family climate, are often impossible to be anticipated by the clinician at the time of the first encounter with the patient. As a result, the idea of a low validity of the SCP, in what concerns responsiveness to treatment, should be regarded with caution. The interactions between SCP and other confounding factors could be better displayed and understood only when analyzing treatment completeness and responsiveness across a longer period of time. This kind of research could also draw more refined conclusions on the real opportunity of using outcomes like continuing treatment or responsiveness to evaluate the prognosis of first episode schizophrenia patients.
Our study has a number of limitations. The generalizability of results can be influenced by the procedure of patient inclusion (eg, some clinicians may have had pre-visits with patients, but this was not covered in the EUFEST protocol and it was not considered a restriction in the inclusion criteria). Regarding SCP, an additional limitation is that we cannot be sure of the moment during the baseline visit when the clinician has decided on a certain prognosis. It is also possible that SCP was influenced by the format of the clinical interview performed by the psychiatrist, as a result of the patient’s cognitive status, or other co-existing symptoms (eg, depression). In our study, we did not analyze the impact of the investigator’s clinical experience on the prognosis assessment, nor the distinct influences of country-specific training, administrative requirements, or clinical work conditions, as all these elements were not captured in the EUFEST protocol.
Our study contributes to the construction of a more solid assessment of the SCP as an extensively used clinical instrument for first episode schizophrenic patients. Over a span of 1 year, SCP appears to be more valid in predicting the completer status of first episode schizophrenic patients, than their responsiveness to treatment. Further research, potentially extended on a longer time and including other variables, could test the validity of new models for decision-making in schizophrenia, with the goal of offering a better quality of care.
ISRCTN Register Identifier: ISRCTN68736636.
Data Sharing Statement
The data set used during the current study is available on reasonable request from Alexandra Ioana Mihăilescu ([email protected]).
The authors report no conflicts of interest in this work.
1. Windeler J. Prognosis - what does the clinician associate with this notion? Stat Med. 2000;19(4):425–430. doi:10.1002/(SICI)1097-0258(20000229)19:4<425::AID-SIM347>3.0.CO;2-J
2. Hilden J, Habbema JDF. Prognosis in medicine: an analysis of its meaning and roles. Theor Med. 1987;8(3):349–365. doi:10.1007/BF00489469
3. Gill TM. The central role of prognosis in clinical decision making. JAMA. 2012;307(2):199–200. doi:10.1001/jama.2011.1992
4. Struthers CW, Perry RP, Menec VH. An examination of the relationship among academic stress, coping, motivation, and performance in college. Res High Educ. 2000;41(5):581–592. doi:10.1023/A:1007094931292
5. Wray CM, Loo LK, Diagnosis T. Prognosis, and treatment of medical uncertainty. J Grad Med Educ. 2015;7(4):523–527. doi:10.4300/JGME-D-14-00638.1
6. Horrobin DF. Evidence-based medicine and the need for non-commercial clinical research directed towards therapeutic innovation. Exp Biol Med (Maywood). 2002;227(7):435–437. doi:10.1177/153537020222700706
7. Correll CU, Kishimoto T, Kane JM. Randomized controlled trials in schizophrenia: opportunities, limitations and novel trial designs. Dialogues Clin Neurosci. 2011;13(2):155–172.
8. Geddes J. Answering clinical questions about prognosis. Evid Based Ment Health. 2000;3(4):100–101. doi:10.1136/ebmh.3.4.100
9. Redelmeier DA, Ferris LE, J V T, Hux JE, Schull MJ. Problems for clinical judgement: introducing cognitive psychology as one more basic science. CMAJ. 2001;164(3):358–360.
10. Kozlowski D, Hutchinson M, Hurley J, Rowley J, Sutherland J. The role of emotion in clinical decision making: an integrative literature review. BMC Med Educ. 2017;17(1):255. doi:10.1186/s12909-017-1089-7
11. Crespo-Facorro B, Bernardo M, Argimon JM, et al. Eficacia, eficiencia y efectividad en el tratamiento multidimensional de la esquizofrenia: proyecto Rethinking. Rev Psiquiatr Salud Ment. 2017;10(1):4–20. doi:10.1016/j.rpsm.2016.09.001
12. Schwartz MA, Wiggins OP. Typifications. The first step for clinical diagnosis in psychiatry. J Nerv Ment Dis. 1987;175(2):65–77. doi:10.1097/00005053-198702000-00001
13. Parnas J, Disappearing Heritage: A. The clinical core of schizophrenia. Schizophr Bull. 2011;37(6):1121–1130. doi:10.1093/schbul/sbr081
14. Nordgaard J, Sass LA, Parnas J. The psychiatric interview: validity, structure, and subjectivity. Eur Arch Psychiatry Clin Neurosci. 2013;263(4):353–364. doi:10.1007/s00406-012-0366-z
15. Clare A. National variations in medical practice. BMJ. 1989;298(6684):1334. doi:10.1136/BMJ.298.6684.1334
16. Kvrgic S, Cavelti M, Beck E-M, Rüsch N, Vauth R. Therapeutic alliance in schizophrenia: the role of recovery orientation, self-stigma, and insight. Psychiatry Res. 2013;209(1):15–20. doi:10.1016/j.psychres.2012.10.009
17. Montgomery K. How Doctors Think: Clinical Judgment and the Practice of Medicine. Oxford: Oxford University Press; 2005.
18. Hamann J, Langer B, Leucht S, Busch R, Kissling W. Medical decision making in antipsychotic drug choice for schizophrenia. Am J Psychiatry. 2004;161(7):1301–1304. doi:10.1176/appi.ajp.161.7.1301
19. Jauhar S, McKenna PJ, Radua J, Fung E, Salvador R, Laws KR. Cognitive–behavioural therapy for the symptoms of schizophrenia: systematic review and meta-analysis with examination of potential bias. Br J Psychiatry. 2014;204(1):20–29. doi:10.1192/bjp.bp.112.116285
20. Jauhar S, Guloksuz S, Andlauer O, et al. Choice of antipsychotic treatment by European psychiatry trainees: are decisions based on evidence? BMC Psychiatry. 2012;12(1):27. doi:10.1186/1471-244X-12-27
21. Croft P, Altman DG, Deeks JJ, et al. The science of clinical practice: disease diagnosis or patient prognosis? Evidence about “what is likely to happen” should shape clinical practice. BMC Med. 2015;13(1):20. doi:10.1186/s12916-014-0265-4
22. Mak K, Kum CK. How to appraise a prognostic study. World J Surg. 2005;29(5):56–59. doi:10.1007/s00268-005-7914-x
23. Fleischhacker WW, Keet IPM, Kahn RS. The European First Episode Schizophrenia Trial (EUFEST): rationale and design of the trial. Schizophr Res. 2005;78(2–3):147–156. doi:10.1016/j.schres.2005.06.004
24. American Psychiatric Association. Diagnostic and Statistic Manual.
25. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 2):22–33.
26. Boter H, Derks EM, Fleischhacker WW, Davidson M, Kahn RS. Generalizability of the results of efficacy trials in first-episode schizophrenia: comparisons between subgroups of participants of the European First Episode Schizophrenia Trial (EUFEST). J Clin Psychiatry. 2010;71(01):58–65. doi:10.4088/JCP.08m04506yel
27. Matei VP, Mihailescu A, Paraschiv G, Al-Bataineh R, Purnichi T. Weight gain and antipsychotics. Data from EUFEST study. Acta Endocrinol. 2016;12(2):177–184. doi:10.4183/aeb.2016.177
28. Kahn RS, Fleischhacker WW, Boter H, et al. Effectiveness of antipsychotic drugs in first-episode schizophrenia and schizophreniform disorder: an open randomised clinical trial. Lancet. 2008;371(9618):1085–1097. doi:10.1016/S0140-6736(08)60486-9
29. International Conference of Harmonization (ICH). ICH tripartite guideline for good clinical practices E6 (R1), June 10, 1996. Available from: http://www.ich.org/fileadmin/Public_Web_Site/ICH_Products/Guidelines/Efficacy/E6/E6_R1_Guideline.pdf.
30. Kay SR, Opler LA, Lindenmayer JP. Reliability and validity of the positive and negative syndrome scale for schizophrenics. Psychiatry Res. 1988;23(1):99–110. doi:10.1016/0165-1781(88)90038-8
31. Jones SH, Thornicroft G, Coffey M, Dunn G. A brief mental health outcome scale-reliability and validity of the Global Assessment of Functioning (GAF). Br J Psychiatry. 1995;166(5):654–659. doi:10.1192/bjp.166.5.654
32. Hilsenroth MJ, Ackerman SJ, Blagys MD, et al. Reliability and validity of DSM-IV Axis V. Am J Psychiatry. 2000;157(11):1858–1863. doi:10.1176/appi.ajp.157.11.1858
33. Addington D, Addington J, Maticka-Tyndale E, Joyce J. Reliability and validity of a depression rating scale for schizophrenics. Schizophr Res. 1992;6(3):201–208. doi:10.1016/0920-9964(92)90003-N
34. Priebe S, Huxley P, Knight S, Evans S. Application and results of the Manchester Short Assessment of Quality of Life (MANSA). Int J Soc Psychiatry. 1999;45(1):7–12. doi:10.1177/002076409904500102
35. Brown RR, Partington JE. The intelligence of the narcotic drug addict. J Gen Psychol. 1942;26:175–179.
36. Wechsler D. WAIS-R: Wechsler Adult Intelligence Scale-Revised. New York, N.Y.: Psychological Corporation; 1981.
37. Tiffin J, Asher EJ. The purdue pegboard: norms and studies of reliability and validity. J Appl Psychol. 1948;32(3):234–247. doi:10.1037/h0061266
38. Schmidt M. Rey Auditory and Verbal Learning Test. A Handbook. Los Angeles: Western Psychological Association; 1996.
39. Leucht S, Kane J, Kissling W, Hamann J, Etschel E, Engel R. What does the PANSS mean? Schizophr Res. 2005;79(2–3):231–238. doi:10.1016/j.schres.2005.04.008
40. Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models. Epidemiol. 2010;21(1):128–138. doi:10.1097/EDE.0b013e3181c30fb2
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.