Correspondence Between the Neuropsychiatric Interview M.I.N.I. and the BDI-II and MADRS-S Self-Rating Instruments as Diagnostic Tools in Primary Care Patients with Depression
Received 20 December 2019
Accepted for publication 27 March 2020
Published 14 May 2020 Volume 2020:13 Pages 177—183
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Dr Scott Fraser
Shabnam Nejati,1 Nashmil Ariai,1 Cecilia Björkelund,1 Ingmarie Skoglund,1,2 Eva-Lisa Petersson,1,2 Pia Augustsson,2 Dominique Hange,1,2 Irene Svenningsson1,2
1Primary Health Care/School of Public Health and Community Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Sweden; 2Narhalsan Research and Development Primary Health Care, Region Vastra Gotaland, Gothenburg, Sweden
Correspondence: Dominique Hange
Primary Health Care/School of Public Health and Community Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, PO Box 454, Gothenburg SE-405 30, Sweden
Tel +46 722 245 700
Email [email protected]se
Objective: To investigate the correspondence between the diagnoses received by patients with symptoms of common mental disorder attending primary care, based on the diagnostic instrument International Neuropsychiatric Interview (M.I.N.I.) and the self-assessment instruments such as Beck Depression Inventory (BDI-II) and Montgomery–Asberg Depression Rating Scale – self-rating version (MADRS-S), respectively.
Design: Data were collected from a prospective observational study, ADAS, between 2014 and 2015.
Setting: Twenty-eight primary care centers in Region Västra Gotaland, Sweden.
Patients: A total of 192 patients, 18– 60 years of age, on sick leave ≥ 14 days, with mild/moderate depression, anxiety syndrome, and stress-related mental illness were included.
Main Outcome Measures: Scores of the assessment instruments (BDI-II and MADRS-S) on inclusion, sensitivity, specificity, positive (PPV) and negative predictive value (NPV) for BDI-II and MADRS-S, respectively, with M.I.N.I used as diagnostic instrument.
Results: Using M.I.N.I. as gold standard, the BDI-II and MADRS-S showed almost the same sensitivity (86.9% and 87.4%, respectively), but specificity for MADRS-S was doubled compared to BDI-II (36% and 18%, respectively). There was a significant association between MADRS-S and M.I.N.I. (p=0.027). However, the same analysis between BDI and M.I.N.I. was not statistically significant (p= 0.635). NPV and PPV were calculated from assumed prevalences (10% and 75%) and were higher for MADRS-S compared to BDI-II. The PPV differences were between 2% and 7% and NPV differences were between 3% and 19%.
Conclusion: With M.I.N.I. as gold standard, MADRS-S performs better than BDI-II as a self-assessment tool in the primary care context for depression diagnostics.
Keywords: depression, diagnostic instrument, primary care, self-assessment instrument
In Sweden, 10–15% of the adult population suffers from depression and anxiety disorders and stress-related mental illness, usually referred to as common mental disorders (CMD).1,2 Epidemiological studies show that around 70% of all patients with depression and anxiety are treated in primary care.3 The need for a validated screening instrument for high-risk groups with depression has been the subject of much debate in primary care.4 In the medical consultation, a variety of assessment instruments and rating scales can be used to classify degree and type of symptoms but there is no explicit recommendation concerning the assessment scales to be used.1 Validation and reliability of the International Neuropsychiatric Interview (M.I.N.I.) compared to the Structured Diagnostic Interview for DSM-III-R (SCID-P) and compared to a structured interview developed by WHO for ICD-10 (CIDI)5,6 has shown acceptable validity and reliability for M.I.N.I., and M.I.N.I. can be a useful tool for identifying individuals with increased risk of mental illness in the primary care setting.7 Using M.I.N.I. for diagnostic purposes is, however, time-consuming and requires about 25–30 minutes by trained assessors.8 Therefore, regular use of M.I.N.I. as a diagnostic instrument can be difficult in the time-pressured primary care. Further, M.I.N.I. is not recommended for diagnosis of stress-related mental illness (adjustment disorder), an increasingly prevalent CMD diagnosis in Swedish primary care.9
There are a variety of self-assessment instruments and rating scales in use in primary care such as the Beck Depression Inventory (BDI-II)10 and the Montgomery–Asberg Depression Rating Scale-Self (MADRS-S).11 Although studies comparing BDI-II and MADRS-S have been performed,12–14 few such studies have been conducted in primary care. The time required for completing MADRS-S or BDI-II amounts to a few to ten minutes, and the patients manage the instruments themselves.
The purpose of the study was to investigate the correspondence between M.I.N.I. and BDI-II and MADRS-S, respectively, for patients with depression, anxiety and stress-related mental illness in the primary care setting.
Patients and Methods
Data were collected from the prospective observational ADAS-study in the Region Västra Götaland, Sweden, between 2014 and 2015.15 All patients from 28 primary care centers (PCCs) who were aged 18 to 60 years and had been on sick-leave for ≥14 days and diagnosed with mild/moderate depression (MADRS-S<35), anxiety syndrome and/or stress-related mental illness were asked to participate in the study by the health center’s rehabilitation coordinator. A total of 192 patients were included and filled in BDI-II and MADRS-S at baseline. M.I.N.I. (version 6.0.0d) and the fatigue syndrome scale (UMS)16 were used as diagnostic instruments by specially educated research nurses.
The exclusion criteria were substance dependence, alcohol abuse, generalized anxiety disorder, bipolar disorder, psychotic disorders or any severe psychiatric disorder, including severe depression (MADRS-S>35), high risk of suicide, or insufficient knowledge of the Swedish language.
Power analysis, the assumption was based on an approximate measure obtained in a previous primary care study. 15 With a power of 0.80 and a significance level of 5% (alpha = 0.05 and beta = 0.20), a total of 57 individuals tested by each instrument was judged required for the analysis. The statistical analyses were made using statistical software SPSS, version 24. Statistical significance was set at p<0.05.
Standard statistical methods were used for descriptive statistics. The continuous variables were analyzed by independent-samples t-test and categorical variables or frequencies by Pearson chi-square test. The consistency between the different instruments, M.I.N.I. and BDI-II and M.I.N.I. and MADRS-S, respectively, was analyzed by crosstabs with chi-square tests. In order to analyze the relationship between the BDI-II and M.I.N.I. and between the MADRS-S and M.I.N.I., the BDI-II and MADRS-S scores were dichotomized using a cut-off point of 13 and 12, respectively, according to the guidelines for minor and major depression.10,11,17,18 The ROC curve was used to determine these cut-off limits.19 Results for the M.I.N.I., BDI-II, and MADRS-S were compared between men and women.
To determine the sensitivity and specificity between BDI-II and M.I.N.I. and MADRS-S and M.I.N.I., respectively, cross tables were analyzed for these variables.
Several positive predictive values (PPV) and negative predictive values (NPV) were calculated for different assumed prevalences between 10% and 75% for both variables BDI-II and MADRS-S. From these values, linear diagrams to see how they were related to each other were created.
A total of 147/151 women and 39/41 men filled out all of the questions in MADRS-S and BDI-II respectively, as well as received M.I.N.I diagnoses. In total, 186 of 192 patients had complete responses for the MADRS-S and BDI-II and all 192 had received M.I.N.I. diagnoses. No significant differences between men and women regarding the variables BDI-II, MADRS-S, and M.I.N.I. were found. See Figure 1 and Table 1.
Table 1 Age, Socioeconomic Characteristics, Lifestyle, M.I.N.I, BDI-II and the MADRS-S Scores of the Participants Included in the Study
Figure 1 Flow-chart over the inclusion, where 33 persons were excluded from the study and further six persons missed one or more questions of MADRS-S and/or BDI-II.
There were statistically significant differences between men and women concerning employment level, physical activity, and ethnicity. Women had higher frequency of physical activity (p < 0.01) and full-time working (p= 0.014) compared to men. See Table 1.
The analysis showed that153/186 patients were identified by MADRS-S and M.I.N.I. and 152/186 patients were identified by BDI-II and M.I.N.I. as having depression. There was a significant statistical association between MADRS-S and M.I.N.I. (p= 0.027). The same analysis between BDI-II and M.I.N.I. was not statistically significant (p= 0.635). The results of ROC analyses show that MADRS-S total score: AUC= 0.679 with 95% CI (0.521, 0.836), p=0.047 < 0.05 but for BDI-II total score: AUC= 0.663 with 95% CI (0.504, 0.823), p=0.069 >0.05 ie not statistically significant at the 5% level. According to ROC analysis for cutoff limit 12 for MADRS-S, sensitivity = 0.88 and specificity = 0.36, while for BDI-II with cutoff = 13, sensitivity = 0.82 and specificity = 0.18.
Using M.I.N.I. as gold standard showed that about 81.7% of the patients were identified as depressed when using BDI-II, while 82.3% were identified as depressed when using MADRS-S. See Table 2.When using M.I.N.I. as gold standard, almost the same sensitivity was obtained for BDI-II and MADRS-S, but twice as high specificity was obtained for MADRS-S compared to BDI-II. See Table 3. Table 4, Figure 2 and 3 show the NPV and PPV values that were calculated from different prevalences ranging between 10% and 75% for both BDI-II and MADRS-S variables. The lines for both PPV and NPV values were higher for MADRS-S compared to BDI-II.
Table 2 Number and Percentage of Patients Identified with Depression by BDI-II and MADRS-S When Using M.I.N.I. As Gold Standard
Table 3 Sensitivity and Specificity for BDI-II and MADRS-S, Respectively, with M.I.N.I. Used as Gold Standard
Table 4 NPV and PPV Values Calculated from Different Prevalences Ranging Between 10% and 75% for BDI-II and MADRS-S Variables
Figure 2 Linear diagram for PPV values calculated from different prevalences ranging between 10% and 75% for BDI-II and MADRS-S variables.
Figure 3 Linear diagram for NPV values calculated from different prevalences ranging between 10% and 75% for BDI-II and MADRS-S variables.
Using M.I.N.I. as the gold standard, the MADRS-S and BDI-II instruments were shown to have acceptable sensitivity to identify most patients with depression in the primary care context. The specificity for MADRS-S was higher and showed a significant relationship to the M.I.N.I. However, the specificity for BDI.II was too low and too many individuals without depression were identified as having depression.
Previous research has shown that there was a good correlation between MADRS-S and BDI-II in the primary care context.12 Further, MADRS-S has been shown to have high NPV (95%), and thus is a relevant instrument for excluding depression diagnosis, which is also an important issue in primary care.20
By using M.I.N.I., the most validated and accepted diagnostic instrument for depression and anxiety syndromes in Swedish care, we could compare the self-assessment instruments most used in Swedish primary care: BDI-II and MADRS-S.1 In primary care, a high sensitivity, as well as high specificity of an instrument, is important, but due to the fact that the prevalence of even the most common mental disorders in primary care is not higher than around 5–15%,21 the PPV and NPV of an instrument are more important measures for primary care clinicians. All patients who have depression should be identified, but at the same time, it is equally important to exclude patients who do not have depression. Both BDI-II and MADRS-S showed too low PPV for being useful as diagnostic instruments in primary care, but MADRS-S could be regarded as an instrument useful for excluding depression based on its high NPV.
Also Patient Health Questionnaire-9 (PHQ-9), more commonly used in Great Britain, the Netherlands and Sweden, has recently been shown to be useful for ruling out depression with an NPV of 97% regarding a prevalence of 12% in the primary care setting, which is equivalent to the results obtained for MADRS-S in our study.22
Using the concepts “sensitivity” and “specificity” to assess the reliability of the scales, we found that MADRS-S had higher specificity. By using different prevalences, we tested the usefulness of the scales in primary care. According to this procedure, MADRS-S was performing better, no matter what the prevalence was. Thus, MADRS-S could be the preferred simple self-assessment instrument in primary care. In an earlier study, we have investigated how patients with depression perceived the use of MADRS-S. It was perceived as an instrument that showed the patients, that they really had depression and changes in symptoms over time as well as a help to know that the GP had taken them seriously.23
The study has several strengths. Firstly, our results are consistent with Council on Technology Assessment in Health care which is that MADRS-S is useful for ruling out depression.7,22 MADRS-S is a validated self-assessment instrument that is simple, short, free of charge, and easily understandable, BDI-II is expensive and can only be ordered by doctors and psychologists.
An additional strength of the study is that it was performed within primary care, where the majority (70%) of all patients with depression are taken care of.1 Another strength is that the data were collected by research staff and did not require additional work on the part of the health center staff, which is an important factor in being able to combine research and clinical work.24
There were also limitations. MADRS-S does not catch patients with CMD such as anxiety, stress-related mental illness and fatigue syndrome. According to exclusion criteria, we did not include patients who had difficulty filling in and understanding the forms. Such difficulties could be due to various reasons, such as language problems, cognitive problems, or serious health problems. However, we may have missed a large group of patients purely on the basis of language difficulties, and we cannot assume that the results would be valid for the group of patients with a high prevalence of CMD because of immigrant background.
All in all, with M.I.N.I. as gold standard, MADRS-S performs better than BDI-II, as a self-assessment tool in the primary care context for depression assessment. MADRS-S has a better specificity, a higher PPV and NPV than BDI-II. We, therefore, suggest that MADRS-S can be used in the clinical situation.
Ethics and Consent Statement
All participants gave their written informed consent to participate in the study, in accordance with the provisions of the Declaration of Helsinki. The study was approved by The Regional Ethical Review Board in Gothenburg, Sweden (577-13).
This study was supported by grants from Region Västra Götaland and REHSAM (RS2011/003).
The authors report no conflicts of interest in this work.
1. SBU. The Swedish Ccouncil on Ttechnology Aassessment in Hhealth Ccare. [Statens beredning för medicinsk utvärdering]. Ttreatment of depression diseases: a systematic review of literature. [Behandling av depressionssjukdomar: en systematisk litteraturöversikt]. Acta Oncol. 2004;63:49–108. Vol. 1. Stockholm SBU; 2004.
2. SBU. The Swedish Council on Technology Assessment in health Care. [Statens beredning för medicinsk utvärdering]. Treatment of anxiety disorders - a systematic review. [Behandling av ångestsyndrom: en systematisk litteraturöversikt]. vol. 1 Stockholm: SBU; 2005. Available from: http://www.sbu.se/Filer/Content=/publikationer/1/angest_Vol_1.pdf.
3. SBU. The Swedish Council on Technology Assessment in Health Care. [Statens beredning för medicinsk utvärdering]. Treatment of depression diseases: a systematic review of literature. [Behandling av depressionssjukdomar: en systematisk litteraturöversikt]. Vol. 2. Stockholm: SBU;2004.
4. Gilbody S, Sheldon T, House A. Screening and case-finding instruments for depression: a meta-analysis. CMAJ. 2008;178(8):997–1003.
5. Sheehan DV, Lecrubier Y, Sheehan KH, et al. TheMmini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatr. 1998;59(Suppl 20):
6. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The validity of the Mini International Neuropsychiatric Interview (M.I.N.I.) according to the SCID-P and its reliability. Eur Psychiatry. b1997;12(5):232–241. doi:10.1016/S0924-9338(97)83297-X
7. Ekselius L. Diagnostik och uppföljning av förstämningssyndrom: en systematisk litteraturöversikt. Stockholm: The Swedish Council on Technology Assessment in Health Care. [Statens beredning för medicinskt utvärdering] (SBU); 2012.
8. Pettersson A, Modin S, Wahlstrom R. Af Winklerfelt Hammarberg S, Krakau I. The Mini-International Neuropsychiatric Interview is useful and well accepted as part of the clinical assessment for depression and anxiety in primary care: a mixed-methods study. BMC Fam Pract. 2018;19(1):19. doi:10.1186/s12875-017-0674-5
9. Wiegner L, Hange D, Bjorkelund C, Ahlborg G
10. Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck Depression Inventory:Ttwenty-five years of evaluation. Clin Psychol Rev. 1988;8(1):77–100. doi:10.1016/0272-7358(88)90050-5
11. Montgomery SA, Åsberg M. A new depression scale designed to be sensitive to change. Br J Psychiatr. 1979;134(4):382–389. doi:10.1192/bjp.134.4.382
12. Wikberg C, Nejati S, Larsson ME, et al. Comparison between the Montgomery-Asberg Depression Rating Scale-Self and the Beck Depression Inventory II in Primary Care. Prim Care Companion CNS Disord. 2015;17(3).
13. Svanborg P, Åsberg M. A comparison between the Beck Depression Inventory (BDI) and the self-rating version of the Montgomery Åsberg Depression Rating Scale (MADRS). J Affect Disord. 2001;64(2–3):203–216. doi:10.1016/S0165-0327(00)00242-1
14. Martinsen EW, Friis S, Hoffart A. Assessment of depression: comparison between Beck Depression Inventory and subscales of Comprehensive Psychopathological Rating Scale. Acta Psychiatr Scand. 1995;92(6):460–463. doi:10.1111/j.1600-0447.1995.tb09613.x
15. Skoglund I, Bjorkelund C, Svenningsson I, et al. Influence of antidepressant therapy on sick leave in primary care: ADAS, a comparative observational study. Heliyon. 2019;5(1):e01101. doi:10.1016/j.heliyon.2018.e01101
16. Institutet för stressmedicin ISM. Utmattningssyndrom - UMS. Available from: https://www.vgregion.se/ov/ism/stress-rad-och-behandling/utmattningssyndrom/.
17. Svanborg P, Åsberg M. A new self‐rating scale for depression and anxiety states based on the Comprehensive Psychopathological Rating Scale. Acta Psychiatr Scand. 1994;89(1):21–28. doi:10.1111/j.1600-0447.1994.tb01480.x
18. Svanborg P, Ekselius L. Self-assessment of DSM-IV criteria for major depression in psychiatric out- and inpatients. Nord J Psychiatr. 2003;57(4):291–296. doi:10.1080/08039480307281
19. Altman DG. Practical Statistics for Medical Research. London: Chapman and Hall; 1991.
20. Magnil M, Gunnarsson R, Bjorkelund C. Using patient-centred consultation when screening for depression in elderly patients: a comparative pilot study. Scand J Prim Health Care. 2011;29(1):51–56. doi:10.3109/02813432.2011.554011
21. Lejtzen N, Sundquist J, Sundquist K, Li X. Depression and anxiety in Swedish primary health care: prevalence, incidence, and risk factors. Eur Arch Psychiatr Clin Neurosci. 2014;264(3):235–245. doi:10.1007/s00406-013-0422-3
22. SBU. The Swedish Council on Technology Assessment in Health care. [Statens beredning för medicinsk utvärdering]. Patient Health Questionnaire-9 as support for diagnostics and assessment of depression level. Available from: https://www.sbu.se/contentassets/f8d620e0134c4277aff8f4d8245057d5/phq_9_stod_diagnostik_bedomning_svarighetsgrad_depression_smf.pdf.
23. Wikberg C, Pettersson A, Westman J, Bjorkelund C, Petersson EL. Patients’ perspectives on the use of the Montgomery-Åsberg Depression Rating Scale Self-assessment version in primary care. Scand J Prim Health Care. 2016;34(4):434–442. doi:10.1080/02813432.2016.1248635
24. Hange D, Bjorkelund C, Svenningsson I, Kivi M, Eriksson MC, Petersson EL. Experiences of staff members participating in primary care research activities: a qualitative study. Int J Gen Med. 2015;8:143–148. doi:10.2147/IJGM.S78847
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.Download Article [PDF]