Psychometric Properties of the Generalized Anxiety Disorder Scale Among Saudi University Male Students
Received 18 January 2020
Accepted for publication 8 May 2020
Published 8 June 2020 Volume 2020:16 Pages 1427—1432
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Dr Roger Pinder
Ahmad Alghadir,1 Md Dilshad Manzar,2 Shahnawaz Anwer,1,3 Abdulrhman Albougami,2 Mohammed Salahuddin4
1Rehabilitation Research Chair, College of Applied Medical Sciences, King Saud University, Riyadh, Saudi Arabia; 2Department of Nursing, College of Applied Medical Sciences, Majmaah University, Majmaah, Saudi Arabia; 3Department of Building and Real Estate, Hong Kong Polytechnic University, Kowloon, Hong Kong SAR; 4Department of Pharmacy, College of Medicine and Health Sciences, Mizan-Tepi University (Mizan Campus), Mizan-Aman, Ethiopia
Correspondence: Shahnawaz Anwer Email [email protected]
Background: Various screening tools have been designed and developed to identify individuals with generalized anxiety disorder (GAD). The current study aimed to assess the psychometric validation of the GAD-7 in Saudi university male students.
Methods: Healthy university male students (n= 192) participated in this cross-sectional study. All the participants were informed about the study details. Participants were asked to complete the GAD-7, the Sleep Hygiene Index (SHI), Perceived Stress Scale (PSS), and demographic details.
Results: In general, the range of the GAD total score was 0– 21. There was no issue of the ceiling or floor effects as only 12.5% of participants reported the minimum score of 0, and none of the participants reported the maximum score of 21. The internal consistency score of the GAD-7 was found to be good (Cronbach’s alpha = 0.83). The internal homogeneity between item scores was 0.22– 0.57 as indicated by the “Spearman correlation coefficient (r)”. The total scores and individual item scores of the GAD-7 were statistically associated with the PSS total score (correlation coefficient r = 0.21– 0.37), and scores of the 8th and 13th item of the SHI (correlation coefficient r = 0.17– 0.26, and 0.21– 0.40, respectively). The exploratory factor and confirmatory factor loadings of the GAD-7 items were ranged from 0.60 to 0.81 and 0.51 to 0.80, respectively.
Conclusion: This study supported the use of the GAD-7 to assess the anxiety level among Saudi university students.
Keywords: GAD-7, anxiety, stress, university students, validity, reliability
Prevalence of Anxiety Disorders
Anxiety disorders are the commonest psychiatric disorders prevalent in both adults and adolescents. About 272.2 million people had been diagnosed with anxiety disorders globally.1 The prevalence of anxiety disorders is almost double in women than men [point prevalence, 5.2% versus 2.8%].1 The prevalence of anxiety disorders is highest in the age group of 20–64 years.1 Previous study of the Global Burden of Disease reported the prevalence of anxiety disorders was highest in the Middle East/North Africa and the lowest in East Asia [point prevalence, 6.1% versus 2.1%].1 Additionally, it is reported that high-income nations and Latin American nations have higher proportion of anxiety disorders.2
The generalized anxiety disorder (GAD) is considered the commonest psychological disorder.3,4 The overall prevalence of GAD is about 6.2%,4 and sometimes it remains unnoticed by Physicians.5 The prevalence of GAD among university students in the United States was 7.5%.6 In addition, around 19% prevalence rate of GAD among university students in India was reported.7 Results of previous studies indicate that anxiety is a major public health issue, especially in Saudi students.8,9 Given that the worldwide average age affected with GAD is in young and in early adulthood,10–12 university students are susceptible to develop GAD. Previous studies reported high prevalence of anxiety and depression among university medical students in Saudi Arabia.8,9 Preventive mental health and counselling services should be included in the routine clinical facilities provided for university students.13
Psychological Problems in University Students
University/College students face various stressors while they adjust their personal relationships, studies, work, and family or personal expectations.14 Additionally, university life is highly challenging for many students as they are away from their home probably the first time and often face financial difficulties, academic pressures, and problems in career choices.15 Moreover, needs of mental health in the current university/college students have been increased significantly compared to past generations.14 Evidence indicates a high prevalence of anxiety-related disorders among college and university students in the USA.16 In the Arab world, higher rates of anxiety-related disorders were reported among college students in Qatar and Lebanon than in their American counterparts.15 The prevalence rate of anxiety and depression is about 10–44% in the developing countries.17
Research Gaps and Aims of Current Study
Psychological problems among college and university students in developed countries, for instance, Europe and USA are well acknowledged, and efforts are taken to deal with them. Therefore, various screening tools have been designed and developed to identify individuals with GAD effectively.18,19 Similarly, Spitzer et al20 developed a 7-item Generalized Anxiety Disorder Scale (GAD-7) designed to identify individuals with GAD. The GAD-7 has been used in the previous studies among various populations and is available in several languages.21–23 However, the issue of psychological health and its various dimensions among university students are not well established in the developing countries and specifically Arab nations including Saudi Arabia. No previous studies validated the use of GAD-7 among Saudi university student population. Therefore, this study aimed to assess the clinimetric properties of the GAD-7 in Saudi university male students.
Participants and Study Design
Purposively sampled students from the college and university of the “King Saud University, Riyadh, Saudi Arabia” participated in this cross-sectional study. Aim of study and procedures was explained to each participant. Participants were excluded if they had self-reported memory problems or use of neuro-psychotic drugs. Participants were asked to complete the original version GAD-7, the Perceived Stress Scale (PSS), the Sleep Hygiene Index (SHI) in addition to their demographic details. A written informed consent was taken from the participant. “The institutional ethical committee, Rehabilitation Research chair, King Saud University, Saudi Arabia approved this study”. All the experiment was performed according to the Declaration of Helsinki.
The GAD-7 scale is a 7-item questionnaire designed to evaluate the level of anxiety as per the “Diagnostic and Statistical Manual of Mental Disorders-IV-TR”.20 Each item is scored between 0 (not at all) and 3 (nearly every day). Total possible score ranges from 0 to 21, with cut off scores ≥5, ≥10, and ≥15 signifying a mild, moderate, and severe level of anxiety, respectively.
The PSS is a 10-item questionnaire developed to assess the self-reported amount of stress. Each item is scored from 0 (never) to 5 (very often) with a total possible score between 0 and 40. Higher score signifies an increasing amount of perceived stress.24
The SHI is a 13-item self-reported questionnaire developed to evaluate participants sleep hygiene behaviour as per the criteria of the “International Classification of Sleep Disorders”.25 Each question is scored between 0 (no) and 1 (yes). The SHI total score (range of 0 to 13) is calculated by adding together all the raw item scores. A higher SHI total score suggests poor sleep hygiene. Additionally, two items of the SHI (item 8 and item 13) also assess perceived stress and worry at sleep time. Hence, these items were used to evaluate the construct validity of the GAD-7.25
Statistical analysis was done using the SPSS version 16.0 for Windows (SPSS Inc., Chicago, USA). Descriptive data including mean, standard deviation, percentage, and frequency were presented. Skewness (statistics, standard error and z) and kurtosis (statistics, standard error and z) determined the distribution characteristics of the GAD-7 score. The internal consistency and the internal homogeneity of the GAD-7 were assessed using the Cronbach’s alpha test and the Spearman correlation test, respectively. The Spearman correlation test evaluated the convergent construct validity. The “Exploratory Factor Analysis (EFA)” used the “Principal Axis Factoring extraction” with an unrotated solution. The “Confirmatory factor analysis (CFA)” was conducted using “Maximum likelihood extraction” technique. The “standardized estimates” of the factor loadings on the latent factors for each item of the GAD-7 scale were computed. Multiple indices from various categories for assessment of fit were employed according to the standard procedures.26 Chi-square statistics, “Incremental fit index (IFI)”, “root mean square error of approximation (RMSEA)”, and “Comparative Fit Index (CFI)” were calculated.
Table 1 details the participant’s characteristics of Saudi university students. Most of the participants (93.7%) had no history of chronic conditions. Only a few participants (11.5%) reported a history of smoking [Table 1]. Most of the participants (58.9%) reported tea or coffee consumption. About half of the participants (49%) indicated an absence of beverage consumption [Table 1].
Table 1 Participant Characteristics of Saudi University Students
Preliminary Item Analysis and Internal Consistency
In general, the range of the GAD total score was 0–21; 12.5% reported the minimum score of 0, but none reported the maximum score of 21. Therefore, there was no issue of the ceiling or floor effects in the GAD-7 total score. However, an analysis of individual item scores showed the presence of the floor effect, but none had the ceiling effect [Supplementary Table S1]. The internal consistency test of the GAD-7 was good as suggested by the Cronbach’s alpha of 0.83. The internal homogeneity between item scores was 0.22–0.57 as indicated by the “Spearman correlation coefficient (r)” [Supplementary Table S2].
The total scores and individual item scores of the GAD-7 were statistically correlated with the PSS total score (correlation coefficient r = 0.21–0.37) [Table 2], and scores of the 8th and 13th item of the SHI (correlation coefficient r = 0.17–0.26, and 0.21–0.40, respectively) [Table 2].
Table 2 Convergent Validity: Correlations of the Generalized Anxiety Disorder-7 (GAD-7) Scale with Related Measures in Saudi University Male Students
The GAD-7 scores in the Saudi university students fulfilled the conditions for the factor analysis as noted by the results of the “anti-image matrix” (>0.84), “Bartlett’s test of sphericity” (<0.001), communality (≥0.4), the determinant score (0.12) and the “Kaiser–Meyer–Olkin test of sampling adequacy” (0.85) (Table 3). Four tests were utilized to identify the number of factors (s) in EFA, ie the cumulative variance rule (>40%), the “Kaiser’s criteria (Eigenvalue>1)”, and the “Scree plot and the parallel analysis” (Supplementary Figure S1) identified a 1-factor model for the GAD-7. The loadings of the GAD-7 items that were retained in the EFA for performing the CFA ranged from 0.60 to 0.81 [Table 4]. The 1-Factor model indicated a perfect fit to the data, ie non-significant χ2test [Table 5]. The 1-Factor model showed adequate values for the IFI, CFI, RMSEA, and χ2/df [Table 5]. The average loading on the CFA model was 0.64 with a range of 0.51–0.80 (Supplementary Figure S2).
Table 3 Measures of the Sample Size Adequacy and Sample Suitability for Factor Analysis: Generalized Anxiety Disorder-7 (GAD-7) Scale Scores in Saudi University Male Students
Table 4 Exploratory Factor Analysis of the Generalized Anxiety Disorder-7 (GAD-7) Scale in Saudi University Male Students
Table 5 Fit Statistics of the Generalized Anxiety Disorder-7 (GAD-7) Scale in Saudi University Male Students
The evaluation of clinimetric properties of any outcome scale is essential to provide a complete clinical picture and utility of a specific outcome scale. For instance, previous study suggests the importance of adding basic psychometrics analysis with clinimetrics27 and later it was known as the science of clinical measurements.28 Similarly, other studies have designed various methods to evaluate the validity of outcome scales from a clinimetric point of view.27,29–31 The clinimetric analysis includes macro- and micro-analyses to assess the clinical utility and validity of an outcome scale.27,29 A recent systematic review has suggested the inclusion of clinimetric analysis in the psychometric model to confirm that the outcome scales are not only psychometrically robust but also clinically valid.32
This study is the first to assess the clinimetric properties of the original English version of the GAD-7 scale in the Saudi university students. The present study indicated the evidence for the clinimetric validation of the GAD-7 in Saudi university students. Overall, there was no issue of the floor effect or the ceiling effects for the GAD-7 in this sample of Saudi university students, and this indicated the internal structural validity of the GAD-7 total score.33 This is in line with the results of past studies. In an earlier study, Sousa et al34 reported no floor or ceiling effects in the Portuguese version of the GAD-7 scale. In the current study, the GAD-7 scale had an adequate internal consistency as noted by the value of the Cronbach’s alpha (0.83) in the population of Saudi university students. However, previous studies reported little higher values of the Cronbach’s alpha (ranges, .88-.94). Sousa et al34 reported a Cronbach’s alpha value of 0.88 in the Portuguese population, while Zhong et al35 reported a Cronbach’s alpha value of 0.89 in the Peruvian pregnant women. Also, Mills et al36 noted a Cronbach’s alpha value of 0.94 in the Hispanic Americans. Nonetheless, a direct comparison between past studies and the current study is unlikely since the former studies were not carried on the young adult population of the university students. There was only little fluctuation in the Cronbach’s alpha value when items were deleted one at a time, indicating importance and relevance of each item for the structural validity of the GAD-7 among Saudi university students.
A significant association between the PSS total score with the GAD-7 total score and each of the 7-items support its convergent validity [Table 2]. These results are corroborated by the convergent validity identified in the previous study.36 Moreover, the expected correlation between anxiety and stress is indicated by the significant correlation between the GAD-7 (total and each item scores) and the item-8 and item-13 of the SHI scores.
The results of the CFA and the EFA both supported the original 1-Factor model of the GAD-7 scale in the Saudi university students. All the four measures of the factor retention in the EFA ie the Cumulative variance rule (>40%), the “Kaiser’s criteria (Eigenvalue>1)”, and the Scree plot suggested a 1-Factor model. The results from the CFA further confirmed the unidimensionality of the GAD-7 scale in Saudi university students’ population. The original 1-Factor model of GAD-7 had absolute fit to the data as suggested previously.37 In addition, this model had adequate values for the IFI, CFI, χ2/df, and the RMSEA.37–40 Similarly, the CFA in the previous study produced a good fit.41 Also, Bártolo et al2,4 had confirmed the unidimensionality of the GAD-7 scale to assess the anxiety level among college students.
The present study had some limitations. The result of the current study is limited to male students. In the current study, the diagnostic interview was not performed which limit the assessment of concurrent validity. Future studies using the diagnostic clinical interview to assess the concurrent validity of the GAD-7 in Saudi students are required. This may help in the establishment of the population-specific cut-off values of the GAD-7. Future studies may benefit from employment of psychiatric diagnosis using the Mini International Neuropsychiatric Interview (MINI) as gold standard. Such a diagnosis may be used to perform a receiver operating characteristic curve analysis, which may help in operationalizing a cut-off score for different types of anxiety disorders in the target population. Such an analysis may help in determining clinimetric properties including clinical validity and utility, sensitivity, and scalability of the scale. Therefore, future studies focusing evaluation of these clinical properties of this scale are warranted to provide a complete picture and usage of this scale to measure anxiety level in university students. Nevertheless, the study provided adequate evidence for some of the important psychometric properties such as factor analysis, internal consistency, internal homogeneity, convergent validity and preliminary item analysis in Saudi university students.
This findings of adequate factorial validity, internal consistency, convergent validity and preliminary item analysis provide initial support for the use of the GAD-7 in the Saudi university students for measuring the anxiety level. Future research to establish the diagnostic validity of the GAD-7 to screen anxiety disorders in the study population is needed.
We are grateful to the participants of the study. The authors are grateful to the Deanship of Scientific Research, King Saud University for funding through Vice Deanship of Scientific Research Chairs. The authors extend their appreciation to the Deanship of Scientific Research at Majmaah University for funding this work under Project Number No (RGP-2019-40).
The authors report no conflicts of interest in this work.
1. Baxter AJ, Vos T, Scott KM, et al. The regional distribution of anxiety disorders: implications for the global burden of disease study, 2010. Int J Methods Psychiatr Res. 2014;23(4):422–438. doi:10.1002/mpr.1444
2. Kader Maideen SF, MohdSidik S, Rampal L, Mukhtar F. Prevalence, associated factors and predictors of anxiety: a community survey in Selangor, Malaysia. BMC Psychiatry. 2015;15(1):262. doi:10.1186/s12888-015-0648-x
3. Remes O, Brayne C, van der Linde R, Lafortune LA. systematic review of reviews on the prevalence of anxiety disorders in adult populations. Brain Behav. 2016;6(7):e00497. doi:10.1002/brb3.497
4. Somers JM, Goldner EM, Waraich P, Hsu L. Prevalence and incidence studies of anxiety disorders: a systematic review of the literature. Can J Psychiatry. 2006;51(2):100–113. doi:10.1177/070674370605100206
5. Parmentier H, García-Campayo J, Prieto R. Comprehensive review of generalized anxiety disorder in primary care in Europe. Curr Med Res Opin. 2013;29(4):355–367. doi:10.1185/03007995.2013.770731
6. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Arch Gen Psychiatry. 2005;62(6):593–602. doi:10.1001/archpsyc.62.6.593
7. Sahoo S, Khess CR. Prevalence of depression, anxiety, and stress among young male adults in India: a dimensional and categorical diagnoses-based study. J Nerv Ment Dis. 2010;198(12):901–904. doi:10.1097/NMD.0b013e3181fe75dc
8. Amr M, El-Gilany A, El-Sayed M, El-Sheshtawy E. study of stress among medical students at Mansoura University. Banha Med J. 2007;37(5):25–31.
9. Abdelghanni HM. Stress and depression among medical students: a cross sectional study at a medical college in Saudi Arabia. Pak J Med Sci. 2008;24(1):12–17.
10. Nair MKC, Russell PSS, Mammen P, et al. ADad 3: the epidemiology of anxiety disorders among adolescents in a rural community population in India. Indian J Pediatr. 2013;80(Suppl 2):S144–S148. doi:10.1007/s12098-013-1097-5
11. Brown T, O’Leary T, Barlow D. Generalized anxiety disorder. In: Barlow DH, editor. Clinical Handbook of Psychological Disorders: A Step by Step Treatment Manual.
12. Yonkers KA, Warshaw MG, Massion AO, Keller MB. Phenomenology and course of generalised anxiety disorder. Br J Psychiatry. 1996;168(3):308–313. doi:10.1192/bjp.168.3.308
13. El-Gilany AH, Amr M, Hammad S. Perceived stress among male medical students in Egypt and Saudi Arabia: effect of sociodemographic factors. Ann Saudi Med. 2008;28(6):442–448. doi:10.5144/0256-4947.2008.442
14. Fiore J. A pilot study exploring the use of an online pre-composed receptive music experience for students coping with stress and anxiety. J Music Ther. 2018;55(4):383–407. doi:10.1093/jmt/thy017
15. Kronfol Z, Khalifa B, Khoury B, et al. Selected psychiatric problems among college students in two Arab countries: comparison with the USA. BMC Psychiatry. 2018;18(1):147. doi:10.1186/s12888-018-1718-7
16. Eisenberg D, Hunt J, Speer N. Mental health in American colleges and universities: variation across student subgroups and across campuses. J Nerv Ment Dis. 2013;201(1):60. doi:10.1097/NMD.0b013e31827ab077
17. WHO. The World Health Report 2001: Mental Health: New Understanding, New Hope. World Health Organization; 2001.
18. Kroenke K, Spitzer RL, Williams JB, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146(5):317–325. doi:10.7326/0003-4819-146-5-200703060-00004
19. McHugh RK, Rasmussen JL, Otto MW. Comprehension of self-report evidence-based measures of anxiety. Depress Anxiety. 2011;28(7):607–614. doi:10.1002/da.20827
20. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–1097. doi:10.1001/archinte.166.10.1092
21. Beard C, Björgvinsson T. Beyond generalized anxiety disorder: psychometric properties of the GAD-7 in a heterogeneous psychiatric sample. J Anxiety Disord. 2014;28(6):547–552. doi:10.1016/j.janxdis.2014.06.002
22. Seo JG, Park SP. Validation of the generalized anxiety disorder-7 (GAD-7) and GAD-2 in patients with migraine. J Headache Pain. 2015;16(1):97. doi:10.1186/s10194-015-0583-8
23. Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016;39:24–31. doi:10.1016/j.genhosppsych.2015.11.005
24. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health SocBehav. 1983;24(4):385–396.
25. Mastin DF, Bryson J, Corwyn R. Assessment of sleep hygiene using the sleep hygiene index. J Behav Med. 2006;29(3):223–227. doi:10.1007/s10865-006-9047-6
26. Jaccard J, Wan CK, Jaccard J. LISREL Approaches to Interaction Effects in Multiple Regression (P114). Sage publication; 1996.
27. Tomba E, Bech P. Clinimetrics and clinical psychometrics: macro and micro-analysis. Psychother Psychosom. 2012;81(6):333–343. doi:10.1159/000341757
28. Fava GA, Tomba E, Sonino N. Clinimetrics: the science of clinical measurements. Int J Clin Pract. 2012;66(1):11–15. doi:10.1111/j.1742-1241.2011.02825.x
29. Bech P. Clinical Psychometrics. Oxford: Wiley-Blackwell; 2012.
30. Bech P. Rating Scales for Psychopathology, Health Status and Quality of Life. New York: Springer; 1993.
31. Bech P. Modern psychometric in clinimetrics: impact on clinical trials of anti-depressants. Psychother Psychosom. 2004;73(3):134–138. doi:10.1159/000076448
32. Lim CR, Harris K, Dawson J, Beard DJ, Fitzpatrick R, Price AJ. Floor and ceiling effects in the OHS: an analysis of the NHS PROMs data set. BMJ Open. 2015;5(7):e007765. doi:10.1136/bmjopen-2015-007765
33. Sousa TV, Viveiros V, Chai MV, et al. Reliability and validity of the Portuguese version of the Generalized Anxiety Disorder (GAD-7) scale. Health Qual Life Outcomes. 2015;13(1):50. doi:10.1186/s12955-015-0244-2
34. Zhong QY, Gelaye B, Zaslavsky AM, et al. Diagnostic validity of the generalized anxiety disorder - 7 (GAD-7) among pregnant women. PLoS One. 2015;10(4):e0125096. doi:10.1371/journal.pone.0125096
35. Mills SD, Fox RS, Malcarne VL, Roesch SC, Champagne BR, Sadler GR. The psychometric properties of the generalized anxiety disorder-7 scale in Hispanic Americans with English or Spanish language preference. Cultur Divers Ethnic Minor Psychol. 2014;20(3):463–468. doi:10.1037/a0036523
36. Ullman JB. Structural equation modeling. In: Tabachnick BG, Fidell LS, editors. Using Multivariate Statistics. 2001:653–771.
37. Byrne BM. Structural Equation Modeling with EQS and EQS/WINDOWS: Basic Concepts, Applications, and Programming. SAGE Publications; 1994.
38. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–246. doi:10.1037/0033-2909.107.2.238
39. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55. doi:10.1080/10705519909540118
40. García-Campayo J, Zamorano E, Ruiz MA, et al. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual Life Outcomes. 2010;8(1):8. doi:10.1186/1477-7525-8-8
41. Bártolo A, Monteiro S, Pereira A. Factor structure and construct validity of the generalized anxiety disorder 7-item (GAD-7) among Portuguese college students. Cad Saude Publica. 2017;33(9):e00212716. doi:10.1590/0102-311x00212716
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.