Back to Journals » Psychology Research and Behavior Management » Volume 14

Psychometric Properties of the Chinese Version of the Primary Care Post-Traumatic Stress Disorder Screen-5 for Medical Staff Exposed to the COVID-19 Pandemic

Authors Huang RW, Shen T, Ge LM, Cao L, Luo JF, Wu SY

Received 19 July 2021

Accepted for publication 20 August 2021

Published 2 September 2021 Volume 2021:14 Pages 1371—1378

DOI https://doi.org/10.2147/PRBM.S329380

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Professor Mei-Chun Cheung



Rui-Wen Huang,1 Tao Shen,2 Lei-Ming Ge,3 Lu Cao,4 Jian-Feng Luo,5– 7 Shi-Yu Wu1

1Department of Science and Education, RuiJin Hospital LuWan Branch, School of Medicine, Shanghai Jiaotong University, Shanghai, People’s Republic of China; 2Department of Psychiatry, Shanghai Huangpu District Mental Health Center, Shanghai, People’s Republic of China; 3Department of General practice, Changfeng Community Health Service Center of Putuo, Shanghai, People’s Republic of China; 4Department of Orthopedic Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China; 5Department of Biostatistics, School of Public Health, Fudan University, Shanghai, People’s Republic of China; 6NHC Key Laboratory of Health Technology Assessment, Fudan University, Shanghai, People’s Republic of China; 7Key Laboratory of Public Health Safety of Ministry of Education, Fudan University, Shanghai, People’s Republic of China

Correspondence: Shi-Yu Wu; Jian-Feng Luo Email [email protected]; [email protected]

Purpose: The COVID-19 pandemic may increase the development of psychiatric disorders, such as posttraumatic stress disorder (PTSD) among medical staff. A brief validated screening tool is essential for the early diagnosis of PTSD. The purpose of the present study was to evaluate the validation of a Chinese version of the Primary Care-PTSD-5 (C-PC-PTSD-5) and determine an appropriate cutoff score with optimal sensitivity and specificity for medical staff in China during the COVID-19 pandemic.
Participants and Methods: An online cross-sectional survey was conducted on medical staff (n = 1104) from 17 medical institutions in Shanghai. Questionnaires comprising general information, medical-related traumatic event experiences, the PTSD Checklist (PCL-5), and C-PC-PTSD-5 were distributed to participants using the online Questionnaire Star electronic system. Internal consistency, convergent validity, and test–retest reliability were calculated. Receiver operating characteristic (ROC) analysis was performed to determine diagnostic accuracy and the optimal cutoff score of the C-PC-PTSD-5 for medical staff.
Results: We included 1062 valid questionnaires for the analysis. Data of 838 traumatic experiences were analyzed. Internal consistency of the C-PC-PTSD-5 was satisfied (Cronbach’s α = 0.756). The total score of the C-PC-PTSD-5 showed good test–retest reliability (r = 0.746). We found a strong correlation between the C-PC-PTSD-5 score and PCL-5 total score (r = 0.669, p < 0.001), which indicated good convergent validity. The ROC analysis showed an area under the curve of 0.81 ± 0.016. A cutoff score of 2 provided optimal sensitivity and specificity for the C-PC-PTSD-5 (sensitivity = 0.632, specificity = 0.871, Youden index = 0.503, and overall efficiency = 0.768).
Conclusion: Our results indicated that the C-PC-PTSD-5 can be employed as a brief and efficient screening instrument for medical staff exposed to the COVID-19 pandemic. A score of 2 was identified as the optimal threshold for probable clinical PTSD symptoms.

Keywords: PTSD, COVID-19, self-reported screens, medical staff, PCL-5, PC-PTSD-5

Introduction

The outbreak of COVID-19 pandemic has resulted in various mental health problems among the public in China since December 2019. In the fight against the COVID-19 pandemic, medical healthcare workers in China have faced enormous pressure, which has included a high risk of infection, overworking, and social isolation.1 These stressors may trigger various mental disorders, such as anxiety and depressive disorders and posttraumatic stress disorder (PTSD),2 which in turn, could result in hazards that exceed the consequences of the COVID-19 epidemic itself.3 Because PTSD is a highly prevalent condition with a significant economic burden, early detection of symptoms in medical staff is essential.4

Efforts have been made to improve early detection and diagnosis accuracy of PTSD through the development of self-reported screening instruments. The PTSD Checklist (PCL) is one of the most widely applied tools for assessing PTSD in clinical and research settings.5 Recently, the PCL was updated to PCL-5, which contains 20 items that are rated on a five-point Likert-type scale. The items are based on the Diagnostic and Statistical Manual of Mental Disorder version 5 (DSM-5) criteria for PTSD.6 In addition to the original English version of the PCL-5, Swedish,7 Chinese,8 and German versions9 of the PCL-5 have also been developed.

The Primary Care Posttraumatic Stress Disorder Screen (PC-PTSD) is a four-item measure that is short and easy to administer,10 and despite its brevity, it has shown to be equivalent to other longer screening tools.11,12 In 2013, the PC-PTSD was revised to the PC-PTSD-5, according to the DSM-5 criteria for PTSD.13 The PC-PTSD-5 comprises five “Yes” or “No” items for re-experiencing, avoidance, hyperarousal, numbing, and alteration in mood and cognition, which correspond to the symptom clusters of the DSM-5 criteria for PTSD. One of the purposes of the PC-PTSD-5 is to screen individuals for PTSD and make a provisional PTSD diagnosis. The diagnostic accuracy of the PC-PTSD-5 was initially demonstrated in a veteran sample.14

The prevalence of probable PTSD in medical staff is approximately three times that of the general population, which is attributed to the long hours and work-related stressors.15,16 In particular, emergency department staff were found to exhibit more severe PTSD symptoms than general staff in psychiatric wards during previous pandemics.17 It is essential to explore the psychometric properties of the Chinese version of the PC-PTSD-5 (C-PC-PTSD-5) before it is implemented for the identification of probable medical-related PTSD among medical staff.

The objective of present study was to evaluate the validation of the C-PC-PTSD-5 and determine an appropriate cutoff score with optimal sensitivity and specificity for medical staff in China during the COVID-19 pandemic.

Materials and Methods

Participants

The survey was carried out from December 6, 2020, to December 24, 2020, in Shanghai approximately 1 year following the outbreak of COVID-19 in China. The study was conducted in accordance with the Declaration of Helsinki and was approved by the ethics committee of Ruijin Hospital/Lu Wan Branch, School of Medicine, Shanghai Jiaotong University. Fifteen hospitals and two centers for disease control (CDCs) across five districts of Shanghai were selected as research sites using the multi-stage stratified random cluster sampling method. With the help of the labor union of selected hospitals and CDCs, questionnaires were distributed to participants using the online Questionnaire Star electronic system (Changsha Ranxing IT Ltd. Corporation, https://www.wjx.cn/). All participants have signed an informed consent form on the first page of the questionnaire, and used WeChat or the webpage to complete the questionnaires. The inclusion criteria for subjects were those working in a hospital or a CDC, which included doctors, nurses, allied healthcare workers (pharmacists, physiotherapists, and occupational therapists), technicians, administrators, clerical staff, and maintenance workers. To ensure data quality, the same IP address could only be used once.

Screening Questionnaire

The study questionnaire was written in Chinese and comprised four main components: General information, medical-related traumatic experiences, the PCL-5, and the C-PC-PTSD-5.

General subject data collected included sex, age, marital status, type of medical institution (hospital or CDC), years working, average hours worked per week, and monthly salary.

The checklist for traumatic events in the questionnaire comprised nine typical medical-related traumatic experiences. A free-text “other” option was provided for participants to describe traumatic events experienced that were not included in the checklist. Participants indicated whether they had experienced any of the nine listed traumatic events and when they had occurred. Participants who had experienced at least one traumatic experience were asked to complete both the PCL-5 and PC-PTSD-5. If they had not experienced a traumatic experience, the survey was terminated and participants were excluded from the validation test of the C-PC-PTSD-5.

PCL-5

The PCL-5 is a 20-item self-report measure to assess the 20 DSM-5 symptoms of PTSD. The PCL-5 is applied as a Likert scale, and the severity of each symptom is divided into five levels from “Not at all” = 0, to “A little bit” = 1, “Moderately = 2”, “Quite a bit” = 3, and “Extremely” = 4. The maximum score is 80.

The PCL-5 is scored using two methods. First, a total score of between 31–33 indicates probable PTSD. Second, a provisional PTSD diagnosis can be made by treating each item rated as 2 or higher as a symptom endorsed and following the DSM-5 diagnostic rule, which requires at least: one B item (questions 1–5), one C item (questions 6–7), two D items (questions 8–14), or two E items (questions 15–20). In the present study, a cutoff score of 33 points was used as a diagnosis of PTSD.9

Chinese Version of the PC-PTSD-5

The C-PC-PTSD-5 was translated by a group of psychiatrists and psychologists. It was adapted using a two-stage process of translation and reverse translation. First, we invited a bilingual psychiatrist to translate the PC-PTSD-5 into Chinese, which was then translated back into English by a bilingual psychologist. Discrepancies were resolved and corrected until the translated version was considered adequate.

To analyze for test–retest reliability of the C-PC-PTSD-5, 30 medical health workers were invited to complete the online questionnaires before the cross-sectional survey, and those who reported medical-related traumatic experiences were required to be re-assessed 3 weeks after the initial assessment.

Data Collection

The results of the survey administered using the online Questionnaires Star were exported as an Microsoft Office Excel 2007 data table A total of 1104 questionnaires from 15 hospitals and two CDCs in Shanghai were collected, and 42 questionnaires were excluded because of incomplete data (18 questionnaires) or response times of less than 90 s (24 questionnaires). The valid response rate was 96.19% as 1062 valid questionnaires were included. In addition, 224 participants who answered “No” to all nine medical-related traumatic experiences were excluded for the validation test of the C-PC-PTSD-5, which resulted in a final sample size of 838 (Figure 1).

Figure 1 Flow chart the study.

Data Analysis

All statistical analyses were performed using IBM SPSS Statistics for Windows version 25.0 (Armonk, NY). Categorical variables are expressed as absolute values (percentages) and continuous variables are expressed as means ± standard deviations (SDs). Test–retest reliability of the C-PC-PTSD-5 was assessed using Spearman correlation and a paired t-test. Internal consistency of the C-PC-PTSD-5 total score was evaluated using Cronbach’s alpha. Sensitivity, specificity, Youden index, and overall efficiency were used to quantify the diagnostic utility of the C-PC-PTSD-5. A receiver operating characteristic (ROC) analysis was performed to determine the optimum cutoff value by comparing the patterns of sensitivity and specificity with those of the PCL-5 as the standard.

Results

Baseline Characteristics of Participants

Data from 838 valid questionnaires were used for the analysis. Baseline characteristics, PCL-5 scores, and PC-PTSD-5 scores of the 838 participants are summarized in Table 1. Participants had an average total score of 34.464 for the PCL-5, and 359 (33.8%) participants met or exceeded the recommended cutoff score of 33 for a standard PTSD diagnosis.

Table 1 Baseline Characteristics of Study Participants (N = 838)

Internal Consistency, Convergent Validity, and Test–Retest Reliability of the C-PC-PTSD-5

The C-PC-PTSD-5 showed good internal consistency (Cronbach’s α = 0.756, 95% confidence interval [CI]: 0.729, 0.781), p < 0.001) based on the criterion of 0.30 as an acceptable corrected item-total correlation. All five items of the C-PC-PTSD-5 performed adequately (0.688, 0.776, 0.613, 0.656, and 0.690, respectively; range, 0.613–0.776).

We found a strong correlation between the C-PC-PTSD-5 score and PCL-5 total score (r = 0.669, p < 0.001), which indicated good convergent validity.

For test–retest reliability, 24 participants were re-assessed using the C-PC-PTSD-5 2 weeks after the initial assessment. The total score of the C-PC-PTSD-5 showed good test–retest reliability (r = 0.746). The paired t-test revealed no significant difference in scores between the assessment times (Time 1: Total score [mean ± SD] = 1.333 ± 2.060; Time 2: Total score [mean ± SD] = 0.916 ± 1.782, t = −0.959, p = 0.358), which indicated good consistency across both assessment times.

Diagnostic Utility and ROC Analysis

Receiver operating characteristic (ROC) analyses were performed to calculate the sensitivity and specificity of the C-PC-PTSD-5 total score when compared with the PCL-5 score’s PTSD diagnosis cutoff value of 33 (Figure 2). The analysis was performed to establish the optimal cutoff score for the C-PC-PTSD-5 for medical staff who had experienced traumatic events and was determined by calculating the maximum area under the curve (AUC). As shown in Figure 2, the AUC of the C-PC-PTSD-5 was 0.81 ± 0.016, which indicated that the C-PC-PTSD-5 has a high degree of discriminatory power (95% CI: 0.779, 0.841).

Figure 2 ROC curves for C-PC-PTSD-5.

When examining the cutoff of a score of 2 for the C-PC-PTSD-5, diagnostic utility was considered more acceptable (sensitivity = 0.632, specificity = 0.871, Youden index = 0.503, and overall efficiency = 0.768) than that of a cutoff of 1 (sensitivity = 0.799, specificity = 0.689, Youden index = 0.488, and overall efficiency = 0.736) or 3 (sensitivity = 0.454, specificity = 0.958, Youden index = 0.412, and overall efficiency = 0.742; Table 2).

Table 2 Diagnostic Utility of Different Scores for the C-PC-PTSD-5

Discussion

This cross-sectional survey in a large sample of participants who had experienced traumatic events indicated that the C-PC-PTSD-5 (a Chinese version of the PC-PTSD-5 that is designed to reflect the new DSM-5 PTSD criteria) is a valid and reliable screening tool for probable PTSD for medical staff exposed to the COVID-19 pandemic. The diagnostic utility analysis of the C-PC-PTSD-5 identified a recommended cutoff score of 2, based on an optimal balance of sensitivity and specificity.

The current results need to be interpreted with consideration of several limitations. First, because clinical interviews in a large sample were not approved in light of the COVID-19 pandemic in China, an online electronic PCL-5 was employed as the standard in the present study, which likely decreased model accuracy. The PCL-5 is currently used globally and has been found to have highly reliable psychometric properties across various settings.9,18–20 In addition, the Chinese version of the PCL-5 has shown good validity and has been used to screen for probable PTSD in earthquake survivors,8,21 and has also been previously implemented as a control to test the psychometric properties of the PC-PTSD-5 in Chinese children.22 Further research comparing the PCL-5 with structured clinical interviews, such as the Clinician-Administered PTSD Scale for DSM-5, is needed. Second, most study participants were physicians, nurses, or technicians (N = 1062, 99.06%), and only 10 labor workers completed the questionnaires. This was due to unfamiliarity or reluctance to complete the electronic questionnaire on a mobile phone. Moreover, socioeconomic status and education level may have influenced our results. Third, 1 year following the COVID-19 outbreak, the spread of virus and infections had been controlled in the Shanghai region, and most participants had not been in direct contact with COVID-19-infected patients. Therefore, our findings may not generalize to medical staff in severely affected areas.

Various studies have reported an increased risk of psychopathologies and stress-related disorders among medical staff, as well as a high rate of PTSD symptomatology.23–26 In the present study, 359 (33.8%) healthcare workers met the PCL-5 standard for a PTSD diagnosis, which is higher than that observed in recent research.27 Specific sample characteristics may play a role in this discrepancy. Healthcare workers have a relatively high level of education, which has been shown to be a significant predictor of PTSD.28 In fact, the mental health of healthcare workers during the Severe Acute Respiratory Syndromes (SARS) and Middle East Respiratory Syndrome (MERS) epidemic was found to be poorer in the phase following the acute outbreak than in the initial phase.29 PTSD symptoms usually appear months or years after the traumatic experience, and it may increase along with the pandemic. The detection of probable PTSD symptoms in medical staff is essential, even several years after experiencing a traumatic event.

Although we did not compare the time taken by participants to complete the PCL-5 and C-PC-PTSD-5, it is clear that the C-PC-PTSD-5 can be completed more quickly than the PCL-5. Participants are required to respond with a “yes” or “no” to only five items compared with the 20 items of the PCL-5, which has five options for each item. We randomly interviewed several healthcare workers who were not involved in the survey and found that a brief questionnaire was more popular and suitable for large samples in medical institutions in light of the COVID-19 pandemic.

Our findings indicated that the C-PC-PTSD-5 has good psychometric properties and the contextually validated cutoff score provides an effective screening instrument for identifying medical staff with PTSD symptoms. A cutoff score of 2 showed an optimal balance of sensitivity and specificity, although a cutoff of 1 revealed the highest sensitivity (0.799). Sensitivity is more important than other diagnostic accuracy measures in primary care settings, especially in non-treatment-seeking medical staff exposed to the COVID-19 pandemic. Participants who score over 1 should be recommended for further assessment for PTSD using a clinical interview.

Conclusion

The present findings demonstrate that the C-PC-PTSD-5 possesses good psychometric properties and can be used as a reliable, valid, and time-saving tool to diagnose and assess PTSD. A score of 2 was identified as a threshold for probable medical-related PTSD symptoms. The Chinese C-PC-PTSD-5 will help identify medical staff with PTSD who may benefit from early intervention, which will facilitate the delivery of mental health care.

Acknowledgments

We would like to thank all participants for their considerable support and assistance.

Funding

This work was supported by grants from Shanghai hospital association management research fund(Q2020027) and Shanghai “Rising Stars of Medical Talent” Youth Development Program (Shanghai Municipal Health Commission 2019-72).

Disclosure

The authors report no conflicts of interest in this work.

References

1. Kang L, Li Y, Hu S, et al. The mental health of medical workers in Wuhan, China dealing with the 2019 novel coronavirus. Lancet Psychiatry. 2020;7(3):e14. doi:10.1016/S2215-0366(20)30047-X

2. Shultz JM, Baingana F, Neria Y. The 2014 Ebola outbreak and mental health: current status and recommended response. JAMA. 2015;313(6):567–568. doi:10.1001/jama.2014.17934

3. Bao Y, Sun Y, Meng S, Shi J, Lu L. 2019-nCoV epidemic: address mental health care to empower society. Lancet. 2020;395(10224):e37–e38. doi:10.1016/S0140-6736(20)30309-3

4. van Dam D, Ehring T, Vedel E, Emmelkamp PMG. Screening for posttraumatic stress disorder in civilian substance use disorder patients: cross-validation of the Jellinek-PTSD screening questionnaire. J Subst Abuse Treat. 2013;44(1):126–131. doi:10.1016/j.jsat.2012.03.005

5. Weathers FWLB, Herman DS, Huska JA, Keane TM. Posttraumatic Stress Disorder Checklist. PTSD Checkl Reliab validity, diagnostic Util. The 9th Annual Conference of the ISTSS; 1993; San Antonio, TX.

6. Weathers FW, Litz BT, Keane TM, Palmieri PA. The PTSD Checklist for DSM-5 (PCL-5). National Center for PTSD; 2013.

7. Sveen J, Bondjers K, Willebrand M. Psychometric properties of the PTSD Checklist for DSM-5: a pilot study. Eur J Psychotraumatol. 2016;7:30165. doi:10.3402/ejpt.v7.30165

8. Liu P, Wang L, Cao C, et al. The underlying dimensions of DSM-5 posttraumatic stress disorder symptoms in an epidemiological sample of Chinese earthquake survivors. J Anxiety Disord. 2014;28(4):345–351. doi:10.1016/j.janxdis.2014.03.008

9. Krüger-Gottschalk A, Knaevelsrud C, Rau H, et al. The German version of the Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): psychometric properties and diagnostic utility. BMC Psychiatry. 2017;17(1):379. doi:10.1186/s12888-017-1541-6

10. Prinsa A, Ouimetle P, Kimerling R, et al. The primary care PTSD screen (PC-PTSD): deveJopment and operating characteristics. Primary Care Psychiatry. 2003;9(1):9–14. doi:10.1185/135525703125002360

11. Hanley J, deRoon-Cassini T, Brasel K. Efficiency of a four-item posttraumatic stress disorder screen in trauma patients. J Trauma Acute Care Surg. 2013;75(4):722–727. doi:10.1097/TA.0b013e3182a53a5f

12. van Dam D, Ehring T, Vedel E, Emmelkamp PMG. Validation of the Primary Care Posttraumatic Stress Disorder screening questionnaire (PC-PTSD) in civilian substance use disorder patients. J Subst Abuse Treat. 2010;39(2):105–113. doi:10.1016/j.jsat.2010.05.005

13. Srivastava S, Sachin D, Dighe R. “The American Psychiatric Association’s Diagnostic and Statistical Manual of Mental Disorders (DSM-IV)”. Guidelines; 2013.

14. Prins A, Bovin MJ, Smolenski DJ, et al. The Primary Care PTSD Screen for DSM-5 (PC-PTSD-5): development and Evaluation Within a Veteran Primary Care Sample. J Gen Intern Med. 2016;31(10):1206–1211. doi:10.1007/s11606-016-3703-5

15. Jackson T, Provencio A, Bentley-Kumar K, et al. PTSD and surgical residents: everybody hurts sometimes. Am J Surg. 2017;214(6):1118–1124. doi:10.1016/j.amjsurg.2017.08.037

16. Jackson TN, Morgan JP, Jackson DL, et al. The Crossroads of Posttraumatic Stress Disorder and Physician Burnout: a National Review of United States Trauma and Nontrauma Surgeons. Am Surg. 2019;85(2):127–135. doi:10.1177/000313481908500217

17. Lee SM, Kang WS, Cho A-R, Kim T, Park JK. Psychological impact of the 2015 MERS outbreak on hospital workers and quarantined hemodialysis patients. Compr Psychiatry. 2018;87:123–127. doi:10.1016/j.comppsych.2018.10.003

18. Bovin MJ, Marx BP, Weathers FW, et al. Psychometric properties of the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition (PCL-5) in veterans. Psychol Assess. 2016;28(11):1379–1391. doi:10.1037/pas0000254

19. Verhey R, Chibanda D, Gibson L, Brakarsh J, Seedat S. Validation of the posttraumatic stress disorder checklist - 5 (PCL-5) in a primary care population with high HIV prevalence in Zimbabwe. BMC Psychiatry. 2018;18(1):109. doi:10.1186/s12888-018-1688-9

20. Ibrahim H, Ertl V, Catani C, Ismail AA, Neuner F. The validity of Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5) as screening instrument with Kurdish and Arab displaced populations living in the Kurdistan region of Iraq. BMC Psychiatry. 2018;18(1):259. doi:10.1186/s12888-018-1839-z

21. Wang L, Zhang L, Armour C, et al. Assessing the underlying dimensionality of DSM-5 PTSD symptoms in Chinese adolescents surviving the 2008 Wenchuan earthquake. J Anxiety Disord. 2015;31:90–97. doi:10.1016/j.janxdis.2015.02.006

22. Li J, Zhang W, Chen W, et al. Applications of the Chinese version of the primary care PTSD screen for DSM-5 (PC-PTSD-5) for children. J Affect Disord. 2019;254:109–114. doi:10.1016/j.jad.2019.05.021

23. Sarapultseva M, Zolotareva A, Kritsky I, Nasretdinova NY, Sarapultsev A. Psychological Distress and Post-Traumatic Symptomatology Among Dental Healthcare Workers in Russia: results of a Pilot Study. Int J Environ Res Public Health. 2021;18(2). doi:10.3390/ijerph18020708

24. Forte G, Favieri F, Tambelli R, Casagrande M. COVID-19 Pandemic in the Italian Population: validation of a Post-Traumatic Stress Disorder Questionnaire and Prevalence of PTSD Symptomatology. Int J Environ Res Public Health. 2020;17(11):4151. doi:10.3390/ijerph17114151

25. Chew NWS, Lee GKH, Tan BYQ, et al. A multinational, multicentre study on the psychological outcomes and associated physical symptoms amongst healthcare workers during COVID-19 outbreak. Brain Behav Immun. 2020;88:559–565. doi:10.1016/j.bbi.2020.04.049

26. Raudenská J, Steinerová V, Javůrková A, et al. Occupational burnout syndrome and post-traumatic stress among healthcare professionals during the novel coronavirus disease 2019 (COVID-19) pandemic. Best Pract Res Clin Anaesthesiol. 2020;34(3):553–560. doi:10.1016/j.bpa.2020.07.008

27. Carmassi C, Foghi C, Dell’Oste V, et al. PTSD symptoms in healthcare workers facing the three coronavirus outbreaks: what can we expect after the COVID-19 pandemic. Psychiatry Res. 2020;292:113312. doi:10.1016/j.psychres.2020.113312

28. Spencer SA, Nolan JP, Osborn M, Georgiou A. The presence of psychological trauma symptoms in resuscitation providers and an exploration of debriefing practices. Resuscitation. 2019;142:175–181. doi:10.1016/j.resuscitation.2019.06.280

29. Martz E, Birks K, Blackwell T. The Prediction of Levels of Posttraumatic Stress Levels by Depression Among Veterans with Disabilities. J Rehabil. 2005;71(1):56–61.

Creative Commons License © 2021 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.