Back to Journals » International Journal of Chronic Obstructive Pulmonary Disease » Volume 12

A review of general pain measurement tools and instruments for consideration of use in COPD clinical practice

Authors Johnson AM, Smith SMS

Received 16 August 2016

Accepted for publication 18 November 2016

Published 17 March 2017 Volume 2017:12 Pages 923—929

DOI https://doi.org/10.2147/COPD.S119889

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 3

Editor who approved publication: Dr Richard Russell



Alisha Maree Johnson,1 Sheree MS Smith1,2

1School of Nursing and Midwifery, Western Sydney University, Penrith, 2Respiratory, Sleep, and Environmental Health Research Academic Unit, Liverpool Hospital, Liverpool, NSW, Australia


Background: The experience of pain can have a significant impact on the everyday life of individuals including those with COPD. Recently, pain has emerged as an area in COPD research. When considering pain measurement in COPD studies, it is important to consider the validity, reliability, responsiveness and interpretability of instruments and tools. This review sought to assess these domains of general pain instruments and tools using the consensus-based standards for the selection of health measurement instruments (COSMIN).
Methods: Three separate analyses were used to assess general pain measurement tools and instruments. These comprise COSMIN’s, 1) methodological quality assessment with dichotomous responses, 2) the 4-point rating scale, and 3) overall quality criteria using an assessment scale for clinimetric properties by Terwee.
Results: Overall Pain Sensitivity Questionnaire (PSQ) was found to have the highest rating in all domains of validity, reliability, responsiveness and interpretability. In the first analysis, PSQ and Geriatric Pain Measure (GPM) scored highest in four of the six domains. In the second analysis, using the 4-point rating, the PSQ scored highest in three of four domains. In the third analysis, the GPM scored the highest in all four domains. Overall the PSQ, GPM and Defense and Veterans Pain Rating Scale scores were consistently high in the three separate analyses in this review.
Conclusion: This review found variability in the domains of validity, reliability, responsiveness and interpretability in general pain tools and instruments. The PSQ was found to be the most valid and reliable general pain measurement instrument for adult populations.

Keywords: pain, measurement, validity, reliability, responsiveness, interpretability, COPD

Introduction

COPD causes significant disability and impacts on the lives of people with the disease, their families and health care services.1 People with COPD often have well-described comorbid conditions, such as heart failure,2 anxiety and depression,3 and the most common symptom experienced by people with COPD is breathlessness. More recently, pain has been reported as a frequent symptom in addition to breathlessness.4

Pain is known to affect psychological well-being5 and has also been linked with a decrease in quality of life.6 Reviews of pain and COPD indicate that pain may contribute to an increase in poor clinical outcomes.7 COPD patients with pain are prescribed more short-acting beta-agonist therapy and oral steroids than those without pain.8 Outpatient prescription data9 suggest that many COPD patients use opioid pain medications on a long-term basis, and it is unclear if this use is related to refractory breathlessness or pain management.10

Pain is a stressful, individual and subjective human experience11 and has been associated with feelings of social isolation.5 The ability to accurately measure and interpret the symptom of pain through valid and reliable tools or instruments may be clinically important in determining medical therapy and nonpharmaceutical interventions for people with COPD. There are a wide range of general and specific pain tools and instruments available to clinicians. Numerous studies describe the adoption of pain tools and instruments to various acute and chronic conditions in terms of their validity and reliability.12,13

Currently, COPD and pain studies appear to utilize general pain tools or instruments, although none have been developed for chronic respiratory diseases. When differing methods to measure pain are used across studies in COPD patients, this could lead to misinterpretation of the phenotype of pain and fluctuating estimates of pain prevalence being reported. To date, a comparison of general pain measurement instruments or tools’ validity, reliability, responsiveness and interpretability has not been described. The primary aims of this review were to provide an overview of general pain tools and instruments and to evaluate their validity, reliability, responsiveness and interpretability in order to reduce methodological concerns in COPD and pain studies.

Methods

The primary aims of this review were to identify general pain measurement tools and instruments used in an adult population and assess their psychometric properties. The review objectives were to provide an overview of the psychometric quality and to compare the assessment of each psychometric property in terms of validity, reliability, responsiveness and interpretability of general pain instruments or tools.

Search strategy and study selection criteria

The Preferred Reporting Items for Systematic Reviews and Meta-analyses guideline was used to underpin the development of the review protocol.14 An a priori search strategy was devised to identify relevant pain measurement literature, and this search of peer-reviewed literature included CINAHL, Embase, Medline, Pubmed, Proquest, PsychArticles, PsychInfo, Sciencedirect and Psychiatry Online electronic databases. The primary search was conducted during January 2016, using combinations of keywords and their abbreviations: “pain”, “scale”, “instrument”, “measurement”, “measure*”, “precision”, “precise”, “validity”, “valid*”, “reliability”, “reliabl*”, “response*”, “responsiveness” and “adults”. The search was not restricted to any publication timeframe although it was restricted to publications in English. The reference lists of selected relevant articles were screened for potential publications. The review protocol outlined the process where abstracts were identified and reviewed for inclusion.

For all included abstracts, full-text articles were retrieved. All included full-text publications were further searched to identify the original psychometric studies of the pain tool or instrument. The protocol restricted the search to psychometric studies that included adult participants and the measurement was pain.

Data extraction and methodological quality assessment

The collecting, collating and evaluation of the published data were predetermined by the reviewers before the commencement of the study. The review of abstracts that met the inclusion criteria was performed by two independent reviewers (AMJ, SMSS) and was aided by a predesigned data extraction spreadsheet. This independent review process (AMJ, SMSS) was replicated for retrieved full-text articles. Disagreements over inclusion of full-text articles were settled through discussion and consensus reached.

All included articles were assessed for methodological quality using the consensus-based standards for the selection of health measurement instruments (COSMIN) checklists of domains and properties in each domain.15 The COSMIN measurement domains are comprised of validity, reliability, responsiveness and interpretability.16 Interpretability of scores was included as an important measurement characteristic that reflects distribution of scores across a population and the reporting of minimal important change or difference.15 It should be noted that interpretability could only be assessed using the dichotomous COSMIN checklist and was not a domain in any of the other analyses that used other COSMIN checklists. Each of these domains had prescribed and defined measurement properties (Table 1). For example, validity has the properties of content validity, construct validity and criterion validity.16

Table 1 Quality criteria for pain measurement tools
Notes: aDefinitions of properties and bquality criteria reprinted from J Clin Epidemiol, 63(7), Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes, 737–745, Copyright (2010), with permission from Elsevier.16
Abbreviations: HR-PRO, health related-patient reported outcomes; ICC, intraclass correlation coefficients.

COSMIN guidance recommends three approaches in the analysis of instrument measurement properties. Permission was granted to utilize the COSMIN definitions. The first analysis was a quality assessment which employed a specific COSMIN checklist incorporating a dichotomous scale comprising of yes and no with numerical value assignment of 1 and 0, respectively. This checklist incorporates a variety of components within each aspect of a measurement study’s methodology15 including descriptions of the study design and statistical methods used15 (Table 1).

The second analysis of general pain instruments and tools utilized the COSMIN 4-point rating scale,17 which calculates a summary of methodological quality for each domain. Each component was assessed using a rating of excellent, good, fair or poor17 (Table 2). The lowest rating was considered for each individual domain being assessed, for example, if poor was assigned as a lowest rating in any domain then the overall score was “poor”.15

Table 2 Overall quality rating assessment of general pain measurement
Note: Data from National Health and Medical Research Council.26

As per COSMIN guidance an overall score of the general pain instrument or tool was subsequently calculated using a predeveloped assessment scale by Terwee et al17 to rate the level of quality. To examine the overall quality of statistical methods used in the development of each general pain instrument or scale, a rating system was adapted from prescribed criteria in accordance with COSMIN recommendations.17 A positive (+), negative (−) or unknown (?) was apportioned to each criteria to determine the quality of each element associated with the statistical methods reported in the development of each instrument (Table 3).

Table 3 Overall quality level of rating from Terwee’s assessment scale for clinimetric properties
Note: Reprinted from J Clin Epidemiol, 60(1), Terwee CB, Bot SDM, de Boer MR, et al, Quality criteria were proposed for measurement properties of health status questionnaires, 34–42, Copyright (2007), with permission from Elsevier.23

The corresponding positive (+), negative (−) or unknown (?) is subsequently linked to a summary of an overall quality rating of strong, moderate, low or unknown (Table 3).

Results

The database search initially yielded 1,862 potentially relevant studies. Duplicate papers were removed and abstracts screened with 191 full-text versions of the published articles retrieved. Additionally, five pain measurement instrument or tools studies were identified through further searching of reference lists. Eligibility criteria were applied and eight general pain measurement instrument development and validation studies were included for methodological quality assessment (Figure 1). Figure 1 illustrates the selection of general pain measurement studies reported in this review.

Figure 1 Pain measurement tool search diagram.
Note: Reproduced from Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement. PLoS Med. 2009;6(7):e1000097. 29

An overview of the results from three approaches used in the analysis of the methodological quality of the general pain instruments/tools are reported in Tables 46. Detailed results for content validity, criterion validity, reliability, internal consistency, responsiveness and interpretability show several general pain instruments were highly rated in one domain but were found to be poor in other aspects of the psychological properties.

Table 4 Summary of methodological quality assessment of measurement tool using COSMIN checklist
Abbreviations: COSMIN, consensus-based standards for the selection of health measurement instruments; D, Design requirement; G, General requirement; S, Statistical methods.

Table 5 Overall score for quality assessment of pain assessment tools using COSMIN 4-point checklist
Abbreviation: COSMIN, consensus-based standards for the selection of health measurement instruments.

Table 6 Quality criteria for pain measurement tools from Terwee’s assessment scale for clinimetric properties
Notes: aIndividual kappa scores ranged between 0.52 and 0.82 with a majority of kappa scores <0.70. bNo pain tools demonstrated correlation statistics. Strong: +++; Moderate: ++; Low: +; Unknown: ?. Reprinted from J Clin Epidemiol, 60(1), Terwee CB, Bot SDM, de Boer MR, et al, Quality criteria were proposed for measurement properties of health status questionnaires, 34–42, Copyright (2007), with permission from Elsevier.23
Abbreviation: NA, not applicable.

The first analysis employed a dichotomous scale and the Pain Sensitivity Questionnaire (PSQ)18 scored high in four of the six domains including content validity, internal consistency, responsiveness (without a gold standard comparison) and interpretability. The Geriatric Pain Measure (GPM)19 also scored highly in four of the six domains including content validity, criterion validity, internal consistency and responsiveness without a gold standard comparison. The highest score for reliability was the Profile of Chronic Pain: Screen (PCP:S).

The second analysis using the COSMIN 4-point rating scale (Table 5), found that the PSQ scored highly in three of the five assessed domains including content validity, internal consistency and responsiveness. The GPM scored highest in two of the five assessable domains including criterion validity and internal consistency. The PainMatcher20 scored highest in reliability and the PCP:S21 scored highest in responsiveness using this assessment.

The third analysis in the examination of overall quality of statistical methods used (Table 6) in the development and validation studies of pain tools and instruments, the GPM scored highest in the content validity, criterion validity, reliability and internal consistency domains. The PSQ and Defense and Veterans Pain Rating Scale (DVPRS)22 scored equal highest with the GPM in three of the four domains assessed comprising content validity, reliability and internal consistency.

Discussion

Our review of validation studies revealed a wide variety of pain measurement instruments and tools have been studied and included general pain and disease-specific pain measurement. This review utilized three approaches to assess selected general pain instruments or tools and found that several pain measurement instruments scored significantly higher on the COSMIN criteria in validity, reliability, responsiveness and interpretability. From this review, the findings suggest that there is wide variability in quality of pain measurement instruments and tools across all domains. This variability may be due to increased rigor and changing expectations in validation studies across time resulting in the potential for varying methodologies and quality of publication.

The results from our analyses associated with content and criterion validity demonstrated the PSQ, DVPRS and GPM scored the highest in both of these domains. These findings were consistent in each separate analysis. Reliability was assessed in terms of reliability and internal consistency. Reliability was found highest in PCP:S, whereas the PSQ and GPM scored the highest for internal consistency. The findings for the PSQ and GPM were consistent in all three analyses. Although the PCP:S scored high in the COSMIN, it did not have reportable findings in overall quality criteria for pain measurement tools using Terwee’s assessment scale of clinimetric properties from Terwee et al.23 In assessing responsiveness the new instrument was required to be evaluated against a gold standard and if a gold standard was not used then different criteria were utilized. The PSQ scored highest without a gold standard comparison, whereas the GPM scored the highest in reliability with a gold standard comparison. In this review, interpretability was assessed with the highest scores found in the Pain Catastrophizing Scale (PCS)24 and PSQ.

Overall the PSQ and GPM scored consistently highest in all domains. The PSQ scored overall the highest when being assessed by COSMIN, with the GPM scoring second highest.

It should be noted that some pain measurement tools/instruments were originally developed in specific disease populations, such as the Brief Pain Inventory,25 which was developed for the measurement of pain in cancer patients and has been utilized in COPD studies.4

Therefore, when considering a pain measurement instrument for either clinical practice or research it is important to examine validity, reliability, responsiveness and interpretability to ensure that the best evidence-based pain measurement tool is selected.15

Limitations

There are several limitations associated with this review. Although we undertook a systematic and extensive search for published articles associated with the original development of general pain measurement tool or instruments, some publications may have been missed. Secondly, new pain measurement tools and instruments may have been published after the completion of the extensive search in January 2016. Finally, articles published in other languages may report the development of general pain measurement instruments or tools and these were not included in this review.

Conclusion

This review of general pain instruments or tools revealed there was variability in the validity, reliability, responsiveness and interpretability when using a standardized approach. The PSQ was found to be the most valid and reliable general pain measurement instrument for adult populations.

Author contributions

AMJ and SMSS conceived the study; both authors contributed to defining and refining the review question and scope of review. Both authors reviewed the findings and contributed to the content, writing, drafting and revision of the manuscript, and agreed to the final version. AMJ is guarantor of the manuscript.

Disclosure

The authors report no conflicts of interest in this work.


References

1.

Gysels MH, Higginson IJ. The lived experience of breathlessness and its implications for care: a qualitative comparison in cancer, COPD, heart failure and MND. BMC Palliat Care. 2011;10:15.

2.

Fisher KA, Stefan MS, Darling C, Lessard D, Goldberg RJ. Impact of copd on the mortality and treatment of patients hospitalized with acute decompensated heart failure: the worcester heart failure study. Chest. 2015;147(3):637–645.

3.

Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380(9836):37–43.

4.

van Dam van Isselt EF, Groenwegen-Sipkema KH, Spruit-van Eijk M, et al. Pain in patients with COPD: a systematic review and meta-analysis. BMJ Open. 2014;4(9):e005898.

5.

Waugh OC, Byrne DG, Nicholas MK. Internalized Stigma in People Living With Chronic Pain. J Pain. 2014;15(5):550.e1–550.e10.

6.

Borge CR, Wahl AK, Moum T. Pain and quality of life with chronic obstructive pulmonary disease. Heart Lung. 2011;40(3):e90–e101.

7.

Bradford EJ, David BC, Rennie R, et al. Health impact of pain among a representative sample of outpatients with COPD. D39 connecting the dots: drawing lines between COPD and comorbid conditions. In: American Thoracic Society International Conference; San Diego Convention Center. Abstracts: American Thoracic Society; 2014:A5824-A.

8.

Roberts MH, Mapel DW, Hartry A, Von Worley A, Thomson H. Chronic pain and pain medication use in chronic obstructive pulmonary disease: a cross-sectional study. Ann Am Thorac Soc. 2013;10(4):290–298.

9.

Nicholas TV, Xuesong W, Hadas F, et al. Opioid drug use among older adults with chronic obstructive pulmonary disease: a population-based cohort study. D37 HELP: advances in COPD therapeutics. In: American Thoracic Society International Conference; Colorado Convention Center. Abstracts: American Thoracic Society; 2015:A5805-A.

10.

Wiseman R, Rowett D, Allcroft P, Abernethy A, Currow DC. Chronic refractory dyspnoea Evidence based management. Aust Fam Physician. 2013;42:137–140.

11.

de Papathanassoglou E. Recent advances in understanding pain: what lies ahead for critical care? Nurs Crit Care. 2014;19(3):110–113.

12.

Bijur PE, Latimer CT, Gallagher EJ. Validation of a verbally administered numerical rating scale of acute pain for use in the emergency department. Acad Emerg Med. 2003;10(4):390–392.

13.

Mawdsley RH, Moran KA, Conniff LA. Reliability of two commonly used pain scales with elderly patients. J Geriatr Phys Ther. 2002;25(3):16–20.

14.

Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statment for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700.

15.

Mokkink LB, Terwee CB, Patrick DL, et al. COSMIN Checklist manual 2012. Available from: http://www.cosmin.nl/images/upload/files/COSMIN%20checklist%20manual%20v9.pdf. Accessed May 15, 2016.

16.

Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–745.

17.

Terwee CB, Mokkink LB, Knol DL, et al. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2011;21(4):651–657.

18.

Ruschewyh R, Marziniak M, Stumpenhorst F, Reinholz J, Knecht S. Pain sensitivity can be assessed by self-rating: development and validation of the pain sensitivity questionnaire. PAIN. 2009;146(1–2):65–74.

19.

Ferrell BA, Stein WM, Beck JC. The geriatric pain measure: validity, reliability and factor analysis. J Am Geriatr Soc. 2000;48(12):1669–1673.

20.

Lundeberg T, Lund I, Dahlin L, et al. Reliability and responsiveness of three different pain assessments. J Rehabil Med. 2001;33(6):279–283.

21.

Ruehlman LS, Karoly P, Newton C, Aiken LS. The development and preliminary evaluation of a brief measure of chronic pain impact for the use in the general population. PAIN. 2005;113(1–2):82–90.

22.

Buckenmaier CC 3rd, Galloway KT, Polomano RC, McDuffie M, Kwon N, Gallagher RM. Preliminary validationof the defense and veterans pain scale (DVPRS) in a military population. Pain Med. 2013;14(1):110–123.

23.

Terwee CB, Bot SDM, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.

24.

Sullivan MJL, Bishop SR, Pivik J. The Pain Catastrophizing Scale: Development and Validation. Psychol Assess. 1995;7(4):524.

25.

Cleeland C. The Brief Pain Inventory User Guide; 1991. Available from: http://sosmanuals.com/manuals/cae48184b7bae3b1d85105ea85375b60.pdf. Accessed January 20, 2016.

26.

National Health and Medical Research Council. NHMRC levels of evidence and grades for recommendations for developers guidelines; 2009. Available from: https://www.nhmrc.gov.au/_files_nhmrc/file/guidelines/developers/nhmrc_levels_grades_evidence_120423.pdf. Accessed May 15, 2016.

27.

Sousa FAEF, Pereira LV, Cardoso R, Hortense P. Multidimensional pain evaluation scale. Rev Lat Am Enfermagem. 2010;18(1):3–10.

28.

Anatchkova MD, Saris-Baglama RN, Kosinski M, Bjorner JB. Development and Preliminary Testing of a Computerized Adaptive Assessment of Chronic Pain. J Pain. 2009;10(9):932–943.

29.

Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement. PLoS Med. 2009;6(7):e1000097.

Creative Commons License © 2017 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.