Back to Journals » Patient Preference and Adherence » Volume 12

Has the quality of physiotherapy care in patients with Whiplash-associated disorders (WAD) improved over time? A retrospective study using routinely collected data and quality indicators

Authors Oostendorp RAB , Elvers H , van Trijffel E, Rutten GM, Scholten-Peeters GGM , Heijmans M, Hendriks E, Mikolajewska E , De Kooning M , Laekeman M , Nijs J , Roussel N , Samwel H 

Received 11 July 2018

Accepted for publication 27 September 2018

Published 8 November 2018 Volume 2018:12 Pages 2291—2308

DOI https://doi.org/10.2147/PPA.S179808

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Johnny Chen



Rob AB Oostendorp,1–4 Hans Elvers,5,6 Emiel van Trijffel,7,8 Geert M Rutten,9,10 Gwendolyne GM Scholten–Peeters,11 Marcel Heijmans,4 Erik Hendriks,12,13 Emilia Mikolajewska,14,15 Margot De Kooning,3,8,16 Marjan Laekeman,17 Jo Nijs,3,8,16 Nathalie Roussel,18 Han Samwel19

1Scientific Institute for Quality of Healthcare, Radboud University Nijmegen Medical Centre, Nijmegen, the Netherlands; 2Department of Manual Therapy, Faculty of Medicine and Pharmacy, Vrije Universiteit Brussel, Brussels, Belgium; 3Pain in Motion International Research Group, Free University Brussels, Brussels, Belgium; 4Practice Physiotherapy and Manual Therapy, Heeswijk-Dinther, the Netherlands; 5Department of Public Health and Research, Radboud University Nijmegen Medical Centre, Nijmegen, the Netherlands; 6Methodological Health-Skilled Institute, Beuningen, the Netherlands; 7SOMT University of Physiotherapy, Amersfoort, the Netherlands; 8Department of Physiotherapy, Human Physiology and Anatomy, Faculty of Physical Education and Physiotherapy, Free University Brussels, Brussels, Belgium; 9Institute of Health Studies, Faculty of Health and Social Studies, HAN University of Applied Science, Nijmegen, the Netherlands; 10Faculty of Science and Engineering, University College Venlo, Maastricht University, Maastricht, the Netherlands; 11Department of Human Movement Sciences, Faculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands; 12Department of Epidemiology, Center of Evidence-Based Physiotherapy, Maastricht University, Maastricht, the Netherlands; 13Practice Physiotherapy ‘Klepperheide’, Druten, the Netherlands; 14Department of Physiotherapy, Ludwik Rydygier Collegium Medicum in Bydgoszcz, Nicolaus Copernicus University, Torun, Poland; 15Neurocognitive Laboratory, Centre for Modern Interdisciplinary Technologies, Nicolaus Copernicus University, Torun, Poland; 16Department of Physical Medicine and Physiotherapy, University Hospital Brussels, Brussels, Belgium; 17Department of Nursing Sciences, Faculty of Health, University Witten/Herdecke, Witten, Germany; 18Department of Rehabilitation Sciences and Physiotherapy (MOVANT), Faculty of Medicine and Health Sciences, University of Antwerp, Belgium; 19Department of Medical Psychology, Canisius Wilhelmina Hospital, Nijmegen, the Netherlands

Purpose: To develop valid quality indicators (QIs) for physiotherapy care based on best available evidence, and to use these QIs to explore trends in the quality of physiotherapy care of patients with Whiplash-associated disorders (WAD) using guideline-based routinely collected data (RCD) gathered between 1996 and 2011.
Materials and methods: The study consisted of two phases: 1) development of QIs and 2) analysis of patient records. A set of QIs was developed based on recommendations in the scientific literature and the Dutch Clinical Practice Guideline (CPG) “Physiotherapy Management and WAD”. QIs were expressed as percentages, allowing target performance levels to be defined (≥80% or ≤30% depending on whether desired performance required a high or low score on a QI). We then analyzed WAD patient data (N = 810) collected over a period of 16 years in two physiotherapy practices, separating patients into two groups defined as before (Group A 1996–2002; n = 353) and after (Group B 2003–2011; n = 457) implementation and transition to the Dutch CPG “Physiotherapy Management and WAD”.
Results: Using an iterative process and input from both experts and users, 28 QIs were developed and subsequently classified per step of the clinical reasoning process for physiotherapy care. Based on 16 years of RCD, we found that the clinical reasoning process differed significantly (P ≤ 0.05) between the groups, in favor of Group B. Twelve of the 25 indicators (48.0%) in Group A and 19 of 26 indicators (73.1%) in Group B met predetermined performance targets. The number of target indicators also differed significantly between groups, favoring Group B (P ≤ 0.05).
Conclusion: A preliminary set of novel QIs was developed. Using RCD and these QIs, we conclude that physiotherapy care in our study setting improved over the period 1996–2011. Furthermore, the QIs met the performance targets set for the clinical reasoning process after the transition to the Dutch CPG “Physiotherapy Management and WAD”.

Keywords: quality of physiotherapy care, Whiplash-associated disorders, clinical guidelines, quality indicators, clinical reasoning process, routinely collected data

Introduction

Current national and international Clinical Practice Guidelines (CPGs) for patients with Whiplash-associated disorders (WAD) are mainly based on the results of systematic reviews and on primary studies of diagnostics, prognostics, and treatment.112 In general, comparable recommendations can be found in these guidelines, all of which are based on weak or moderate levels of evidence.

Due to the lack of high-quality supporting evidence and a limited understanding of how well CPGs for physiotherapy management and WAD are implemented in daily practice,13,14 patients may currently receive suboptimal or even inappropriate physiotherapy diagnostics and treatment.15 This, in turn, may result in negative health consequences and higher societal costs.

The CPG “Physiotherapy Management and WAD” was introduced between 20012 and 2002.3 In contrast to international CPGs,46,9,11 Dutch CPGs are generally based on a nine-step clinical reasoning process. Clinical reasoning has been defined “as a process in which the physiotherapist, interacting with the patient and significant others, structures meaning, goals and health management strategies based on clinical data, client choices and professional judgment and knowledge”.16,17 The clinical reasoning cycle is an internationally accepted concept to facilitate problem solving and decision making in daily practice. The transparency of the clinical reasoning process, as provided by measurable elements such as quality indicators (QIs), is considered a cornerstone of the quality of care.18

QIs have been defined as “measurable elements of practice performance for which there is evidence or consensus that they can be used to assess the quality of the care provided.”19 QIs may relate to structures (such as staff, equipment, appointment systems), processes (such as clinical reasoning), or outcomes of care (such as a patient’s functioning or disability).20 QIs can be used to analyze and evaluate the quality of physiotherapy care of patients with WAD, and the systematic development of QIs is preferably centered on guideline-based recommendations, supplemented by expert clinical experience and patient perspectives. Process and outcome indicators are often based on patient registration systems that encompass operationalized guideline-based recommendations as measurable elements of clinical practice.1820 It is also generally accepted that the quality of patient registration systems is a reliable indicator of the quality of care.21

Despite the fact that a large proportion of WAD patients are managed by physiotherapists, only limited data are available on the quality of the physiotherapy care process. Furthermore, there is still little data or understanding of the complexity of the clinical reasoning process in patients with WAD, a deficiency that may hamper quality improvements for physiotherapy in primary care.9,15

One promising approach to the assessment of the quality of physiotherapy care for patients with WAD is exploration of routinely collected data (RCD).22 RCD has several distinct advantages, since data collection during routine clinical practice maximizes representativeness, minimizes costs, and allows capture of information from a large population. These data include many clinical events occurring in large data sets that are continuously updated over long periods and as such form the basis of the present study.

Using a novel set of QIs developed specifically for this study, our overall aim was to explore trends in the quality of physiotherapy care in patients with WAD over a period of 16 years (1996–2011) using structured, detailed, and systematically gathered RCD. We anticipated that these novel QIs, together with high-quality, long-term RCD, would allow us to track trends in the quality of physiotherapy care following the dissemination and transition to the Dutch CPG Physiotherapy Management and WAD in 2002.

Materials and methods

Design

This retrospective cohort study, based on RCD that cover a period of 16 years (1996–2011), was carried out in two primary care physiotherapy practices in the Netherlands, specialized in assessments in patients with WAD.

The Medical Ethics Committee of Radboud University Medical Center, Nijmegen, in the Netherlands waived in writing the requirement for ethical approval as our study involved routinely collected clinical data that represented no extra burden for patients.

As members of the steering committee of the project Quality of Physiotherapy and WAD, we agree to conduct ourselves in strict conformance with all applicable laws and with the polices of the Royal Dutch Association of Physiotherapy regarding patient data confidentiality and security. These obligations apply to confidential information that is collected or maintained verbally, in paper, or electronic format.

For the purposes of the study, we divided the collected data into two groups: one detailing care before (Group A 1996–2002) and the second after (Group B 2003–2011) the implementation of the Dutch CPG Physiotherapy Management and WAD.

Phases

The study protocol comprised two distinct phases: 1) indicator development and 2) analysis of WAD patient records. The assembled data included variables on all steps of the physiotherapy clinical reasoning process, including I: Administration, II: History taking, III: Objectives of examination, IV: Clinical examination, V: Analysis and conclusion, VI: Treatment plan, VII: Treatment, VIII: Evaluation and IX: Discharge. All items describing each step of the clinical reasoning process, except for medical information and specific care needs, were collected in a closed format patient record. The physiotherapy modalities were coded according to the Classification of Physiotherapy, which distinguishes nine modalities: 1) History taking; 2) Inspection and observation; 3) Palpation; 4) Active exercise therapy; 5) Passive exercise therapy/manual therapy; 6) Massage therapy; 7) Modalities of physical therapy (ie, low- and high-frequency electrotherapy); 8) Coaching; and 9) Education.23 Patient records were outlined in accordance with the national CPG regarding requirements for physiotherapy documentation.24

A systematic RAND-modified Delphi method, including independent expert comments and iterative feedback, was used to develop a set of recommendations suitable for transcription into QIs.18,25 The method of QI development included five steps: 1) extraction of recommendations from literature and guidelines; 2) transformation of recommendations into indicators; 3) appraisal of a preliminary set of indicators by an expert and user panel with consensus; 4) classification of process indicators; and 5) classification of outcome indicators.

Phase 1: indicator development

Step 1: extraction of physiotherapy and WAD-related recommendations

The first group of recommendations was derived from the 1995 Quebec Task Force on WAD.1 A second group of 2001/2002 recommendations for physiotherapy management of WAD was extracted from the Dutch CPG Physiotherapy Management and Whiplash,2,3 and a third group of recommendations was identified using more recently published (2009) international guidelines46 and publications concerning pain modulation and central sensitization in patients with WAD.2630 In addition, we used existing relevant information from the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders,31 orthopedic textbooks,3136 and core sets for musculoskeletal disorders of the International Classification of Functioning, Disability, and Health (ICF).37,38 These recommendations were extracted by two members of the research team (RABO and MH) and, if necessary, differences were discussed with a third member of the team (EH) until consensus was reached. Previously formulated recommendations were compared against current evidence and updated using new recommendations when necessary.

Step 2: transformation of recommendations into QIs

The recommendations were transformed into QIs by phrasing them as the average degree (in %) to which patients were subjected to a methodically performed clinical reasoning process (eg, the average degree to which patients were subjected to a methodically performed history taking).

Step 3: appraisal by an expert and user panel

Steps 1 and 2 were followed by an online survey of a panel of experts (n = 27), including physical therapists specialized in musculoskeletal PT, particularly WAD (n = 15), clinical epidemiologists (n = 3), developers of physiotherapy CPGs (n = 3), psychologists (n = 4), and neurologists (n = 2). The panel was asked to score the set of QIs on a five-point Likert scale (1 = not at all to 5 = completely), based on their clarity and relevancy to the physiotherapy care process. The results were discussed in the steering committee, using a standardized consensus criterion (clarity and relevancy scores 4 and 5). In a second online survey, the set of selected QIs was subsequently presented to a user panel of physiotherapists working in private practices (n = 15) who scored the indicators on a five-point Likert scale (1 = not at all to 5 = completely), based on feasibility and acceptability. Again, the results were discussed in the steering committee using a similar standardized consensus tool (feasibility and acceptability scores 4 and 5). We anticipated that this procedure would produce a set of QIs with content validity.

Step 4: classification of process indicators

The process indicators, including the type of indicator (process generic or specific, outcome generic, number of items per indicator, and level of evidence), were classified into nine domains according to the previously mentioned steps of the clinical reasoning process in physiotherapy care.

The level of research evidence for the formulated QIs, from levels I to IV, was determined based on a national consensus document,39 with level I being the highest: level I = systematic review or >2 high-quality controlled trials or high-quality diagnostic studies or high-quality psychometric studies; level II = two high-quality controlled trials or high-quality diagnostic studies or high-quality psychometric studies; level III = high-quality non-controlled trials or low-quality diagnostic studies or low-quality psychometric studies; level IV = expert opinion and professional consensus or standard.

Step 5: classification of outcome indicators

Based on recommended standard outcome measures and on psychometric quality, the outcome indicators consisted of scores for a variety of patient-reported outcome measures, including measures of neck pain intensity, functioning or disability, and global perceived effect (GPE).40 The outcome indicators were classified in accordance with the ICF as body functions (head and neck pain) and activities and participation (eg, mobility, self-care, domestic life, work, employment).37,38 Pain intensity was measured using the Visual Analog Scale for Pain (VAS-P), which consists of a 100 mm line scored from 0 (no pain) to 100 (worst imaginable pain).41 Functioning-related outcome measures included the Neck Disability Index (NDI).4245 The NDI consists of 10 questions, scored 0–5, with increasing scores representing functional impairment and disability due to neck pain. Patients were asked to evaluate treatment GPE, rating the pre- to postintervention change in GPE from 1 (complete resolution) to 6 (clearly worsened).45 The QIs for outcome measures in this part of the study consisted of the average degree to which the recommended outcome measurements were applied. In addition to these outcome measures, the duration of the treatment episode in weeks and the number of treatment sessions were both recorded as outcome indicators.

Phase II: RCD

Data collection

Data on WAD patients were collected over a period of 16 years in the form of a pen and paper patient record that guided the steps of the clinical reasoning process of care. The first WAD patient record was developed in 1995 using the Quebec Task Force WAD1 and was updated in 2002 using the Dutch CPG Physiotherapy Management and WAD,2,3 and further modernized in 2009 using both international guidelines46 and evidence concerning pain modulation and central sensitization in patients with WAD.28,29,46 Patients with a history, signs, and symptoms suggestive of potentially serious pathology (red flags), including an initial interview related to the 5 D’s + 1 (dizziness, diplopia, drop attack, dysarthria, dysphagia, plus nausea), were excluded from the analysis. Red flags are signs and symptoms that may indicate a specific pathology due to injury.34 The registration of data on otoneurological and psychological examinations started in 2000, pre- and posttreatment measures of pain, functioning or disability, and GPE began in 2002, psychological questionnaires and arrangement of aftercare in 2003, and registration of signs indicting central sensitization began in 2009. See flowchart for the latest version of the clinical reasoning process (see Supplementary S1).

In 1996, the first WAD patient record was introduced in two Dutch primary care physiotherapy practices with eight participating physiotherapists, and no reimbursement or compensation for their participation was involved. The following characteristics of the physiotherapists were noted: age, gender, practice experience with patients with WAD, and specialization in manual physiotherapy. The participating physiotherapists received updates in accordance with adjustments to the content of the patient records, explained during three 3-hour meetings that took place in 2001, 2002, and 2009. They also received instructions on how to score the items of each step of the clinical reasoning process. All patient records were archived.

Data analysis

In 2016, we started a quality improvement study on primary care physiotherapy management and WAD using an existing large data set. After cleaning and processing of the data set, the analysis was carried out retrospectively.

Most of the variables for the two periods 1996–2002 and 2003–2011 were collected in a similar way, allowing comparison. Algorithms that followed the clinical reasoning process in patients with WAD (see flowchart in Supplementary S1) were formulated to translate the data into scores on QIs. QIs were expressed as frequencies, allowing target performance to be defined.18 See formula in Figure 1.

Figure 1 Formula for frequency of indicator (∑I = sum scores of items per indicator, Nk = number of items per indicator, and Nj = number of respondents per year).

QIs were scored as percentages, yielding possible scores for quality of care ranging from 0 to 100. The performance target for 23 indicators was set to ≥80% (indicators 1–4, 8–15, and 17–27), to ≤30% for three indicators (5–7) depending on whether desired performance target required a high or low score on the indicator (preexistent functioning, preexistent health status before injury, and previous diagnostics and treatment), and was “nondefined” for two indicators (indicators 16 and 28) due to the innovative character of these indicators.30,47 The analytical software program Statistix 9 was used for descriptive statistics.

Descriptive statistics were used to characterize the patient population and QI percentages. Differences between patient characteristics on dichotomous variables and means of QIs between the groups were tested using a chi-squared test. Two-sample t-tests were used to test differences in continuous data between the groups. Statistical significance was set at α = 0.05. An overview of all variables for analysis per clinical reasoning step is presented in Supplementary S2.

Results

Phase 1: indicator development

Step 1: guideline-based recommendations

In total, 125 literature- and guideline-based items were extracted in relation to the total clinical reasoning process in patients with WAD. After critical evaluation and checking for duplication and overlap by two members of the project group (RABO and MH), the number of preselected items was reduced to 96 items covering the nine steps of the physiotherapy clinical reasoning process: I. Administration (n = 6); II. History taking (n = 35); III. Objectives of examination (n = 4); IV. Clinical examination (n = 16); V. Analysis and conclusion (n = 14); VI. Treatment plan (n = 5); VII. Treatment (n = 2); VIII. Evaluation (n = 11); IX. Discharge (n = 3) (see Supplementary S2).

Step 2: QIs

The remaining 96 items were transformed into 28 QIs, including both process and outcome indicators, by phrasing them as the average degree (%) to which patients were subjected to a methodically performed clinical reasoning process. For example, the average degree (in %) to which patients underwent a methodically performed history taking, the average degree to which accident-related information was noted, the average degree to which treatment goals were determined and recorded in agreement with individual prognostic health profiles and the time phase since an accident, and the average degree to which physiotherapy modalities agreed with treatment goals and with time phases since an accident.

Step 3: expert and user appraisal of QIs

The expert panel (n = 27) evaluated the preliminary set of 28 QIs as being clear and precise, with unambiguous language. The experts judged all indicators to be (very) relevant in the clinical reasoning process (scores 4 and 5 on a five-point Likert scale). The user panel (n = 15) evaluated the 28 QIs as completely clinically acceptable and feasible (score 5 on a five-point Likert scale). This procedure resulted in a set of 28 QIs with content validity and accompanying criteria.

Step 4: classification of QIs

The QIs were classified per step of the clinical reasoning process in physiotherapy care, including the level of evidence. A complete overview of these 28 indicators per step of the clinical reasoning process is presented in Supplementary S3 and includes type of indicator, the number of items, the level of evidence, and the performance target per indicator. QI 19 was supported by level I evidence; indicator 20 by level II evidence; indicators 11, 14, and 15 by level II–IV evidence; and indicators 1–10, 12, 13, 16–18, 21, 27, 28 by level IV evidence.

Step 5: classification of outcome indicators

In the case of step VIII “Evaluation”, four outcome indicators were classified including: subjective evaluation of treatment goals and return to work (indicators 22 and 23), objective evaluation of posttreatment measures of pain (VAS) and functioning (NDI) (indicator 24), GPE (indicator 25), and duration of treatment, period, and number of treatment sessions (indicator 26). Indicators 24 and 25 were supported by levels I and II evidence, respectively, and indicators 22, 23, and 26 by level IV evidence.

Phase II: RCD

Eight physiotherapists at two primary care physiotherapy practices in the South of the Netherlands collected data over a period of 16 years. The mean age of the physiotherapists (n = 8) at the beginning of the study was 46.2 years (SD = 5.6), six were male and six were manual physiotherapists. The range of practice experience regarding patients with WAD varied between 6 and 28 years.

The number of referrals per year is presented in Figure 2. In total, 810 patients were referred by a GP (n = 549) or by a medical specialist (n = 164) or were self-referred (open access to physiotherapy was introduced in the Netherlands in 2005) (n = 97). Following an initial interview related to the 5 D’s + 1 (dizziness, diplopia, drop attacks, dysarthria, dysphagia, plus nausea), 10 patients were excluded due to red flags.34

Figure 2 Number of referrals per year 1996–2011 (N = 810).

Diagnostic process

The diagnostic process for the total group (N = 810) is presented in Table 1. Most patients were referred 4 weeks to <6 months after an accident (n = 651; 80.4%), having undergone extensive prior diagnostics and treatment, including medical imaging neck diagnostics (n = 178; 22.0%), cervical soft neck collar (n = 514; 63.4%), pain medication (n = 369; 45.6%), and (manual) physiotherapy (n = 332; 40.0%). A cervical collar was worn for an average of 3.9 weeks (SD = 2.0). The most commonly applied prior therapeutic modalities were manual therapy (mobilization and manipulation) (n = 234; 70.1%) and massage therapy (n = 210; 63.3), and the least applied modalities were active exercise therapy (n = 194; 58.4%) and coaching and education (n = 20; 6.0%). In addition to neck pain, a number of complaints were reported in a substantial proportion of patients (n = 804; 99.3%; ≥3 complaints: dizziness, headache, tinnitus, and cognitive impairments). Most patients were classified as WAD 2 (n = 555; 68.5%) with a delayed recovery rate (n = 441; 54.4%). A number of potentially negative indicators for recovery were reported, including observation of pain behavior (n = 577; 92.9%), >3 Waddell’s (modified Sobel’s) signs (n = 530; 92.2%), use of passive coping (n = 443; 54.7%), and fear avoidance (n = 467; 57.7%). Somewhat more than half of all patients were classified as Health Profile C (n = 441; 54.4%) (delayed recovery, high intensity pain, increasing pain, decreasing activities). The diagnostic process of Group A 1996–2002 (n = 353) compared with Group B 2003–2011 (n = 457) is presented in Table 1.

Table 1 Diagnostic process: differences between Group A 1996–2002 (n = 353) and Group B 2003–2011 (n = 457) regarding the clinical reasoning process in patients with Whiplash-associated disorders (WAD)
Notes: aP ≤ 0.05; NS, non significant; -, no statistics. bModified Waddell’s signs: tenderness, stimulation, cervical Range of Motion (ROM), regional disturbance, and overreaction. cPsychological questionnaires: Fear Avoidance Beliefs Questionnaire (FABQ) and Pain Coping Inventory (PCI). dClassification: WAD 0: no neck symptoms, no physical sign(s); WAD 1: neck pain, stiffness or tenderness only, no physical sign(s); WAD 2: neck symptoms and musculoskeletal sign(s); WAD 3: neck symptoms and neurological sign(s); WAD 4: neck symptoms and fracture or dislocation; eHealth Profile: Profile A: normal recovery, low intensity of pain, decreasing pain, increasing activities; Profile B: inestimable recovery, middle intensity of pain, persistent pain, persistent activity limitations; Profile C: delayed recovery, high intensity of pain, increasing pain, decreasing activities.

Accident-related characteristics, previous diagnostics and treatment, and current health status and recovery rates differed significantly (P ≤ 0.05) between the groups. However, there was no significant difference between the groups in terms of sociodemographic characteristics and preexistent health status. All patients in both groups underwent musculoskeletal examination. The frequency of neurological examinations was not significantly different between the groups. Conversely, the frequency of the otoneurological and psychological examinations differed significantly between groups, occurring more frequently in Group B. Some potential prognostic factors for recovery were significantly less favorable (P ≤ 0.05) in Group B (longer period since accident, more serious functioning problems, longer delay in recovery, greater number and variety of complaints, more passive coping, more fear avoidance, and greater likelihood of classification in health profile C). However, other potential prognostic factors for recovery were significantly (P ≤ 0.05) more favorable in Group B (fewer medical imaging diagnostics, less use of and shorter time in cervical soft collar, and less pain medication). The overall prognostic factors for recovery were significantly less favorable for Group B. Furthermore, the indication “physiotherapy” differed significantly (P ≤ 0.05) between Group A (n = 353; 100%) and Group B (n = 398; 87.1%).

Therapeutic process

The therapeutic process for the total group (N = 810) is presented in Table 2. The treatment goals in 529 (65.3%) patients agreed with prognostic health profiles and time Phases I–VI since an accident. Physiotherapy modalities agreed with treatment goals and best available evidence in 442 (83.6%) of 529 patients. Treatment duration was ≥4 months in 530 (65.4%) patients and the number of treatment sessions was ≥16 in 469 (57.9%) patients.

Table 2 Therapeutic and evaluative process: differences between Group A 1996–2002 (n = 353) and Group B 2003–2011 (n = 457) regarding the clinical reasoning process in patients with Whiplash-associated disorders (WAD) N = 810; n (%) unless otherwise stated
Notes: aP ≤ 0.05; bNo statistics: n ≤ 20 ; /-, no statistics.
Abbreviation: GPE, global perceived effect.

The therapeutic process in Group A 1996–2002 (n = 353) compared with Group B 2003–2011 (n = 457) is presented in Table 2. The treatment goals for all phases (except Phases I, IIIa, and IVa; no statistics when n < 20 per phase) differed significantly (P ≤ 0.05) between the groups, and more closely agreed in Group B with the prognostic health profile and time Phases I–VI since an accident. Group B also showed significantly closer agreement (P ≤ 0.05) between the application of physiotherapy modalities and treatment goals and best available treatment evidence. For instance, we noted a significant shift (P ≤ 0.05) toward evidence-based (combinations of) physiotherapy modalities in Group B, including less massage therapy (Group B 17.6% vs Group A 60.9%) and more cognitive and physical principle-based exercise therapy (Group B 91.2% vs Group A 35.6%).

Evaluative process

The evaluative process for the total group (N = 810) and for Groups A (n = 353) and B (n = 457) is presented in Table 2. The frequency of contacts with physicians in case of unsatisfactory treatment results differed significantly between groups (Group A: n = 67 [19.0%] vs Group B: n = 180 [39.4%]). The outcome measures pain intensity (VAS), functioning (NDI), and GPE were introduced in 2002. The use of these outcome measures differed significantly (P ≤ 0.05), in favor of Group B. In addition, the duration of treatment was significantly (P ≤ 0.05) shorter and the number of treatment sessions was significantly (P ≤ 0.05) greater for Group B. A final discharge report was written for all patients in both groups.

QIs: performance targets

The mean percentages of the indicator scores per step of the clinical reasoning process and per group were presented in Table 3.

Table 3 Differences between Group A 1996–2002 (n = 353) and Group B 2003–2011 (n = 457) expressed as percentages of QIs of the clinical reasoning process and performance target for physiotherapy in patients with Whiplash-associated disorders (WAD)
Notes: aDescription of type and number of variables per indicator for analysis: see Supplementary S2; bFull description of indicators: see Supplementary S3; cLevels of evidence: I = systematic review or >2 high-quality controlled trials or high-quality diagnostic studies or high-quality psychometric studies; II = two high-quality controlled trials or high-quality diagnostic studies or high-quality psychometric studies; III = high-quality noncontrolled trials or low-quality diagnostic studies or low-quality psychometric studies; IV = experts opinion and professional consensus or standard.
Abbreviations: NDI, Neck Disability Index; VAS, Visual Analog Scale; QI, quality indicator; ICF, International Classification of Functioning, Disability, and Health.

Twelve indicators (1, 2, 3, 5, 6, 8, 11, 17, 21, 23, 26, and 27) met performance targets in both periods. Compared with Group A, the mean scores in Group B were significantly higher (P ≤ 0.05) for indicators 1, 2, 5, 10, 14, 15, and 22, with only indicators 3 and 7 showing higher scores in Group A compared with Group B. Twelve of the 25 indicators (48.0%) in Group A and 19 of 26 indicators (73.1%) in Group B met the performance targets of ≥80% or ≤30%. The performance targets of two indicators (16 and 28) were nondefined. The difference between the groups, expressed as number of target indicators met, significantly favored Group B (P ≤ 0.05).

Discussion

In this study, we first systematically developed a novel set of QIs that reflect the clinical reasoning process used in primary care physiotherapy for patients with WAD. In the only study of its type, we then used these QIs to track trends in the quality of primary care physiotherapy of WAD patients over an extended period (16 years; 1996–2011). This analysis was made possible by patient data systematically gathered in a routine setting using a high-quality patient record regularly updated in accordance with the latest guidelines and recommendations. Having defined the quality of physiotherapy care as the degree to which patients were subjected to a methodically performed clinical reasoning process, our analysis suggests that the quality of care improved following the adoption of the Dutch CPG Physiotherapy Management and WAD in 2002.2,3 In addition, fewer QIs met performance targets in the period 1996–2002 compared with the period 2003–2011.

During the development of QIs related to the (improvement of) quality of care, we identified a number of studies that described the implementation of CPGs4851 but no study used a methodology comparable to ours. Similar physiotherapy studies were found5257 but these studies focused on different patient groups and different scores for quality improvements.5860 International consensus on performance targets and scoring procedures would improve the comparability of studies on the quality of physiotherapy care.

High-quality patient record and the clinical reasoning process

Due to the absence of a gold standard regarding the quality of the clinical reasoning process, we developed a patient record that described requirements for physiotherapy documentation based on the first draft of the national CPG in 1995,24 and later updated it based on new CPGs.61 Our patient record included a clinical reasoning process algorithm relevant to patients with WAD and is comparable to general instruments such as the Hypothesis-Oriented Algorithm for Clinicians.62,63 In our opinion, a well-organized, guideline-based patient record is an indispensable instrument when the goal is quality improvement of the physiotherapy clinical reasoning process in clinical practice.

Set of QIs

The validity of the QIs was ensured by carefully chosen panels of both experts and users, and the clarity, relevancy, acceptability and feasibility of the QIs received substantial support in terms of face and content validity. Although no other stakeholders were involved in the process of QI development, we accept the varied perspectives of patients, health insurers, policy makers, and other stakeholders.64

The levels of evidence established for QIs were largely consistent with the Dutch CPG Neck Pain (including WAD) published in 201612 and with international CPGs,46,911 with most evidence based on the psychometrics of psychological questionnaires and outcome indicators, while evidence supporting recommendations on diagnosis, prognosis, and treatment was often weak to moderate at best.46,912 Establishing a higher level of evidence will require an ongoing effort, drawing on a mixture of scientific research, clinical practice and observation, and based on a multivariable diagnostic and therapeutic approach, with support from multiple stakeholders (including patients).6466

Quality improvement

Although 12 indicators already met performance targets before 2002, the number of positively assessed indicators for performance targets continued to improve over the period 2003–2011. The most striking quality improvements were seen in the analysis and conclusion of the diagnostic process, and in the frequency of use of outcome measures such as pain intensity, functioning, and GPE. However, ceiling effects (indicator = 100%) were noted for five indicators (8, 11, 21, 26, and 27), suggesting that critical assessment of these QIs is warranted.

Seven indicators (7, 9, 10, 13, 18, 20, and 22) failed to meet performance targets in either period. Earlier findings also suggested that indicators including previous diagnostics and treatment, objectives of examination, treatment plan, and treatment and evaluation represent the weakest links in the clinical reasoning and decision-making process.67 Nevertheless, in both periods the mean scores for most indicators were ≥70% and thus sufficient, suggesting that participating physiotherapists were already applying recommended management approaches, resulting in a limited improvement on some of the QIs. This explanation corresponds to the findings of another implementation study in which a tailored, multivariate guideline implementation was compared with usual practice.68 In that study, it appeared that usual care was broadly in line with recommendations even before implementation.68 The future development, implementation, and evaluation of QIs should elaborate on the findings of these studies.

RCD vs randomized controlled trial (RCT)

The data on WAD patients in this study were collected routinely over a period of 16 years, in a large population, and without narrow inclusion and exclusion criteria, under routine care conditions that differ from the artificial conditions of a RCT. To the best of our knowledge, there are currently no other examples of the use of RCD in the (manual) physiotherapy management of WAD patients.

RCD offer several advantages. Data collection under real-life practice conditions maximizes representativeness and generalizability, minimizes costs and effort, and allows the capture of information from large populations and many clinical practices over long periods. However, these advantages should be viewed with caution as errors and biases due to incomplete registration can interfere with results.22 To use RCD properly, some challenges may have to be overcome.69 Consequently, in order to assess the quality of our findings, we compared our data to the criteria of the Reporting of Studies Conducted using Observational Routinely collected Data statement and found that most criteria were met.70

The use of RCD generally represents a useful alternative for understanding the quality of physiotherapy care as many evidentiary gaps currently exist concerning prognostics, diagnostics, and treatment in patients with WAD. RCD on physiotherapy management in patients with different phases of WAD may provide a more complete view of the clinical reasoning process and a more comprehensive and realistic view of routine practice than data gathered during an RCT. In the majority of RCTs (n = 122) involving patients with nonspecific neck pain, the clinical reasoning process was reportedly incomplete, specifically in the diagnostic aspect of the process, with only 6% of the RCTs including a complete diagnostic process.71

Compared with RCTs, there is little empirical guidance on the interpretation of RCD evidence. We need to develop tools for assessment of bias risk, generalizability, and data validity and to discuss the limitations of RCTs and whether these limitations can be best overcome through optimal use of RCD. Despite these limitations, we expect that the RCD underlying this study could plausibly act as preliminary evidence concerning (manual) physiotherapy management and WAD and could be used to improve the design of future RCTs. In conclusion, while improvement of RCT quality is an important goal, broadening our focus to include improved, accurate documentation of patient records is also worth considering.

A shifting diagnostic process: patient characteristics and prognostic factors

Many characteristics and prognostic factors have shifted in the direction of chronicity (and delayed recovery). Internationally, the proportion of patients with chronic WAD is now around 20%–40%.72 The increase in the proportion of patients with chronic WAD in Group B reflects an increase in the number of patients with multiple complaints (>7), more unfavorable prognostic factors (Waddell’s sign >3), greater use of passive coping, and more fear avoidance. This shift conflicts with one of the primary goals of patient management in primary care, namely prevention of WAD chronicity.

However, although notes in early records were based on the clinical observation of pain behavior, coping and fear avoidance, and on an inventory of symptoms of central sensitization during the process of history taking, a gradual shift has taken place toward the application of validated psychological questionnaires (coping: Pain Coping Inventory73 and fear avoidance: Fear Avoidance Beliefs Questionnaire).74

A systematic use of psychological questionnaires, including psychological factors prognostic for recovery,75,76 was introduced as a component of patient records in 2002 and symptoms related to central sensitization were added in 2009.

Based on the gradual improvement in the evidence supporting prognostic factors for WAD, a further update of patient records should now be considered, with greater emphasis on initial pain during anamnesis; postinjury psychological factors, such as coping, mood, and fear of movement; and pain (especially chronic pain) associated with a hypervigilant nervous system.7780 Better understanding and skills in the application and interpretation of measurement instruments will allow physiotherapists to assess these factors earlier in the process of care and will aid development of an adequate therapeutic intervention. However, these new features of patient records will require active implementation strategies, particularly in history taking, clinical assessment, and individual interpretation of the questionnaire score, before visible changes and quality improvements can be expected.

A shifting therapeutic process: treatment plan and treatment

Following changes in treatment goals as a function of the time since an accident, physiotherapy modalities have shifted in the direction of evidence- and guideline-based treatment (see Supplementary S1). In the current study, we noted relatively large changes in the use of physiotherapy modalities in Group B, which presumably indicates broader implementation of guideline-based interventions. For example, massage therapy was the most frequently applied intervention (70%) in the period 1996–2002, but this intervention declined to around 40% in the period 2003–2011. By contrast, the use of (cognitive and physical) active exercise therapy has increased from 35% in the period 1996–2002 to 90% in the period 2003–2011.

At the present time, the physiotherapy modalities active exercise therapy, patient coaching, and pain education, in combination with pain medication and manual therapy, are the recommended primary interventions for patients at different stages of Whiplash injury. The positive effect of these physiotherapy modalities (or combinations of) compared to placebo or other treatment is supported by low-to-moderate levels of evidence.9,8190

A shifting evaluative process

Treatment effects were evaluated by interviewing patients both during and after completion of treatment, and this approach was consistently applied during the entire study period. However, the proportion of patients with chronic WAD increased substantially in the period 2003–2011. Consequently, contacts with physicians were more frequent, the duration of treatment was between 4 and 6 months for most patients, and the number of treatment sessions increased (>16 sessions). The recently published Dutch CPG Neck pain (including WAD) advises only three sessions for patients with profile A (normal recovery, low intensity of pain, decreasing pain, and increasing activities), with no advice regarding other profiles.12 As the average number of sessions noted in this study differs markedly from the number covered by health insurance in the Netherlands, a gap clearly exists between clinical practice and health insurance policy.

The use of recommended and validated questionnaires (VAS, NDI, and GPE) to provide an objective evaluation at the end of treatment began in 2003 and remains in line with current CPG recommendations on physiotherapy management and WAD.12 The frequency of use of these questionnaires was presented as a process indicator rather than as an outcome indicator. An evaluation of the scores of these questionnaires as an outcome indicator will be presented in manuscript in preparation.

Limitations

The principal limitation of this retrospective cohort study was that it was conducted in only two primary care physiotherapy practices in the Netherlands and included data collected by eight physiotherapists in total. Although the characteristics of the participating physiotherapists were comparable to the national average91 and the patient sample was comparable to participants in another Dutch study,92 the number of participating practices and physiotherapists may have limited generalizability and thus reduced the external validity of the results. A major concern for future studies should be recruitment of a greater number of participating practices and physiotherapists, thus substantially enhancing generalizability and the ability to investigate the psychometrics of the set of QIs.

Another limitation was that although this study took international literature and CPGs into account, it was conducted within the framework of Dutch primary care physiotherapy and specifically within the established framework for patients with WAD. This implies that the results may be more relevant to the Dutch situation and perhaps less applicable internationally. Nevertheless, although national in scope, many of the lessons learned will surely resonate with an international audience.

Conclusion

Bearing in mind the goals of this study, its limitations, and the possibly limited external validity of the results, we cautiously conclude that 1) the systematic development of a preliminary set of QIs is a valid approach; 2) RCD can provide valuable information on trends and improvements in the quality of primary physiotherapy care; and 3) the quality of physiotherapy management of patients with WAD met the predetermined performance targets based on the preliminary set of QIs.

Author contributions

All authors contributed to data analysis, drafting and revising the article, gave final approval of the version to be published, and agree to be accountable for all aspects of the work.

Disclosure

The authors report no conflicts of interest in this work.


References

1.

Spitzer WO, Skovron ML, Salmi LR, et al. Scientific monograph of the Quebec Task Force on Whiplash-associated disorders: redefining “whiplash” and its management. Spine. 1995;20(8 Suppl):1S–73S.

2.

Bekkering GE, Hendriks HJM, Lanser K, et al. KNGF-richtlijn Whiplash. Ned Tijdschr Fysiother. 2001;111(3 supplement):S1–S25.

3.

Scholten-Peeters GG, Bekkering GE, Verhagen AP, et al. Clinical practice guideline for the physiotherapy of patients with whiplash-associated disorders. Spine. 2002;27(4):412–422.

4.

Leigh TA. Best Practices Task Force. Clinical Practice Guidelines for the Physiotherapy Treatment of Whiplash-Associated Disorders. Vancouver, BC: Physiotherapy Association British Columbia; 2004.

5.

Moore A, Jackson A, Jordan J, et al. Clinical Guidelines for the Physiotherapy Management of Whiplash-Associated Disorder (WAD). London: Chartered Society of Physiotherapy; 2005.

6.

TRACsa. Clinical Guidelines for Best Practice Management of Aacute and Chronic Whiplash Associated Disorders: Clinical Resource Guide. Adelaide: South Australian Centre for Trauma and Injury Recovery; 2008.

7.

Hurwitz EL, Carragee EJ, van der Velde G, et al. Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. Treatment of neck pain: noninvasive interventions: results of the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. Spine. 2008;33(4 Suppl):S123–S152.

8.

Carroll LJ, Holm LW, Hogg-Johnson S, et al. Course and prognostic factors for neck pain in whiplash-associated disorders (WAD): results of the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. J Manipulative Physiol Ther. 2009;32(2 Suppl):S97–S107.

9.

Sterling M. Physiotherapy management of whiplash-associated disorders (WAD). J Physiother. 2014;60(1):5–12.

10.

Côté P, Wong JJ, Sutton D, et al. Management of neck pain and associated disorders: a clinical practice guideline from the Ontario Protocol for Traffic Injury Management (OPTIMa) Collaboration. Eur Spine J. 2016;25(7):2000–2022.

11.

Bussières AE, Stewart G, Al-Zoubi F, et al. The treatment of neck pain-associated disorders and Whiplash-associated disorders: a clinical practice guideline. J Manipulative Physiol Ther. 2016;39(8):523–564.

12.

Bier JD, Scholten-Peeters GGM, Staal JB, et al. KNGF-Richtlijn Nekpijn. Amersfoort: Koninklijk Nederlands Genootschap voor Fysiotherapie; 2016. Dutch.

13.

Farmer AP, Légaré F, Turcot L, et al. Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008;3(3):CD004398.

14.

Rebbeck T, Macedo LG, Maher CG. Compliance with clinical guidelines for whiplash improved with a targeted implementation strategy: a prospective cohort study. BMC Health Serv Res. 2013;13(1):213.

15.

Jull GA, Söderlund A, Stemper BD, et al. Toward optimal early management after whiplash injury to lessen the rate of transition to chronicity: discussion paper 5. Spine. 2011;36(25 Suppl):S335–S342.

16.

Higgs J, Jones MA, Loftus S, Christensen N. Clinical Reasoning in the Health Professions. Edinburgh: Butterworth-Heinemann; 2008:3–18.

17.

Jones MA, Rivett DA. Clinical Reasoning for Manual Therapists. Edinburgh: Butterworth-Heinemann; 2004:1–24.

18.

Campbell S, Braspenning J, Hutchinson A, Marshall M. Research methods used in developing and applying quality indicators in primary care. In: Grol R, Baker R, Moss F, editors. Quality Improvement Research: Understanding the Science of Change in Health Care. London: BMJ Publishing Group; 2004:6–28.

19.

Lawrence M, Olesen F. Indicators of quality in health care. Eur J Gen Pract. 1997;3(3):103–108.

20.

Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15(6):523–530.

21.

Hoque DME, Kumari V, Hoque M, Ruseckaite R, Romero L, Evans SM. Impact of clinical registries on quality of patient care and clinical outcomes: a systematic review. PLoS One. 2017;12(9):e0183667.

22.

Hemkens LG, Contopoulos-Ioannidis DG, Ioannidis JP. Routinely collected data and comparative effectiveness evidence: promises and limitations. CMAJ. 2016;188(8):E158–E164.

23.

Heerkens Y, van den Heuvel J, van Klaveren T, van Ravensberg D, van den Heuvel C, van Meeteren N. Classification Allied Health Care – Version Physiotherapy. Amersfoort: Nederlands Paramedisch Instituut; 1995. Dutch.

24.

KNGF. Richtlijnen voor de Fysiotherapeutische Verslaglegging. Amersfoort: Koninklijk Nederlands Genootschap voor Fysiotherapie; 1993. Dutch.

25.

Brook RH, Mcglynn EA, Shekelle PG. Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000;12(4):281–295.

26.

de Kooning M, Daenen L, Cras P, Gidron Y, Roussel N, Nijs J. Autonomic response to pain in patients with chronic whiplash associated disorders. Pain Physician. 2013;16(3):E277–E285.

27.

de Kooning M, Daenen L, Roussel N, et al. Endogenous pain inhibition is unrelated to autonomic responses in acute whiplash-associated disorders. J Rehabil Res Dev. 2015;52(4):431–440.

28.

van Oosterwijck J, Nijs J, Meeus M, Paul L. Evidence for central sensitization in chronic whiplash: a systematic literature review. Eur J Pain. 2013;17(3):299–312.

29.

Meeus M, Nijs J, Hamers V, Ickmans K, Oosterwijck J. The efficacy of patient education in whiplash associated disorders: a systematic review. Pain Physician. 2012;15(5):351–361.

30.

Nijs J, van Houdenhove B, Oostendorp RA. Recognition of central sensitization in patients with musculoskeletal pain: application of pain neurophysiology in manual therapy practice. Man Ther. 2010;15(2):135–141.

31.

Nordin M, Carragee EJ, Hogg-Johnson S, et al. Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. Assessment of neck pain and its associated disorders: results of the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and Its Associated Disorders. Spine. 2008;33(4s):S110–S122.

32.

Dutton M. Orthopedic Examination, Evaluation and Intervention. New York: McGraw-Hill Medical Publishing Division; 2004.

33.

Gerard JA, Kleinfield ST. Orthopedic Testing. New York: Churchill Livingstone; 1993.

34.

Greenhalgh S, Selfe J. RedFlags: A Guide to Identifying Serious Pathology of the Spine. Edinburgh: Churchill Livingstone; 2006.

35.

Harms-Ringdal K, Nachemson A. Acute and subacute neck pain: nonsurgical treatment. In: Nachemson AL, Jonsson E, editors. Neck and Back Pain: The Scientific Evidence of Causes, Diagnosis, and Treatment. Philadelphia: Lippincott Williams & Wilkins; 2000:327–338.

36.

van Tulder M, Goossens M, Hoving J. Nonsurgical treatment of chronic neck pain. In: Nachemson AL, Jonsson E, editors. Neck and Back Pain: The Scientific Evidence of Causes, Diagnosis and Treatment. Philadelphia: Lippincott Williams & Wilkins; 2000:339–354.

37.

World Health Organization. International Classification of Functioning, Disability and Health. Geneva: WHO; 2001.

38.

Schwarzkopf SR, Ewert T, Dreinhöfer KE, Cieza A, Stucki G. Towards an ICF Core Set for chronic musculoskeletal conditions: commonalities across ICF Core Sets for osteoarthritis, rheumatoid arthritis, osteoporosis, low back pain and chronic widespread pain. Clin Rheumatol. 2008;27(11):1355–1361.

39.

Scholten RJPM, Tuut MK, Kremer LCM, Assendelft WJJ. Beoordelen van de kwaliteit van medisch-wetenschappelijk onderzoek. In: Van Everdingen JJE, Burgers JS, Assendelft WJJ, Swinkels JA, Van Barneveld TA, Van de Klundert JLM, editors. Evidence-Based Richtlijnontwikkeling. Houten: Bohn Stafleu Van Loghum; 2004:158–171. Dutch.

40.

Pietrobon R, Coeytaux RR, Carey TS, Richardson WJ, Devellis RF. Standard scales for measurement of functional outcome for cervical pain or dysfunction: a systematic review. Spine. 2002;27(5):515–522.

41.

Wewers ME, Lowe NK. A critical review of visual analogue scales in the measurement of clinical phenomena. Res Nurs Health. 1990;13(4):227–236.

42.

Vernon H, Mior S. The Neck Disability Index: a study of reliability and validity. J Manipulative Physiol Ther. 1991;14(7):409–415.

43.

Stratford P, Gill C, Westaway M. Assessing disability and change on individual patients: a report of a patient specific measure. Physiotherapy Canada. 1995;47(4):258–263.

44.

Pool JJ, Ostelo RW, Hoving JL, Bouter LM, de Vet HC. Minimal clinically important change of the Neck Disability Index and the Numerical Rating Scale for patients with neck pain. Spine. 2007;32(26):3047–3051.

45.

Ostelo RW, de Vet HC. Clinically important outcomes in low back pain. Best Pract Res Clin Rheumatol. 2005;19(4):593–607.

46.

Nijs J, van Oosterwijck J, de Hertogh W. Rehabilitation of chronic whiplash: treatment of cervical dysfunctions or chronic pain syndrome? Clin Rheumatol. 2009;28(3):243–251.

47.

Walton DM, Pretty J, Macdermid JC, Teasell RW. Risk factors for persistent problems following whiplash injury: results of a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2009;39(5):334–350.

48.

Rebbeck T, Maher CG, Refshauge KM. Evaluating two implementation strategies for whiplash guidelines in physiotherapy: a cluster randomised trial. Aust J Physiother. 2006;52(3):165–174.

49.

van der Wees PJ, Jamtvedt G, Rebbeck T, de Bie RA, Dekker J, Hendriks EJ. Multifaceted strategies may increase implementation of physiotherapy clinical guidelines: a systematic review. Aust J Physiother. 2008;54(4):233–241.

50.

Rebbeck T, Macedo LG, Maher CG. Compliance with clinical guidelines for whiplash improved with a targeted implementation strategy: a prospective cohort study. BMC Health Serv Res. 2013;13(13):213.

51.

Corkery MB, Edgar KL, Smith CE. A survey of physical therapists’ clinical practice patterns and adherence to clinical guidelines in the management of patients with whiplash associated disorders (WAD). J Man Manip Ther. 2014;22(2):75–89.

52.

Jansen MJ, Hendriks EJ, Oostendorp RA, Dekker J, De Bie RA. Quality indicators indicate good adherence to the clinical practice guideline on “Osteoarthritis of the hip and knee” and few prognostic factors influence outcome indicators: a prospective cohort study. Eur J Phys Rehabil Med. 2010;46(3):337–345.

53.

Peter WF, Hurkmans EJ, van der Wees PJ, Hendriks EJ, van Bodegom-Vos L, Vliet Vlieland TP. Healthcare quality indicators for physiotherapy management in hip and knee osteoarthritis and rheumatoid arthritis: a Delphi study. Musculoskeletal Care. 2016;14(4):219–232.

54.

Gijsbers HJ, Lauret GJ, van Hofwegen A, van Dockum TA, Teijink JA, Hendriks HJ. Development of quality indicators for physiotherapy for patients with PAOD in the Netherlands: a Delphi study. Physiotherapy. 2016;102(2):196–201.

55.

Rutten GM, Harting J, Bartholomew LK, Schlief A, Oostendorp RA, de Vries NK. Evaluation of the theory-based Quality Improvement in Physical Therapy (QUIP) programme: a one-group, pre-test post-test pilot study. BMC Health Serv Res. 2013;13:194.

56.

Nijkrake MJ, Keus SH, Ewalds H, et al. Quality indicators for physiotherapy in Parkinson’s disease. Eur J Phys Rehabil Med. 2009;45(2):239–245.

57.

Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE. A systematic review of quality indicators for evaluating pediatric trauma care. Crit Care Med. 2010;38(4):1187–1196.

58.

Scholte M, Neeleman-van der Steen CW, Hendriks EJ, Nijhuis-van der Sanden MW, Braspenning J. Evaluating quality indicators for physical therapy in primary care. Int J Qual Health Care. 2014;26(3):261–270.

59.

Braspenning JCC, Pijnenborg L, Grol RPTM. Ontwikkelen van kwaliteitsindicatoren. In: Braspenning JCC, Pijnenborg L, In ’t Veld CJ, Grol RPTM, editors. Werken aan Kwaliteit in de Huisartsenpraktijk. Indicatoren Gebaseerd op de NHG-Standaarden. Houten: Bohn Stafleu Van Loghum; 2005:10–20. Dutch.

60.

Pijnenborg L, Bouma M, Braspenning JCC, Witmer H. Toepassen van kwaliteitsindicatoren. In: Braspenning JCC, Pijnenborg L, In ’t Veld CJ, Grol RPTM, editors. Werken aan Kwaliteit in de Huisartsenpraktijk. Indicatoren Gebaseerd op de NHG-Standaarden. Houten: Bohn Stafleu Van Loghum; 2005:21–30. Dutch.

61.

Heerkens YF, Lakerveld-Heyl K, Verhoeven ALJ, Hendriks HJM. KNGF-richtlijn Fysiotherapeutische Verslaglegging. Ned Tijdschr Fysiother. 2007;117(6):Supplement 1–20. Dutch.

62.

Rothstein JM, Echternach JL. Hypothesis-oriented algorithm for clinicians. A method for evaluation and treatment planning. Phys Ther. 1986;66(9):1388–1394.

63.

Rothstein JM, Echternach JL, Riddle DL. The Hypothesis-Oriented Algorithm for Clinicians II (HOAC II): a guide for patient management. Phys Ther. 2003;83(5):455–470.

64.

van der Weijden T, Légaré F, Boivin A, et al. How to integrate individual patient values and preferences in clinical practice guidelines? A research protocol. Implement Sci. 2010;5:10.

65.

van Trijffel E, Lindeboom R, Bossuyt PM, et al. Indicating spinal joint mobilisations or manipulations in patients with neck or low-back pain: protocol of an inter-examiner reliability study among manual therapists. Chiropr Man Therap. 2014;22:22.

66.

Jones MA, Jensen G, Edwards I. Clinical reasoning in physiotherapy. In: Higgs J, Jones M, Loftus S, Christensen N, editors. Clinical Reasoning in the Health Professions. Edinburgh: Butterworth-Heinemann; 2008:193–204.

67.

Oostendorp RA, Rutten GM, Dommerholt J, Nijhuis-van der Sanden MW, Harting J. Guideline-based development and practice test of quality indicators for physiotherapy care in patients with neck pain. J Eval Clin Pract. 2013;19(6):1044–1053.

68.

Bernhardsson S, Larsson MEH. Does a tailored guideline implementation strategy have an impact on clinical physiotherapy practice? A nonrandomized controlled study. J Eval Clin Pract. Epub 2018 May 28.

69.

Jorm L. Routinely collected data as a strategic resource for research: priorities for methods and workforce. Public Health Res Pract. 2015;25(4):e2541540.

70.

Benchimol EI, Smeeth L, Guttmann A, et al. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015;12(10):e1001885.

71.

Maissan F, Pool J, de Raaij E, Mollema J, Ostelo R, Wittink H. The clinical reasoning process in randomized clinical trials with patients with non-specific neck pain is incomplete: a systematic review. Musculoskelet Sci Pract. 2018;35:8–17.

72.

Ioppolo F, Rizzo RS. Epidemiology of whiplash-associated disorders. In: Alpini DC, Brugnoni G, Cesarani A, editors. Whiplash Injuries: Diagnosis and Treatment. Italia: Springer Verlag; 2014:13–16.

73.

Kraaimaat FW, Bakker B, Evers AWM. Pijncoping-strategieën bij chronische pijn patiënten: De ontwikkeling van de Pijn-Coping-Inventarisatielijst (PCI). Gedragstherapie. 1997;3:185–201. Dutch.

74.

Waddell G, Newton M, Henderson I, Somerville D, Main CJ. A Fear-Avoidance Beliefs Questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. Pain. 1993;52(2):157–168.

75.

Vangronsveld KL, Peters M, Goossens M, Vlaeyen J. The influence of fear of movement and pain catastrophizing on daily pain and disability in individuals with acute whiplash injury: a daily diary study. Pain. 2008;139(2):449–457.

76.

Campbell L, Smith A, Mcgregor L, Sterling M. Psychological factors and the development of chronic Whiplash-associated disorder(s): a systematic review. Clin J Pain. 2018;34(8):755–768.

77.

Bohman T, Côté P, Boyle E, Cassidy JD, Carroll LJ, Skillgate E. Prognosis of patients with whiplash-associated disorders consulting physiotherapy: development of a predictive model for recovery. BMC Musculoskelet Disord. 2012;13:264.

78.

Carstensen TB. The influence of psychosocial factors on recovery following acute whiplash trauma. Dan Med J. 2012;59(12):B4560.

79.

Carroll LJ, Holm LW, Hogg-Johnson S, et al. Course and prognostic factors for neck pain in whiplash-associated disorders (WAD): results of the Bone and Joint Decade 2000–2010 Task Force on Neck Pain and its associated disorders. Spine. 2008;33(4 Suppl):S83–S92.

80.

Kamper SJ, Rebbeck TJ, Maher CG, Mcauley JH, Sterling M. Course and prognostic factors of whiplash: a systematic review and meta-analysis. Pain. 2008;138(3):617–629.

81.

Walton DM, Elliott JM. An Integrated Model of Chronic Whiplash-Associated Disorder. J Orthop Sports Phys Ther. 2017;47(7):462–471.

82.

Michaleff ZA, Maher CG, Lin CW, et al. Comprehensive physiotherapy exercise programme or advice for chronic whiplash (PROMISE): a pragmatic randomised controlled trial. Lancet. 2014;384(9938):133–141.

83.

Meeus M, Nijs J, Hamers V, Ickmans K, Oosterwijck JV. The efficacy of patient education in whiplash associated disorders: a systematic review. Pain Physician. 2012;15(5):351–361.

84.

van Son M, Zemouri C, Hoving J, Hulshof C, Frings-Dresen M. Update van de Kennis over Whiplash: Diagnose, Prognose, Interventies en Patiëntperspectief. Amsterdam: Coronel Instituut, Universiteit van Amsterdam; 2015. Dutch.

85.

Gross A, Langevin P, Burnie SJ, et al. Manipulation and mobilisation for neck pain contrasted against an inactive control or another active treatment. Cochrane Database Syst Rev. 2015;9:CD004249.

86.

Gross AR, Paquin JP, Dupont G, et al. Exercises for mechanical neck disorders: a Cochrane review update. Man Ther. 2016;24:25–45.

87.

Verhagen AP, Scholten-Peeters GG, van Wijngaarden S, de Bie RA, Bierma-Zeinstra SM. Conservative treatments for whiplash. Cochrane Database Syst Rev. 2007;2:CD003338.

88.

Patel KC, Gross A, Graham N, et al. Massage for mechanical neck disorders. Cochrane Database Syst Rev. 2012;9(9):CD004871.

89.

Gross A, Forget M, St George K, et al. Patient education for neck pain. Cochrane Database Syst Rev. 2012;3:CD005106.

90.

Malfliet A, Kregel J, Coppieters I, et al. Effect of pain neuroscience education combined with cognition-targeted motor control training on chronic spinal pain: a randomized clinical trial. JAMA Neurol. 2018;75(7):808–817.

91.

Van Hassel DTP, Kenens RJ. Cijfers uit de registratie van fysiotherapeuten. Peiling January 1, 2012. Available from: https://www.nivel.nl/sites/default/files/bestanden/Cijfers-uit-de-registratie-van-fysiotherapeuten-peiling-jan-2012.pdf. Accessed June 28, 2018.

92.

Scholten-Peeters GG, Neeleman-van der Steen CW, van der Windt DA, Hendriks EJ, Verhagen AP, Oostendorp RA. Education by general practitioners or education and exercises by physiotherapists for patients with whiplash-associated disorders? A randomized clinical trial. Spine. 2006;31(7):723–731.

Creative Commons License © 2018 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.