Back to Journals » Journal of Multidisciplinary Healthcare » Volume 9

Attributes of innovations and approaches to scalability – lessons from a national program to extend the scope of practice of health professionals

Authors Masso M, Thompson C

Received 29 April 2016

Accepted for publication 7 July 2016

Published 26 August 2016 Volume 2016:9 Pages 401—410

DOI https://doi.org/10.2147/JMDH.S111688

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Scott Fraser



Malcolm Masso, Cristina Thompson

Centre for Health Service Development, Australian Health Services Research Institute, University of Wollongong, Wollongong, NSW, Australia

Abstract: The context for the paper was the evaluation of a national program in Australia to investigate extended scopes of practice for health professionals (paramedics, physiotherapists, and nurses). The design of the evaluation involved a mixed-methods approach with multiple data sources. Four multidisciplinary models of extended scope of practice were tested over an 18-month period, involving 26 organizations, 224 health professionals, and 36 implementation sites. The evaluation focused on what could be learned to inform scaling up the extended scopes of practice on a national scale. The evaluation findings were used to develop a conceptual framework for use by clinicians, managers, and policy makers to determine appropriate strategies for scaling up effective innovations. Development of the framework was informed by the literature on the diffusion of innovations, particularly an understanding that certain attributes of innovations influence adoption. The framework recognizes the role played by three groups of stakeholders: evidence producers, evidence influencers, and evidence adopters. The use of the framework is illustrated with four case studies from the evaluation. The findings demonstrate how the scaling up of innovations can be influenced by three quite distinct approaches – letting adoption take place in an uncontrolled, unplanned, way; actively helping the process of adoption; or taking deliberate steps to ensure that adoption takes place. Development of the conceptual framework resulted in two sets of questions to guide decisions about scalability, one for those considering whether to adopt the innovation (evidence adopters), and the other for those trying to decide on the optimal strategy for dissemination (evidence influencers).

Keywords: diffusion of innovations, extended scope practice, evaluation, multidisciplinary models of care, scalability

Introduction

The catalyst for this paper was the evaluation of a national program, the Expanded Scopes of Practice (ESOP) Program, to extend the scope of practice of health professionals in Australia through introducing new multidisciplinary models of care. The focus of the program was to investigate the extent to which each role could be implemented on a national scale and the conditions under which the roles would be most likely to succeed.

Twenty-six organizations were funded across four subprojects, involving extended roles for paramedics in primary care, physiotherapists in emergency departments (EDs), nurses conducting endoscopies, and nurses in EDs. In total, 224 health professionals participated, at 36 sites.

The primary aim of this paper is not to report on the results of the evaluation, which are available in a series of comprehensive reports.14 Rather, it is to describe how the results and lessons learned from evaluating the program were used to develop a conceptual framework for determining how to scale up innovations. Planning for “scaling up” is often overlooked.5

The framework (the “Conceptual Framework for Scaling up Innovations”) draws in part on a systematic review of the literature on the diffusion of innovations.6 We illustrate the use of the framework with case studies from the program evaluation. The relevant terms used in the paper are defined in Table 1.

Table 1 Definitions of terms

Evaluation methods

Evaluation of the ESOP program took place between 2012 and 2014, using a mixed-methods approach. The evaluation was based on a framework that has been used for over 10 years to evaluate a wide variety of health programs. The framework recognizes that implementation is influenced by the setting in which it takes place, the individuals involved, and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers, and the care delivery system and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalizability, and dissemination.7

Quantitative data were obtained from routine administrative data sets at three time points (baseline, implementation, and postimplementation) for more than 29,000 patients treated by the extended scope practitioners. Surveys were distributed to a sample of patients to collect data on patient experiences and satisfaction with the care provided. A 20-item questionnaire was sent to those working in extended roles to elicit their experiences, including job satisfaction, relationships with other staff, consumer acceptability, and their opinions on the sustainability of the roles. Professional colleagues of those working in extended roles were surveyed with a 15-item questionnaire designed to collect data on their understanding, opinions, and attitudes regarding the extended roles. Qualitative data were collected from documentation produced by each project and during site visits. Semistructured interviews were conducted with purposively sampled key stakeholders and each extended scope practitioner.

Interviews were recorded and transcribed. Transcripts were imported into NVivo software to facilitate data analysis. Thematic analysis was undertaken, starting with an initial set of codes informed by the evaluation framework that was amended and refined as data analysis progressed with inclusion of additional codes developed inductively to ensure the best fit with the data. Quantitative data were analyzed using Excel, SAS 9.2, SPSS (Chicago, IL, USA) and relevant comparisons made across time and implementation site. Data for each survey were compiled into one worksheet and checked by members of the evaluation team prior to analysis. The evaluation was approved by the University of Wollongong/South Eastern Sydney and Illawarra Area Health Service Human Research Ethics Committee and consent was implied by the completion of the survey.

Conceptual framework

Taking an innovation that has been tested in one or more locations and getting that innovation adopted more widely can be framed in various ways. From the perspective of researchers, the issue is one of generalizability, the process of conducting studies so that general conclusions can be drawn from particular instances,8 of which there are three types: statistical generalization, analytic generalization, and case-to-case translation (transferability).9 Within the context of the ESOP program, the most relevant type was that of transferability, ie, an innovation in one setting is considered for adoption in another setting.

From the perspective of policy makers and decision makers, the issue of scaling up innovations essentially involves a decision about their role. Do they act passively, allowing the innovation to be implemented in an uncontrolled, unplanned, way, or do they take a more active role by “pushing” the innovation by the various means at their disposal. It has been suggested that this can be conceptualized as a continuum, ranging from pure diffusion to active dissemination, involving three main mechanisms:

  1. “Let it happen”: Allowing innovations to be adopted in a “natural” way, with individual organizations making their own decisions about whether to adopt an innovation. This approach is unpredictable and self-organizing.
  2. “Help it happen”: The process of innovation adoption is facilitated, influenced, and enabled.
  3. “Make it happen”: The adoption of innovations is managed formally, typically by a central agency.6

Øvretveit,10 drawing on the international health literature, also identified three approaches: facilitated evolution, participatory adaptation, and hierarchical control. Facilitated evolution has been equated with “let it happen”, participatory adaptation with “help it happen”, and hierarchical control with “making it happen”.11

From the perspective of those thinking of adopting an innovation, there are many issues to consider. For example, do they have the capacity to implement the innovation, how will the innovation “fit” with existing services, and how acceptable will the innovation be to other members of the health care team or the wider health care professions? The evidence suggests that certain attributes of an innovation can influence adoption and implementation:

  • Relative advantage – The degree to which the innovation is better than what is in place already.
  • Compatibility – The innovation is compatible with the values and perceived needs of the adopting organization.
  • Complexity – The innovation is relatively simple. If the innovation is relatively complex, it helps if it can be broken down and implemented in stages.
  • Trialability – The innovation can be “tried out” before full adoption.
  • Observability – The benefits of the innovation (to either consumers or staff) are visible.
  • Adaptability – The innovation can be adapted for local use.
  • Risk – The innovation is perceived as low risk.6,12

These different perspectives indicate that three stakeholder groups should be involved in scaling up innovations, presented schematically in Figure 1:

  1. Evidence producers: Those involved in researching or evaluating an innovation, who not only have to conduct their work rigorously but also present their findings in a way that is useful to others.
  2. Evidence adopters: Those considering implementation of an innovation that has been tested elsewhere.
  3. Evidence influencers: Those in a position to facilitate scaling up.

Figure 1 Conceptual framework for scaling up innovations.

The field of international health has examples of approaches to “scaling up” innovations, particularly in public health, that align with this conceptual framework.13 Support for the framework also comes from a literature review which identified three categories of barriers hindering dissemination: 1) the research or evaluation design; 2) characteristics of the innovation; and 3) characteristics of the target setting.14 The underlying premise of the framework is that understanding innovation attributes and what is involved in implementation are part of deciding whether to make it happen, help it happen, or let it happen. In the context of the evaluation, it was particularly important to understand the impact of the innovation on other health care providers and members of the multidisciplinary health care team.14

Case study 1: extending the role of paramedics

This model centered on extended care paramedics (ECPs) managing lower acuity patients in their usual place of residence, with the potential to reduce the number of patients transported to hospital. Existing evidence generally supports the model but is primarily from overseas, particularly the United Kingdom, and more research is required to establish the effectiveness and safety of the model.15,16

The ECP role was relatively standardized, with local variations. At three sites, it operated in a solo capacity using a vehicle without the capacity to transport patients; at one site, the ECP worked with another paramedic as part of an existing emergency response service; and at another site, the ECP role was combined with another paramedic role. Training included a structured program of face-to-face teaching, simulations, clinical placements, and supervised practice.

The evaluation findings, framed in terms of “innovation attributes” are summarized in Table 2. The role worked well for patients (eg, less likelihood of being transported to hospital unnecessarily) but presented some difficulties for individual paramedics (eg, maintaining intensive care skills) and the ambulance service more generally (eg, the role requires sufficient throughput to reduce costs). The main requirements for successful implementation were as follows:

  • A receptive context for change.
  • Selecting personnel with the necessary skills, experience, and personal characteristics for the role.
  • Overcoming structural barriers such as funding models and role classification.2

Table 2 Innovation attributes of the ECP model


Abbreviation: ECPs, extended care paramedics.

A receptive context for change, a term used throughout this paper, includes factors such as a supportive organizational culture, key people leading change, clear goals, and appropriate infrastructure.17,18 The role of medical mentors was pivotal to successful implementation, providing ongoing support, clinical supervision, telephone advice, and backup for the ECPs.2

There were some legislative barriers to realizing the full potential of the role. For example, in some states and territories, amendments to legislation would be required for ECPs to prescribe medications and remove restrictions on the use and mobile storage of pharmaceuticals such as antibiotics. The inability to supply medicines meant that some patients had to be transported to an ED or general practitioner for this purpose.

Case study 2: extending the role of physiotherapists in emergency departments

Traditionally, physiotherapists assess and treat patients in EDs after initial assessment and referral by a medical practitioner (a secondary contact role). In contrast, this subproject involved primary contact physiotherapists (PCPs) assessing and treating patients with musculoskeletal (MSK) conditions without medical intervention, unless clinically indicated. Published evidence to support the PCP role is quite limited.1923

The evaluation findings, summarized in Table 3, indicate that the role works well for patients (eg, satisfaction with care by the PCPs). Clinically, the PCP model is compatible with current practice, but from the perspective of the care delivery system, it presented some challenges, primarily the need for sufficient throughput of low-acuity patients with MSK conditions to ensure efficiency. The number of such patients represented a quarter of all ED presentations, suggesting plenty of scope for PCPs to be utilized. However, PCPs treated only 9.5% of these presentations, with the low percentage due to three main factors: 1) patients with MSK conditions presenting when PCPs were not rostered on-duty; 2) occasions when there were too many patients with MSK conditions to be all seen by the available PCPs; and 3) “competition” for patients from other health professionals in the ED (medical staff and nurse practitioners).

Table 3 Innovation attributes of the PCP model


Abbreviations: PCP, primary contact physiotherapist; MSK, musculoskeletal; ED, emergency department.

The evaluation indicated that the main requirements for successful implementation were a receptive context for change and the availability of staff with the necessary skills.1 The key group for facilitating a receptive context was medical staff in the ED, by providing general support for the model and practical assistance in the form of mentoring, supervision, and assessment of clinical competencies.

Implementation required close collaboration with other disciplines working within the EDs. Most clinicians working in EDs are “generalists”, ie, they are capable of assessing and managing all types of patients who present. Introducing the PCP role, which only assessed and treated a specific patient cohort, introduced a complexity that was not present before.1

Legislation restricted full implementation of the role at some sites, eg, limitations on administering and prescribing medications.

Case study 3: extending the role of nurses to conduct endoscopies

The aim of this subproject was to train nurses to perform endoscopies previously only undertaken in Australia by doctors. Research from other countries indicates that for simple endoscopies nurses can achieve similar results for efficacy and safety to those achieved by doctors.24

Nurses were trained at five sites where they functioned as part of multidisciplinary teams, primarily medical, and other nursing staff. The focus of their training was almost entirely on colonoscopies. Two models of practice were implemented: one framed in terms of advanced practice nursing, and the other involving nurses training to become nurse practitioners. The net cost of training each nurse was estimated to be almost A$90,000.3

By the time the evaluation concluded, full implementation was not achieved, with some trainees still working to complete the required number of procedures and be assessed as competent. The relative advantage (effectiveness and cost effectiveness), observability (visible benefits), and risks of the model could therefore not be properly evaluated. The extensive training requirements mean that the role cannot be “tried out”, but once competency is achieved, the role is relatively straightforward. The role can be varied to meet local circumstances, but there are core elements that cannot be varied, particularly the training requirements, need for medical mentoring and supervision, and dedicated resources for performing endoscopies. Both models of nursing practice are acceptable, with the preferred model depending on local factors, particularly the need for nurses to work in an extended role (eg, prescribing, ordering pathology).

The main factors influencing implementation were a receptive context for change, selecting appropriate personnel, and the availability of a well-structured, well-resourced training program with strong medical supervision and mentorship supported by an ongoing credentialing process. Important characteristics of a receptive context were management support at all levels of the organization, engagement and support of key medical leaders, and adequate resources.3

The evaluation indicated two fundamental problems limiting wider implementation. First, training requires a critical mass of medical proceduralists to provide the necessary mentoring and clinical supervision. The presence of a critical mass reduces the need for nurse endoscopists once they are trained. Locations lacking medical proceduralists may have greater need for nurse endoscopists but are not well placed to provide the training. Second, only about a quarter of same-day colonoscopies are performed in public hospitals in Australia, with the remainder performed in private facilities. Doctors interviewed for the evaluation indicated fierce opposition to nurses performing colonoscopies (or any type of endoscopy) in the private sector.

Case study 4: advancing the role of nurses in emergency departments

This subproject involved a diverse range of organizations implementing different models of care to meet local needs with the common goal of improving patient flow through EDs. Of the eight projects, three targeted mental health patients, two targeted pediatric patients, two addressed the needs of rural hospitals, and one established a “review” clinic to follow-up patients initially seen in the ED. Six projects involved registered nurses working within a framework of clinical guidelines, protocols, and pathways, which were little different from the incremental expansion of nursing roles that has been occurring for many years. Two projects focused on the employment of nurse practitioners or nurses training to become nurse practitioners.

The projects were relatively small in scale, with the diversity and limited reach of the projects preventing a comparative analysis of incremental costs and consequences. Hence, the relative advantage and observability of each model was not established. The evaluation indicated that the models are compatible with accepted practice; the changes are relatively simple and can be “tried out”; the models can be adapted for local use; and the risks are low, as long as suitable clinical governance arrangements are in place. Any barriers to implementation were largely intraorganizational, rather than arising from the broader economic, policy, and legislative environment. An important enabling factor was the ability to work with other members of the health care team, either within the EDs or from other services, eg, liaison psychiatry service.4

Discussion

Across all four case studies, the evaluation findings indicated two key factors facilitating implementation; first, a receptive context for change, particularly the support of key medical staff and availability of appropriate infrastructure. Some of this “receptivity” can be influenced from outside but much of it relies on the intraorganizational environment. Second, the characteristics of the people working in the extended role, including their knowledge, skills, and experience. These findings, and our overall experience conducting the evaluation, became the basis for developing two sets of questions to guide decisions about scalability, one for evidence adopters and the other for evidence influencers (Table 4). For evidence influencers, answering the questions can assist in deciding whether to support the innovation and how to support the innovation. The questions have a different focus and use of language, and are framed in a different way, but the intent is consistent with the approach taken in the Institute for Healthcare Improvement’s “spread planner”.25 For example, the “spread planner” includes questions about the availability of resources and leadership to support the spread of innovations and the alignment of an innovation with organizational goals and incentives.

Table 4 Questions for scalability

The conceptual framework, answers to the scalability questions, and the evaluation findings suggest appropriate scaling up strategies for each model.

Extending the role of paramedics

In Australia, ambulance services are organized at the level of states and territories, managed fairly directly by the relevant government, ie, there are close links between evidence adopters (ambulance services) and evidence influencers (government). The evaluation findings provided support for the ECP role but indicated that adoption of the role requires careful thought regarding potential impact on individual paramedics and how the role fits within existing services. These findings suggest that decisions to adopt the role should be taken centrally by government and ambulance service leaders with a “make it happen” approach, leaving room for local variation in how the role is implemented.

Extending the role of physiotherapists in emergency departments

The evaluation findings indicated that the PCP role has the potential to provide a “relative advantage” over existing practice, with a caveat regarding the lack of evidence of cost effectiveness. The importance of local factors for successful implementation suggests that trying to impose the PCP role with a “make it happen” approach is likely to be unsuccessful. The specialist nature of the role requires careful consideration about how it “fits” with the existing practices to ensure efficiency.

One option for evidence influencers is to take a “let it happen” approach, leaving it up to evidence adopters to decide at a local level whether they wish to implement the role. However, another option is to take more of a “help it happen” approach. EDs in Australia are located almost entirely within publicly funded hospitals organized on a geographic basis. In the case of the PCP role, evidence influencers are likely to be found in government health departments or senior roles within local health services, with knowledge of hospitals likely to be receptive to the role. They will be in a position to identify any funding or legislative changes required to support the role and judge any potential economies of scale in training physiotherapists.

The significant resources developed in the ESOP program to train PCPs will require constant updating to ensure relevance, another example of where “help” can be provided. Other potential ways to “help” wider implementation include funding for hospitals that have already implemented the role to support other sites to implement the role. The need for further evidence to support wider implementation indicates a role for evidence producers (to conduct the research and disseminate the results) and evidence influencers (by funding the research and supporting dissemination).

Extending the role of nurses to conduct endoscopies

The evaluation findings indicate that wider implementation of nurse endoscopists would require considerable medical support and involve large training costs. The evaluation highlighted a fundamental contradiction – health services in the best position to train nurse endoscopists are in the least favorable position to justify the role once the nurses are trained.

This situation indicates a role for evidence influencers to take a “help it happen” approach with various forms of practical assistance, including funding to support implementation and development of a strategy, where some health services may train nurse endoscopists to work in other health services once they are trained.

The evaluation left some of the scalability questions unanswered, particularly regarding the relative advantage and productivity of the role, primarily because full implementation was not achieved during the timeframe of the program. Further research to answer these questions would support more informed decisions about wider implementation of the role, again indicating a role for evidence producers and evidence influencers.

Advancing the role of nurses in emergency departments

These models were diverse and relatively small in scale, limiting the ability to judge the merits of each model. However, the issue of increasing the scope of practice of nurses in EDs is an important one, particularly in rural and remote locations where securing adequate medical coverage can be problematic. There is an extensive literature on the merits of extending the role of nurses working in EDs, either as nurse practitioners26 or other extended roles.27,28 Rather than continuing to conduct small-scale local projects, it may be preferable to take a more strategic “make it happen” approach by implementing a particular model on a larger scale. This is already happening in one state (New South Wales) where registered nurses working in small rural hospitals are expected to have completed the First Line Emergency Care Course for Registered Nurses and function as advanced clinical nurses in accordance with specially formulated clinical guidelines.

Conclusion

The Conceptual Framework for Scaling up Innovations was developed iteratively during the evaluation of the ESOP program, based on our existing knowledge of the literature and evolving understanding of the projects we were evaluating. Many conceptual frameworks for disseminating research findings currently exist, with a tendency to emphasize the role of evidence producers.2931 There is a lack of emphasis in existing frameworks on the tripartite nature of knowledge exchange (evidence producers, evidence influencers, and evidence adopters) and little basis for helping evidence influencers to decide what they should do to facilitate the scaling up of innovations. This is the key contribution of our paper to improving knowledge of this challenging topic. Although developed within the context of a program on workforce reform, the framework has the potential to be applied to other health service innovations.

The “questions for scalability” were based on the conceptual framework and informed by the evaluation findings, providing a practical means of assisting evidence adopters and evidence influencers. For the evidence influencers, answering the questions helps the process of deciding what approach to take on the continuum from pure diffusion (“let it happen”) to active dissemination (“make it happen”). Examples of how this might be done were presented in the form of the four case studies. Answering the scalability questions can improve planning for the introduction of new extended roles that can help to realize the potential for such roles.32

Implementing effective health workforce reform is hard work. The right investment has the potential to deliver better care for consumers, optimize the skill mix and job satisfaction of the health workforce, and generate productivity benefits for the health system. The wrong investment has the potential to waste valuable resources. When policy makers consider the potential for scaling up health workforce innovations, they need to consider three main issues: 1) the attributes of an innovation (eg, relative advantage, adaptability); 2) the optimal sites for implementation; and 3) the broader economic, policy, and legislative environment within which implementation will take place. Our framework provides policy makers with a tool that can be used to consider these three issues in a systematic way.

The knowledge that attributes of innovations such as relative advantage and complexity can influence adoption is well known. This suggests that, from the perspective of potential adopters, it would be advantageous if the findings from research and evaluation were framed in this way. Our experience over many years of reading the results of research studies and evaluations is that this does not occur. For the evaluation of the ESOP program, we found this to be a useful exercise, not only in part to synthesize the results of a long and complex evaluation in a concise and useable way but also because of the direction this gave regarding scalability to policy makers.

Disclosure

The authors report no conflicts of interest in this work.

References

1.

Thompson C, Williams K, Morris D, Bird S, Kobel C. HWA Expanded Scopes of Practice Program Evaluation: Physiotherapists in the Emergency Department Sub-Project Final Report. Wollongong, Australia: University of Wollongong; 2014.

2.

Thompson C, Williams K, Morris D, et al. HWA Expanded Scopes of Practice Program Evaluation: Extending the Role of Paramedics Sub-Project Final Report. Wollongong, Australia: University of Wollongong; 2014.

3.

Thompson C, Williams K, Morris D, et al. HWA Expanded Scopes of Practice Program Evaluation: Advanced Practice in Endoscopy Nursing Sub-Project Final Report. Wollongong, Australia: University of Wollongong; 2014.

4.

Thompson C, Williams K, Morris D, Quinsey K, Bird S. HWA Expanded Scopes of Practice Program Evaluation: Nurses in the Emergency Department Sub-Project Final Report. Wollongong, Australia: University of Wollongong; 2014.

5.

Zullig LL, Bosworth HB. Selecting, adapting, and sustaining programs in health care systems. J Multidiscip Healthc. 2015; 8:199–203

6.

Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.

7.

Masso M, Quinsey K, Fildes D. Evolution of a multilevel framework for health program evaluation. Aust Health Rev. Epub June 16, 2016.

8.

Polit DF, Beck CT. Generalization in quantitative and qualitative research: Myths and strategies. Int J Nurs Stud. 2010;47:1451–1458.

9.

Firestone WA. Alternative arguments for generalizing from data as applied to qualitative research. Educ Res. 1993;22:16–23.

10.

Øvretveit J. Widespread focused improvement: lessons from international health for spreading specific improvements to health services in high-income countries. Int J Qual Health Care. 2011;23:239–246.

11.

Ilott I, Gerrish K, Pownall S, Eltringham S, Booth A. Exploring scale-up, spread, and sustainability: an instrumental case study tracing an innovation to enhance dysphagia care. Implement Sci. 2013;8:128.

12.

Rogers EM. Diffusion of Innovations, 5th edition. New York, NY: Free Press; 2003.

13.

Simmons R, Shiffman J. Scaling up health service innovations: a framework for action. In: Simmons R, Fajans P, Ghiron L, editors. Scaling Up Health Service Delivery: From Pilot Innovations to Policies and Programmes. Geneva, Switzerland: World Health Organization; 2007.

14.

Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007;28:413–433.

15.

Bigham BL, Kennedy SM, Drennan I, Morrison LJ. Expanding paramedic scope of practice in the community: a systematic review of the literature. Prehosp Emerg. Care 2013;17:361–372.

16.

Tohira H, Williams TA, Jacobs I, Bremner A. Finn J. The impact of new prehospital practitioners on ambulance transportation to the emergency department: a systematic review and meta-analysis. Emerg Med J. 2014;31(e1):e88–e94.

17.

Pettigrew AM, Ferlie E, McKee L. Shaping Strategic Change. London, UK: SAGE Publications; 1992.

18.

Dopson S, FitzGerald L, Ferlie E, Gabbay J, Locock L. No magic targets! Changing clinical practice to become more evidence based. Health Care Manag Rev. 2002;27:35–47.

19.

Desmeules F, Roy J, MacDermid JC, Champagne F, Hinse O, Woodhouse LJ. Advanced practice physiotherapy in patients with musculoskeletal disorders: a systematic review. BMC Musculoskelet Disord. 2012;13:107.

20.

Kilner E. What evidence is there that a physiotherapy service in the emergency department improves health outcomes? A systematic review. J Health Serv Res Policy. 2011;16:51–58.

21.

Gill SD, Stella J. Implementation and performance evaluation of an emergency department primary practitioner physiotherapy service for patients with musculoskeletal conditions. Emerg Med Australas. 2013;25:558–564.

22.

Guengerich M, Brock K, Cotton S, Mancuso S. Emergency department primary contact physiotherapists improve patient flow for musculoskeletal patients. Int J Ther Rehabil. 2013;20:396–402.

23.

Saxon RL, Gray MA, Oprescu FI. Extended roles for allied health professionals: an updated systematic review of the evidence. J Multidiscip Healthc. 2014;7:479–488.

24.

Day LW, Siao D, Inadomi JM, Somsouk M. Non-physician performance of lower and upper endoscopy: a systematic review and meta-analysis. Endoscopy. 2014;46:401–410.

25.

Institute for Healthcare Improvement. Spread Planner. Cambridge, MA: Institute for Healthcare Improvement; 2004.

26.

Jennings N, Clifford S, Fox AR, O’Connell J, Gardner G. The impact of nurse practitioner services on cost, quality of care, satisfaction and waiting times in the emergency department: a systematic review. Int J Nurs Stud. 2015;52:421–435.

27.

Considine J, Lucas E, Payne R, Kropman M, Stergiou HE, Chiu H. Analysis of three advanced practice roles in emergency nursing. Australas Emerg Nurs J. 2012;15:219–228.

28.

Hudson PV, Marshall AP. Extending the nursing role in Emergency Departments: challenges for Australia. Australas Emerg Nurs J. 2008;11:39–48.

29.

Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci. 2010;5:91.

30.

Mitton A, Adair CE, McKenzie E, Patten SB, Perry BW. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007;85:729–768.

31.

Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43:337–350.

32.

Morris J, Grimmer K, Gilmore L, et al. Principles to guide sustainable implementation of extended-scope-of-practice physiotherapy workforce design initiatives in Australia: stakeholder perspectives, barriers, supports, and incentives. J Multidiscip Healthc. 2014;7:249–258.

33.

Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, Weaver NL. A glossary for dissemination and implementation research in health. J Public Health Manag Pract. 2008;14:117–123.

34.

Simmons R, Fajans P, Ghiron L. Scaling Up Health Service Delivery: From Pilot Innovations to Policies and Programmes. Geneva: World Health Organization; 2007.

Creative Commons License © 2016 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.