Back to Journals » Patient Preference and Adherence » Volume 13

Eliciting stakeholder preferences for patient-centered research

Authors Mostofsky E, Dunn JA, Hernández-Díaz S, Johansson AC, Mittleman MA

Received 30 June 2018

Accepted for publication 3 January 2019

Published 21 February 2019 Volume 2019:13 Pages 339—349

DOI https://doi.org/10.2147/PPA.S178765

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Professor Qizhi (Cathy) Yao



Elizabeth Mostofsky,1–3 Jillian A Dunn,3 Sonia Hernández-Díaz,3 Anna C Johansson,2,4 Murray A Mittleman1–4

1Cardiovascular Epidemiology Research Unit, Beth Israel Deaconess Medical Center, Boston, MA, USA; 2Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA; 3Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA; 4Department of Medicine, Harvard Medical School, Boston, MA, USA

Background: Rather than identifying exposures and outcomes for research solely based on interests of medical professionals, there is a need for research that answers questions that are important to patients, so that they may make treatment decisions based on evidence that reflect their individual preferences.
Objective: To identify exposures and outcomes of interest that could be studied with electronic health record data from inpatient care.
Design, setting, participants: Mixed-methods analysis of semi-structured interviews administered in 2017 to 76 patients and 26 physicians who receive or provide care at Beth Israel Deaconess Medical Center in Boston, MA.
Measurements: After conducting detailed semi-structured interviews about topics of interest that can be studied using electronic health records of inpatient care, we used an inductive approach to identify themes about the health care experience.
Results: Participants reported concerns about adverse effects of medication changes, drug interactions, and surgery and other invasive procedures. The outcomes of greatest concern to them were in-hospital deaths and hospital-acquired infections. Participants commented on the importance of clear communication and information transfers, the hospital environment, accurate skills and knowledge, and upholding patient dignity and respect.
Conclusion: Engaging patients and physicians in the research development process provided insight to the exposures and outcomes they consider important. Our questions about exposures and outcomes of interest were restricted to topics that could be studied with electronic health record data from inpatient care, but using a similar approach to elicit feedback about the health care experience could be used to glean insight for other areas of future research.

Keywords: patient-oriented methods, clinical, health communication

 

Background

Rather than identifying exposures and outcomes for research solely based on interests of medical professionals, there is a need for research that answers questions that are important to patients, so that they may make treatment decisions based on evidence that reflect their individual preferences.1,2

For instance, oncologists may place greater value on interventions that promote gains in survival, whereas patients may assign a higher value to treatments that enhance quality of life.3 By involving patients, caregivers, clinicians, and others involved in health care in identifying exposures and outcomes to be studied, the focus of clinical research may be more relevant to the community. Agencies such as the National Institutes of Health and Patient-Centered Outcomes Research Institute (PCORI) aim to close this gap by inviting stakeholders to engage in the research process.1 PCORI defines stakeholder as any individual or entity involved in the health care process, such as patients, caregivers, clinicians, community members, health care purchasers, payers, industry, hospitals and other health systems, policy makers, training institutions, and researchers.4

With the rapid expansion, integration, and availability of electronic health information such as inpatient medications, diagnoses, and procedures, there are new opportunities to conduct large studies with detailed health data without the need to recruit and interview patients or the need to rely on self-reported information.5 Yet this increased data availability has not been met with increased research to seek guidance on exposures and outcomes from interested parties. We therefore conducted a mixed methods study of 102 patients and physicians in a large tertiary care hospital. We implemented an approach to identify exposures and outcomes of interest to patients and physicians and that could be studied with electronic data generated during routine inpatient care.

Methods

Beth Israel Deaconess Medical Center (BIDMC) is a tertiary care teaching hospital with 673 beds and had 40,656 inpatient discharges in 2017. Embedded within BIDMC is a large, academic primary care practice, Health Care Associates (HCA), with four practice sites across the Boston-based medical center. In 2017, HCA provided care for over 41,500 patients with 271,063 outpatient visits. We identified a convenience sample of patients who receive their primary care at HCA and physicians who provide care for patients admitted to the BIDMC.

A convenience sample of HCA primary care providers provided written permission to contact potentially eligible individuals. To be eligible, patients had to communicate in English and have had at least one outpatient visit to HCA in the prior 24 months. Patients were contacted by a letter sent to their home with a description of the study and the opportunity to opt out. Reasons for opting out were collected. We also recruited a convenience sample of BIDMC-affiliated physicians who provide medical care for inpatients. We targeted physicians across a range of medical and surgical specialties as well as hospitalists. Physicians were contacted by email with a description of the study and option to opt out. We contacted patients by phone and physicians by email up to ten times to see if they were interested in participating in our study. All participants were mailed written information about the study and a copy of the informed consent form, and they were invited to complete the interview over the phone or in-person in a private office. Recruitment and data collection were conducted simultaneously; invitation letters were mailed in batches, follow-up calls were made in waves, and enrollment and interviews were scheduled as soon as participants agreed and were available.

All participants who enrolled in the study provided verbal consent. A single investigator conducted the semi-structured interview (see Supplementary materials) for all participants. The interviews were audio recorded. We asked participants to identify possible harmful exposures and consequent adverse outcomes in the hospital setting, and to rank their suggestions from highest to lowest priority as research targets. If the suggestions were not amenable to examination from routinely collected electronic health data, we asked participants to consider exposures and outcomes that would typically be recorded in electronic health records. We transcribed the recorded interviews to obtain information on exposures and outcomes of interest and to conduct qualitative analyses to gain greater insight about stakeholder interests and concerns. Study data were collected and managed using REDCap electronic data capture tools hosted at Harvard T.H. Chan School of Public Health.6

Analysis

We conducted a mixed methods study7 to gain insight about exposures and outcomes of interest to physicians and patients that can be studied using inpatient electronic health data, a rapidly expanding resource. In this approach, we combined quantitative and qualitative approaches, by asking participants about exposures and outcomes of interest, and calculating the frequency of each response. In addition to this quantitative presentation of the data, we used an inductive analysis8 of the qualitative data from the transcribed interviews about health exposures and outcomes. Using this approach, we identified themes in participants’ research interests that would not be readily apparent from their listed suggestions of exposures and outcomes. Three authors (EM, JD, and MAM) independently read transcribed interviews from five patients and five physicians to identify themes, and we developed definitions of these themes. Based on the themes, two authors (EM and JD) independently reviewed a second sample of five patient and five physician transcribed interviews, and coded the texts according to the identified themes. After a third reviewer (MAM) compared the coded interviews to assure that the themes were clearly defined, a fourth reviewer (ACJ) examined these interviews. The themes were further refined through discussion until we reached a final agreement by consensus. Transcripts were reviewed until themes reached saturation.

Results

The enrollment of study participants is depicted in Figure 1. Among 315 individuals contacted to participate, only 16% (49 patients and three physicians) declined to participate. We were unable to contact eight potential participants and there was one incomplete interview. Recruitment and enrollment happened simultaneously. Therefore, once the recruitment goals were met (n=76 patients and 26 physicians), we closed recruitment before we could follow-up and enroll the remaining 152 people. Of those who were invited, 102 completed the study (84 phone interviews, 18 interviews in-person) including 76 of the 236 (32%) patients and 26 of the 79 (33%) physicians.

Figure 1 Participant recruitment and enrollment process of 26 Beth Israel Deaconess Medical Center physicians and 76 Health care Associate patients from January to July 2017.

Approximately two-thirds of the participants in the study were women, the majority were White and had a high level of education (Table 1). The median time for completing the interview following the consent process was 28 minutes. Physicians were most likely to report exposures of medication changes and interactions, surgery and other invasive procedures, and exposure to lines, catheters and needles. Patients were also most likely to report exposures of medication changes and interactions and surgery and other invasive procedures, but they also frequently reported hospital-acquired infections. Regarding outcomes of great concern, physicians were most likely to report hospital-acquired infections and bleeding whereas patients were most likely to report death and hospital-acquired infections as the outcomes of greatest importance for future research using inpatient electronic health data. (Table 2).

Table 1 Characteristics of 102 patient and physician study participants from January–July 2017, mean ± standard deviation or n (%)
Abbreviation: GED, general educational development.

Table 2 Commonly reported exposures and outcomes of interest
Note: aSome participants suggested allergic reaction as an exposure that may result in higher risk of in-hospital mortality.

In addition to the specific exposures and outcomes identified by participants, our qualitative analysis allowed us to identify seven themes that provide context for physicians’ and patients’ values about the health care experience. Table 3 includes example statements from physicians and from patients related to each of the themes described below:

Table 3 Themes and representative quotes that emerged from stakeholder interviews

Theme 1 – Information transfers

Patients and physicians frequently commented on the importance of clear communication and accurate information transfer between providers and information transfer between providers and patients. Participants noted that being hospitalized was a good opportunity to clarify treatment confusion and communicate care instructions: “Being informed, well informed. Your doctor informing you of the pros and cons of whatever the illness is and how it is going to be treated.” Participants also noted the dangers of poor information transfer in the hospital. A physician stated that, “There are a lot of potential harms that are caused by human factors like poor communication.” Included here are provider teams working together to provide care. Participants commonly reported communication as an exposure of interest, suggesting that there is a prevalent concern that communication affects health outcomes.

Theme 2 – Processes of care

Participants shared several examples of the processes of care formalized through protocols and procedures to address quality measures, health monitoring, and obtaining extensive medical histories. The organizational environment that accounts for each step within a patient’s care was highlighted: “The use of IVs and catheters and all of the, all of the other instruments that hospitals seem to take a great care to ensure that those are properly disposed of and carefully wrapped and protected, you know, prior to use so that’s probably a good thing that’s happening right now.”

Theme 3 – Provider skills and knowledge

Both patients and physicians noted the importance of a provider’s ability to perform necessary and appropriate procedures, to have adequate knowledge of treatment, and to properly diagnose patients; they also voiced concerns that a lack of knowledge and skill can result in errors with adverse consequences. For instance, participants frequently suggested infection as an important adverse event in the hospital setting, and they posited that it may be attributable to provider skills. A patient said, “You’re relying on somebody to do their job well and make sure the tools are sterile.” The avoidance of this harm depends on provider’s skill and knowledge. Provider skills and knowledge were also noted as impacting a patient’s trust and confidence on their providers’ skills.

Theme 4 – Proposing solutions

When prompted about possible hospital harms and outcomes, participants provided a means of solving or dealing with an issue or difficult situation. For instance, medication changes and interactions was a commonly reported exposure of interest and allergic reactions ranked high on reported outcomes of interest. One patient suggested the harm of taking a medication that causes discomfort, and began to propose a solution: “The doctor could maybe at that point throttle the dosage or change to a secondary type of medication vs the patient sitting in discomfort and maybe isn’t tolerating the medication properly.”

Theme 5 – Respect

Participants expressed the importance of upholding patient dignity and respect for their privacy and cited the lack of respect as negative outcome in the hospital setting. When prompted about good hospital exposures and outcomes, a patient offered, “You know, being treated with respect.”

Theme 6 – Support and relationships

Participants highlighted the value of providers’ or caregivers’ willingness to provide support, give assistance beyond necessary protocol measures, and formulate rapport and relationships. From the care and attention of caregivers who “go the extra mile” to social and psychological support, participants shared their appreciation for “Developing a better relationship whether it’s with a doctor or an ongoing provider. I think that’s important, especially with older people … and if you have a new provider every time that could be a challenge, so establishing a relationship would be a positive.”

Theme 7 – Normalizing risk

Although participants commonly reported invasive procedures and hospital-acquired infections as exposures of interest, they also recognized that there is some inevitable level of heightened risk in an in-patient setting: “It’s easy to get an infection in the hospital because it’s the hospital and people are ill,” says one patient; while a physician stated, “… even with all possible precautions taken, I think there’s going to be some degree of infection.”

Discussion

In this study, we aimed to include patients and physicians in identifying exposures and outcomes for clinically relevant research by asking what topics were important to them that could be studied with electronic data from inpatient care. We implemented an approach for gaining insight about exposures and outcomes of interest to patients and physicians so that they may make treatment decisions based on evidence that reflect their preferences.9 The high recruitment success depicted in Figure 1 shows that patients and physicians are interested, willing, and able to offer their perspectives.

The opportunity to use mixed methods techniques to identify themes and gain additional insight about values and concerns of the patients and physicians proved to be both achievable and informative. By obtaining information about exposures and outcomes of interest and combining these findings with an in-depth thematic analysis of the participants’ process in responding to those questions, we were able to glean greater insight into how the respondents’ interests and concerns might have shaped their preferences and their ranking of the priority of these preferences. Furthermore, we identified themes that offered a different framework for understanding patient and physician preferences that would not have emerged without the inductive approach, including comments about an inevitable level of risk in the inpatient setting and the theme of proposing solutions to the concerns that had been raised.

There is increasing interest in addressing the importance of including stakeholders in the research development process.1,4 Basic research that is publicly funded needs to consider and protect the public’s interests.10 Clinical research has room to involve patients and clinicians; patients are prepared to participate in and help formulate meaningful research questions.1 Different methods have been suggested for eliciting feedback from patients and other stakeholders, including satisfaction surveys and focus groups, presenting hypothetical treatment scenarios, and encouraging participants to elaborate on their understanding of presented choices.9,1113 For example, the Prospective Measure of Preference method measures patient preferences and surgeon choice in complex decision-making that provides choices between standard treatment and alternate options. Identifying treatment preferences is a useful tool to assess willingness of taking part in a specific surgery and allows research to focus on trials that may be most effective.11 The benefits and feasibility of involving the community in the research process has been reported extensively in the literature about methods for community-based participatory research (CBPR) that are used in behavioral research.1416 This approach involves communities in all aspects of the research process,16 adding to the cost and time to conduct these projects, but also potentially improving the relevance and timeliness of the project.15 Despite the known value of CBPR and mixed-methods techniques17 their relevance for epidemiology,18 and the recognized importance of patient-centered care, studies involving qualitative data remain rare in clinical settings.

We identified patients who receive outpatient medical care at a large urban teaching hospital, since these are individuals who are likely to represent the population who are admitted to this hospital, and we identified physicians involved in the care of inpatients. The patient and physician experience may vary by the area of medicine and prognosis of the health outcomes. For instance, the perspective and interests of patients and physicians facing issues related to acute care may be different from those who are involved in the decision-making process for preventive services, cancer screening, elective surgeries, and palliative care. By using methods for qualitative analysis, we were able to gain a deeper understanding about gaps in knowledge and issues involved in transitions in care and health communication. The incorporation of mixed methods research in clinical settings presents greater insight on research questions and understanding of complex health problems.19

Our sample includes people at risk of being hospitalized at BIDMC, but not necessarily people who have been hospitalized. Our participants may have different perspectives and exposures and outcomes of interest than those who are currently facing choices required of inpatient care. They may differ from patients who receive care in suburban practices, concierge practices, safety net hospitals, or community health centers. Rather than recruiting a sample from a large urban hospital, other interview studies have been conducted in a range of settings. For example, a qualitative study with palliative care patients about meaning-making was conducted at a large research institution, a community hospital, and a community mobile clinic.20 Across these settings, they collected information about patients’ perspectives and found through chronic and life-limiting illnesses, emphasizing relationships was central to meaning-making. Future research could further explore the diversity of patient research interests within varying clinical settings.

There are some limitations to our study that warrant discussion. This moderately sized study is based on a convenience sample comprised of interested patients and physicians at BIDMC who were available to complete the interview. Therefore, the responses of our participants may not reflect those of other more diverse populations. For instance, we were not able to include other stakeholders, such as health care purchasers, payers, industry, hospitals and other health systems, policy makers, training institutions, and researchers.4 Furthermore, the exposures and outcomes suggested by the study participants are contingent on the health care experiences of the respondents and their friends and relatives. In addition, our questions about exposures and outcomes of interest for research were restricted to topics that could be studied with electronic health record data recorded in the routine course of inpatient care, whereas research on the questions that are most important to patients and physicians may not be possible using electronic health record data. The themes identified with the inductive approach are inevitably shaped by the individuals conducting the analysis, but the study authors include people with different clinical and research backgrounds. Our team includes a clinical physician, epidemiologist, social psychologist, and early career social science researcher.

Patient engagement is needed to identify high-priority research questions. Integrating mixed methods into clinical research can expand our understanding of exposures and outcomes that are of interest to stakeholders such as patients and physicians in order to help develop relevant, responsive research. By gathering this information, patient-centered research can provide greater insight to new outlooks on the health care experience. Our results provide further evidence of the feasibility of incorporating these important perspectives.

Acknowledgments

We thank Stephanie Li (Decision Support Specialist, Beth Israel Deaconess Medical Center) and the InSIGHT Core in the Center for Health care Delivery Science at Beth Israel Deaconess Medical Center for their assistance in creating the list of potential study participants. This work was funded by a grant from the Patient-Centered Outcomes Research Institute (ME-1507-31028) and a KL2/Catalyst Medical Research Investigator Training award (an appointed KL2 award) from Harvard Catalyst | The Harvard Clinical and Translational Science Center (National Center for Research Resources and the National Center for Advancing Translational Sciences, National Institutes of Health Award KL2 TR001100). The content is solely the responsibility of the authors and does not necessarily represent the official views of Harvard Catalyst, Harvard University and its affiliated academic health care centers, or the Patient-Centered Outcomes Research Institute.

Disclosure

The authors report no conflicts of interest in this work.


References

1.

Fleurence R, Selby JV, Odom-Walker K, et al. How the patient-centered outcomes Research Institute is engaging patients and others in shaping its research agenda. Health Aff. 2013;32(2):393–400.

2.

Frank L, Forsythe L, Ellis L, et al. Conceptual and practical foundations of patient engagement in research at the patient-centered outcomes Research Institute. Qual Life Res. 2015;24(5):1033–1041.

3.

Dilla T, Lizan L, Paz S, et al. Do new cancer drugs offer good value for money? The perspectives of oncologists, health care policy makers, patients, and the general population. Patient Prefer Adherence. 2016;10:1–7.

4.

PCORI Website [webpage on the Internet]. PCORI’s Stakeholders; 2018. Available from: https://www.pcori.org/engagement/what-we-mean-engagement/pcoris-stakeholders. Accessed October 22, 2018.

5.

Krumholz HM. Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system. Health Aff. 2014;33(7):1163–1170.

6.

Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381.

7.

Wisdom J, Creswell JW. Mixed Methods: Integrating Quantitative and Qualitative Data Collection and Analysis While Studying Patient-Centered Medical Home Models. Rockville, MD: Agency for Healthcare Research and Quality; February 2013. AHRQ Publication No. 13-0028-EF.

8.

Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2006;27(2):237–246.

9.

Byrne CM, Tan KK, Young JM, Selby W, Solomon MJ. Patient and clinician preferences for surgical and medical treatment options in ulcerative colitis. Colorectal Dis. 2014;16(4):285–292.

10.

Department of Health and Human Services NIoH. NIH Response to the Conference Report Request for a Plan to Ensure Taxpayers’ Interests are Protected; 2001. Available from: https://www.ott.nih.gov/sites/default/files/documents/policy/wydenrpt.pdf. Accessed May 15, 2018.

11.

Young JM, Solomon MJ, Harrison JD, Salkeld G, Butow P. Measuring patient preference and surgeon choice. Surgery. 2008;143(5):582–588.

12.

Kauffman KS, Dosreis S, Ross M, Barnet B, Onukwugha E, Mullins CD. Engaging hard-to-reach patients in patient-centered outcomes research. J Comp Eff Res. 2013;2(3):313–324.

13.

Wilde-Larsson B, Larsson G. Patients’ views on quality of care and attitudes towards re-visiting providers. Int J Health Care Qual Assur. 2009;22(6):600–611.

14.

Wallerstein NB, Duran B. Using community-based participatory research to address health disparities. Health Promot Pract. 2006;7(3):312–323.

15.

Flicker S. Who benefits from community-based participatory research? A case study of the positive youth project. Health Educ Behav. 2008;35(1):70–86.

16.

Salimi Y, Shahandeh K, Malekafzali H, et al. Is community-based participatory research (CBPR) useful? A systematic review on papers in a decade. Int J Prev Med. 2012;3(6):386–393.

17.

Lucero J, Wallerstein N, Duran B, et al. Development of a mixed methods investigation of process and outcomes of community-based participatory research. J Mix Methods Res. 2018;12(1):55–74.

18.

Leung MW, Yen IH, Minkler M. Community based participatory research: a promising approach for increasing epidemiology’s relevance in the 21st century. Int J Epidemiol. 2004;33(3):499–506.

19.

Tariq S, Woodman J. Using mixed methods in health research. JRSM Short Rep. 2013;4(6):2042533313479197.

20.

Sloan DH, Brintzenhofeszoc K, Mistretta E, Cheng MJ, Berger A. The influence of relationships on the meaning making process: patients’ perspectives. Ann Palliat Med. 2017;6(3):220–226.

Supplementary material

Semi-structured interview data collection form

Research topics

Based on today’s discussion, you will help us identify important research topics that can be studied in people who are hospitalized. We will ask you for guidance on the most meaningful way to report the results of these studies. This will allow us to help physicians and patients make informed decisions. Thank you for taking the time to participate in this study.

What questions do you have at this point?

We are aiming to think of exposures and how they may affect your risk of “adverse events.” An adverse event means “harm to a patient as a result of medical care.”1 A report from the Inspector General stated more than 1 in 5 hospitalized patients experience an adverse event, of either permanent or temporary harm.

We have used this report to identify the leading causes of harmful hospital exposures and their complications. We are interested in hospital exposures that vary over time such as drugs or therapies that are taken every so often, surgeries, and other procedures. Further, we are interested in hospital complications that occur suddenly without warning such as a change in mental status, abnormally low blood sugar, inhaling materials into the lungs, and infections.

We will be asking you about the relationships between exposures and their potentially harmful results. An example of a relationship between exposures and their outcomes is the use of a catheter and developing an infection.

What questions do you have at this point?

The relationships that you identify will guide research priorities in future studies using information from patients hospitalized at Beth Israel Deaconess Medical Center. We will not be looking at your medical records and we will not ask you about your personal medical history. We are more interested in hearing your thoughts and suggestions and because of this, there are no right or wrong answers.

Do you have any questions before we begin?

  1. We are hoping to identify different adverse events that patients may experience during a hospital stay. The underlying causes that lead to adverse events can result in permanent or temporary harm. What are possible causes of hospital harms and the effects they may have on one’s health in the hospital?
    • Probe: Let’s think about some adverse events that might happen in the hospital

      Follow up: What might a patient be exposed to for that complication to occur?

    • Probe: These may be issues that have affected you, someone you care about, or issues that you wonder about. What relationships between hospital exposures and outcomes are important to you, your family, or your colleagues/friends?
    • Redirect: If conversation is about slowly developing outcomes – Can you think of an example of events that happen suddenly without warning; something you might be able to observe within a hospital stay?
    • Close out: Based on our discussion, you recommended that researchers focus on the following harms and adverse events. Can you please rank this list from most to least importance to you?
  2. On the other hand, can you help identify good things that might happen in a hospital setting?

Table S1 Exposures and outcomes during a hospital stay and ranking of perceived importance


Reference

1.

Office of the Inspector General. Adverse Events in Hospitals: National Incidence Among Medicare Beneficiaries. OEI-06-09-00090. Washington, DC: US Department of Health and Human Services; 2010.

Creative Commons License © 2019 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.