Development of a New Patient-Reported Medication Adherence Instrument: Concerns Influencing Medication Adherence

Plain-Language Summary

In general, patients who take their medications as prescribed have better health outcomes than those who do not. This was a two-stage, multi-year, qualitative research study in persons diagnosed with atrial fibrillation or osteoarthritis, who were prescribed blood thinners or pain medications, respectively. Our intent was to develop a questionnaire that might help identify persons who are, or are likely to, not take their medications the way their health provider told them to, by asking small groups of patients to voice their concerns about their medicines. The result of our research is the Concerns Influencing Medication Adherence (CIMA) questionnaire, a new patient-reported questionnaire made up of 16 questions: 11 that might apply to several diseases, 3 that are specific to atrial fibrillation, and 2 that are unique to osteoarthritis. The CIMA questionnaire is meant to be used by all types of healthcare professionals in many settings. It was created using techniques recommended by the United States Food and Drug Administration (FDA). This study did not answer how the questionnaire might work outside the United States or in persons with other chronic diseases, although the 11 general questions may be useful in that situation.

Introduction

Medication adherence, which is the extent to which patients take their medication as prescribed and in agreement with their healthcare provider, is an important determinant of the safety and effectiveness of their therapy.¹ Optimal adherence is associated with improved health outcomes, such as reduced infectious disease transmission, reduced drug resistance, and lower healthcare utilization.^2,3 As many as 69% of medication-related hospital admissions are due to poor adherence.^4,5 In one recent study of 401 hospital readmissions, 26% were found to be potentially preventable and medication related. Of these, 23.8% were associated with nonadherence due to patient choice.⁶

Chronic conditions are often associated with low medication adherence rates.^1,3,7 It has been estimated that in the developed world only 50% of the persons with chronic disease take their medication as instructed.^8,9 Adherence rates in developing countries are believed to be much lower.⁸ How well patients adhere to a particular regimen is a function of complex and dynamic behaviors influenced by an array of internal and external factors.^1,8 Understanding the barriers and facilitators to optimal medication adherence is an important part of disease management.

A variety of instruments have been developed to collect information about medication adherence directly from patients. Some were developed for general use, others for use in specific conditions. One limitation of many currently available instruments is a lack of publicly available evidence of direct patient input and/or the use of past and future medication adherence mapping questions in developing the instrument content. This is now a key component to establishing content validity as described in the United States Food and Drug Administration’s (FDA) 2009 Guidance on Patient-Reported Outcomes (PROs)¹⁰ and the FDA Patient-Focused Drug Development Guidance Series for Enhancing the Incorporation of the Patient’s Voice in Medical Product Development and Regulatory Decision Making, which is in development.¹¹ Additional limitations of many available instruments include lack of testing in a formal setting using electronic administration and presence of user fees or licensing requirements which may pose barriers to widespread use. This adherence assessment instrument is being developed with a goal of addressing these limitations.

The research described here focused on identifying concerns patients have regarding their treatment that may have affected past medication adherence patterns and could potentially impact future adherence. The target populations were persons diagnosed with atrial fibrillation (AFib) who were prescribed oral anticoagulants and persons diagnosed with osteoarthritis (OA) who were prescribed over-the-counter (OTC) or prescription medications for their OA pain. These 2 populations were chosen because of the potentially deleterious effects of non-adherence (stroke in the case of persons with AFib and potential use of opiates for pain control in the case of persons with OA) and because they are of interest to the study sponsor. The objectives of this research were to understand, from the perspective of persons living with AFib or OA, the concerns that influence their decisions to initially fill and then refill their medication; and, with that understanding, to develop a content-valid adherence-assessment tool for identifying persons who are, or are likely to be, non-adherent to their AFib or OA medications. For the purpose of this study, non-adherence was defined as failure to obtain the first prescribed refill and/or non-persistent after the first prescribed refill. We report here the evidence to support the development and content relevance of the Concerns Influencing Medication Adherence (CIMA) instrument.

Materials and Methods

Development of this new adherence assessment tool followed the Best Practices outlined in the FDA’s 2009 PRO guidance.¹⁰ These include the use of literature reviews to understand past scientific insights on a given concept of interest; qualitative concept elicitation (CE) research to obtain direct patient input and point of view; and qualitative cognitive debriefing (CD) interviews to gauge respondent understanding of the instructions, item stems, categorical rating scales, and recall period. This was a two-stage, multi-year, qualitative research study that included content exploration and content confirmation and refinement (Figure 1).

Figure 1 Schematic of the instrument development flow.

Stage 1. Content Exploration

Stage 1 consisted of a targeted literature review followed by a series of CE focus groups from which a pool of draft concepts was developed.

Targeted Literature Review

Targeted literature searches were conducted using MEDLINE^® and Embase^® to identify peer-reviewed evidence relating to non-adherence to prescribed medications for AFib or OA, published in English between January 1, 2012, and October 1, 2018. The protocol for the search was developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines^12,13 and the Guidance on the Conduct of Narrative Synthesis in Systematic Reviews.¹⁴ After identifying and screening for relevance to AFib, OA, and adherence, a thorough review of the publications was conducted. Eligible publications included those reporting on studies in adult patients with self- or clinician-reported AFib or OA that examined regulatory approved treatments and presented evidence on medication initiation, implementation, and discontinuation behaviors. The following study types were included: qualitative or quantitative observational studies, systematic reviews and/or meta-analyses, adherence-intervention research, qualitative clinical research, or analyses of real-world evidence data among adult patients with AFib or OA.

In addition to the articles identified from the search, the reference list of each article deemed eligible for full-text abstraction was examined for any pertinent literature cited before 2012. Abstract and article screening was performed in 3 levels of increasingly in-depth review: title and abstract, full text, and data extraction. Articles were selected for full-text abstraction according to the following prioritization (from highest to lowest priority):

• Original qualitative research describing patients’ adherence value propositions (trade-offs between perceived benefits and risks), patients’ subjective prioritization of their AFib or OA, or patient-centered and modifiable adherence drivers (eg, self-reported reasons for adherence or non-adherence).
• Original research that describes the development and/or validation of adherence surveys or segmentation tools specific to AFib or OA or includes patients with AFib or OA.
• Narrative or systematic reviews, meta-analyses, or meta-ethnographies that focus on patient-centered and modifiable adherence drivers specific to AFib or OA.
• Original qualitative or quantitative research focusing on patient preferences concerning prescription medications for AFib or OA.
• Conference abstracts specific to medication adherence in AFib or OA.
• Publications reporting results only from administrative data (eg, pharmacy claims data that assess largely immutable drivers of non-adherence).
• For AFib, prioritization was given to publications that focus on direct-acting oral anticoagulants (DOACs) as opposed to warfarin.

The reviewers were not blind to the journal titles, study authors, or institutions. Reviewers resolved disagreements by discussion. The Principal Investigators adjudicated unresolved disagreements. The final list of articles deemed eligible for final abstraction (n=13 each for AFib^15–27 and OA^28–40) was submitted to the study team for final review and approval.

A thematic analysis⁴¹ was performed to assess the extracted data. This analysis involved reading then re-reading the extracted data to identify themes relating to initiation, implementation, and discontinuation of treatment regimens from the patient perspective, as well as caregiver and clinician perspectives, if available. When multiple perspectives were available, the results were compared to identify similarities and differences. Thematic analysis was conducted in 4 steps: in-depth reading of each article, abstraction of relevant findings, comparing and contrasting themes across AFib and OA separately, and final synthesis of data-driven themes. The abstracted data were assigned discrete conceptual labels and classified into descriptive qualitative themes. Codes were added through iterative review of the abstracted articles until a final coding schema emerged. The analysis was developed inductively (ie, directed by data content), whereby themes were developed through constant comparison of the similarities and differences in the abstracted data from the articles; both supportive and disconfirming evidence of the themes were identified.

Concept Elicitation Focus Groups

During November and December 2018, persons with AFib or OA were recruited by an experienced qualitative research recruitment firm to attend in-person focus groups at sites in Los Angeles, California and Philadelphia, Pennsylvania, United States (US). The objective was to understand patient-centered reasons for medication adherence and non-adherence. Discussion focused on the participants’ self-reported reasons for adherence or non-adherence to medications prescribed for their AFib or OA, including facilitators and barriers to optimal medication adherence, the beliefs and attitudes that influence their medication-taking, their knowledge and understanding about their disease and their prescription medications, and how aspects of the doctor–patient relationship influence their adherence.

A maximum of 12 focus groups (6 each for AFib and OA) was planned with approximately 80 participants in total. Interested participants were screened by telephone using a standardized script to evaluate eligibility and ensure recruitment targets were met. The focus groups were expected to last 1.5 hours and were conducted in sequence; saturation, the point at which no new themes emerge, was assessed sequentially. The groups were separated by gender to enhance open conversation and minimize biases associated with gender differentials in conversational dynamics.⁴² Semi-structured discussion guides were used to conduct the groups and all group discussions were audio-taped and transcribed.

Both the discussion guide and the transcript for each focus-group were reviewed to develop an a priori coding dictionary to capture important concepts of interest related to medication adherence, non-adherence, and medication-implementation errors raised by the participants. Transcripts were coded by trained coders to highlight participant responses to scripted probes, as well as any themes that emerged. Concept saturation was tracked on an ongoing basis following analysis of each focus group, thus enabling ongoing assessment and slight revision in content as the focus groups proceeded. At the end of the concept elicitation phase, the research team met to determine which concepts would be represented in the instrument. The decision was based on the extent to which a concept was viewed as modifiable and actionable for affecting medication adherence.

Stage 2. Content Confirmation and Refinement

The objective of Stage 2 was to finalize a set of content-valid items representing the concerns that influence medication adherence from the perspective of individuals living with AFib or OA. This was achieved through one-on-one hybrid qualitative interviews that began with a very brief CE section to solicit feedback on the participants’ experiences with taking their prescribed medications, followed by a very lengthy and detailed CD section designed to assess whether the draft questions were relevant, comprehensive, and understandable to the participants.

One-on-One Interviews

The goal was to screen and recruit 16 adults with AFib or OA (8 for each condition) for one-on-one, in-person, qualitative interviews. The 1.5-hour interviews were conducted by senior staff at two locations (Philadelphia, Pennsylvania and Boston, Massachusetts, US) using semi-structured, qualitative interview guides specific to AFib or OA and the draft medication adherence instrument. The interviews were recorded and transcribed by a third-party vendor. After half of the interviews were conducted, minor modifications were made to the draft items (ie, adding parentheses to one question, changing the order of a set of questions, and correcting a small handful of typographical errors and numbering sequences) for testing in the remaining interviews.

During the interviews, participants completed either the AFib or OA draft medication adherence instrument by themselves, after which they were asked to reflect on each question using the think-aloud approach.⁴³ To confirm that the content was relevant and comprehensive, participants were asked to discuss any concepts they felt were missing when considering adherence to their medication. Then they were asked what each question meant to them, why they chose the response option they did, and what possible scenarios might cause them to choose other response options. To test the word question stems and address the different phrasing of the questions, participants were asked how each stem differed in meaning and why they preferred one wording over the others. Concepts that could be combined were also discussed. Further, participants were asked to reflect on various response scale constructs, eg, level of worry, level of concern, etc., to ensure that the response scale construct was reflective of the intention of the item’s stem. Finally, the interviews explored comprehension that the recall period for responding to the items was current, ie, right now, in this moment.

Research Participants

Across both stages of the research, efforts were made to recruit individuals who were diverse with respect to duration and severity of disease, education, race or ethnicity, socioeconomic status, healthcare insurance type, and adherence-status. For Stage 1, participants with AFib were required to be currently taking or recently (past 12 months) non-persistent to a DOAC (60% quota) and/or a vitamin-K antagonist (VKA; 40% quota). The requirements for Stage 2 were similar except that individuals taking a VKA were not eligible to participate. The requirements were the same for both Stages in the OA group: ie, participants were required to be currently taking or to have taken medication for OA in the past 12 months. This included prescription or OTC nonsteroidal anti-inflammatory drugs (NSAIDS), narcotic pain relievers, combination medicines with acetaminophen, tramadol, injectable steroids, or prescription topical treatments, referred to collectively hereafter as OA medications. Further, OA participants had to report that their worst OA pain in the past month was a ≥5 on an 11-point scale where 0 means “No pain” and 10 means “Worst pain you can imagine”.

All participants were required to be able to read, speak, and understand English sufficiently to complete the assessments and to be willing and able to attend an in-person interview session, complete questionnaires, and provide written informed consent. Consent to being audio recorded was also required for participation. Presence of a major health problem that would interfere with participation in an in-person interview; hospitalization for any reason at time of screening; major surgery within 8 weeks prior to screening; presence of any other clinically relevant and/or serious chronic medical condition which, in the opinion of the sponsor’s research team and/or investigator, would interfere with completion of the research study procedures, and refusal to be observed by the sponsor from a different room were also causes for exclusion. The following additional restrictions were in place: focus group participants were not eligible to participate in the CE one-on-one interviews; persons involved as a research participant for the recruiting agency >3 times in the last 12 months could not participate in either the focus groups or the one-on-one interviews. Key inclusion criteria for both stages of the research are shown in Table 1.

Table 1 Inclusion Criteria for Both Stages of the Research

Data Analysis

Audio recordings and interviewer notes from the one-on-one interviews were used to analyze participants’ responses. A thematic, content-analysis approach⁴⁴ was used to analyze data from the transcripts obtained from the focus groups and one-one-one interviews. These narrative data were entered into and analyzed by ATLAS.ti⁴⁵ to organize the data. Descriptive statistics were used to summarize the quantitative data, which were entered into DataFax, an FDA Title 21 Code of Federal Regulations Part 11 compliant system that provides a time-stamped electronic audit trail for the creation, modification, or deletion of electronic data. Quantitative and sociodemographic data were analyzed using SAS version 9.4. Descriptive statistics were used to summarize participant demographics and clinical characteristics. All participants who provided consent and fulfilled the research study entry criteria were included in the analyses.

Protection of Participant Rights

This study was conducted in accordance with the Declaration of Helsinki. All parts of this research protocol were approved by a central Institutional Review Board (IRB: Advarra, 6940 Columbia Gateway Drive, Suite 110, Columbia, MD 21046, USA) prior to study initiation. All participants provided written informed consent prior to participation. Participants were informed that participation in the research was voluntary, and they could refuse to participate or withdraw at any time without penalty and without giving up any benefits to which they were otherwise entitled. All participant data were de-identified. Participants received nominal remuneration for their time.

Results

Stage 1. Content Exploration

Targeted Literature Review

The AFib literature search identified 591 unique citations for screening; 483 were deemed ineligible, the majority because they reported on clinical trials (58%). The remaining 108 were reviewed by the research team for final determination of which would be subject to full-text extraction. Thirteen publications were selected for full-text extraction. Research methods in these studies were as follows: mixed-method research (n=5), qualitative focus groups (n=4), one-on-one semi-structured interviews (n=2), and literature review (n=2). Two of the mixed-method studies were specific to PRO development for AFib.

The OA literature search identified 491 unique citations for screening; during the first review, 427 were deemed ineligible as they did not match the inclusion criteria. The top reason for abstract ineligibility was study type being clinical trial (68%). A second screening identified 51 duplicates among the remaining 64 abstracts (eg, multiple conference presentations or publications from the same study), leaving 13 unique articles for full-text extraction. Research methods in the selected studies included the following: qualitative focus groups (n=1), qualitative, semi-structured interviews (n=4), survey research (n= 6), mixed-method research (n=1), and meta-ethnography (n=1).

In total, 26 themes that influence medication adherence were identified from the targeted literature search; 10 shared between AFib and OA; 9 unique to AFib; and 7 unique to OA (Figure 2).

Figure 2 Shared and unique adherence drivers.

The themes identified in the targeted literature review were used to draft a focus group discussion guide for use across AFib and OA. The Proximal-Distal Continuum of Adherence Drivers⁴⁶ was used as a conceptual framework to apply the findings from the TLR to the qualitative guides. The continuum asserts that some adherence determinants are nearer or closer to patients’ medication-taking decisions (proximal) while others are more removed from patients’ adherence decisions (distal). This continuum was specifically studied and populated with respect to the literature extracted from AFib and OA. Figures 3 and 4 show how the extracted reasons for adherence/non-adherence from the TLR in AFib and OA were applied to present a framework of the proximal-distal continuum in each of the diseases. The guides were developed using the content derived from these figures and addressed seven general topics: patient knowledge, unmet information needs, and experience of conflicting medical information; perceived medication concerns; perceived need for medications; perceived medication affordability; aspects of the medication regimen; aspects of the doctor–patient relationship; practical adherence facilitators.

Figure 3 Elements of the proximal-distal continuum of adherence drivers specific to AFib.

Figure 4 Elements of the proximal-distal continuum of adherence drivers specific to OA.

Research Participants

Participants in both stages of this research were diverse with respect to their demographic (Table 2) and clinical characteristics (Table 3).

Table 2 Demographic Characteristics

Table 3 Participant-Reported Clinical Characteristics

Focus Group Results

Eleven focus groups were conducted: 5 for AFib (2 in Los Angeles, California and 3 in Philadelphia, Pennsylvania, US) and 6 for OA (3 each in Los Angeles and Philadelphia). There were 66 participants in total (30 in the AFib groups and 36 in the OA groups). The demographic characteristics of these individuals can be found in Table 2.

AFib Participant Perspectives

High-level insights were remarkably similar between the two geographic locations. Saturation was achieved in these five focus groups.

All participants understood the clinical nature of AFib, had a good understanding of why they were taking oral anticoagulants, and generally understood that they would need to take their medication for the rest of their lives. Overall, participants adhered to their oral anticoagulant regimen. Intentional medication non-adherence was rarely reported. The most common reason for unintentional non-adherence was forgetting doses (56.7%; n=17/30), which was reported as a particular challenge with twice daily medications. The majority (76.7%; n=23/30) of participants expressed that they were adherent to their AFib therapy most of the time. Only a few expressed that they were 100% diligent and had never missed a dose, mostly because of the perceived seriousness of the disease.

All participants said that, whenever they received a new prescription for their oral anticoagulants, they filled it (primary adherence); however, subsequent discussion showed that at least 5 participants mentioned they did not refill all prescriptions. The most common reason for not refilling a prescription was medication side-effects (16.7%; n=5/30).

Most participants felt very independent and did not need or want any social or technological support to remind them to take their medications. They used pill boxes and compartmentalized medicine trays to remind themselves to take their medications.

On being asked how they prioritize AFib compared with other chronic diseases they have, AFib appeared to be among the highest in importance. There was a sense of fear toward AFib, as it affects their heart and could be fatal. Other chronic diseases the participants had that ranked higher than AFib were hypertension, because “hypertension leads to AFib,” heart failure, hypertrophic cardiomyopathy, leukemia, sleep apnea, and depression. Other diseases, such as diabetes, OA, rheumatoid arthritis, and peripheral neuropathy, were being managed with medications consistently, and the participants felt their conditions were under control.

The top two concerns for participants were medication-related side effects and the fear of “bleeding to death” (both 46.7%; n=14/30). Participants were also concerned about internal bleeding and bruising as side effects of their medications and wanted to know the long-term side effects of the DOACs they were taking. About half of the participants also expressed concern that they were not sure if their AFib drug was working and felt the need to know more about monitoring their disease and drugs.

Five participants (16.7%;n=5/30) indicated they were concerned about developing resistance to their current medication and being in a situation where the medication would no longer work for them. Two participants mentioned that they were concerned about dependency and addiction to their AFib drugs (6.7%; n=2/30) and expressed that long-term usage may make their bodies dependent on these drugs for clotting, thereby interfering with natural clotting. Affordability of medications was a concern for about one-quarter of participants (26.7%; n=8/30).

A majority of participants (66.7%; n=20/30) expressed trust in their doctors and indicated that they have a positive relationship with them. Almost all participants (93.3%; n=28/30) had heard of nutraceuticals, herbal, and other OTC therapies for AFib.

OA Participant Perspectives

As with the AFib sample, high-level insights were similar between the two geographic locations, and saturation was achieved in six focus groups.

Pain was the most common symptom among the 36 OA participants. On an 11-point scale of 0 to 10, with 10 being the most severe, most participants in one focus group described their average pain levels on a normal day to be between 3 and 6 inclusive during the day and worse at night. Most of the participants admitted to being non-adherent to their OA prescription medications most of the time. Although they realized the importance of their medications, they were not adherent to the recommended dosing, because they felt they could manage their pain with non-prescription resources such as icing or taking OTC products. When it came to pain management, there was a sense of “stretching out the prescription” or “fighting through (the pain).”

The majority of OA participants took their OA prescription medications PRN (pro re nata; as needed). Some spoke of “shuffling” the bolus of all their prescription medications, meaning that in some situations they might prioritize one medication over another. Participants who shuffled their medications all stated they made that decision on their own.

Only two participants stated they were 100% adherent with their OA prescription medications. Almost all participants (92%) said that when they received a new prescription for their OA, they filled it; however, they almost all admitted to being nonadherent to filling the first refill at some point in time. Most of the participants (86%; n=31/36) who chose not to get their first refill noted that the medication was not effective in reducing their pain or that its effects wore off. Other reasons for not refilling their prescription included fear of or experience of side effects, ie, gastrointestinal disturbances and insomnia (28%; n=10/36), inconvenience of twice-daily dosing/application and affordability/insurance issues (6% each; 2/36). A few patients (11%; n=4/36) admitted stopping their OA medications altogether because of a sense of “toughing up.” Many respondents had their own subjective “pain point” when they decided they needed an OA prescription medication. A few of the participants substituted their prescription drugs with OTC drugs, such as ibuprofen and acetaminophen, assuming the OTC drugs would have lesser side effects than their prescription medications for OA.

Participants used various “reminding devices” to help them with adherence, such as pill dispensers set every weekend, pill boxes, or social support systems such as spouses.

When participants were asked to prioritize OA against other chronic diseases they had, OA fell in the middle. Chronic diseases that ranked higher were hepatitis C, diabetes, hypertension, congestive heart failure, and asthma. Participants expressed that OA becomes more important depending on the degree of pain and location of pain.

Short- (eg, gastrointestinal upset and stomach problems) and long-term (eg, kidney and liver damage) side effects of OA medications were the top concern (83%; n=30/36). The next biggest concern was the potential of being addicted to their pain medications (39%; n=14/36). The third most common concern was the lack of efficacy (33%; n=12/36). During three of the focus groups, participants raised inconvenience of dosing frequency as a factor in their medication adherence. While fear of addiction was common, some participants stockpiled narcotics “just in case it (the pain) gets too bad.” Affordability was a concern for only a few participants (14%; n=5/36).

The majority of participants expressed that their doctors were too busy and did not have time for all their concerns, but 47% (n=17/36) added that they still trusted them with their treatment decisions. Almost half of the participants had tried using turmeric, CBD oil, herbal teas, and glucosamine and chondroitin tablets as a complement to prescription therapy.

Combined AFib and OA Focus Group Results

Item stems covering 13 common concepts of interest (COIs) and 12 unique COIs were derived from the focus-group transcripts. The item stems and COIs were reviewed by the research team during an in-person meeting and COIs were either included or excluded from the draft medication adherence instrument depending on the extent to which they were viewed as modifiable, ie, the concept could be influenced through interventional education and other health management tools, such that there was a favorable impact on adherence. COIs deemed not to be modifiable were excluded. The team also discussed different wordings of items, recall period, and use of categorical response scales that would be appropriate for both AFib and OA populations at a sixth-grade reading level. The result was that 42 AFib and 38 OA items representing concepts relevant to factors that influence medication adherence and that were considered modifiable were drafted for further evaluation during cognitive debriefing.(Figure 5) These items were grouped into 8 common COIs, one COI specific to AFib and one specific to OA. A semi-structured interview guide was also developed for use in the one-on-one interviews to confirm concept coverage and to probe various aspects of the item stems and response options that were included for each question, leading to final refinement of the items.

Figure 5 CIMA content evolution.

Stage 2. Content Confirmation and Refinement

One-on-One Interviews

In total, 14 hybrid interviews were conducted, 6 with persons with AFib and 8 with those having OA. Six participants (1 female and 5 males) were recruited in Boston, Massachusetts, US, and eight participants (4 females and 4 males) were recruited in Philadelphia, Pennsylvania. The demographic and clinical characteristics of these participants are shown in Tables 2 and 3.

Cognitive Debriefing

Almost half of all respondents (43.0%) gave the questionnaire positive feedback, noting that it “seems sensible” and included “fundamental, important questions.” Negative feedback (7% of respondents) was targeted at the length and redundancy of the questionnaire, which was somewhat expected as the purpose of the research was to test variations of the draft adherence assessment tool items. The remaining participants gave the questionnaire neutral feedback.

The response options in the medication adherence instrument ranged from “extremely … ” to ‘not at all … ’ and participants were asked to discuss how they perceived the differences among them. For many, there was a relationship between perceived risk and degree of concern. Participants demonstrated understanding of the differences between the response options and, in general, felt that there was a sufficient range of options.

For the set of questions about medication concerns, participants were asked “How concerned …,” “How worried …,” or “How afraid … ” they were about potential side effects. There was a preference for the word “concerned” in both groups (67%; n=4/6 for AFib and 75% n=6/8 for OA). Four of the 5 participants who were asked about their preference for the term “side-effect” versus “adverse effects” preferred the term “side effects” (1 in the AFib group and all 3 in the OA group). Among a small sample of participants with OA, there was a preference for the term “medication” (75%; n=3/4) over “medicine” (25%; n=1/4).

When asked about the set of questions that was intended to assess how “concerned/worried/afraid” participants were about “bleeding” or “bruising” as sequelae of their AFib prescription medications, two participants (50%; n=2/4) stated they would prefer “bleeding” and “bruising” to remain separate while two participants (50%; n=2/4) reported they should be combined. The decision was made to retain these two concepts as separate items to distinguish between internal and external bleeding.

For the set of questions intended to assess “How concerned …,” “How motivated …,” “How convinced …,” “How necessary …,” “How essential …,” and/or “How confident … ” participants were when considering the importance of their medications, both AFib and OA participants reviewed eight different questions. Each question was worded in a slightly different way and offered five response options ranging from “Not at all … ” to “Extremely … ” The most preferred wording for the questions was “How necessary” (42.9%; n=6/14, 3 from each group). Two AFib participants (33.3%; n=2/6) and three OA participants (37.5%; n=3/8) reported that they preferred “How essential,” while one AFib participant (16.7%; n=1/6) and three OA participants (37.5%; n=3/8) stated they preferred the term “convinced” over the other potential terms.

When asked about a set of five differently worded questions intended to assess “How concerned” and “How worried” participants were that their respective medication might have “harmful effects in the long term” or “long-term risks/effects,” there was a general preference (78.5%; n=11/14) for the phrase “How concerned.” This included 5 AFib participants (83.3%; n=5/6) and 6 OA participants (75.0%; n=6/8). Twelve participants were asked which wording they preferred among the following: “harmful effects in long-term,” “harmful long-term effects,” and “long-term risks to your health.” Eight participants (66.7%; n=8/12) stated they preferred the term “harmful long-term effects;” 3 (25%; n=3/12) preferred “long-term risks,” and 1 (8.3%; n=1/12) participant expressed preference for the term “harmful effects in long-term.”

When asked to comment on a set of questions intended to assess “How confident … ” each participant was that their respective medication was “working for them,” 33% (n=2/6) of the AFib participants and 38% (n=3/8) of the OA participants preferred the word “confident” rather than “How concerned …,” “How sure …,” and “How convinced ….”

With respect to questions that assessed “How concerned … ” or “How worried” each participant was about “out of pocket costs” for their medications, 67% (n=4/6) of participants with AFib and 38% (n=3/8) of those with OA preferred the word “concerned” over the word “worried.” The term “out of pocket” was also preferred, as it makes clear that the cost is a personal expense.

The next set of questions focused on the perceived importance of the participants’ AFib or OA compared with other health problems they had. Four participants discussed the meaning of the term “future health.” The lone participant with AFib said they associated the term “future health” with mortality, while the three OA participants had various interpretations. One thought the term was vague and could mean anything from “tonight to 10 years from now;” another thought of being “70, 80, or 90 years old;” and the third equated “future health” to “quality of life.”

For the set of questions that was intended to assess how “concerned” each participant was about becoming addicted to or dependent on their OA medication, there was a general preference for “dependent.” For the unique AFib questions about “missing” or “stretching out” doses of their oral anticoagulants, participants understood the terminology used. Participants made the distinction between missing doses and stretching out doses by explaining that missing doses is unintentional whereas stretching out doses is done willfully.

With respect to how “confident” the participants were in terms of their knowledge and understanding of their AFib or OA medication, there was a preference among those with AFib for the term “understanding” over “knowledge” (67%; n=4/6).

Based on these findings, the final content for the Concerns Influencing Medication Adherence (CIMA) instrument includes 11 questions covering common COIs, 3 questions specific to AFib, and 2 questions specific to OA (Figure 5). Each question offers five possible responses ranging from “Not at all … ” to “Extremely … ”

Discussion

The objectives of this research were to develop a content-valid, patient-reported assessment, the CIMA instrument, which is representative of the concerns that influence the decisions of persons living with AFib or OA regarding the filling and refilling of their prescription medications and can identify persons who are, or are likely to be, non-adherent to their medications (defined as failure to obtain the first prescribed refill and/or non-persistent after the first prescribed refill). This was accomplished through two stages of research: concept elicitation via focus groups to obtain direct patient input into the concepts that affect likelihood to fill and continue to refill prescription medications, and content confirmation and refinement via one-on-one cognitive debriefing interviews to finalize the set of items that would represent a content valid assessment of medication adherence in these two patient populations. Concept saturation, an important criterion for establishing evidence that the concepts represented in an instrument are comprehensive and relevant to the intended responders (in this case patients) was achieved. Specifically, by the completion of five focus groups with individuals affected by AFib and six focus groups of individuals affected by OA, no new concepts emerged. Further, no concepts were introduced or mentioned as missing from the one-on-one interviews. After two rounds of cognitive debriefing interviews, no further refinements to the item stems and response scales were necessary, and interviewees understood that the time frame of reference for responding was “current” (ie, no past recall, rather “as of right now”). A recall period was not included in the draft medication adherence instrument used in the CE/CD interviews to allow participants to think generally about their medication-taking experiences with the intent of making it more generalizable.

The CIMA instrument is intended to be completed electronically by patients. It is comprised of a core set of 11 items applicable to multiple disease states, as well as “add-on” items specific to persons with AFib (3 items) or OA (2 items). Use of the CIMA instrument is appropriate regardless of how patients obtain their prescriptions. It was designed to focus on intentional adherence, ie, active decisions on the part of patients to forego taking medication as prescribed. The context of use for the CIMA instrument is as a publicly available content-valid tool for use in population health management, by health plans, Integrated Delivery Networks (IDNs), and/or large group practices. A potential topic for future research is whether the CIMA instrument has practical applicability in clinical practice as a tool to help identify patients who might need additional intervention to stay adherent to their medication regimens.

This research has a few limitations. With respect to the literature review, differences in sampling strategies and sampling frames across the selected studies could have affected their representativeness and generalizability. All information on the clinical status of the focus group participants was based on self-report. The concepts of polypharmacy and pill burden came up sparingly in the qualitative research, and the participants did not raise the issue during the interviews. Thus, it is not addressed in the CIMA instrument. It is not unusual for persons with chronic illnesses to take multiple medications for a variety of medical conditions, however, and this may have been a factor (conscious or unconscious) in how the participants ranked their illnesses, and, therefore, their medications in terms of prioritization. This is a question that could be explored in future research. Both the focus groups and one-on-one interviews were conducted in coastal cities, as opposed to a broader sample that included persons from rural areas and/or from the Midwest or South. The sample populations for both OA and AFib were predominantly white and not of Hispanic origin. Similar to other research using opt-in chronic disease panels,⁴⁶ participants in both the focus groups and one-on-one interviews were fairly highly educated.

The next steps for validating the CIMA instrument include usability testing in an electronic format, establishing a scoring algorithm, and evaluating its psychometric measurement performance, including identification of external criteria for evaluating its ability to identify those most likely and not likely to be adherent. The item stems used in this instrument were included depending on the extent to which they were viewed as modifiable, ie, the concept could be influenced through interventional education and other health management tools, such that there would be a higher likelihood of a favorable impact on adherence. These results need to be tested by fielding the CIMA instrument in a future research study and examining of the effects of said interventions. Finally, for use in conditions outside of AFib or OA, we recommend additional qualitative research to confirm that the core items are relevant and to identify any COIs that are unique to other patient population or conditions of interest.

Conclusion

While a variety of instruments have been developed on medication adherence, many lack publicly available details concerning patient input. The current research collects direct patient input, a key component of content validity, that centers on identifying concerns that patients have regarding their treatments. Such concerns are expected to have affected past medication adherence and can potentially impact future adherence. Our focus was on active (and thus potentially modifiable) decisions on the part of patients to forego taking medications as prescribed. The proposed tool is intended to be completed electronically, to be publicly available for licensing, and to constitute a core set of general and specific items applicable to persons with AFib or OA. Although applicability outside of either AFib or OA was not assessed, the general items may be useful in assessing adherence in other chronic diseases.