User Acceptability and Technical Robustness Evaluation of a Novel Smart Pill Bottle Prototype Designed to Support Medication Adherence
Received 29 November 2019
Accepted for publication 27 February 2020
Published 20 March 2020 Volume 2020:14 Pages 625—634
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 3
Editor who approved publication: Dr Johnny Chen
Tanja R Zijp,1 Daan J Touw,1–3 Job FM van Boven1,3
1Department of Clinical Pharmacy and Pharmacology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands; 2Department of Pharmaceutical Analysis, University of Groningen, Groningen Research Institute of Pharmacy, Groningen, the Netherlands; 3Medication Adherence Expertise Center of the Northern Netherlands (MAECON), Groningen, the Netherlands
Correspondence: Job FM van Boven
University Medical Center Groningen, Hanzeplein 1 (Internal Postcode EB70), Groningen 9700 RB, the Netherlands
Email [email protected]
Purpose: Smart medication adherence monitoring devices can provide objective and granular drug utilization data and help patients engaging with their treatment. In this proof-of-concept study, the acceptability and technical robustness of a novel smart pill bottle prototype (SPBP) were assessed in order to allow further optimization.
Methods: The SPBP is an app-controlled automatic dispense system, capturing real-time data on a web-based platform, which sends text reminders and measures storage conditions. A heterogeneous group of ten volunteers was asked to dispense placebo capsules with the SPBP and to follow a predefined dosing schedule for a trial period of 2 weeks. Afterwards, a questionnaire was filled out during a short interview. Primary outcome was dispense adherence as measured by the bottle. Other study outcomes included system acceptability (System Usability Scale [SUS]), self-reported adherence (MARS) and technical robustness of the bottle’s mechanics (electronic pill dispenser) and sensors (bottle temperature).
Results: The overall dispense adherence rate as measured by the SPBP was 88%. All participants completed the study and four participants had an adherence rate of 100% during the study. The dispense adherence rates corresponded well with participants’ self-reported adherence with an average MARS total score of 23.6 (out of 25). Participants judged the system easy to use, with a mean SUS score of 79.3 (range: 57.5– 97.5). The overall mean temperature difference between the bottle sensor and calibrated external sensor was − 0.82°C (range: − 1.37°C to − 0.21°C).
Conclusion: The SPBP was well accepted and this study provides data for further optimization and follow-up studies. Smart adherence technologies such as these may change the way healthcare professionals, trialists and patients manage medication adherence.
Keywords: smart device, real-time monitoring, medication management, electronic data, medication dispenser, mobile app
Up to half of the people taking medication for chronic conditions are non-adherent.1,2 Medication non-adherence hinders disease control and places a significant negative burden on patients’ quality of life. Notably, the World Health Organization (WHO) concludes that improving patients’ adherence may have a greater effect on patients’ health than any other improvement in therapy.1 Besides clinical impact, non-adherence also has economic impact as it may lead to increased use of healthcare resources.3
Over the last decade, a wide range of promising smart devices has been developed that can monitor medication adherence.4 Data from these smart devices provide information that is granular – eg more time points – than a pill count, and more objective than patient self-report. These data can also be complimentary to – and even help explain – clinical and biochemical laboratory findings such as response biomarkers and drug concentrations.5–8 Finally, these smart devices can directly support interventions, patient self-monitoring, and help appropriate implementation of a prescribed medication regimen.9
The technology for medication monitoring of solid doses by smart pill bottles (SPBs) is rapidly developing with new options for electronics, sensors, real-time data collection, and direct communication between patients and healthcare professionals or trialists.10 However, the currently used SPBs still suffer from the limitation that they only measure the opening of the bottle and not whether a dose has actually been taken out and – if so – how many.11–13
Recently, a novel smart pill bottle prototype (SPBP), the Elucid Pill Connect system, has been developed with the aim of providing insights into non-adherence and supporting patients to better manage their medicines.14 The system consists of a regular pill bottle equipped with an automated dispense and reminder system that connects to a mobile app. Within a predefined timeframe, only the prescribed number of pills is released and at the moment of dispense the time and temperature are logged. The SPBP has potential for both daily practice and clinical trials. However, the usability, reliability and acceptability need to be established first before wide-scale implementation.
Therefore, this proof-of-concept study was designed to test this possible new medication adherence intervention by the means of human factor testing and product evaluation in healthy volunteers. It aims to elucidate user acceptance and technical robustness of the first prototype of an SPB, to ultimately inform the development of a final version ready for scale-up.
This proof-of-concept trial involved 10 healthy volunteers using the SPBP with placebo capsules for 14 days between June and July 2019. Afterwards, the SPBP was evaluated by all subjects to understand the impact and barriers to its use. This study was registered at the Dutch trial registry (Trial NL7835).
The study was performed with volunteers recruited through the University Medical Center Groningen in the Netherlands. Subjects were eligible for the trial if all of the following criteria were met: age >18 years, own an Android or iPhone mobile phone with operating system versions Android ≥6.0 or IOS ≥11.4, able to operate the mobile phone themselves and provide informed consent. There were no exclusion criteria assessed prior to enrollment. Exclusion criteria assessed after enrollment were the withdrawal of informed consent and unavailability of the subject to participate in the trial.
Twenty-one individuals were asked for their interest in participation; 19 (90%) showed interest and were recruited and assessed for their availability during the study period. From this pool, 10 volunteers were randomly selected and balanced by gender, age group, education level and smartphone operating platform in order to achieve a heterogeneous group. All participants provided written consent to participate in the study.
First, all participants were asked to attend a presentation where they received information on the trial and a short training on how to use the SPBP. Subsequently, all subjects had two site visits. At Visit 1, they received their SPBP connected to a temperature logger and containing a sufficient number of placebo capsules. They also received written information and a short explanation on SPBP use. At Visit 2, they returned the bottles and temperature loggers and completed the questionnaire and a short interview on problems that occurred and suggestions to optimize the system. During the first week of the study, all participants were instructed to dispense one morning dose. In the second week, all participants were instructed to dispense a morning dose and an evening dose. For each dose, the participants had a time frame of 6 hr to perform the dispensing. When the participants did not dispense within the first 3 hr, an SMS reminder was sent.
Technical Specifications of the Smart Pill Bottle
The SPBP (Elucid Pill Connect system, eLucid mHealth Ltd, Manchester, United Kingdom) is a patented system that allows for electronic dispenses of medication units (tablets or capsules), registering the time, bottle temperature and number of units that are dispensed. The smart bottle consists of a standard white plastic pill bottle with an automated dispensing module inserted. This module is powered by a small battery. The system is operated by a mobile phone application, and can only be unlocked when a dose is due. This prevents double dosing. In case, for example, serious side-effects occur during a clinical trial, bottles can be centrally locked from a distance. Data are sent real-time to a dedicated platform, which can be viewed by healthcare professionals or trialists, see Figure 1. Via the app, users have insight in their dosing schedule and get SMS reminders when their dose is due or when they are about to forget their medication. For the purpose of the trial, bottles were made transparent instead of white so that the dispensing mechanism could be easily observed.
Figure 1 Data transfer of the SPBP system. Notes: Dispenses are performed through an app on the mobile phone. Time and temperature data are registered when the dose is successfully dispensed, and then loaded to an online platform.
All participants completed the questionnaire that included the System Usability Scale (SUS),15,16 additional satisfaction questions and the Medication Adherence Report Scale (MARS).17 The questionnaire incorporated the five-point Likert scale where one is “always” and five is “never”. SUS is a measure for user acceptance of a new system, where a user rates 10 questions on topics such as the need for support, training, and complexity of the system. The outcomes are scored and the overall value ranges from 0 to 100, where high scores indicate good usability. The additional satisfaction questions were self-designed. More details can be found in the Supplementary Materials. MARS is a scale consisting of five topics, where a subject rates self-assessed engagement in non-adherent behavior and where higher scores indicate higher levels of adherence. The validated Dutch translation was used.
To validate the temperature sensor inside the SPBP (LMT85-Q1, Texas Instruments, Dallas, Texas, United States) a calibrated temperature data logger (Testo 174T, Testo SE & Co. KGaA, Lenzkirch, Germany) was attached to each SPBP. Temperature data of the internal sensor were recorded at every dispense, whereas the external logger recorded every 5 mins. As it was assumed that environmental temperature is quite stable, two external temperature measurements were averaged around the time of the sensor measurement.
The mean temperature difference between the bottle sensors and the external loggers was calculated per bottle. To evaluate the systematic bias of the temperature sensor, a Bland–Altman plot was used for all measured data points.18 In this plot, the difference between the two paired temperature measurements (y-axis) is set out against the average of the two measurements (x-axis). The limit of agreement (LOA) represents 95% of the differences between the two measurement methods (± 2 SD).
The primary outcome was the percentage of capsules successfully dispensed according to the intended dosing schedule. Secondary outcomes were user acceptance, measured with the SUS, additional satisfaction questions, self-reported adherence (MARS) and technical validation, ie correct dispense and logging of dispense data, sending of reminders, central locking at distance and temperature validity.
Outcomes were reported with descriptive statistics where appropriate.
On the basis of the study protocol, the Medical Ethics Review Board of the University Medical Center Groningen (METc UMCG, number: 2019/332) exempted this study from the Medical Research Involving Human Subjects Act. This research followed the declaration of Helsinki and the General Data Protection Regulation. No clinical data were collected or used during this study and there were no changes to subjects’ regular care routines.
The characteristics of the 10 study participants are shown in Table 1. Participants had equal gender balance and varied in age group, education level, smartphone platform and experience with following a medication schedule (regarded as chronic medication use). All participants completed both study visits.
Table 1 Characteristics of the Study Participants (Total n=10)
Dispensing and Adherence
During the study, a total of 168 capsules out of 190 were successfully dispensed, which implicates an overall dispense adherence of 88% to the intended dosing schedule. Four participants had an adherence rate of 100% during the study. A total of 22 doses were missed by six participants. Of these missed doses, 12 were due to human error (eg forgot the bottle at home) and 10 were missed because of a product design problem (with nine of those occurring in the same bottle, further discussed in the technical evaluation). The participants had a high self-reported adherence with an average MARS total score of 23.6 out of 25; the participants’ responses are reported in Figure 2.
Figure 2 Medication adherence report scale scores.
The majority of the participants judged the system usability acceptable, with a mean SUS score of 79.3 (range: 57.5 to 97.5). The responses of the participants to the SUS questionnaire are shown in Figure 3. In the questionnaire, most participants (80%) thought the system was easy to use; two participants thought that most people would need training of which one participant needed to learn a lot before they could get going. No participants needed the support of a technical person. In total, 70% liked to use this system frequently.
Figure 3 System usability score for the smart pill bottle prototype.
In the additional questions, as shown in Figure 4, all but one user found both the dispenser as the application simple to use. However, they found it uneasy to carry the dispenser around (30%), and handling the system was more difficult than standard drug packaging (40%). Half of the group found benefits from this system. Most participants (80%) were positive towards the idea that a healthcare professional received information about their medication intake, while two participants marked this question as “not applicable”, as there was no actual information shared with healthcare professionals in this study. Being reminded by the system and seeing upcoming doses was appreciated by 60% of the participants. Only three of the participants reported problems with taking their medicine at the correct time, where four liked help for taking their medicine on time.
Figure 4 Additional questions on the smart pill bottle prototype.
All bottles’ batteries remained functional during the length of the trial. Nine bottles were in proper condition after the end of the study. In one bottle, the automated dispensing mechanism got jammed due to a technical problem. Dispensing data were correctly logged and sent to the platform for all dispenses. All capsules that were dispensed were confined to the permitted time window.
In the short interview, seven participants reported that they encountered an error during the study. Two participants reported that not all capsules were dispensed successfully due to an error in the dispensing mechanism. Two participants reported a situation where a double dose was dispensed. Other errors were easily resolved by the participants in their next attempt by shaking the bottle and trying to dispense again.
Furthermore, two participants reported that they got reminders after they already performed a dispense. In these situations, data were not rapidly synchronized but loaded in the next dispense at most times, while the participants were connected to Wi-Fi and to the mobile network at the moment of dispense. Moreover, participants reported that they did not always get their reminders when needed.
There were 188 data points where the recorded temperature of the SPBP sensor could be compared with the external temperature logger data, with temperatures that ranged from 13.1°C to 26.6°C, as shown in Figure 5. Temperature data of Android phones were more detailed as there was one decimal available, whereas iOS phones only recorded whole numbers. The overall mean temperature difference was −0.82°C, where the mean temperature difference per bottle ranged from −1.37°C to −0.21°C. These data implicate that the temperatures that were measured within the SPBP are lower than the measurements of the external logger. When all data points were combined, the mean temperature difference between the methods was −0.78°C (SD: 0.70, LOA: -2.15, 0.58), see Figure 6.
Figure 5 Comparison of temperatures that were measured simultaneously by the sensor inside the smart pill bottle prototype (x-axis) and by the calibrated external temperature logger (y-axis).
On the last day, all bottles were successfully locked. There were no dispenses recorded during this lock-out period, and in the short interview all participants confirmed that no dispense was possible.
Outcomes per Adherence Type
The main method and score outcomes were stratified per adherence type as determined by the number of dispensing attempts that were made by the participant, as shown in Figure 7. Participants with a 100% intended adherence missed no capsules and regarded the system with a lower SUS score. However, one participant still regarded themself as non-adherent. There was one capsule count discrepancy caused by a double dispense. Of the three participants that had 90–99% dispense adherence, one told during the interview that she did not miss a dispense and regarded herself as adherent. All three rated the SUS score high. All participants with a lower SPBP-measured adherence also reported being non-adherent during both the interview and the questionnaires.
Suggestions for Optimization
Several participants recommended to personalize the timing of the reminders. Two participants asked for a strict time point to receive the messages, of which one asked for an earlier timing to fit the message into their morning schedule. One participant wanted to set the time of the messages himself. Another suggestion regarding reminders was to use pop-ups in the app instead of SMS reminders. One participant suggested to do more with the phone during the training and to explain how to install sound options when reminders come in. Another participant had her phone constantly silenced, she reported that it works better for her just to set an alarm on her phone (as it overrules the silence).
There were a few suggestions to improve the system. Two participants suggested an option in the application where you can look back which doses were due, or that all medication taken is put into a graph. Moreover, one participant wanted an emergency option, so access to the medication would be granted when the mobile phone would crash.
In this study, we evaluated dispense adherence rates, user acceptance and technical robustness of a novel smart pill bottle prototype. While both adherence and acceptability were high, the dispense and reminder systems require further optimization.
All participants completed the trial and were adherent to their placebo dosing schedule, which was reflected in the self-assessed adherence. The user acceptance was high, as the majority of the participants saw benefits in the system and thought it was easy to use. To increase user acceptance, some suggestions were given to optimize the system.
For the technical robustness, all dispensing moments were within the predefined time frames and the measured temperature accuracy was within the accuracy range as given by the sensor manufacturer,19 but did not reach the expected average of ±0.4°C. In total, 95% of all measurements ranged between a difference of −0.5 to 2.1°C. This accuracy may be regarded as acceptable for less temperature-sensitive drugs, as temperature differences may still exist between the in-and outside of the bottle. For highly temperature-sensitive drugs, this discrepancy needs further investigation. Furthermore, all participants were locked out successfully at the end of the trial.
However, two issues were identified in the technical aspects of the bottle. First, a manufacturing error for the prototype was signaled and this has been reported to the manufacturer. Accordingly, the manufacturer has introduced a new process and quality assurance to prevent this from happening again. Second, the double dispense events could be attributed to the study-specific use of see-through bottles instead of the common white bottles, as the sensor in the dispensing mechanism was possibly saturated with scattered infrared light.20 Indeed, both participants that encountered this problem were outside when they performed the dispense. The manufacturer will therefore increase the power of the sensor and provide a secondary block of dark plastic to the bottles.
The observed high adherence rates were significantly higher than real-world adherence rates. Indeed, trial participation generally improves adherence behavior. While the general impact of being electronically monitored may be low,13,21 this system was especially designed to improve adherence by involving patients in their dose schedule and sending reminders. Previously, reminders were shown to improve adherence.22–27 According to our findings, these reminders could be more beneficial when better timed and personalized by end-users.
Assessment of SPBP Assets
The SPBP tested in this study records the exact time, temperature and number of capsules that are dispensed. Furthermore, all data could be accessed in real-time. This could potentially improve intake data for trials as the trialist can immediately take action and have an open discussion with the participant based on the provided adherence overview. However, this could also increase the stigma of being monitored and raise privacy concerns. Another downside is that the moving parts in the dispensing mechanism have a risk of blockage and may have a higher impact on battery durability.
An additional opportunity of this system is the temperature monitoring. In clinical trials, drug storage conditions are tightly regulated before giving out to the patient to ensure product quality and drug stability.28 However, when at home, patients may store their medication at less suitable places, eg in a bathroom or a windowsill in the sun, where the medication can reach high temperatures.29 As the container is air-sealed with a cap and only the required amount is dispensed, the content will be minimally exposed to humidity. Adding a sound alarm may increase participants’ awareness when the temperature is outside the recommended storage range. For this purpose, the temperature should be measured continuously.
Another asset of the system is its ability to send reminders. Text reminders have previously shown to be a simple and effective way to increase adherence.23–27 On the other hand, a high frequency of reminders may introduce response fatigue. In this system, reminders are sent only when this information is relevant (ie when doses are not taken), which may even trigger the subjects to take the medication before the reminder time.30 While in this study these reminders were sent at a certain time point, the system is suitable to be adjusted to user preferences.
Strengths and Limitations
Usability studies are an important step in the development of user-friendly technologies, as they provide valuable user feedback on needs and expectations. Strengths of this study were that participants were randomly selected to obtain a heterogeneous group, and the use of multiple methods to assess adherence and satisfaction.
However, there were also some limitations, including generalizability and sample size. As this study did not use prescribed medication, no formal medication adherence could be tested. Furthermore, the participants in this study were on average young, healthy, and half of them was not accustomed to a medication schedule. While the age groups and education levels that were covered in this study could be possible target groups for this device, their experiences may differ from the experiences of actual medication users, who may feel more unwell and may use the device for a longer period. Younger participants are also in general more comfortable with new e-technology. Whether higher age groups could benefit from this device is not covered in this study. For participants that do not possess or know how to operate a smartphone, other non-smartphone-connected devices (MEMs, blister packs, week boxes) may be more suitable to track and support adherence.
Implications for Future Research
This study gives insight in the development process of a mobile phone-connected pill bottle, provides design and implementation considerations and may stimulate further research in features to improve and monitor adherence. Suggested improvements from this study related to optimization of the manufacturing process and personalization of the app-based reminder system. When these improvements to the SPBP are made, a follow-up trial with the next SPB version is recommended, until 100% robustness and high user satisfaction is shown.
Ultimately, application of these SPBs could be diverse. For example in clinical trials, these pill bottles would be suitable to assess non-adherence, but also in pharmacokinetic research, where knowledge of the precise time of intake, dose and storage environment of the drug are pivotal for estimations of exposure and explanation of individual variability in drug response.
The SPBP was well accepted and this study informs further technical optimization and follow-up studies. Taking into account patient needs and usability is important in the development of new technologies. The issues that were uncovered may stimulate further research and advancements in the smart adherence devices area.
Data Sharing Statement
Study data reported in this article, after de-identification will be available from the corresponding author upon reasonable request.
The authors thank all the participants in this study. Furthermore, the authors would especially thank Dr JC Visser for kindly supplying the placebo capsules, H Dijkstra, PharmD, for providing the temperature loggers and Dr DP Allersma for information on temperature measurement, Prof Dr R Horne for the permitted use of the MARS score in this study, and Dr J Burnstone for his support in the preparation of this study and delivering the SPBPs.
eLucid mHealth Ltd provided the smart pill bottles for this study. The Department of Clinical Pharmacy and Pharmacology (UMCG) received an unrestricted grant from eLucid mHealth Ltd to perform this trial. The authors report no other conflicts of interest in this work.
1. World Health Organization. Adherence to long-term therapies: evidence for action [Internet]; 2003 [
2. Khan R, Socha-dietrich K. Investing in medication adherence improves health outcomes and health system efficiency: adherence to medicines for diabetes, hypertension and hyperlipidaemia. OECD Heal Work Pap; 2018
3. Cutler RL, Fernandez-llimos F, Frommer M, Benrimoj C, Garcia-cardenas V. Economic impact of medication non-adherence by disease groups: a systematic review. BMJ Open. 2018;8(1):e016982. doi:10.1136/bmjopen-2017-016982
4. Zijp TR, Mol PGM, Touw DJ, van Boven JFM. Smart medication adherence monitoring in clinical drug trials: a prerequisite for personalised medicine? EClinicalMedicine. 2019;15:3–4. doi:10.1016/j.eclinm.2019.08.013
5. Vrijens B, Tousset E, Rode R, Bertz R, Mayer S, Urquhart J. Successful projection of the time course of drug concentration in plasma during a 1-year period from electronically compiled dosing-time data used as input to individually parameterized pharmacokinetic models. J Clin Pharmacol. 2005;45(4):461–467. doi:10.1177/0091270004274433
6. Rubio A, Cox C, Weintraub M. Prediction of diltiazem plasma concentration curves from limited measurements using compliance data. Clin Pharmacokinet. 1992;22(3):238–246. doi:10.2165/00003088-199222030-00006
7. Dunbar-jacob J, Sereika SM, Houze M, Luyster FS, Callan JA. Accuracy of measures of medication adherence in a cholesterol-lowering regimen. West J Nurs Res. 2012;34(5):578–597. doi:10.1177/0193945912439251
8. Schwed A, Fallab CL, Burnier M, et al. Electronic monitoring of compliance to lipid-lowering therapy in clinical practice. J Clin Pharmacol. 1999;39(4):402–409. doi:10.1177/00912709922007976
9. Zullig LL, Blalock DV, Dougherty S, et al. The new landscape of medication adherence improvement: where population health science meets precision medicine. Patient Prefer Adherence. 2018;12:1225–1230. doi:10.2147/PPA
10. Aldeer M, Javanmard M, Martin R. A review of medication adherence monitoring technologies. Appl Syst Innov. 2018;1(2):14. doi:10.3390/asi1020014
11. Mehta SJ, Asch DA, Troxel AB, et al. Comparison of pharmacy claims and electronic pill bottles for measurement of medication adherence among myocardial infarction patients. Med Care. 2019;57(2):E9–14. doi:10.1097/MLR.0000000000000950
12. Mauro J, Mathews KB, Sredzinski ES. Effect of a smart pill bottle and pharmacist intervention on medication adherence in patients with multiple myeloma new to lenalidomide therapy. J Manag Care Spec Pharm. 2019;25(11):1244–1254. doi:10.18553/jmcp.2019.25.11.1244
13. Denhaerynck K, Schäfer-keller P, Young J, Steiger J, Bock A, De Geest S. Examining assumptions regarding valid electronic monitoring of medication therapy: development of a validation framework and its application on a European sample of kidney transplant patients. BMC Med Res Methodol. 2008;8(5). doi:10.1186/1471-2288-8-5
15. Brooke J. SUS - A quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McCelland IL, editors. Usability Evaluation in Industry. CRC Press, London; 1996:189–194.
16. Lewis JR. The system usability scale: past, present, and future. Int J Hum Comput Interact. 2018;34(7):577–590. doi:10.1080/10447318.2018.1455307
17. Horne R, Weinman J. Self-regulation and self-management in asthma: exploring the role of illness perceptions and treatment beliefs in explaining non-adherence to preventer medication. Psychol Health. 2002;17(1):17–32. doi:10.1080/08870440290001502
18. Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies †. Statistician. 1983;32(3):307. doi:10.2307/2987937
19. Texas Instruments. LMT85-Q1 1.8-V, SC70, analog temperature sensors 1 [Internet]; 2017 [
20. Jain P. EngineersGarage: infrared sensors or IR sensors [Internet]. Vol. 2012; 2012 [
21. Van Onzenoort HAW, Menger FE, Neef C, et al. Participation in a clinical trial enhances adherence and persistence to treatment: a retrospective cohort study. Hypertension. 2011;58(4):573–578. doi:10.1161/HYPERTENSIONAHA.111.171074
22. Chan AHY, Stewart AW, Harrison J, Camargo CA, Black PN, Mitchell EA. The effect of an electronic monitoring device with audiovisual reminder function on adherence to inhaled corticosteroids and school attendance in children with asthma: a randomised controlled trial. Lancet Respir Med. 2015;3(3):210–219. doi:10.1016/S2213-2600(15)00008-9
23. Pandey A, Krumme AA, Patel T, Choudhry NK. The impact of text messaging on medication adherence and exercise among postmyocardial infarction patients: randomized controlled pilot trial. JMIR Mhealth Uhealth. 2017;5(8):e110. doi:10.2196/mhealth.7144
24. Miloh T, Annunziato R, Arnon R, et al. Improved adherence and outcomes for pediatric liver transplant recipients by using text messaging. Pediatrics. 2009;124(5):e844–50. doi:10.1542/peds.2009-0415
25. Thakkar J, Kurup R, Laba TL, et al. Mobile telephone text messaging for medication adherence in chronic disease a meta-analysis. JAMA Intern Med. 2016;176(3):340–349. doi:10.1001/jamainternmed.2015.7667
26. Park LG, Howie-esquivel J, Chung ML, Dracup K. A text messaging intervention to promote medication adherence for patients with coronary heart disease: a randomized controlled trial. Patient Educ Couns. 2014;94(2):261–268. doi:10.1016/j.pec.2013.10.027
27. Vervloet M, Linn AJ, van Weert JCM, de Bakker DH, Bouvy ML, van Dijk L. The effectiveness of interventions using electronic reminders to improve adherence to chronic medication: a systematic review of the literature. J Am Med Inform Assoc. 2012;19(5):696–704. doi:10.1136/amiajnl-2011-000748
28. ICH GCP. Integrated addendum to ICH E6(R1): guideline for good clinical practice E6(R2); 2016.
29. Hewson C, Shen CC, Strachan C, Norris P. Personal medicines storage in New Zealand. J Prim Health Care. 2013;5(2):146–150. doi:10.1071/HC13146
30. Sabin LL, Bachman Desilva M, Gill CJ, et al. Improving adherence to antiretroviral therapy with triggered real-time text message reminders: the China adherence through technology study. J Acquir Immune Defic Syndr. 2015;69(5):551–559. doi:10.1097/QAI.0000000000000651
31. Godbehere P, Wareing P. Hypertension assessment and management: role for digital medicine. J Clin Hypertens. 2014;16(3):235. doi:10.1111/jch.2014.16.issue-3
32. Reddy M, Pesl P, Xenou M, et al. Clinical safety and feasibility of the advanced bolus calculator for type 1 diabetes based on case-based reasoning: a 6-week nonrandomized single-arm pilot study. Diabetes Technol Ther. 2016;18(8):487–493. doi:10.1089/dia.2015.0413
33. Hayashi A, Yamaguchi S, Waki K, et al. Testing the feasibility and usability of a novel smartphone-based self-management support system for dialysis patients: a pilot study. JMIR Res Protoc. 2017;6(4):e63. doi:10.2196/resprot.7105
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.Download Article [PDF]