Back to Journals » International Journal of General Medicine » Volume 17

Integrated Digital Mental Health Care: A Vision for Addressing Population Mental Health Needs

Authors Lim CT, Fuchs C, Torous J

Received 12 November 2023

Accepted for publication 10 January 2024

Published 1 February 2024 Volume 2024:17 Pages 359—365

DOI https://doi.org/10.2147/IJGM.S449474

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Woon-Man Kung



Christopher T Lim,1,2 Cara Fuchs,1 John Torous3

1Department of Psychiatry, Boston Medical Center, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA; 2Population Health Services, Boston Medical Center Health System, Boston, MA, USA; 3Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA

Correspondence: Christopher T Lim, Department of Psychiatry, Boston Medical Center, Boston University Chobanian & Avedisian School of Medicine, 85 East Concord Street, 5th Floor, Boston, MA, 02118, USA, Tel +1 617 414 4238, Email [email protected]

Abstract: The unmet need for mental health care continues to rise across the world. This article synthesizes the evidence supporting the components of a hypothetical model of integrated digital mental health care to meet population-wide mental health needs. This proposed model integrates two approaches to broadening timely access to effective care: integrated, primary care-based mental health services and digital mental health tools. The model solves for several of the key challenges historically faced by digital health, through promoting digital literacy and access, the curation of evidence-based digital tools, integration into clinical practice, and electronic medical record integration. This model builds upon momentum toward the integration of mental health services within primary care and aligns with the principles of the Collaborative Care Model. Finally, the authors present the major next steps toward implementation of integrated digital mental health care at scale.

Keywords: digital health, psychiatry, integrated care, primary care

Introduction

The pressing demand for new solutions to address unmet mental health needs is undeniable. Equally apparent is the potential for technology to provide scalable solutions.1 In the United States, the President’s office designated digital approaches as one of its top three priorities for advancing mental health in 2023.2 This article explores the current challenges faced to date and proposes a vision for enabling the full potential of digital mental health care, through the integration of digital mental health tools and services into the primary care setting.

Reflecting on the evolution of digital mental health reveals a discernible direction for the future. Mental health apps have been accessible on smartphones for over a decade,3 and internet-based cognitive-behavioral therapy (CBT) programs have been available for 20 years.4 Additionally, billions of dollars have been invested in venture-capital-backed digital mental health startups.5 However, despite these advancements, mental health outcomes have not improved meaningfully for any age or demographic group.6,7 While the COVID-19 pandemic contributed to worsening population mental health, the rise of telehealth also posed an opportunity for digital tools to have greater prominence in mental health care.8

Several barriers to the current generation of digital mental health approaches have limited their potential to make an impact on population-level mental health outcomes. Ongoing outrage at privacy violations,9 lack of clear effectiveness data,10 low user retention and engagement,11 and minimal clinical integration12 have limited the scale to which digital approaches can be disseminated among patients and clinicians. Furthermore, there have been inequities in the development and implementation of digital health tools,13 and solutions have typically been oriented away from and inaccessible to individuals with serious mental illnesses and individuals living in poverty, who may be among the neediest.14 Most digital approaches are not designed for people with lower levels of digital literacy and thus present a barrier to access for those without access to consistent high-speed internet connections and adequate hardware, such as smartphones or computers.15

Despite these current challenges, the potential of digital mental health tools to improve access to population-wide mental health remains. The aforementioned challenges to date can illuminate the path forward. First, any advances need to address inequities and ensure access to devices, the internet, and digital literacy. Second, new approaches need to guarantee privacy and communicate that clearly to the user. Third, any digital health technology deployed at scale should have demonstrated effectiveness and be embedded in a system where ongoing evaluation can facilitate further improvements to effectiveness. Fourth, focusing on engagement through not only advanced digital approaches but also coaching and human support is critical to ensure meaningful use. Fifth and finally, there must be a focus on clinical uptake, with training for clinicians combined with reimagined clinical workflows and payment models.

While the above changes may sound vast, they reflect other major health system priorities, including ensuring equity and building workforce capacity.2 The US Centers for Medicare & Medicaid Services (CMS) announced a set of new remote therapeutic monitoring codes for 2023, distinct from remote physiological monitoring codes, including one targeted to mental health treatment and that could support new workflows and funding for staff.16 Below is outlined a proposed vision for a model designed to implement these principles through integration in the primary care setting. The potential for digital tools in health care extends beyond mental health; while the scope of this article is limited to mental health, similar principles may apply to integrating digital tools in primary care generally. In addition, while the authors are based in the US and synthesize data largely from the US, the problems addressed and the model principles apply to other health care settings worldwide. This is the first instance of which the authors are aware of a fully integrated model of mental health care, digital tools and services, and primary care, although it builds upon prior work by others toward this vision.17,18 The integration of digital tools into clinic-based mental health care, including in the primary care setting, has been described in both a US academic medical center and the Department of Veterans Affairs.18 A collaboration between the Asia-Pacific Economic Cooperation Digital Hub for Mental Health and the World Organization of Family Doctors has laid out basic steps in expanding mental health services within primary care, including with the support of digital tools, across the Asia-Pacific region.19 Broadly, the desire to incorporate digital approaches in addressing mental health needs in the primary care setting has been described across the world,19–21 and international partnerships to develop strategies for both digital tool dissemination and standard setting may be beneficial in the current juncture of digital health evolution.22 While the deployment of digital solutions alone will not address the full extent of mental illness in the primary care setting, these solutions represent a substantial opportunity to transform the delivery of mental health care and improve population-wide outcomes.

Integrated Digital Mental Health

Model Overview

Integrated digital mental health is a clinical model, anchored in primary care, that recognizes that (1) mental health is a population health priority and (2) with the right deployment, digital interventions can be uniquely accessible to patients, particularly given the current mental health provider landscape. The prevalence of mental health and substance use disorders has risen in the context of the COVID-19 pandemic and remains elevated as society recovers. Certain populations, such as adolescents, have been particularly severely affected in recent years.6 This coincides with a wave of enormous provider burnout and mental health workforce shortages, making traditional mental health care services even more inaccessible.23,24 Primary care settings have historically provided the majority of mental health care and are especially likely to serve as an entry point for individuals with incident conditions25,26 and from racial and ethnic minority populations.27 Needless to say, traditional mental health and psychiatric practices remain a critical part of the overall mental health system, and public health interventions promoting mental wellness and addressing risk factors for mental illness have a clear role in population mental health; the scope of these relative to primary care practices may vary depending on local, regional, and national resourcing for each. Digital interventions may have a large opportunity for impact particularly for spreading information and awareness. Nonetheless, many patients have long-term relationships with their primary care providers, with whom they would consider addressing mental health concerns and using new digital tools and programs. Furthermore, as consensus guidelines have increasingly encouraged the universal screening for mental health and substance use disorders,28,29 primary care practices will continue to find themselves with a growing number of patients with identified but unaddressed symptoms and diagnoses requiring clinical attention. The validation and dissemination of integrated models such as the Collaborative Care Model, discussed further below, reinforce the viability of delivering mental health care in the primary care setting.

Digital Navigation

Successful implementation of any digital solution requires an emphasis on people. Primary care practices and health systems already recognize the role of care coordination in promoting favorable health outcomes. An extension or variation of this role is the digital navigator, a member of the care team who supports digital equity, access, engagement, and selection of apps, websites, and other digital tools. A digital navigator training curriculum has already been published for dissemination and use.30 This training consists of five key modules: (1) core smartphone skills, (2) basic technology troubleshooting, (3) app evaluation, (4) clinical terminology and data, and (5) engagement techniques. Relevant to integrated digital mental health, a digital navigator can offer support in two fundamental ways. First, they can serve as an initial guide in overcoming any gaps in digital connectivity, such as by determining eligibility for public benefits around digital access, and providing instruction in basic digital functions on a smartphone.30 Studies of digital navigation have demonstrated substantial improvements in digital literacy and access, including functional outcomes; in one study of digital navigation for individuals with severe mental illnesses, nearly 75% of participants reported improvement in at least one smartphone skill.31 Second, the navigator can help patients identify and use specific tools that may support their mental well-being; a crucial role of the digital navigator is the curation of secure, evidence-based tools that are a good fit for the population and practice setting.17 For example, they can help clinicians and patients search through hundreds of mental health-related digital tools in databases like the Mobile-Health Index and Navigation Database (MIND) to match tools across 100 dimensions to the unique needs of each person;32 as one area to highlight, privacy features are a dimension systematically reviewed by MIND. The United Kingdom’s National Health Service has also taken on the “kitemarking” of recommended digital health apps, based on both efficacy and safety.33 Regardless of the use of a specific database or set of tools, the navigator can provide essential patient education about digital security and make recommendations that take into account privacy considerations. The digital navigator can then help the patient engage with that tool and summarize progress for all parties at the next clinical visit. Note that the navigator may serve as a dedicated mental health digital navigator, but also either may be a general digital navigator (ie, also supporting the use of apps for, eg, diabetes management or hypertension management) or, alternatively, may be a general care coordinator or community health worker who supports other care coordination activities, depending on the practice’s scale, other needs, and funding. The aforementioned digital navigator training is not specific to mental health, and may be applied to a new role on a team or an existing team member.30

Digital Integration into Mental Health Care

With greater recognition of the impact that primary care mental health integration has on patient outcomes, quality, and total cost of care,34,35 there has been a rise of primary care-based mental health clinicians. Practices with integrated mental health clinicians can maximize the impact of digital mental health tools by integrating digital information and interventions into the course of clinical care. This allows for the practice of hybrid care, a combination of synchronous and asynchronous health care, which can enable increased access to care. Hybrid care can address the known challenge of low retention in digital health tools,11,36 given that a digital navigator or clinician can promote engagement, guide the patient to relevant content, and, depending on the tool, use data from the patient’s use in further guiding face-to-face care. In a large study of trained-clinician-led referrals to mental health apps, 40% of patients downloaded, enrolled, and used an app at least once, reflecting substantially higher engagement than has been demonstrated in other studies.17 For practices without integrated mental health clinicians, digital navigators may serve in a “follow-up” role to promote engagement. The role of a clinician or other integrated staff member providing encouragement and reminders to engage with digital mental health tools has demonstrated substantial decreases in symptom scores for patients from primary care referred for treatment; in one study, a 40 to 50% reduction in depression and anxiety scales was seen over an 8-week period, with app engagement in more than half of the days in the study.37

Digital Integration into Electronic Medical Records

The ability to use digital tools to capture meaningful patient data, including both passive data and patient-reported outcome measures, and the ability to integrate this data into clinical care imply several opportunities for more effective clinical care.38 In the nearer term, such data capture naturally facilitates the practice of measurement-based care, which has repeatedly demonstrated better outcomes than routine mental health care without consistent measurement; this may be as simple as obtaining a brief, single set of patient-reported outcome measures on a periodic basis.39 In the longer term, the integration of much larger datasets into a robust analytic infrastructure, alongside medical data and other patient information, may guide the transition toward a learning health system, wherein continuous improvement in the digital data itself and ever-better decision support are facilitated.40 In a 2022 study of approximately 150 college students, passive data alone poorly predicted patient-reported outcomes, but the combination of passive data with daily patient-reported outcomes enhanced the prediction of weekly patient-reported outcomes.38 Along the way, the identification of relevant digital biomarkers can support more robust population health management, identifying patients for whom outreach and proactive engagement may be warranted.41

Team-Based Care

Synthesizing the elements of the model, integrated digital mental health represents collaboration between patient, primary care provider, digital navigator, and mental health clinician, along with digital tools that directly engage patients and collect clinical data for the care team, to support the primary care patient population.18 While prior models of digital mental health clinics and digital mental health tools in primary care have been reported,17,18 this vision represents a unique synthesis. This is a vision for population health management that is both integrated in regard to mental and physical health care and “technology-enabled.” The model of care for an individual patient may vary depending on patient preference, mental health needs, digital navigation needs, and other practice factors.

Principles of Effective Integrated Care

In the integrated model described, several principles of effective mental health care naturally follow. The model is aligned with the principles of the Collaborative Care Model,42 among the leading evidence-based models in all of mental health care. The five principles of the Collaborative Care Model are evidence-based care, measurement-based treatment to target, population health management, accountable care, and team-based care. The alignment with these principles is despite clear differences between the actual models of Collaborative Care and integrated digital mental health care. First, the intentional selection of evidence-based digital tools naturally leads to the integration of evidence-based practices into the course of the patient’s treatment. In addition, the collection of structured patient data facilitates measurement-based care and establishes a foundation of population-wide data for population health management. The use of effective digital tools is aligned with the vision of accountable care, which moves away from reimbursement for face-to-face care volume. Lastly, the Collaborative Care principles provide a reminder that team-based care may be a necessary ingredient to mobilize the opportunity represented by digital navigation and integration of digital mental health tools into a primary care clinic workflow. This suggests that team collaboration and coordination should be essential to achieving improved outcomes. Of note, given that many co-located primary care-based mental health clinicians do not themselves practice in a truly collaborative or team-based model,43 it is possible that establishing a digital navigator role as a partner to an existing primary care-based mental health clinician can serve as a catalyst to establish collaborative, team-based mental health care and enhance the effectiveness of the mental health clinician.

The Investment Needed

While the integrated digital mental health model may incorporate existing elements in primary care practices, several novel additions and investments stand out. From a staffing perspective, the digital navigator role, even if incorporated into an existing staff role, represents a new set of responsibilities not part of typical health care services or benefits today. Second, digital navigation is a novel skill set for most individuals, and content on both general digital literacy as well as mental health-specific digital navigation are necessary to disseminate the model, even on a small scale. Time for team members to learn and become comfortable with the information and workflows is also needed. Third, the selection of specific digital tools and their workflow, clinical integration into practice, and technical integration into electronic medical records are critical to unlocking the elements of effective care delivery, such as measurement-based care and population-based care. In particular, electronic medical record platforms vary widely between health care systems, and medical record integration of digital data may not be a near-term possibility in some settings. Finally, while integrated mental health clinicians may exist in clinics today and obtain reimbursement for traditional patient care, primary care-based mental health clinicians are by no means universal and their implementation still faces numerous challenges.44 Beyond financial challenges, interdisciplinary collaboration between primary care providers, mental health clinicians, and digital navigators is necessary for model success, and integration thus requires provider buy-in, culture change, and new ways of collaborating. Mental health integration may be an initial step before digital navigation can be incorporated. It is hard to imagine primary care practices having existing capacity or funding to invest into such a digital mental health model independently, today. Greater sustainability of primary care-based integrated mental health models, generally, will also support the implementation and sustainability of integrated digital mental health care. In the US, there is reason for some optimism, as the expansion of remote therapeutic monitoring Current Procedural Terminology (CPT) codes, in part a result of substantial provider advocacy,45 has led to the inclusion of a specific CPT code for Cognitive Behavioral Therapy monitoring services.16 Indeed, local, regional, and national coverage or provision of primary care-based mental health services, digital mental health tools and services, health care navigation services, and digital access broadly can affect the degree of investment needed.

Discussion

The ongoing global mental health crisis sets the stage for now as the optimal time for scaling an integrated digital mental health model. Studies of the elements of integrated digital mental health care have each demonstrated effectiveness, as reviewed above. The next phase in the evolution of this model is broader, larger-scale implementation at a local or regional level of a suite of evidence-based digital tools and trainings to enhance mental health care and engagement, in the primary care setting. However, as a step before this, greater dissemination of the individual components of the model described would help to prepare for implementation of a full suite of services. In particular, greater use of digital navigation—whether as dedicated digital navigation or as part of other existing care coordination support—would provide a key foundation for implementing the other components described. The adaptation of existing, ready-to-use tools and training programs30,32 in consultation with local stakeholders can ensure a balance between both expedient implementation and local adaptation.

Collaboration with local stakeholders should center on three key objectives. First is to assess the digital and mental health needs and experiences of the local patient population. Second, a synthesis of the existing evidence base should draw from real-world population data. Third is to explore the strengths, weaknesses, and opportunities learned in the deployment of digital mental health interventions.

These combined efforts will culminate in a set of digital mental health resources and processes that are evidence based, which can serve as the foundation for future teams to build upon and scale further. In addition, greater digital integration in practices and increases in patients’ digital literacy and access can open opportunities for the use of digital tools outside of mental health, such as in managing chronic medical conditions. It is clear from current epidemiological trends, technological trends, and trends in health care delivery that now is the time for population-wide digital solutions to mental health needs globally. Furthermore, the field is at a tipping point where the next order of scale—across an entire community or region—is the level at which digital mental health solutions need to demonstrate feasibility and effectiveness. The next chapter in the evolution of digital mental health solutions holds the promise of population health impact.

Acknowledgments

This article was not supported by any external funding.

Disclosure

Dr. Lim has received consulting fees from Aetna Inc., CVS Health, Lyra Health, and Cartwheel Care, has equity in Cartwheel Care, and has received research funding from Humana Inc. Dr. Torous is a scientific adviser for Precision Mental Wellness. Dr. Fuchs declares no conflicts of interest.

References

1. D’Anza B, Pronovost PJ. Digital health: unlocking value in a post-pandemic world. Popul Health Manag. 2022;25:11–22. doi:10.1089/pop.2021.0031

2. Prabhakar A, Rice SE. White House Report on Mental Health Research Priorities. Washington, DC: The White House; 2023.

3. Rathbone AL, Prescott J. The use of mobile apps and SMS messaging as physical and mental health interventions: systematic review. J Med Internet Res. 2017;19(8):e295. doi:10.2196/jmir.7740

4. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205. doi:10.1080/16506070903318960

5. Shah RN, Berry OO. The rise of venture capital investing in mental health. JAMA Psychiatry. 2021;78(4):351–352. doi:10.1001/jamapsychiatry.2020.2847

6. Jones SE, Ethier KA, Hertz M, et al. Mental health, suicidality, and connectedness among high school students during the COVID-19 pandemic - adolescent behaviors and experiences survey, United States, January-June 2021. MMWR Suppl. 2022;71(3):16–21. doi:10.15585/mmwr.su7103a3

7. McKnight-Eily LR, Okoro CA, Strine TW, et al. Racial and ethnic disparities in the prevalence of stress and worry, mental health conditions, and increased substance use among adults during the COVID-19 pandemic - United States, April and May 2020. MMWR Morb Mortal Wkly Rep. 2021;70(5):162–166. doi:10.15585/mmwr.mm7005a3

8. Crawford A, Serhal E. Digital health equity and COVID-19: the innovation curve cannot reinforce the social gradient of health. J Med Internet Res. 2020;22:e19361.

9. Fair L. FTC Says Online Counseling Service BetterHelp Pushed People into Handing Over Health Information – And Broke Its Privacy Promises. Washington, DC: Federal Trade Commission; 2023.

10. Goldberg SB, Lam SU, Simonsson O, et al. Mobile phone-based interventions for mental health: a systematic meta-review of 14 meta-analyses of randomized controlled trials. PLOS Digit Health. 2022;1:e0000002.

11. Baumel A, Muench F, Edan S, et al. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res. 2019;21(9):e14567. doi:10.2196/14567

12. Connolly SL, Hogan TP, Shimada SL, et al. Leveraging implementation science to understand factors influencing sustained use of mental health apps: a narrative review. J Technol Behav Sci. 2021;6(2):184–196. doi:10.1007/s41347-020-00165-4

13. Raza MM, Venkatesh KP, Kvedar JC. Promoting racial equity in digital health: applying a cross-disciplinary equity framework. NPJ Digit Med. 2023;6(1):3. doi:10.1038/s41746-023-00747-5

14. Greer B, Robotham D, Simblett S, et al. Digital exclusion among mental health service users: qualitative investigation. J Med Internet Res. 2019;21(1):e11696. doi:10.2196/11696

15. Lyles CR, Wachter RM, Sarkar U. Focusing on digital health equity. JAMA. 2021;326(18):1795–1796. doi:10.1001/jama.2021.18459

16. Centers for Medicare & Medicaid Services. 42 CFR Parts 405, 410, 411, 414, 415, 423, 424, 425, and 455. Washington, DC: Centers for Medicare & Medicaid Services; 2022.

17. Mordecai D, Histon T, Neuwirth E, et al. How kaiser permanente created a mental health and wellness digital ecosystem. NEJM Catalyst. 2021;2:1.

18. Connolly SL, Kuhn E, Possemato K, et al. Digital clinics and mobile technology implementation for mental health care. Curr Psychiatry Rep. 2021;23(7):38. doi:10.1007/s11920-021-01254-8

19. Dowrick C, Kassai R, Lam CLK, et al. The APEC digital hub-WONCA collaborative framework on integration of mental health into primary care in the Asia pacific. J Multidiscip Healthc. 2020;13:1693–1704. doi:10.2147/JMDH.S271070

20. Brătucu G, Tudor AIM, Litră AV, et al. Designing the well-being of Romanians by achieving mental health with digital methods and public health promotion. Int J Environ Res Public Health. 2022;19(13):7868. doi:10.3390/ijerph19137868

21. Mota NB, Pimenta J, Tavares M, et al. A Brazilian bottom-up strategy to address mental health in a diverse population over a large territorial area - an inspiration for the use of digital mental health. Psychiatry Res. 2022;311:114477. doi:10.1016/j.psychres.2022.114477

22. Gaebel W, Lukies R, Kerst A, et al. Upscaling e-mental health in Europe: a six-country qualitative analysis and policy recommendations from the eMEN project. Eur Arch Psychiatry Clin Neurosci. 2021;271(6):1005–1016. doi:10.1007/s00406-020-01133-y

23. Yellowlees P. Impact of COVID-19 on mental health care practitioners. Psychiatr Clin North Am. 2022;45(1):109–121. doi:10.1016/j.psc.2021.11.007

24. Trombello JM, David NS, Robbins MA, et al. Burnout during the COVID-19 pandemic: descriptive and predictive data from a survey of psychologists at a single academic medical center. Acad Psychiatry. 2022;46(6):718–722. doi:10.1007/s40596-021-01562-4

25. Thronson LR, Pagalilauan GL. Psychopharmacology. Med Clin North Am. 2014;98(5):927–958. doi:10.1016/j.mcna.2014.06.001

26. Olfson M, Blanco C, Wang S, et al. National trends in the mental health care of children, adolescents, and adults by office-based physicians. JAMA Psychiatry. 2014;71(1):81–90. doi:10.1001/jamapsychiatry.2013.3074

27. Sanchez K, Ybarra R, Chapa T, et al. Eliminating behavioral health disparities and improving outcomes for racial and ethnic minority populations. Psychiatr Serv. 2016;67(1):13–15. doi:10.1176/appi.ps.201400581

28. Siu AL, Bibbins-Domingo K, Grossman DC. US Preventive Services Task Force (USPSTF). Screening for depression in adults: us preventive services task force recommendation statement. JAMA. 2016;315(4):380–387. doi:10.1001/jama.2015.18392

29. Mangione CM, Barry MJ, Nicholson WK; US Preventive Services Task Force. Screening for anxiety in children and adolescents: US preventive services task force recommendation statement. JAMA. 2022;328(14):1438–1444. doi:10.1001/jama.2022.16936

30. Wisniewski H, Gorrindo T, Rauseo-Ricupero N, et al. The role of digital navigators in promoting clinical care and technology integration into practice. Digit Biomark. 2020;4(Suppl. 1):119–135. doi:10.1159/000510144

31. Rodriguez-Villa E, Camacho E, Torous J. Psychiatric rehabilitation through teaching smartphone skills to improve functional outcomes in serious mental illness. Internet Interv. 2021;23:100366. doi:10.1016/j.invent.2021.100366

32. Camacho E, Cohen A, Torous J. Assessment of mental health services available through smartphone apps. JAMA Netw Open. 2022;5:e2248784.

33. Harding C, Ilves P, Wilson S. Digital mental health services in general practice. Br J Gen Pract. 2015;65(631):58–59. doi:10.3399/bjgp15X683377

34. Balasubramanian BA, Cohen DJ, Jetelina KK, et al. Outcomes of integrated behavioral health with primary care. J Am Board Fam Med. 2017;30(2):130–139. doi:10.3122/jabfm.2017.02.160234

35. Ross KM, Klein B, Ferro K, et al. The cost effectiveness of embedding a behavioral health clinician into an existing primary care practice to facilitate the integration of care: a prospective, case-control program evaluation. J Clin Psychol Med Settings. 2019;26(1):59–67. doi:10.1007/s10880-018-9564-9

36. Nwosu A, Boardman S, Husain MM, et al. Digital therapeutics for mental health: is attrition the achilles heel? Front Psychiatry. 2022;13:900615. doi:10.3389/fpsyt.2022.900615

37. Chang S, Gray L, Torous J. Smartphone app engagement and clinical outcomes in a hybrid clinic. Psychiatry Res. 2023;319:115015. doi:10.1016/j.psychres.2022.115015

38. Currey D, Torous J. Digital phenotyping correlations in larger mental health samples: analysis and replication. BJPsych Open. 2022;8(4):e106. doi:10.1192/bjo.2022.507

39. Lewis CC, Boyd M, Puspitasari A, et al. Implementing measurement-based care in behavioral health: a review. JAMA Psychiatry. 2019;76(3):324–335. doi:10.1001/jamapsychiatry.2018.3329

40. Shiner B, Watts BV. Invited commentary: baby steps to a learning mental health-care system-can we do the work? Am J Epidemiol. 2021;190(7):1220–1222. doi:10.1093/aje/kwaa261

41. Scheuer L, Torous J. Usable data visualization for digital biomarkers: an analysis of usability, data sharing, and clinician contact. Digit Biomark. 2022;6(3):98–106. doi:10.1159/000525888

42. AIMS Center. Principles of Collaborative Care. Seattle, WA: University of Washington; 2023.

43. Possemato K, Johnson EM, Beehler GP, et al. Patient outcomes associated with primary care behavioral health services: a systematic review. Gen Hosp Psychiatry. 2018;53:1–11. doi:10.1016/j.genhosppsych.2018.04.002

44. Ramanuj P, Ferenchik E, Docherty M, et al. Evolving models of integrated behavioral health and primary care. Curr Psychiatry Rep. 2019;21(1):4. doi:10.1007/s11920-019-0985-4

45. Kvedar JC, Mittermaier M, Pritzker J. The industry impact of the American medical association’s Digital Medicine Payment Advisory Group (DMPAG). NPJ Digit Med. 2022;5(1):193. doi:10.1038/s41746-022-00743-1

Creative Commons License © 2024 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.