Back to Journals » Medical Devices: Evidence and Research » Volume 11

Critical appraisal concerning “Wearable cardioverter defibrillators for the prevention of sudden cardiac arrest: a health technology assessment and patient focus group study”

Authors Sperzel J, Staudacher I, Goeing O , Stockburger M, Meyer T, Oliveira Gonçalves AS, Sydow H, Schoenfelder T, Amelung VE

Received 16 February 2018

Accepted for publication 7 March 2018

Published 8 June 2018 Volume 2018:11 Pages 201—204

DOI https://doi.org/10.2147/MDER.S165770

Checked for plagiarism Yes

Editor who approved publication: Dr Scott Fraser



Johannes Sperzel,1 Ingo Staudacher,2 Olaf Goeing,3 Martin Stockburger,4 Thorsten Meyer,5 Ana Sofia Oliveira Gonçalves,6 Hanna Sydow,6 Tonio Schoenfelder,6 Volker Eric Amelung6

1Department of Cardiology, Hospital Kerckhoff Klinik GmbH, Bad Nauheim, Germany; 2Department of Cardiology, Medical University Hospital Heidelberg, Heidelberg, Germany; 3Department of Cardiology, Sana-Hospital Lichtenberg, Berlin, Germany; 4Medical Department I, Havelland Kliniken GmbH, Nauen, Germany; 5Department of Public Health, Universität Bielefeld, Bielefeld, Germany; 6Institute for Applied Health Services Research, inav – privates Institut für angewandte Versorgungsforschung GmbH, Berlin, Germany

We read with great interest the article “Wearable cardioverter defibrillators for the prevention of sudden cardiac arrest: a health technology assessment and patient focus group study” by Ettinger et al. The authors conclude that wearable cardioverter defibrillators (WCDs) seem to be fairly safe in the short-to-medium term, but the quality of the available evidence is low. They also state that – according to their study inclusion criteria – they were not able to identify studies to assess the clinical effectiveness of the WCD. Given the importance of WCD for its target population and considering our clinical expertise, we see a particular need to clarify some points of this article.


Author's Reply

Sabine Ettinger,1 Michal Stanak,1 Piotr Szymański,2 Claudia Wild,1 Romana Tandara Haček,3 Darija Erčević,3 Renata Grenković,3 Mirjana Huić3

1Ludwig Boltzmann Institute for Health Technology Assessment, Vienna, Austria; 2Institute of Cardiology, Warsaw, Poland; 3Department for Development, Research and Health Technology Assessment, Agency for Quality and Accreditation in Health Care and Social Welfare, Zagreb, Croatia

We read the letter to the editor with regard to our published paper on “Wearable cardioverter defibrillators for the prevention of sudden cardiac arrest: a health technology assessment and patient focus group study” and gladly take the opportunity to appropriately address and clarify the issues that were raised. 


View the original paper by Ettinger and colleagues.

Two further letters have been published

Sperzel et al

Ettinger et al

 

Dear editor

We read with great interest the article “Wearable cardioverter defibrillators for the prevention of sudden cardiac arrest: a health technology assessment and patient focus group study” by Ettinger et al.1 The authors conclude that wearable cardioverter defibrillators (WCDs) seem to be fairly safe in the short-to-medium term, but the quality of the available evidence is low. They also state that – according to their study inclusion criteria – they were not able to identify studies to assess the clinical effectiveness of the WCD. Given the importance of WCD for its target population and considering our clinical expertise, we see a particular need to clarify some points of this article.

The authors consider an implantable cardioverter defibrillator (ICD) as a WCD comparator. However, it is important to clarify that a WCD is not a substitute for an ICD, since it will only be temporarily worn. Treatment with a WCD may be considered for patients with a high risk of sudden cardiac death who are currently not candidates for an ICD.

Health Technology Assessments systematically aim to evaluate the effects of a technology on different health aspects, by collecting as much evidence as possible. This includes not only randomized controlled studies, but also studies with “weaker” designs should be considered and results should be discussed, taking into consideration their hierarchical importance in terms of internal validity.2 Ettinger et al1 decided to exclude retrospective studies, but this type of study design is not only the most often applied to evaluate the WCD’s effects, it is also the one that embodies by far the largest number of patients, such as that of Epstein et al,3 (N=8,678), Zishiri et al,4 (N=4,149), and Chung et al,5 (N=3,569). Simultaneously, the authors included case series involving very few patients (Duncker et al6 [n=7 of N=12 with WCD] and Kondo et al7 [N=24]), making it questionable why small one-armed case series are preferred to large retrospective studies with several thousand patients. The narrow inclusion criteria led to the nonidentification of publications for efficacy studies on the WCD.

The authors did not account for the heterogeneity in study designs (interventional single-arm study, prospective case series, and prospective registry studies), when reporting the research results: findings were summarized for N=2,000 (Kutyifa et al8) patients together with a case series including only N=12 patients (Duncker et al6). We suggest that the study results are presented in a way that takes into account differing study methodologies as well as differing study populations.

The authors claim to have conducted a focus group, although the requirements are not fulfilled. Only 5 participants, who had all undergone heart transplantation, were included, none with practical experience in using the WCD, none with an indication for a WCD, and none with knowledge regarding its technology. Thus, participants could not meaningfully comment on the possible use of the WCD. It is highly questionable how accurately the focus group participants were informed about the devices’ functionalities: participants seem concerned that patients must decide when to receive a shock by pressing the WCD response buttons. This suggests a serious misunderstanding. It is crucial to highlight that patients can neither prevent an appropriate therapy nor trigger inappropriate shocks by pressing the WCD response buttons. Shocks must only be triggered when patients are in an unconscious state. We find it rather misleading that findings of what was apparently a single-group interview have been reported as if they were results of a qualitative study.

In our opinion, it is of high relevance to make the reader aware of the aforementioned limitations and how they influence the conclusions of the publication.

Disclosure

Ana Sofia Oliveira Gonçalves, Hanna Sydow, Tonio Schoenfelder, and Volker Eric Amelung received financial support from Zoll GmbH for the submitted work. The authors report no other conflicts of interest in this communication.

References

1.

Ettinger S, Stanak M, Szymański P, et al. Wearable cardioverter defibrillators for the prevention of sudden cardiac arrest: a health technology assessment and patient focus group study. Med Devices. 2017;14;10:257–271.

2.

Drummond MF, Schwartz JS, Jonsson B, et al. Key principles for the improved conduct of health technology assessments for resource allocation decisions. Int J Technol Assess Health Care. 2008;24(3):244–258; discussion 362–368.

3.

Epstein AE, Abraham WT, Bianco NR, et al. Wearable cardioverter-defibrillator use in patients perceived to be at high risk early post-myocardial infarction. J Am Coll Cardiol. 2013;62(21):2000–2007.

4.

Zishiri ET, Williams S, Cronin EM, et al. Early risk of mortality after coronary artery revascularization in patients with left ventricular dysfunction and potential role of the wearable cardioverter defibrillator. Circ Arrhythm Electrophysiol. 2013;6(1):117–128.

5.

Chung MK, Szymkiewicz SJ, Shao M, et al. Aggregate national experience with the wearable cardioverter-defibrillator: event rates, compliance, and survival. J Am Coll Cardiol. 2010;56(3):194–203.

6.

Duncker D, Haghikia A, König T, et al. Risk for ventricular fibrillation in peripartum cardiomyopathy with severely reduced left ventricular function-value of the wearable cardioverter/defibrillator. Eur J Heart Fail. 2014;16(12):1331–1336.

7.

Kondo Y, Linhart M, Andrié RP, Schwab JO. Usefulness of the wearable cardioverter defibrillator in patients in the early post-myocardial infarction phase with high risk of sudden cardiac death: a single-center European experience. J Arrhythm. 2015;31(5):293–295.

8.

Kutyifa V, Moss AJ, Klein H, et al. Use of the wearable cardioverter defibrillator in high-risk cardiac patients: data from the Prospective Registry of Patients Using the Wearable Cardioverter Defibrillator (WEARIT-II Registry). Circulation. 2015;132(17):1613–1619.

Authors’ reply

Sabine Ettinger1, Michal Stanak1, Piotr Szymański2, Claudia Wild1, Romana Tandara Haček3, Darija Erčević3, Renata Grenković3, Mirjana Huić3

1Ludwig Boltzmann Institute for Health Technology Assessment, Vienna, Austria; 2Institute of Cardiology, Warsaw, Poland; 3Department for Development, Research and Health Technology Assessment, Agency for Quality and Accreditation in Health Care and Social Welfare, Zagreb, Croatia

Correspondence: Sabine Ettinger, Ludwig Boltzmann Institute for Health Technology Assessment, Garnisongasse, 7/20, 1090 Vienna, Austria
Tel +43 1 236 8119 ext 25
Fax +43 1 236 8119 ext 99
Email [email protected]

Dear editor

We read the letter to the editor with regard to our published paper on “Wearable cardioverter defibrillators for the prevention of sudden cardiac arrest: a health technology assessment and patient focus group study” and gladly take the opportunity to appropriately address and clarify the issues that were raised.

Following the processes and procedures established by the European network for Health Technology Assessment (EUnetHTA), this HTA is a result of a cooperation between a wide range of European HTA institutes, experienced cardiologists, and methodological experts.

We would like to clarify that it is not the case that the wearable cardioverter defibrillator (WCD) is only to be used in situations when the use of an implantable cardioverter defibrillator (ICD) is not possible or as a bridge to an ICD, but it may also be used in situations where the two can be compared (ie, post myocardial infarction [MI]). MADIT II and VALIANT trials suggest that there is no mortality benefit from an ICD implantation immediately post MI. However, to prove a mortality benefit from WCD in that time period, a controlled trial needs to be conducted. It needs to be established and proven that WCD has an added therapeutic benefit (including clinical as well as quality of life benefits).1 In addition, currently there is an ongoing, controlled, Zoll Medical Corporation-funded, VEST trial comparing WCD and conventional treatment immediately post MI; this can be interpreted as Zoll considering this patient group as potential candidates for the use of WCD. WCD is also used in patients who refuse ICD therapy, so it is important to see the relative effectiveness of a WCD in comparison to an ICD. This is appropriately defined in the Population–Intervention–Comparison–Outcome study design in our paper.

We recognize that the assessment of medical devices might be subject to specific challenges in comparison to pharmaceutical technologies. Randomized controlled trials (RCTs) are nonetheless the preferred study design for evaluation of effectiveness since they provide the most robust evidence. Nonrandomized intervention studies or observational studies might be included in the evaluation of effectiveness under certain conditions: no RCT was performed, no RCT was yet published, no RCT was feasible, or the observational data complemented RCTs.2 In the case of WCD, we concluded that an RCT is possible (one is already ongoing), and the lack of required controlled trials was previously also acknowledged by other organizations eg, the American Heart Association3 and the BlueCross BlueShield Association.4 We also allowed for inclusion of nonrandomized controlled studies in the effectiveness domain in the attempt of providing the “best guess,” rather than having no answer at all, for the relatively new technology of WCD.5 For the evaluation of safety, we also took account of prospective observational studies since they could help identify other or less frequent types of risks.

It is important to state that the goal of HTA is not to collect as much evidence as possible but to collect as much high-quality evidence as possible for making a valid conclusion. The hierarchy of evidence shows systematic reviews and meta-analysis at the top, followed by RCTs, quasi-experimental studies (like nonrandomized controlled trials), observational studies (prospective, retrospective), and expert opinion at the bottom. Study designs at the bottom of the hierarchy are often more prone to various different kinds of bias (eg, selection bias, information bias, etc.) than the ones at the top. The Grading of Recommendations, Assessment, Development and Evaluation – GRADE – methodology shows that the quality of evidence from observational studies (especially retrospective studies) is usually low to very low.6,7 As stated in our paper, we excluded retrospective studies since only prospective evidence can provide robust and reliable data in both effectiveness and safety domains. Moreover, we did not find any reason to go further down the hierarchy of the evidence. Furthermore, the inclusion of other study designs may mislead manufacturers into the false belief that RCTs and controlled studies are not required and, therefore, not worthwhile to perform.5 After consultation with a statistician, we decided to also include studies with a small sample size, in order to present all the existing prospective research on WCD.

We recognize the issue of heterogeneity in the studies that we have included in our assessment. Due to the great variety of indications, there also exists a wide range of study populations that are included in different study designs. We have presented the results in an extensive extraction table within our paper, which should enable the reader to differentiate the results of the different study designs appropriately.

The focus group participants definitely fulfilled our criteria to comment on the possible use of WCD since all patients who were selected would have qualified for the use of a WCD at one point in their disease history. As described in our paper, our intention was to evaluate perspectives of patients on areas of their cardiac disease and on the possible use of WCD therapy. We highly valued the questions from the patients with regard to device functionalities, which showed the importance of patient information and training in order to enable patient compliance. We used the terminology “qualitative study” since we followed the steps that are conducted in qualitative research: we framed the research question and the research design including a data collection method. The questions to the focus group participants were prepared based on available literature (as explained in our paper), and the results of the focus group were appropriately recorded, transcribed, and analyzed.8

We appreciate the critical review of our paper and hope to have clarified the issues raised for your readers.

Disclosure

The authors report no conflicts of interest in this communication.

References

1.

European network for Health Technology Assessment (EUnetHTA). COMPARATORS & COMPARISONS: direct and indirect comparisons; 2015 [cited March 17, 2018]. Available from: https://www.eunethta.eu/wp-content/uploads/2018/03/Direct_comparators_comparisons.pdf. Accessed April 24, 2018.

2.

European network for Health Technology Assessment (EUnetHTA). Rapid Relative Effectiveness Assessments (4.2); 2016 [cited March 17, 2018]. Available from: http://meka.thl.fi/htacore/ViewApplication.aspx?id=25468. Accessed April 24, 2018.

3.

Piccini JP Sr, Allen LA, Kudenchuk PJ, et al. Wearable cardioverter-defibrillator therapy for the prevention of sudden cardiac death: a Science advisory from the American Heart Association. Circulation. 2016;133(17):1715–1727.

4.

BlueCross BlueShield Association. Wearable cardioverter-defibrillator as a bridge to implantable cardioverter-defibrillator treatment. TEC Assessment Program. Chicago, IL: Blue Cross Blue Shield Association (BCBSA); 2010.

5.

European network for Health Technology Assessment (EUnetHTA). Internal validity of non-randomised studies (NRS) on interventions; 2015 [cited March 17, 2018]. Available from: https://www.eunethta.eu/wp-content/uploads/2018/01/Internal-validity-of-non-randomised-studies-NRS-on-interventions_Guideline_Final-Jul-2015.pdf. Accessed April 24, 2018.

6.

Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401–406.

7.

Schünemann H, Brożek J, Guyatt G, Oxman A. GRADE Handbook. 2013. Available from: http://gdt.guidelinedevelopment.org/app/handbook/handbook.html. Accessed April 24, 2018.

8.

Durand MA, Chantler T. Principles of Social Research. London: Open University Press; 2014.

Dove Medical Press encourages responsible, free and frank academic debate. The content of the Medical Devices: Evidence and Research ‘letters to the editor’ section does not necessarily represent the views of Dove Medical Press, its officers, agents, employees, related entities or the Medical Devices: Evidence and Research editors. While all reasonable steps have been taken to confirm the content of each letter, Dove Medical Press accepts no liability in respect of the content of any letter, nor is it responsible for the content and accuracy of any letter to the editor.

Creative Commons License © 2018 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.