Back to Journals » Open Access Medical Statistics » Volume 2

Comparing the performance of different multiple imputation strategies for missing binary outcomes in cluster randomized trials: a simulation study

Authors Ma J, Raina P, Beyene J, Thabane L

Received 5 July 2012

Accepted for publication 25 July 2012

Published 20 December 2012 Volume 2012:2 Pages 93—103

DOI https://doi.org/10.2147/OAMS.S35621

Checked for plagiarism Yes

Review by Single-blind

Peer reviewer comments 2

Jinhui Ma,1–3 Parminder Raina,1,2 Joseph Beyene,1 Lehana Thabane1,3–5

1Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, ON, Canada; 2McMaster University Evidence-based Practice Center, Hamilton, ON, Canada; 3Biostatistics Unit, St Joseph's Healthcare Hamilton, Hamilton, ON, Canada; 4Centre for Evaluation of Medicines, St Joseph's Healthcare Hamilton, Hamilton, ON, Canada; 5Population Health Research Institute, Hamilton Health Sciences, Hamilton, ON, Canada

Introduction: Although researchers have proposed various strategies to handle missing outcomes in cluster randomized trials (CRTs), limited attention has been paid to the performance of these strategies. Under the assumption of covariate-dependent missingness, the objective of this simulation study is to compare the performance of various strategies in handling missing binary outcomes in CRTs under different design settings.
Methods: There are six missing data strategies investigated in this paper, which include complete case analysis, standard multiple imputation (MI) strategies using either logistic regression or Markov chain Monte Carlo (MCMC) method, within-cluster MI strategies using either logistic regression or MCMC method, and MI using logistic regression with cluster as a fixed effect. The performance of these strategies is evaluated through bias, empirical standard error, root mean squared error, and coverage probability.
Results: Under the assumption of covariate-dependent missingness and applying the generalized estimating equations approach for fitting the logistic regression, it was shown that complete case analysis yields valid inferences when the percentage of missing outcomes is not large (<20%) for all the designs of CRTs considered in this paper. Standard MI strategies can be adopted when the design effect is small (variance inflation factor [VIF] ≤ 3); however, they tend to underestimate the standard error of treatment effect when the design effect is large. Within-cluster MI strategy using logistic regression is valid for imputation of missing data from CRTs, especially when the cluster size is large (>50) and the design effect is large (VIF > 3). In contrast, within-cluster MI strategy using MCMC method may yield biased estimates of treatment effect for CRTs with small cluster size (≤50). MI using logistic regression with cluster as a fixed effect may substantially overestimate the standard error of the estimated treatment effect when the intracluster correlation coefficient is small. It may also lead to biased estimated treatment effect.
Conclusion: Findings from this simulation study provide researchers with quantitative evidence to guide selection of an appropriate strategy to deal with missing binary outcomes.

Keywords: missing data, design effect, variance inflation factor

Creative Commons License This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.

Download Article [PDF] 

 

Other articles by this author:

Reporting quality of stepped wedge design randomized trials: a systematic review protocol

Thabane A, Dennis BB, Gajic-Veljanoski O, Paul J, Thabane L

Clinical Epidemiology 2016, 8:261-266

Published Date: 8 July 2016

A systematic scoping review of adherence to reporting guidelines in health care literature

Samaan Z, Mbuagbaw L, Kosa D, Borg Debono V, Dillenburg R, Zhang S, Fruci V, Dennis B, Bawor M, Thabane L

Journal of Multidisciplinary Healthcare 2013, 6:169-188

Published Date: 6 May 2013

Mentoring in biostatistics: some suggestions for reform

Odueyungbo A, Thabane L

Journal of Multidisciplinary Healthcare 2012, 5:265-272

Published Date: 15 October 2012

Comparison of various modeling approaches in the analysis of longitudinal data with a binary outcome: The Ontario Mother and Infant Study (TOMIS) III

Bai YQ, Foster G, Sword W, Krueger P, Kurtz Landy C, Watt S, Thabane L

Open Access Medical Statistics 2012, 2:43-51

Published Date: 19 July 2012

Readers of this article also read:

Generating productive dialogue between consulting statisticians and their clients in the pharmaceutical and medical research settings

Emir B, Amaratunga D, Beltangady M, Cabrera J, Freeman R, Madigan D, Nguyen H, Whalen E

Open Access Medical Statistics 2013, 3:51-56

Published Date: 16 September 2013

Analysis of tooth decay data in Japan using asymmetric statistical models

Yamamoto K, Tomizawa S

Open Access Medical Statistics 2012, 2:61-64

Published Date: 19 November 2012

Body mass index and the risk of prostate cancer

McGee DL, Crespo CJ

Open Access Medical Statistics 2012, 2:53-60

Published Date: 27 September 2012

Comparison of various modeling approaches in the analysis of longitudinal data with a binary outcome: The Ontario Mother and Infant Study (TOMIS) III

Bai YQ, Foster G, Sword W, Krueger P, Kurtz Landy C, Watt S, Thabane L

Open Access Medical Statistics 2012, 2:43-51

Published Date: 19 July 2012

Setting sample size using cost efficiency in fMRI studies

Guo Q, Hall G, McKinnon M, Thabane L, Goeree R, Pullenayegum E

Open Access Medical Statistics 2012, 2:33-41

Published Date: 21 May 2012

Appropriate statistical testing of quality of life scores from children with asthma and their caregivers

Myers JA, Steiner RWP, Legleiter J, Chen YT, Esterhay RJ

Open Access Medical Statistics 2012, 2:15-20

Published Date: 20 February 2012

Assessment of reaching proficiency in procedural skills: fiberoptic airway simulator training in novices

Duan X, Wu D, Bautista AF, Akca O, Carter MB, Latif RK

Open Access Medical Statistics 2011, 1:45-50

Published Date: 17 November 2011