Back to Journals » Open Access Journal of Clinical Trials » Volume 5

Publication bias: what is it? How do we measure it? How do we avoid it?

Authors Song F, Hooper L, Loke Y

Received 12 April 2013

Accepted for publication 22 May 2013

Published 4 July 2013 Volume 2013:5 Pages 71—81


Checked for plagiarism Yes

Review by Single-blind

Peer reviewer comments 4

Fujian Song, Lee Hooper, Yoon K Loke

Norwich Medical School, University of East Anglia, Norwich, UK

Abstract: Publication bias occurs when results of published studies are systematically different from results of unpublished studies. The term "dissemination bias" has also been recommended to describe all forms of biases in the research-dissemination process, including outcome-reporting bias, time-lag bias, gray-literature bias, full-publication bias, language bias, citation bias, and media-attention bias. We can measure publication bias by comparing the results of published and unpublished studies addressing the same question. Following up cohorts of studies from inception and comparing publication levels in studies with statistically significant or "positive" results suggested greater odds of formal publication in those with such results, compared to those without. Within reviews, funnel plots and related statistical methods can be used to indicate presence or absence of publication bias, although these can be unreliable in many circumstances. Methods of avoiding publication bias, by identifying and including unpublished outcomes and unpublished studies, are discussed and evaluated. These include searching without limiting by outcome, searching prospective trials registers, searching informal sources, including meeting abstracts and PhD theses, searching regulatory body websites, contacting authors of included studies, and contacting pharmaceutical or medical device companies for further studies. Adding unpublished studies often alters effect sizes, but may not always eliminate publication bias. The compulsory registration of all clinical trials at inception is an important move forward, but it can be difficult for reviewers to access data from unpublished studies located this way. Publication bias may be reduced by journals by publishing high-quality studies regardless of novelty or unexciting results, and by publishing protocols or full-study data sets. No single step can be relied upon to fully overcome the complex actions involved in publication bias, and a multipronged approach is required by researchers, patients, journal editors, peer reviewers, research sponsors, research ethics committees, and regulatory and legislation authorities.

publication bias, reporting bias, research-dissemination bias, evidence synthesis, systematic review, meta-analysis

Creative Commons License This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.

Download Article [PDF] 


Readers of this article also read:

Sarcopenia and impairment in cognitive and physical performance

Tolea MI, Galvin JE

Clinical Interventions in Aging 2015, 10:663-671

Published Date: 30 March 2015

Green synthesis of water-soluble nontoxic polymeric nanocomposites containing silver nanoparticles

Prozorova GF, Pozdnyakov AS, Kuznetsova NP, Korzhova SA, Emel’yanov AI, Ermakova TG, Fadeeva TV, Sosedova LM

International Journal of Nanomedicine 2014, 9:1883-1889

Published Date: 16 April 2014

Methacrylic-based nanogels for the pH-sensitive delivery of 5-Fluorouracil in the colon

Ashwanikumar N, Kumar NA, Nair SA, Kumar GS

International Journal of Nanomedicine 2012, 7:5769-5779

Published Date: 15 November 2012

A novel preparation method for silicone oil nanoemulsions and its application for coating hair with silicone

Hu Z, Liao M, Chen Y, Cai Y, Meng L, Liu Y, Lv N, Liu Z, Yuan W

International Journal of Nanomedicine 2012, 7:5719-5724

Published Date: 12 November 2012

Cross-linked acrylic hydrogel for the controlled delivery of hydrophobic drugs in cancer therapy

Deepa G, Thulasidasan AK, Anto RJ, Pillai JJ, Kumar GS

International Journal of Nanomedicine 2012, 7:4077-4088

Published Date: 27 July 2012

Crystallization after intravitreal ganciclovir injection

Pitipol Choopong, Nattaporn Tesavibul, Nattawut Rodanant

Clinical Ophthalmology 2010, 4:709-711

Published Date: 14 July 2010