Back to Journals » Pragmatic and Observational Research » Volume 8

An evaluation of exact matching and propensity score methods as applied in a comparative effectiveness study of inhaled corticosteroids in asthma

Authors Burden A, Roche N, Miglio C, Hillyer EV, Postma DS, Herings RMC, Overbeek JA, Khalid JM, van Eickels D, Price DB

Received 17 September 2016

Accepted for publication 19 December 2016

Published 22 March 2017 Volume 2017:8 Pages 15—30


Checked for plagiarism Yes

Review by Single-blind

Peer reviewers approved by Dr Akshita Wason

Peer reviewer comments 3

Editor who approved publication: Professor Christoph Meier

Anne Burden,1 Nicolas Roche,2 Cristiana Miglio,1 Elizabeth V Hillyer,1 Dirkje S Postma,3 Ron MC Herings,4 Jetty A Overbeek,4 Javaria Mona Khalid,5 Daniela van Eickels,6 David B Price1,7

1Observational and Pragmatic Research Institute Pte Ltd, Singapore; 2University Paris Descartes (EA2511), Cochin Hospital Group (AP-HP), Paris, France; 3Department of Pulmonology, University Medical Center Groningen, University of Groningen, Groningen, 4PHARMO Institute for Drug Outcomes Research, Utrech, the Netherlands; 5Takeda Development Centre Europe Ltd, London, UK; 6Takeda Pharmaceuticals International GmbH, Zurich, Switzerland; 7Academic Primary Care, University of Aberdeen, Aberdeen, UK

Background: Cohort matching and regression modeling are used in observational studies to control for confounding factors when estimating treatment effects. Our objective was to evaluate exact matching and propensity score methods by applying them in a 1-year pre–post historical database study to investigate asthma-related outcomes by treatment.
Methods: We drew on longitudinal medical record data in the PHARMO database for asthma patients prescribed the treatments to be compared (ciclesonide and fine-particle inhaled corticosteroid [ICS]). Propensity score methods that we evaluated were propensity score matching (PSM) using two different algorithms, the inverse probability of treatment weighting (IPTW), covariate adjustment using the propensity score, and propensity score stratification. We defined balance, using standardized differences, as differences of <10% between cohorts.
Results: Of 4064 eligible patients, 1382 (34%) were prescribed ciclesonide and 2682 (66%) fine-particle ICS. The IPTW and propensity score-based methods retained more patients (96%–100%) than exact matching (90%); exact matching selected less severe patients. Standardized differences were >10% for four variables in the exact-matched dataset and <10% for both PSM algorithms and the weighted pseudo-dataset used in the IPTW method. With all methods, ciclesonide was associated with better 1-year asthma-related outcomes, at one-third the prescribed dose, than fine-particle ICS; results varied slightly by method, but direction and statistical significance remained the same.
Conclusion: We found that each method has its particular strengths, and we recommend at least two methods be applied for each matched cohort study to evaluate the robustness of the findings. Balance diagnostics should be applied with all methods to check the balance of confounders between treatment cohorts. If exact matching is used, the calculation of a propensity score could be useful to identify variables that require balancing, thereby informing the choice of matching criteria together with clinical considerations.

Keywords: asthma, exact matching, propensity score, observational

Creative Commons License This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.

Download Article [PDF]  View Full Text [HTML][Machine readable]


Other articles by this author:

Seasonal patterns of oral antihistamine and intranasal corticosteroid purchases from Australian community pharmacies: a retrospective observational study

Carney AS, Price DB, Smith PK, Harvey R, Kritikos V, Bosnic-Anticevich SZ, Christian L, Skinner DA, Carter V, Durieux AMS

Pragmatic and Observational Research 2017, 8:157-165

Published Date: 30 August 2017

Asthma referrals: a key component of asthma management that needs to be addressed

Price D, Bjermer L, Bergin DA, Martinez R

Journal of Asthma and Allergy 2017, 10:209-223

Published Date: 25 July 2017

Cardiovascular risks in smokers treated with nicotine replacement therapy: a historical cohort study

Dollerup J, Vestbo J, Murray-Thomas T, Kaplan A, Martin RJ, Pizzichini E, Pizzichini MMM, Burden A, Martin J, Price DB

Clinical Epidemiology 2017, 9:231-243

Published Date: 26 April 2017

Does co-payment for inhaler devices affect therapy adherence and disease outcomes? A historical, matched cohort study

Voorham J, Vrijens B, van Boven JFM, Ryan D, Miravitlles M, Law LM, Price DB

Pragmatic and Observational Research 2017, 8:31-41

Published Date: 18 April 2017

The use of multiple respiratory inhalers requiring different inhalation techniques has an adverse effect on COPD outcomes

Bosnic-Anticevich S, Chrystyn H, Costello RW, Dolovich MB, Fletcher MJ, Lavorini F, Rodríguez-Roisin R, Ryan D, Wan Yau Ming S, Price DB

International Journal of Chronic Obstructive Pulmonary Disease 2017, 12:59-71

Published Date: 21 December 2016

Predicting frequent COPD exacerbations using primary care data

Kerkhof M, Freeman D, Jones R, Chisholm A, Price DB

International Journal of Chronic Obstructive Pulmonary Disease 2015, 10:2439-2450

Published Date: 9 November 2015

The inevitable drift to triple therapy in COPD: an analysis of prescribing pathways in the UK

Brusselle G, Price D, Gruffydd-Jones K, Miravitlles M, Keininger DL, Stewart R, Baldwin M, Jones RC

International Journal of Chronic Obstructive Pulmonary Disease 2015, 10:2207-2217

Published Date: 15 October 2015

Comparing the effectiveness of small-particle versus large-particle inhaled corticosteroid in COPD

Postma DS, Roche N, Colice G, Israel E, Martin RJ, van Aalderen WMC, Grigg J, Burden A, Hillyer EV, von Ziegenweidt J, Gopalan G, Price D

International Journal of Chronic Obstructive Pulmonary Disease 2014, 9:1163-1186

Published Date: 17 October 2014

Management of COPD in the UK primary-care setting: an analysis of real-life prescribing patterns

Price D, West D, Brusselle G, Gruffydd-Jones K, Jones R, Miravitlles M, Rossi A, Hutton C, Ashton VL, Stewart R, Bichel K

International Journal of Chronic Obstructive Pulmonary Disease 2014, 9:889-905

Published Date: 27 August 2014

Impact of night-time symptoms in COPD: a real-world study in five European countries

Price D, Small M, Milligan G, Higgins V, Garcia Gil E, Estruch J

International Journal of Chronic Obstructive Pulmonary Disease 2013, 8:595-603

Published Date: 27 November 2013