Simulation study comparing exposure matching with regression adjustment in an observational safety setting with group sequential monitoring
- PMID: 25510526
- DOI: 10.1002/sim.6398
Simulation study comparing exposure matching with regression adjustment in an observational safety setting with group sequential monitoring
Abstract
Sequential methods are well established for randomized clinical trials (RCTs), and their use in observational settings has increased with the development of national vaccine and drug safety surveillance systems that monitor large healthcare databases. Observational safety monitoring requires that sequential testing methods be better equipped to incorporate confounder adjustment and accommodate rare adverse events. New methods designed specifically for observational surveillance include a group sequential likelihood ratio test that uses exposure matching and generalized estimating equations approach that involves regression adjustment. However, little is known about the statistical performance of these methods or how they compare to RCT methods in both observational and rare outcome settings. We conducted a simulation study to determine the type I error, power and time-to-surveillance-end of group sequential likelihood ratio test, generalized estimating equations and RCT methods that construct group sequential Lan-DeMets boundaries using data from a matched (group sequential Lan-DeMets-matching) or unmatched regression (group sequential Lan-DeMets-regression) setting. We also compared the methods using data from a multisite vaccine safety study. All methods had acceptable type I error, but regression methods were more powerful, faster at detecting true safety signals and less prone to implementation difficulties with rare events than exposure matching methods. Method performance also depended on the distribution of information and extent of confounding by site. Our results suggest that choice of sequential method, especially the confounder control strategy, is critical in rare event observational settings. These findings provide guidance for choosing methods in this context and, in particular, suggest caution when conducting exposure matching.
Keywords: generalized estimating equations; matching; observational study; regression; sequential monitoring; vaccine safety.
Copyright © 2014 John Wiley & Sons, Ltd.
Similar articles
-
Challenges in the design and analysis of sequentially monitored postmarket safety surveillance evaluations using electronic observational health care data.Pharmacoepidemiol Drug Saf. 2012 Jan;21 Suppl 1:62-71. doi: 10.1002/pds.2324. Pharmacoepidemiol Drug Saf. 2012. PMID: 22262594
-
Leveraging the entire cohort in drug safety monitoring: part 1 methods for sequential surveillance that use regression adjustment or weighting to control confounding in a multisite, rare event, distributed data setting.J Clin Epidemiol. 2019 Aug;112:77-86. doi: 10.1016/j.jclinepi.2019.04.012. Epub 2019 May 18. J Clin Epidemiol. 2019. PMID: 31108199 Review.
-
Methods for observational post-licensure medical product safety surveillance.Stat Methods Med Res. 2015 Apr;24(2):177-93. doi: 10.1177/0962280211413452. Epub 2011 Dec 2. Stat Methods Med Res. 2015. PMID: 22138688 Review.
-
Statistical approaches to group sequential monitoring of postmarket safety surveillance data: current state of the art for use in the Mini-Sentinel pilot.Pharmacoepidemiol Drug Saf. 2012 Jan;21 Suppl 1:72-81. doi: 10.1002/pds.2320. Pharmacoepidemiol Drug Saf. 2012. PMID: 22262595
-
Continuous sequential boundaries for vaccine safety surveillance.Stat Med. 2014 Aug 30;33(19):3387-97. doi: 10.1002/sim.6161. Epub 2014 Apr 1. Stat Med. 2014. PMID: 24691986
Cited by 1 article
-
Near real-time vaccine safety surveillance using electronic health records-a systematic review of the application of statistical methods.Pharmacoepidemiol Drug Saf. 2016 Mar;25(3):225-37. doi: 10.1002/pds.3966. Epub 2016 Jan 28. Pharmacoepidemiol Drug Saf. 2016. PMID: 26817940 Free PMC article. Review.