Does information from ClinicalTrials.gov increase transparency and reduce bias? Results from a five-report case series

Gaelen P. Adam, Stacey Springs, Thomas Trikalinos, John W. Williams, Jennifer L. Eaton, Megan Von Isenburg, Jennifer M. Gierisch, Lisa M. Wilson, Karen A. Robinson, Meera Viswanathan, Jennifer Cook Middleton, Valerie L. Forman-Hoffman, Elise Berliner, Robert M. Kaplan

We investigated whether information in ClinicalTrials.gov would impact the conclusions of five ongoing systematic reviews. We considered five reviews that included 495 studies total. Each review team conducted a search of ClinicalTrials.gov up to the date of the review's last literature search, screened the records using the review's eligibility criteria, extracted information, and assessed risk of bias and applicability. Each team then evaluated the impact of the evidence found in ClinicalTrials.gov on the conclusions in the review. Across the five reviews, the number of studies that had both a registry record and a publication varied widely, from none in one review to 43% of all studies identified in another. Among the studies with both a record and publication, there was also wide variability in the match between published outcomes and those listed in ClinicalTrials.gov. Of the 173 total ClinicalTrials.gov records identified across the five projects, between 11 and 43% did not have an associated publication. In the 14% of records that contained results, the new data provided in the ClinicalTrials.gov records did not change the results or conclusions of the reviews. Finally, a large number of published studies were not registered in ClinicalTrials.gov, but many of these were published before ClinicalTrials.gov's inception date of 2000. Improved prospective registration of trials and consistent reporting of results in ClinicalTrials.gov would help make ClinicalTrials.gov records more useful in finding unpublished information and identifying potential biases. In addition, consistent indexing in databases, such as MEDLINE, would allow for better matching of records and publications, leading to increased utility of these searches for systematic review projects.