A meta-epidemiological study of reporting of heterogeneity measures in Diagnostic Test Accuracy (DTA) reviews. A proposal of new measures to quantify heterogeneity.

OBJECTIVES: To describe the methods used to quantify heterogeneity and to propose alternative measures to improve reporting of heterogeneity in Cochrane Diagnostic Test Accuracy (DTA) Reviews. STUDY DESIGN AND SETTING: Our meta-epidemiological study included all DTA reviews in the Cochrane Library up to October 6th, 2019. We summarized reviews' characteristics focusing on heterogeneity analysis. We selected reviews with a bivariate model and ≥4 studies for reanalysis. In this group we fitted bivariate random effects models and we quantified heterogeneity by means of logit variances of sensitivity and specificity, bivariate I2, median odds ratio (MOR) and the area of the 95% prediction ellipse. We provided a narrative interpretation of these measures in different scenarios. RESULTS: There were 124 Cochrane DTA reviews of which 91 (73%) included meta-analysis. Only in 5 meta-analyses variances of the logit sensitivity and specificity were reported and in 21 meta-analyses (23%) the 95% prediction ellipse was reported without any calculation of its area. We selected 60 of these 91 reviews to explore the behaviour of all measures of heterogeneity. We found that most reviews described the subjective heterogeneity as moderate or extreme (n=31/60, 52%) whereas the area of the 95% prediction ellipse and the MOR for sensitivity and specificity showed high variability; the area ranged from 5% to 97%, the MOR of sensitivity ranged from 1.13 to 10.7, and the MOR of specificity ranged from 1.18 to 19.68. CONCLUSION: Cochrane DTA reviews show a poor reporting of between-study heterogeneity. Using median OR and the area of the 95% prediction ellipse will improve reporting and interpretation of this crucial aspect of DTA meta-analysis.