Trim-and-fill method

Also available in: Arabic | Chinese | German
 

Definition:

A method used in meta-analysis to assess how publication bias might affect the pooled effect estimate. It assumes that missing studies on one side of a funnel plot account for the plot’s asymmetry. The procedure temporarily removes (“trims”) extreme studies from the more populated side and repeatedly re-estimates the centre of the plot. It then restores the trimmed studies and adds hypothetical studies that mirror them on the opposite side (“fills”). The pooled effect and its confidence interval are recalculated using the observed and imputed studies (Duval & Tweedie, 2000).

Funnel-plot asymmetry can arise for reasons other than publication bias, including differences in the underlying effects across studies. Trim-and-fill therefore provides a sensitivity analysis under particular assumptions about missing studies; it does not establish that publication bias occurred or guarantee an unbiased effect estimate (Shi & Lin, 2019; Viechtbauer, n.d.).

Several methodologists recommend using other approaches, such as selection models or suitable regression-based methods, instead of trim-and-fill because it can leave substantial bias uncorrected and perform poorly when effects differ across studies (Moreno et al., 2009; Carter et al., 2019).

Related terms: Meta-analysis, Publication bias (File Drawer Problem)

References:

  • Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463. https://doi.org/10.1111/j.0006-341x.2000.00455.x
  • Shi, L., & Lin, L. (2019). The trim-and-fill method for publication bias: Practical guidelines and recommendations based on a large database of meta-analyses. Medicine, 98(23), e15987. https://doi.org/10.1097/MD.0000000000015987
  • Moreno, S. G., Sutton, A. J., Ades, A. E., Stanley, T. D., Abrams, K. R., Peters, J. L., & Cooper, N. J. (2009). Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Medical Research Methodology, 9, 2. https://doi.org/10.1186/1471-2288-9-2
  • Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019). Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods. Advances in Methods and Practices in Psychological Science, 2(2), 115–144. https://doi.org/10.1177/2515245919847196
  • Viechtbauer, W. (n.d.). Trim and Fill Analysis for “rma.uni” Objects (trimfill), metafor package documentation. https://wviechtb.github.io/metafor/reference/trimfill.html

Originally drafted by: Mahmoud Elsherif

Reviewed by: Lukas Wallrich

Suggest an improvement

Spotted an error, a broken link, or think this entry is missing something? Let us know — this goes directly to the glossary team.