Skip to main content
Robust point and variance estimation for ecological and evolutionary meta-analyses with selective reporting and dependent effect sizes

Robust point and variance estimation for ecological and evolutionary meta-analyses with selective reporting and dependent effect sizes

This is a Preprint and has not been peer reviewed. This is version 1 of this Preprint.

Add a Comment

You must log in to post a comment.


Comments

There are no comments or no comments have been made public for this article.

Downloads

Download Preprint

Authors

Yefeng Yang, Malgorzata Lagisz, Coralie Williams , Jinming Pan, Daniel W.A. Noble, Shinichi Nakagawa

Abstract

Meta-analysis produces a quantitative synthesis of evidence-based knowledge, shaping not only research trends but also policy and practices in ecology and evolution. However, two statistical issues, selective reporting and statistical dependence, can severally distort meta-analytic evidence. Here, we propose a two-step procedure to tackle these challenges concurrently and re-analyse 448 ecological and evolutionary meta-analyses. First, we employ bias-robust weighting schemes under the generalized least square estimator to obtain less biased population mean effect sizes by mitigating selective reporting. Second, we use cluster-robust variance estimation to account for statistical dependence and reduce bias in estimating standard errors, ensuring valid statistical inference. Re-analyses of 448 meta-analyses show that ignoring the two issues tends to overestimate effect sizes by an average of 110% and underestimate standard errors by 120%. Our approach is effective at mitigating these biases in meta-analytic evidence. To facilitate the implementation, we have developed a website showing the step-by-step tutorial available on our website. Complementing the current meta-analytic practice with the proposed method can facilitate a transition to a more pluralistic approach in quantitative evidence synthesis in ecology and evolution.

DOI

https://doi.org/10.32942/X20G6Q

Subjects

Life Sciences, Medicine and Health Sciences, Statistics and Probability

Keywords

Dates

Published: 2023-10-03 17:59

Last Updated: 2023-10-03 21:59

License

CC-BY Attribution-NonCommercial 4.0 International

Additional Metadata

Language:
English

Conflict of interest statement:
None