Methods for testing publication bias in ecological and evolutionary meta‐analyses

Nakagawa S, Lagisz M, Jennions MD, Koricheva J, Noble DWA, Parker TH, Sanchez-Tojar A, Yang Y, O’Dea RE (2021)
Methods in Ecology and Evolution 13(1).

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
OA 1.97 MB
Autor*in
Nakagawa, Shinichi; Lagisz, Malgorzata; Jennions, Michael D.; Koricheva, Julia; Noble, Daniel W.A.; Parker, Timothy H.; Sanchez-Tojar, AlfredoUniBi ; Yang, Yefeng; O’Dea, Rose E.
Abstract / Bemerkung
1. Publication bias threatens the validity of quantitative evidence from meta-analyses as it results in some findings being overrepresented in meta-analytic datasets because they are published more frequently or sooner (e.g. ‘positive’ results). Unfortunately, methods to test for the presence of publication bias, or assess its impact on meta-analytic results, are unsuitable for datasets with high heterogeneity and non-independence, as is common in ecology and evolutionary biology. 2. We first review both classic and emerging publication bias tests (e.g. funnel plots, Egger's regression, cumulative meta-analysis, fail-safe N, trim-and-fill tests, p-curve and selection models), showing that some tests cannot handle heterogeneity, and, more importantly, none of the methods can deal with non-independence. For each method, we estimate current usage in ecology and evolutionary biology, based on a representative sample of 102 meta-analyses published in the last 10 years. 3. Then, we propose a new method using multilevel meta-regression, which can model both heterogeneity and non-independence, by extending existing regression-based methods (i.e. Egger's regression). We describe how our multilevel meta-regression can test not only publication bias, but also time-lag bias, and how it can be supplemented by residual funnel plots. 4. Overall, we provide ecologists and evolutionary biologists with practical recommendations on which methods are appropriate to employ given independent and non-independent effect sizes. No method is ideal, and more simulation studies are required to understand how Type 1 and Type 2 error rates are impacted by complex data structures. Still, the limitations of these methods do not justify ignoring publication bias in ecological and evolutionary meta-analyses.
Erscheinungsjahr
2021
Zeitschriftentitel
Methods in Ecology and Evolution
Band
13
Ausgabe
1
ISSN
2041-210X
eISSN
2041-210X
Finanzierungs-Informationen
Open-Access-Publikationskosten wurden durch die Universität Bielefeld im Rahmen des DEAL-Vertrags gefördert.
Page URI
https://pub.uni-bielefeld.de/record/2958845

Zitieren

Nakagawa S, Lagisz M, Jennions MD, et al. Methods for testing publication bias in ecological and evolutionary meta‐analyses. Methods in Ecology and Evolution. 2021;13(1).
Nakagawa, S., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Sanchez-Tojar, A., et al. (2021). Methods for testing publication bias in ecological and evolutionary meta‐analyses. Methods in Ecology and Evolution, 13(1). https://doi.org/10.1111/2041-210X.13724
Nakagawa, Shinichi, Lagisz, Malgorzata, Jennions, Michael D., Koricheva, Julia, Noble, Daniel W.A., Parker, Timothy H., Sanchez-Tojar, Alfredo, Yang, Yefeng, and O’Dea, Rose E. 2021. “Methods for testing publication bias in ecological and evolutionary meta‐analyses”. Methods in Ecology and Evolution 13 (1).
Nakagawa, S., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Sanchez-Tojar, A., Yang, Y., and O’Dea, R. E. (2021). Methods for testing publication bias in ecological and evolutionary meta‐analyses. Methods in Ecology and Evolution 13.
Nakagawa, S., et al., 2021. Methods for testing publication bias in ecological and evolutionary meta‐analyses. Methods in Ecology and Evolution, 13(1).
S. Nakagawa, et al., “Methods for testing publication bias in ecological and evolutionary meta‐analyses”, Methods in Ecology and Evolution, vol. 13, 2021.
Nakagawa, S., Lagisz, M., Jennions, M.D., Koricheva, J., Noble, D.W.A., Parker, T.H., Sanchez-Tojar, A., Yang, Y., O’Dea, R.E.: Methods for testing publication bias in ecological and evolutionary meta‐analyses. Methods in Ecology and Evolution. 13, (2021).
Nakagawa, Shinichi, Lagisz, Malgorzata, Jennions, Michael D., Koricheva, Julia, Noble, Daniel W.A., Parker, Timothy H., Sanchez-Tojar, Alfredo, Yang, Yefeng, and O’Dea, Rose E. “Methods for testing publication bias in ecological and evolutionary meta‐analyses”. Methods in Ecology and Evolution 13.1 (2021).
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung-Nicht kommerziell 4.0 International (CC BY-NC 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2022-07-04T12:21:29Z
MD5 Prüfsumme
a799afadb3dee1655d616b8b99c334d8

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®
Suchen in

Google Scholar