This is a Preprint and has not been peer reviewed. This is version 1 of this Preprint.

Ungeneralizable generalizations? A meta-meta-analysis of the influence of taxonomic bias on the study of behavior.
Downloads
Authors
Abstract
Meta-analysis is a powerful tool for synthesizing behavioral research and identifying general patterns. However, are the conclusions we draw from these analyses truly representative across animal groups? Alternatively, are our conclusions shaped by taxonomic biases in the underlying research? For example, in animal behavior, vertebrates are often overrepresented in the research we conduct. This taxonomic imbalance raises concerns about the validity of generalizations drawn in the field, especially from meta-analyses. To examine this issue, we examined the meta-analyses published in Animal Behaviour, Behavioral Ecology, and Behavioral Ecology and Sociobiology from 2000 – 2024. We then conducted a “meta-meta-analysis” to calculate the degree to which overall effects in prior meta-analytical results may have been mis-estimated due to taxonomic bias. We found that taxonomic biases in the primary research systematically influence effect size estimates in meta-analyses and can lead to improper inferences and generalizations. On average, meta-analytical averages are mis-estimated by ~35% (p << 0.01) and significance changes in about 25% of instances when sampling is taxonomically representative. Because meta-analyses aggregate data, they propagate the biases present in an area of research, leading to potentially incorrect generalizations. Addressing this taxonomic bias is critical to generalizations that describe the true richness of animal behavior.
DOI
https://doi.org/10.32942/X2XM06
Subjects
Behavior and Ethology, Ecology and Evolutionary Biology
Keywords
Behavior, taxonomic bias, meta-analysis
Dates
Published: 2025-07-03 00:03
Last Updated: 2025-07-03 00:03
License
CC-By Attribution-NonCommercial-NoDerivatives 4.0 International
Additional Metadata
Conflict of interest statement:
None
Data and Code Availability Statement:
Data will be made available via the OSF platform upon submission of manuscript to an appropriate journal
Language:
English
There are no comments or no comments have been made public for this article.