Computer vision, machine learning, and the promise of phenomics in ecology and evolutionary biology

This is a Preprint and has not been peer reviewed. The published version of this Preprint is available: https://doi.org/10.3389/fevo.2021.642774. This is version 4 of this Preprint.

Add a Comment

You must log in to post a comment.


Comments

There are no comments or no comments have been made public for this article.

Downloads

Download Preprint

Authors

Moritz Lürig, Seth Donoughe, Erik Svensson, Arthur Porto, Masahito Tsuboi

Abstract

For centuries, ecologists and evolutionary biologists have used images such as drawings, paintings and photographs to record and quantify the shapes and patterns of life. With the advent of digital imaging, biologists continue to collect image data at an ever-increasing rate. This immense body of data provides insight into a wide range of biological phenomena, including phenotypic trait diversity, population dynamics, mechanisms of divergence and adaptation, and evolutionary change. However, the rate of image acquisition frequently outpaces our capacity to manually extract meaningful information from images. Moreover, manual image analysis is low-throughput, difficult to reproduce, and typically measures only a few traits at a time. This has proven to be an impediment to the growing field of phenomics - the study of many phenotypic dimensions together. Computer vision (CV), the automated extraction and processing of information from digital images, provides the opportunity to alleviate this longstanding analytical bottleneck. In this review, we illustrate the capabilities of CV as an efficient and comprehensive method to collect phenomic data in ecological and evolutionary research. First, we briefly review phenomics, arguing that ecologists and evolutionary biologists can effectively capture phenomic-level data by taking pictures and analyzing them using CV. Next we describe the primary types of image-based data, review CV approaches for extracting them (including techniques that entail machine learning and others that do not), and identify the most common hurdles and pitfalls. Finally, we highlight recent successful implementations and promising future applications of CV in the study of phenotypes. In anticipation that CV will become a basic component of the biologist’s toolkit, our review is intended as an entry point for ecologists and evolutionary biologists that are interested in extracting phenotypic information from digital images.

DOI

https://doi.org/10.32942/osf.io/98cuw

Subjects

Ecology and Evolutionary Biology, Life Sciences, Other Ecology and Evolutionary Biology

Keywords

automated analysis, high dimensional data, high-throughput phenotyping, Image Analysis, morphometrics, phenotype, Signal Processing

Dates

Published: 2020-12-18 02:05

Last Updated: 2021-03-15 16:28

Older Versions
License

CC-By Attribution-ShareAlike 4.0 International