fossilbrush: An R package for automated detection and resolution of anomalies in palaeontological occurrence data

Flannery-Sutherland JT, Raja NB, Kocsis Á, Kießling W (2022)


Publication Type: Journal article

Publication year: 2022

Journal

DOI: 10.1111/2041-210X.13966

Abstract

Fossil occurrence databases are indispensable resources to the palaeontological community, yet present unique data cleaning challenges. Many studies devote significant attention to cleaning fossil occurrence data prior to analysis, but such efforts are typically bespoke and difficult to reproduce. There are also no standardised methods to detect and resolve errors despite the development of an ecosystem of cleaning tools fuelled by the concurrent growth of neontological occurrence databases. As fossil occurrence databases continue to increase in size, the demand for standardised, automated and reproducible methods to improve data quality will only grow. Here, we present semi-automated cleaning solutions to address these issues with a new R package fossilbrush. We apply our cleaning protocols to the Paleobiology Database to assess the prevalence of anomalous entries and the efficacy and impact of our methods. We find that anomalies may be effectively resolved by comparison against a published compendium of stratigraphic ranges, improving the stratigraphic quality of the data, and through methods which detect outliers in taxon-wise occurrence stratigraphic distributions. Despite this, anomalous entries remain prevalent throughout major clades, with often more than 30% of genera in major fossil groups (e.g. bivalves, echinoderms) displaying stratigraphically suspect occurrence records. Our methods provide a way to flag and resolve anomalous taxonomic data before downstream palaeobiological analysis and may also aid in the automation and targeting of future cleaning efforts. We stress, however, that our methods are semi-automated and are primarily for the detection of potential anomalies for further scrutiny, as full automation should not be a substitute for expert vetting. We note that some of our methods do not rely on external databases for anomaly resolution and so are also applicable to occurrences in neontological databases, expanding the utility of the fossilbrush R package.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Flannery-Sutherland, J.T., Raja, N.B., Kocsis, Á., & Kießling, W. (2022). fossilbrush: An R package for automated detection and resolution of anomalies in palaeontological occurrence data. Methods in Ecology and Evolution. https://dx.doi.org/10.1111/2041-210X.13966

MLA:

Flannery-Sutherland, Joseph T., et al. "fossilbrush: An R package for automated detection and resolution of anomalies in palaeontological occurrence data." Methods in Ecology and Evolution (2022).

BibTeX: Download