104 D22. Paleontology: Recent Developments in Phylogeny, Morphological Patterns, and Biogeography

Monday, 10 October 2022
1:30 PM - 5:30 PM
Mile High Ballroom 4C

USING ARTIFICIAL INTELLIGENCE TO IDENTIFY FOSSIL ANGIOSPERM LEAVES AT FAMILY LEVEL

Paper number: 104-10
Program: Technical Sessions
Time: 3:45 PM – 4:00 PM

Authors

Abstract

The identification of fossil angiosperm leaves poses a well-known challenge for paleobotany. Recent progress in computer vision offers a path towards the development of AI agents to assist paleobotanists, but several challenges have slowed progress. Images of taxonomically vetted fossil leaves are very scarce in comparison to the need of AI for enormous visual training libraries, and their quality is highly variable due to preservation and taphonomic factors. To overcome these limitations, we have developed a deep generative model that learns to automatically synthesize photorealistic fossils from known cleared and x-ray extant-leaf Images. Given the considerable amount of unvetted images available in different collections ( Such as the Yale Peabody Museum collection and others), we have also managed to leverage the usage of unsupervised training, extending the possibility of generalization of our synthesizer model. We further use these synthetic fossils to train a deep neural network architecture to learn to classify both cleared leaves and fossil leaves at the family level. Using a leave-one-family-out cross-validation procedure to evaluate accuracy (whereby real leaf fossils are excluded from training for a test family), we report well above chance-level accuracy at family level for real fossil leaves, even when the system did not see any real fossils during training. We report significantly above-chance classification accuracy in this scenario. As well, a study using explainability methods is carried out in order to identify some of the strategies used for the classification. Our results strongly suggest that AI methods will provide significant assistance to paleobotanists with the identification of leaf fossils. We are also shortly releasing a website for the community where it is possible to upload fossils from any part of the world and test first hand the potential of our approach.

Geological Society of America Abstracts with Programs. Vol. 54, No. 6

doi: 10.1130/abs/2022AM-382974

© Copyright 2022 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.