T156 Sustainable, Equitable and Usable Earth Science Cyberinfrastructure

Tuesday, 24 September 2024
8:00 AM - 12:00 PM
209B

PREDICTING ARTICLE RELEVANCE FOR DISCIPLINARY GEOSCIENCE DATABASES USING MACHINE LEARNING

Paper number: T156-7
Program: Technical Sessions
Time: 9:25 AM – 9:40 AM

Authors

Abstract

Data archiving is critical for the research process; many funding agencies require researchers to archive data. Without clear direction, repository choice is left to the researcher, potentially fragmenting the data landscape, with relevant data spread across both disciplinary and generalist data resources.

We present a machine learning pipeline (Database Article Relevance Tagging; DataART) that can be used by disciplinary resources to predict whether published articles are likely to contain relevant data. DataART allows resources to reach out to contributing authors to solicit data contributions post-publication. The framework consists of three elements:

  1. A PostgreSQL database to store information on publications, user tags, and model metadata
  2. A Nodejs/Express API to connect to the database to support secure cloud deployment
  3. A Python library (dataART) and Quarto notebook to demonstrate the system, using five classification models (logistic regression, decision trees, Bayesian approaches and ensemble models) to predict article relevance

Using the Neotoma Paleoecology Database as a test system, model performance is high (test accuracy = 0.92, precision = 0.89; recall = 0.87) with simple logistic regression on a dataset of 2600 labeled articles. We consider Type II errors (false negatives) to be more critical to the model. Type I errors are likely to arise from articles that may not be suitable to the database, but would be of interest to researchers. One significant outcome is the discovery of relevant articles outside the common set of publication journals within the Neotoma database, particularly discovery of articles within more "generalist" publications, such as PNAS or PLoS ONE, where lead authors may be more likely to submit data to a general data repository such as Dryad or PANGEA.

DataART is an important contribution to the continuing development and sustainability of disciplinary data resources, providing an opportunity for data resource discovery, by both researchers and data managers in the geosciences, with more general applications in the long run.

Geological Society of America Abstracts with Programs. Vol. 56, No. 5

doi: 10.1130/abs/2024AM-404387

© Copyright 2024 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.