T280 Big Data in the Geosciences: In Memory of M. Lee Allison

Wednesday, 28 September 2016
8:00 AM - 12:00 PM
Room 205

STRATEGIES FOR CURATING BIG DATA IN THE HETEROGENEOUS LONG TAIL: EXAMPLES FROM THE USGS SCIENCEBASE REPOSITORY AND SEAD DATA SERVICES

Paper number: T280-5
Program: Technical Sessions
Time: 9:00 AM – 9:15 AM

Authors

Abstract

Properly curating big data remains a challenge for heterogeneous datasets in the long tail of research science data. Big data and long tail data used to be on opposite ends of a spectrum, but now with advances in technology for data collection, long tail datasets can fall into the category of big data. Creation of large datasets from high resolution imagery and high frequency sensors has been outgrowing capabilities for storing, maintaining, and serving the data; however, funder and publisher policies often require all supporting data of research products to be made available. Data repositories are working with users to create solutions for curating these large datasets. We present two cases where capabilities have been developed in response to user needs to handle big data from the long tail, the ScienceBase repository and the SEAD data services. ScienceBase (sciencebase.gov) is a data platform developed and maintained by the U.S. Geological Survey (USGS) to provide shared, permission-controlled access to scientific data products and bureau resources. SEAD (sead-data.net) offers end-to-end data services for managing, sharing, and preserving data through partnering repositories across a broad range of physical and social science disciplines. Both platforms have developed tools for transferring large data collections that exceed the size that is currently easily handled (10s of GB). We show examples from image- and video-heavy geomorphology datasets from the field and laboratory. This discussion of current strategies and challenges will help users understand options to provide increased access to their valuable and unique big datasets.

Geological Society of America Abstracts with Programs. Vol. 48, No. 7

doi: 10.1130/abs/2016AM-285056

© Copyright 2016 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.