T97 Methodological Decision Making in Geoscience Education Research

Monday, 26 September 2016
8:00 AM - 12:00 PM
Mile High Ballroom 4EF

DO ACTIONS SPEAK LOUDER THAN WORDS? COMPARING AUDIO AND VIDEO RECORDS OF REASONING IN THE FIELD

Paper number: T97-10
Program: Technical Sessions
Time: 10:15 AM – 10:30 AM

Authors

Abstract

A common methodology in studies of scientific reasoning is the analysis of participant verbalizations. In some cases, the approach is to ask participants to think aloud as they complete a problem solving task. These verbalizations are typically comprised of fragmented and incomplete sentences that may be challenging to decipher without a secondary data source. Another approach is to have participants explain their thinking after completing a task. These verbalizations tend to be expressed as complete sentences, but are also vulnerable to retrospective interpretation. For both approaches, the problems are usually designed to be completed in a matter of minutes. Less common are problems that take an hour or more to complete.

In this project, we conducted two different kinds of extended, multi-hour think-aloud studies. We asked sixteen geologists with varying levels of experience to think out loud as they completed a geologic mapping problem in the field. Eight of the participants carried a hand-held audio-recorder and made entries over the course of their mapping. To provide context, participants were asked to announce the time at the beginning of each entry in their audio recording. The other eight participants wore a head-mounted video camera with attached audio recorder that were running continuously over the day. Video data were automatically time stamped by the recording device. Participants were entirely self-prompted and not accompanied by a researcher. On average, participants needed 6.5 hours to complete the task. Overall, both approaches captured expressed thoughts over the full time participants were in the field. Verbalizations made using audio recorders resemble retrospective verbal reports: thoughts are commonly spoken in complete sentences. Some participants, though, did not always provide time stamps making it difficult to track reasoning over the day. Verbalizations recorded with video cameras tended to be more fragmented. The video data, though, provided context for the geologists’ thinking as well as visual evidence of their actions. Finally, comparisons of audio recordings and audio-video recordings in the field with end-of-task debriefing audio-video files provide interesting insights into field researcher verbalization strategies across a variety of settings.

Geological Society of America Abstracts with Programs. Vol. 48, No. 7

doi: 10.1130/abs/2016AM-287638

© Copyright 2016 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.