T218 Making Sense of Methodologies and Theoretical Frameworks in Geoscience Education Research

Wednesday, 13 October 2021
8:00 AM - 12:00 PM
B112

APPLYING CLASSICAL TEST THEORY AND ITEM RESPONSE THEORY IN THE VALIDATION OF THE EARTH SYSTEMS THINKING CONCEPT INVENTORY

Paper number: T218-14
Program: Technical Sessions
Time: 11:00 AM – 11:15 AM

Authors

Abstract

A key area in understanding the development of systems thinking skills in the geosciences relies on the development of a quantitative tool to assess systems thinking abilities in the context of the Earth sciences. This talk will overview how both classical test theory and item response theory were used to validate Earth systems thinking concept inventory (EST CI). The instrument was administered in multiple iterations using Amazon’s Mechanical Turk (MTURK) (n= 1004). By using these two approaches to validity and reliability in a complementary fashion, we were able to take an iterative approach to provide robust evidence for both validity and reliability. Additionally, the instrument is semi-customizable as language regarding feedbacks can be shifted between using ‘positive’ and ‘negative’ or ‘reinforcing’ or balancing’ terminology, with the latter resulting in better reliability among a largely novice audience. This talk will provide tools for practitioners to apply elements of both classical theory and item response theory to the development of their own instruments and overview the theoretical underpinnings of both approaches and how they can be integrated.

Geological Society of America Abstracts with Programs. Vol. 53, No. 6

doi: 10.1130/abs/2021AM-364084

© Copyright 2021 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.