T183 Measuring Learning in Geoscience Education

Tuesday, 12 October 2021
1:30 PM - 5:30 PM
B113/B114 (Hybrid Room)

PAIRED COGNITIVE AND AFFECTIVE SELF-ASSESSMENT MEASURES SEEM TO RENDER SOLELY COGNITIVE ASSESSMENT INSTRUMENTS ARCHAIC

Paper number: T183-11
Program: Technical Sessions
Time: 3:45 PM – 4:00 PM

Authors

Abstract

We share results from paired measures of cognitive competence via the Science Literacy Concept Inventory (SLCI) and self-assessed competence taken from knowledge surveys (KSs) and global queries. The SLCI measures understanding of science as a way of knowing. That is the primary learning outcome for required general education introductory-level science courses, which constitute the largest enrollment science courses in American colleges and universities. In keeping with doing assessment of learning in aggregate, we focus on institutional assessments through studying students grouped by specific academic ranks at separate institutions. Paired measures reveal surprising insights that conventional tests of cognitive knowledge alone cannot provide. The value we obtained from using separate paired measures impressed us so much that we modified the original SLCI to obtain the cognitive and affective self-assessment measures from a single instrument. The modifications that offer validated self-assessment measures and indicators of mindset (Carol Dweck's growth and fixed) add less than a minute to the total time participants spend in taking the SLCI.

In the late 1960s, William G. Perry Jr. discovered that successful education produces development in stages that have signature cognitive and affective attributes. Since becoming educated requires mastery of specified content together with developing the understanding of self, the most appropriate instructional designs attend to both. Enactments of such instructional designs seem rare, and rarer still are assessments that secure measures of both. The intellectual development offered by knowledge surveys is a unique exception. Each item of a KS addresses specific content posed as a challenge that requires a respondent to focus in the moment on present knowledge and skill and render a rating of self-assessed competency to meet the challenge. Pairing such responses with direct measures of competence taken with a nationally recognized validated exam advances assessment to new territory. The compilation "Reversals in Psychology" already credits this work with disrupting the behavioral science consensus about the nature of human self-assessment.

Geological Society of America Abstracts with Programs. Vol. 53, No. 6

doi: 10.1130/abs/2021AM-370303

© Copyright 2021 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.