T97 Methodological Decision Making in Geoscience Education Research

Monday, 26 September 2016
8:00 AM - 12:00 PM
Mile High Ballroom 4EF

A MIXED-METHODS APPROACH TO ASSESSMENT DESIGN THAT INCORPORATES CULTURE AND PLACE

Paper number: T97-2
Program: Technical Sessions
Time: 8:15 AM – 8:30 AM

Authors

Abstract

The validity of assessment implemented within Native American and other cultural minority populations can be improved by incorporating elements of culture and place. We propose a new methodology for effective assessment across cultural boundaries. Effective cross-cultural assessment requires: (1) engagement of community members from the target community in the actual assessment design, and (2) a variety of data collection approaches (sequential surveys, focus groups, questionnaires, and think-aloud interviews). We present an example from a collaboration with the Blackfeet and Navajo (Diné) Nations to revise items from the Geoscience Concept Inventory (a standardized instrument) and to identify additional geoscience concepts for new items. We collected data through one-on-one semi-structured interviews with Tribal college faculty, science educators and Native students employed a think-aloud strategy to gather information on select items of the GCI. Interview transcripts were analyzed to identify emergent themes and coded to determine theme frequency. Next, through a combination of sequential surveys and focus group sessions, cultural experts provided feedback on the role of assessment and identified important geoscience concepts within their local communities. Lastly, Tribal college faculty and Native students were surveyed to determine how they related to geoscience, Native science, place and culture. The open-ended responses and focus group transcripts were analyzed to identify emergent themes and used to guide the format, language, and content of the new geoscience assessment items. New assessment items, authored collectively by the Native expert groups, were piloted with students. The student responses were analyzed collectively by the expert groups to identify language and content for use in the design of selected response items. We will discuss the rationale for the selection of a variety of data collection tools as well as the data analysis techniques that incorporate individual researchers, research pairs, and expert groups. This work demonstrates how collective efforts are essential to the validation of assessment instruments that are valid across different cultures and places.

Geological Society of America Abstracts with Programs. Vol. 48, No. 7

doi: 10.1130/abs/2016AM-284298

© Copyright 2016 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.