T231 Enhancing the Geosciences by Empowering Indigenous and Latinx Students II

Tuesday, 24 September 2019
1:30 PM - 5:30 PM
Room 106BC, West Building

COMPARING REU STUDENT VS. ADVISOR RATINGS OF STUDENT PERFORMANCE INDICATES LOW STUDENT SELF-EFFICACY

Paper number: T231-10
Program: Technical Sessions
Time: 3:40 PM – 3:55 PM

Authors

Abstract

Undergraduate researchers and their advisors can have differing opinions of the students’ performance and abilities. We analyze results from performance surveys of 30 School of Ocean and Earth Science and Technology (SOEST) Scholars at the University of Hawaii. The SOEST Scholars program is an academic-year REU that includes research, professional development and mentoring. Each student and advisor completes an identical year-end survey on the student's performance, evaluating "Absolute" performance in 10 areas (e.g., Research Productivity), and "Growth" during the internship in 9 areas (e.g., Works more independently). All survey responses are recorded on a 5-point Likert-style scale (e.g., unsatisfactory to excellent).

For each question, we compare student-advisor responses by quantifying the Likert scale on a scale of 1 to 5, and applying paired, two-tailed t-tests. For the Absolute and Growth datasets as a whole, we use non-parametric permutation tests, which only consider the sign (not the magnitude) of the student-advisor difference, and therefore avoid problems inherent in quantification.

For the "Absolute" questions, the student’s self-assessments consistently underrate their skills and performance relative to their advisor's ratings. Advisor minus student differences (D) range from -0.03 to 0.39 (only 1 of 10 questions had negative D). For all 10 questions combined, the mean student and advisor ratings were 4.06 and 4.24 respectively – a difference that is highly significant (p=0.004). This suggests that mentoring within the SOEST Scholars program, and perhaps in REU's more generally, could be improved by placing additional emphasis on building student confidence and self-appraisal skills, which have been linked to student success and retention.

The "Growth" questions also exhibit some potential differences in student vs. advisor assessment, with the largest differences appearing in questions where advisors underestimated the extent to which students' interest in STEM careers (p=0.08) and graduate school (p=0.06) change over the course of the REU program. This suggests that mentoring and professional development in these areas might be more impactful if they are scheduled towards the end of the REU.

Geological Society of America Abstracts with Programs. Vol. 51, No. 5

doi: 10.1130/abs/2019AM-331812

© Copyright 2019 The Geological Society of America (GSA), all rights reserved. Permission is hereby granted to the author(s) of this abstract to reproduce and distribute it freely, for noncommercial purposes. Permission is hereby granted to any individual scientist to download a single copy of this electronic file and reproduce up to 20 paper copies for noncommercial purposes advancing science and education, including classroom use, providing all reproductions include the complete content shown here, including the author information. All other forms of reproduction and/or transmittal are prohibited without written permission from GSA Copyright Permissions.