A Modified CREATE Intervention Improves Student Cognitive and Affective Outcomes in an Upper-Division Genetics Course †
-
Authors:
Stanley M. Lo1,2,3,*,
Tiffany B. Luu1,#,
Justin Tran1,#
-
Received 17 July 2019 Accepted 24 January 2020 Published 30 April 2020
- ©2020 Author(s). Published by the American Society for Microbiology
-
[open-access] This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial-NoDerivatives 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/ and https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode), which grants the public the nonexclusive right to copy, distribute, or display the published work.
-
†Supplemental materials available at http://asmscience.org/jmbe
- *Corresponding author. Mailing address: University of California, San Diego, 9500 Gilman Drive #0355, La Jolla, CA 92093. Phone: 858-246-1087. E-mail: [email protected].
-
# These authors contributed equally to this work.
Abstract:
Many national reports have called for undergraduate biology education to incorporate research and analytical thinking into the curriculum. In response, interventions have been developed and tested. CREATE (Consider, Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) is an instructional strategy designed to engage students in learning core concepts and competencies through careful reading of primary literature in a scaffolded fashion. CREATE has been successfully implemented by many instructors across diverse institutional contexts and has been shown to help students develop in the affective, cognitive, and epistemological domains, consistent with broader meta-analyses demonstrating the effectiveness of active learning. Nonetheless, some studies on CREATE have reported discrepant results, raising important questions on effectiveness in relation to the fidelity and integrity of implementation. Here, we describe an upper-division genetics course that incorporates a modified version of CREATE. Similar to the original CREATE instructional strategy, our intervention’s design was based on existing learning principles. Using existing concept inventories and validated survey instruments, we found that our modified CREATE intervention promotes higher affective and cognitive gains in students in contrast to three comparison groups. We also found that students tended to underpredict their learning and performance in the modified CREATE intervention, while students in some comparison groups had the opposite trend. Together, our results contribute to the expanding literature on how and why different implementations of the same active-learning strategy contribute to student outcomes.
References & Citations
Supplemental Material
-
Appendix 1: Example clicker questions from the modified CREATE intervention, Appendix 2: CI items
-
MyBook is a cheap paperback edition of the original book and will be sold at uniform, low price.
-
PDF
576.77 Kb
-
PDF
-

Article metrics loading...
Abstract:
Many national reports have called for undergraduate biology education to incorporate research and analytical thinking into the curriculum. In response, interventions have been developed and tested. CREATE (Consider, Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) is an instructional strategy designed to engage students in learning core concepts and competencies through careful reading of primary literature in a scaffolded fashion. CREATE has been successfully implemented by many instructors across diverse institutional contexts and has been shown to help students develop in the affective, cognitive, and epistemological domains, consistent with broader meta-analyses demonstrating the effectiveness of active learning. Nonetheless, some studies on CREATE have reported discrepant results, raising important questions on effectiveness in relation to the fidelity and integrity of implementation. Here, we describe an upper-division genetics course that incorporates a modified version of CREATE. Similar to the original CREATE instructional strategy, our intervention’s design was based on existing learning principles. Using existing concept inventories and validated survey instruments, we found that our modified CREATE intervention promotes higher affective and cognitive gains in students in contrast to three comparison groups. We also found that students tended to underpredict their learning and performance in the modified CREATE intervention, while students in some comparison groups had the opposite trend. Together, our results contribute to the expanding literature on how and why different implementations of the same active-learning strategy contribute to student outcomes.

Full text loading...
Author and Article Information
-
Received 17 July 2019 Accepted 24 January 2020 Published 30 April 2020
- ©2020 Author(s). Published by the American Society for Microbiology
-
[open-access] This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial-NoDerivatives 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/ and https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode), which grants the public the nonexclusive right to copy, distribute, or display the published work.
-
†Supplemental materials available at http://asmscience.org/jmbe
- *Corresponding author. Mailing address: University of California, San Diego, 9500 Gilman Drive #0355, La Jolla, CA 92093. Phone: 858-246-1087. E-mail: [email protected].
-
# These authors contributed equally to this work.
Figures

Click to view
FIGURE 1
Implementation of the modified CREATE intervention. Annotated DART profiles for: A) a CREATE-only class, B) an interactive clicker lecture, and C) a mixed class with both CREATE and clicker questions. CQ = clicker question; DART = Decibel Analysis for Research in Teaching.

Click to view
FIGURE 2
Cognitive outcomes. (A) Pre- and post-course CI scores are plotted on the left y-axis and students’ perceived learning on the right y-axis. Two-way ANOVA indicates that the perceived learning score in CREATE was lower than the three comparison courses (p at least < 0.01), whereas the comparison courses were not statistically different among themselves. For CI scores, error bars indicate standard deviation; effect sizes (ES) are calculated by Cohen’s d, and p values are determined by two-way ANOVA. (B) Pre- and post-course TOSLS scores for the modified CREATE intervention are compared by t-test (p < 0.001). Error bars indicate standard deviation, and ES is calculated by Cohen’s d. (C) Distributions of students’ actual and perceived grades (legend: A, B, C, D, and F) are plotted as outer and inner rings respectively in the donut graphs and compared using Fisher’s exact test. CI = concept inventory items.

Click to view
FIGURE 3
Affective outcomes. Results on the six affective dimensions from our survey are plotted: (A) personal relevance, (B) uncertainty of science, (C) critical voice, (D) shared control, (E) peer negotiation, and (F) affective support. Error bars indicate standard deviation, and statistical differences (by two-way ANOVA) are indicated by brackets and the following notation: * p < 0.05; ** p < 0.01; *** p < 0.001; **** p < 0.0001.