A Call for Programmatic Assessment of Undergraduate Students’ Conceptual Understanding and Higher-Order Cognitive Skills †
-
Authors:
Lacy M. Cleveland1,2,*,
Thomas M. McCabe3,
Jeffrey T. Olimpo4
-
Received 09 June 2017 Accepted 05 February 2018 Published 27 April 2017
- ©2018 Author(s). Published by the American Society for Microbiology.
-
[open-access] This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial-NoDerivatives 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/ and https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode), which grants the public the nonexclusive right to copy, distribute, or display the published work.
-
†Supplemental materials available at http://asmscience.org/jmbe
- *Corresponding author. Mailing address: Early College of Denver, 2650 Eliot Street, Denver, CO 80211. Phone: 720-423-6600. E-mail: [email protected].
Abstract:
In response to empirical evidence and calls for change, individual undergraduate biology instructors are reforming their pedagogical practices. To assess the effectiveness of these reforms, many instructors use course-specific or skill-specific assessments (e.g., concept inventories). We commend our colleagues’ noble efforts, yet we contend that this is only a starting point. In this Perspectives article, we argue that departments need to engage in reform and programmatic assessment to produce graduates who have both subject-matter knowledge and higher-order cognitive skills. We encourage biology education researchers to work collaboratively with content specialists to develop program-level assessments aimed at measuring students’ conceptual understanding and higher-order cognitive skills, and we encourage departments to develop longitudinal plans for monitoring their students’ development of these skills.
References & Citations
Supplemental Material
-
Appendix 1: Model for evaluating the department’s promotion of higher-order cognitive skills
-
MyBook is a cheap paperback edition of the original book and will be sold at uniform, low price.
-
PDF
100.75 Kb
-
PDF
-

Article metrics loading...
Abstract:
In response to empirical evidence and calls for change, individual undergraduate biology instructors are reforming their pedagogical practices. To assess the effectiveness of these reforms, many instructors use course-specific or skill-specific assessments (e.g., concept inventories). We commend our colleagues’ noble efforts, yet we contend that this is only a starting point. In this Perspectives article, we argue that departments need to engage in reform and programmatic assessment to produce graduates who have both subject-matter knowledge and higher-order cognitive skills. We encourage biology education researchers to work collaboratively with content specialists to develop program-level assessments aimed at measuring students’ conceptual understanding and higher-order cognitive skills, and we encourage departments to develop longitudinal plans for monitoring their students’ development of these skills.

Full text loading...
Author and Article Information
-
Received 09 June 2017 Accepted 05 February 2018 Published 27 April 2017
- ©2018 Author(s). Published by the American Society for Microbiology.
-
[open-access] This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial-NoDerivatives 4.0 International license (https://creativecommons.org/licenses/by-nc-nd/4.0/ and https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode), which grants the public the nonexclusive right to copy, distribute, or display the published work.
-
†Supplemental materials available at http://asmscience.org/jmbe
- *Corresponding author. Mailing address: Early College of Denver, 2650 Eliot Street, Denver, CO 80211. Phone: 720-423-6600. E-mail: [email protected].
Figures

Click to view
FIGURE 1
Students were asked to indicate their agreement (0 = strongly disagree, 5 = strongly agree) with anthropocentric, teleological, and essentialist misconceptions. No significant interaction was found between students’ academic level, between students enrolled in freshman level courses, sophomore, and upperclass courses (junior and senior level, F(4, 352) = 0.961, p = 0.429). Participants were given a list of six misconceptions (two for each type of cognitive construal) and asked to indicate how well they agreed or disagreed with the statement and then provide a brief description of their understanding. Some students did not provide responses for all six statements. The number of statements answered per grade-level is as follows: freshmen (n = 354), sophomore (n = 492), junior (n = 476), and senior (n = 258).

Click to view
FIGURE 2
Students were randomly given two of the four anthropocentric statements related to cell death, sexual reproduction, the size of different genders of organism, or how plants acquire food. A chi-squared analysis was performed and no relationship was found between academic level of the students (freshman, sophomore, and upperclass) and students’ level of agreement (agree, neutral, or disagree) with the various anthropocentric statements: Cell death χ2 (4, 91) = 1.094; p = 0.895; Sexual reproduction χ2 (4, 92) = 1.429; p = 0.839; Males are bigger χ2 (4, 100) = 4.304; p = 0.366; Plants get food from soil χ2 (4, 193) = 4.023; p = 0.403.

Click to view
FIGURE 3
Students were randomly given two of the four teleological statements related to evolution and cellular respiration. A chi-squared analysis was performed and no relationship was found between the students’ academic level (freshman, sophomore, and upperclass) and the students’ level of agreement (agree, neutral, or disagree) with the various teleological statements: Birds have wings χ2 (4, 90) = 2.726; p = 0.605; Species adapt χ2 (4, 90) = 1.212; p = 0.876; Evolution χ2 (4, 99) = 4.372; p = 0.358; Plants Produce O2 χ2 (4, 102) = 1.624; p = 0.804.

Click to view
FIGURE 4
Students were randomly given two of the four essentialist statements related to evolution and cellular respiration. A chi-squared analysis was performed and no relationship was found between students’ academic level (freshman, sophomore, and upperclass) and level of agreement (agree, neutral, or disagree) with three of the teleological statements: Species χ2 (4, 90) = 0.586; p = 0.965; Homeostasis χ2 (4, 97) = 7.731; p = 0.102; Wetlands χ2 (4, 99) = 1.791; p = 0.774. Freshmen displayed a significantly higher level of misconceptions for genetic changes χ2 (4, 90) = 15.802; p = 0.003.