1887

How to Assess Your CURE: A Practical Guide for Instructors of Course-Based Undergraduate Research Experiences

    Authors: Erin E. Shortlidge1,*, Sara E. Brownell1
    VIEW AFFILIATIONS HIDE AFFILIATIONS
    Affiliations: 1: School of Life Sciences, Arizona State University, Tempe, AZ 85201
    AUTHOR AND ARTICLE INFORMATION AUTHOR AND ARTICLE INFORMATION
    Source: J. Microbiol. Biol. Educ. December 2016 vol. 17 no. 3 399-408. doi:10.1128/jmbe.v17i3.1103
MyBook is a cheap paperback edition of the original book and will be sold at uniform, low price.
  • PDF
    324.06 Kb
  • HTML
    89.33 Kb
  • XML
    104.43 Kb

    Abstract:

    Integrating research experiences into undergraduate life sciences curricula in the form of course-based undergraduate research experiences (CUREs) can meet national calls for education reform by giving students the chance to “do science.” In this article, we provide a step-by-step practical guide to help instructors assess their CUREs using best practices in assessment. We recommend that instructors first identify their anticipated CURE learning outcomes, then work to identify an assessment instrument that aligns to those learning outcomes and critically evaluate the results from their course assessment. To aid instructors in becoming aware of what instruments have been developed, we have also synthesized a table of “off-the-shelf” assessment instruments that instructors could use to assess their own CUREs. However, we acknowledge that each CURE is unique and instructors may expect specific learning outcomes that cannot be assessed using existing assessment instruments, so we recommend that instructors consider developing their own assessments that are tightly aligned to the context of their CURE.

References & Citations

1. American Association for the Advancement of Science 2011 Vision and change in undergraduate biology education: a call to action: a summary of recommendations made at a national conference organized by the American Association for the Advancement of Science July 15–17, 2009 Washington, DC
2. American Educational Research Association, American Psychological Association, National Council on Measurement in Education 1999 Standards for educational and psychological testing AERA Publication Series Washington, DC
3. Auchincloss LC, et al 2014 Assessment of course-based undergraduate research experiences: a meeting report CBE Life Sci Educ 13 29 40 24591501 3940459
4. Bangera G, Brownell SE 2014 Course-based undergraduate research experiences can make scientific research more inclusive CBE Life Sci Educ 13 602 606 25452483 4255347
5. Barbera J, VandenPlas J 2011 All assessment materials are not created equal: the myths about instrument development, validity, and reliability 177 193 Bunce DM Investigating Classroom Myths through Research on Teaching and Learning American Chemical Society Washington, DC
6. Bascom-Slack CA, Arnold AE, Strobel SA 2012 Student-directed discovery of the plant microbiome and its products Science 338 485 486 10.1126/science.1215227 23112324 http://dx.doi.org/10.1126/science.1215227
7. Biggs J, Kember D, Leung DY 2001 The revised two-factor study process questionnaire: R-SPQ-2F Brit J Educ Psychol 71 133 149 10.1348/000709901158433 11307705 http://dx.doi.org/10.1348/000709901158433
8. Bollen KA, Hoyle RH 1990 Perceived cohesion: a conceptual and empirical examination Soc Forces 69 2 479 504 10.1093/sf/69.2.479 http://dx.doi.org/10.1093/sf/69.2.479
9. Bowman NA 2011 Validity of college self-reported gains at diverse institutions Educ Res 40 22 24 10.3102/0013189X10397630 http://dx.doi.org/10.3102/0013189X10397630
10. Brownell SE, et al 2015 A high-enrollment course-based undergraduate research experience improves student conceptions of scientific thinking and ability to interpret data CBE Life Sci Educ 14 ar21 26033869 4477737
11. Brownell SE, Kloser MJ 2015 Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology Studies Higher Educ 40 525 544 10.1080/03075079.2015.1004234 http://dx.doi.org/10.1080/03075079.2015.1004234
12. Brownell SE, Kloser MJ, Fukami T, Shavelson R 2012 Undergraduate biology lab courses: comparing the impact of traditionally based “cookbook” and authentic research-based courses on student lab experiences J Coll Sci Teach 41 18 27
13. Brownell SE, Kloser MJ, Fukami T, Shavelson RJ 2013 Context matters: volunteer bias, small sample size, and the value of comparison groups in the assessment of research-based undergraduate introductory biology lab courses J Microbiol Biol Educ 14 2 176 182 10.1128/jmbe.v14i2.609 24358380 3867754 http://dx.doi.org/10.1128/jmbe.v14i2.609
14. Brownell SE, et al 2013 How students think about experimental design: novel conceptions revealed by in-class activities BioScience bit016
15. Chan D 2009 So why ask me? Are self-report data really that bad? 309 336 Lance CE, Vandenberg RJ Statistical and methodological myths and urban legends: doctrine, verity and fable in the organizational and social sciences Routledge New York, NY
16. Corwin LA, Graham MJ, Dolan EL 2015 Modeling course-based undergraduate research experiences: an agenda for future research and evaluation CBE Life Sci Educ 14 es1 25687826 4353087
17. Corwin LA, Runyon C, Robinson A, Dolan EL 2015 The laboratory course assessment survey: a tool to measure three dimensions of research-course design CBE Life Sci Educ 14 ar37 26466990 4710398
18. Creamer EG, Magolda MB, Yue J 2010 Preliminary evidence of the reliability and validity of a quantitative measure of self-authorship J Coll Student Devt 51 550 562 10.1353/csd.2010.0010 http://dx.doi.org/10.1353/csd.2010.0010
19. Crowe A, Dirks C, Wenderoth MP 2008 Biology in bloom: implementing Bloom’s taxonomy to enhance student learning in biology CBE Life Sci Educ 7 368 381 10.1187/cbe.08-05-0024 19047424 2592046 http://dx.doi.org/10.1187/cbe.08-05-0024
20. Dasgupta AP, Anderson TR, Pelaez N 2014 Development and validation of a rubric for diagnosing students’ experimental design knowledge and difficulties CBE Life Sci Educ 13 265 284 4041504
21. Deane T, Nomme K, Jeffery E, Pollock C, Birol G 2014 Development of the biological experimental design concept inventory (BEDCI) CBE Life Sci Educ 13 540 551 25185236 4152214
22. Dolan EL, Collins JP 2015 We must teach more effectively: here are four ways to get started Mol Biol Cell 26 2151 2155 10.1091/mbc.E13-11-0675 26067566 4462934 http://dx.doi.org/10.1091/mbc.E13-11-0675
23. Duckworth AL, Quinn PD 2009 Development and validation of the short grit scale (GRIT–S) J Pers Assess 91 166 174 10.1080/00223890802634290 19205937 http://dx.doi.org/10.1080/00223890802634290
24. Dunlap R, Liere K, Mertig A, Jones RE 2000 Measuring endorsement of the new ecological paradigm: a revised NEP scale J Soc Iss 56 425 442 10.1111/0022-4537.00176 http://dx.doi.org/10.1111/0022-4537.00176
25. Ebel R, Frisbie D 1979 Essentials of educational measurement Prentice-Hall Englewood Cliffs, NJ
26. Facione PA 1991 Using the California Critical Thinking Skills Test in Research, Evaluation, and Assessment [Online.] http://www.insightassessment.com/Products/Products-Summary/Critical-Thinking-Skills-Tests/California-Critical-Thinking-Skills-Test-CCTST
27. Glynn SM, Brickman P, Armstrong N, Taasoobshirazi G 2011 Science motivation questionnaire II: validation with science majors and nonscience majors J Res Sci Teach 48 1159 1176 10.1002/tea.20442 http://dx.doi.org/10.1002/tea.20442
28. Gormally C, Brickman P, Lutz M 2012 Developing a test of scientific literacy skills (TOSLS): measuring undergraduates’ evaluation of scientific information and arguments CBE Life Sci Educ 11 364 377 10.1187/cbe.12-03-0026 23222832 3516792 http://dx.doi.org/10.1187/cbe.12-03-0026
29. Gurel DK, Eryılmaz A, McDermott LC 2015 A review and comparison of diagnostic instruments to identify students’ misconceptions in science Eurasia J Math Sci Technol Educ 11 989 1008
30. Halloun I, Hestenes D 1998 Interpreting VASS dimensions and profiles for physics students Sci Educ 7 553 577 10.1023/A:1008645410992 http://dx.doi.org/10.1023/A:1008645410992
31. Hanauer DI, Dolan EL 2014 The project ownership survey: measuring differences in scientific inquiry experiences CBE Life Sci Educ 13 149 158 24591513 3940455
32. Hanauer DI, Hatfull G 2015 Measuring networking as an outcome variable in undergraduate research experiences CBE Life Sci Educ 14 ar38 26538387 4710399
33. Handelsman J, et al 2004 Scientific teaching Science 304 521 522 10.1126/science.1096022 15105480 http://dx.doi.org/10.1126/science.1096022
34. Hark AT, Bailey CP, Parrish S, Leung W, Shaffer CD, Elgin SC 2011 Undergraduate research in the genomics education partnership: a comparative genomics project exploring genome organization and chromatin structure in Drosophila FASEB J 25 576.573
35. Harrison M, Dunbar D, Ratmansky L, Boyd K, Lopatto D 2011 Classroom-based science research at the introductory level: changes in career choices and attitude CBE Life Sci Educ 10 279 286 10.1187/cbe.10-12-0151 21885824 3164567 http://dx.doi.org/10.1187/cbe.10-12-0151
36. Jordan TC, et al 2014 A broadly implementable research course in phage discovery and genomics for first-year undergraduate students MBio 5 e01051 01013 10.1128/mBio.01051-13 24496795 3950523 http://dx.doi.org/10.1128/mBio.01051-13
37. Kloser MJ, Brownell SE, Chiariello NR, Fukami T 2011 Integrating teaching and research in undergraduate biology laboratory education PLoS Biol 9 e1001174 10.1371/journal.pbio.1001174 22110400 3216991 http://dx.doi.org/10.1371/journal.pbio.1001174
38. Kloser MJ, Brownell SE, Shavelson RJ, Fukami T 2013 Effects of a research-based ecology lab course: a study of nonvolunteer achievement, self-confidence, and perception of lab course purpose J Coll Sci Teach 42 90 99
39. Kuh GD 2009 The national survey of student engagement: conceptual and empirical foundations New Direct Inst Res 2009 5 20 10.1002/ir.283 http://dx.doi.org/10.1002/ir.283
40. Kuncel NR, Credé M, Thomas LL 2005 The validity of self-reported grade point averages, class ranks, and test scores: a meta-analysis and review of the literature Rev Educ Res 75 63 82 10.3102/00346543075001063 http://dx.doi.org/10.3102/00346543075001063
41. Lawson AE, Clark B, Cramer-Meldrum E, Falconer KA, Sequist JM, Kwon YJ 2000 Development of scientific reasoning in college biology: do two levels of general hypothesis-testing skills exist? J Res Sci Teach 37 81 101 10.1002/(SICI)1098-2736(200001)37:1%3C81::AID-TEA6%3E3.0.CO;2-I http://dx.doi.org/10.1002/(SICI)1098-2736(200001)37:1%3C81::AID-TEA6%3E3.0.CO;2-I
42. Lederman NG, Abd-El-Khalick F, Bell RL, Schwartz RS 2002 Views of nature of science questionnaire: toward valid and meaningful assessment of learners’ conceptions of nature of science J Res Sci Teach 39 497 521 10.1002/tea.10034 http://dx.doi.org/10.1002/tea.10034
43. Lopatto D 2004 Survey of undergraduate research experiences (SURE): first findings Cell Biol Educ 3 270 277 10.1187/cbe.04-07-0045 15592600 533131 http://dx.doi.org/10.1187/cbe.04-07-0045
44. Lopatto D 2008 Classroom Undergraduate Research Experiences Survey (CURE) [Online.] https://www.grinnell.edu/academics/areas/psychology/assessments/cure-survey
45. Lopatto D, et al 2014 A central support system can facilitate implementation and sustainability of a classroom-based undergraduate research experience (CURE) in Genomics CBE Life Sci Educ 13 711 723 25452493 4255357
46. Makarevitch I, Frechette C, Wiatros N 2015 Authentic research experience and “big data” analysis in the classroom: maize response to abiotic stress CBE Life Sci Educ 14
47. Messick S 1989 Meaning and values in test validation: the science and ethics of assessment Educ Res 18 5 11 10.3102/0013189X018002005 http://dx.doi.org/10.3102/0013189X018002005
48. Milfont TL, Duckitt J 2010 The environmental attitudes inventory: a valid and reliable measure to assess the structure of environmental attitudes J Environ Psychol 30 80 94 10.1016/j.jenvp.2009.09.001 http://dx.doi.org/10.1016/j.jenvp.2009.09.001
49. President’s Council of Advisors on Science and Technology 2012 Engage to excel: producing one million additional college graduates with degrees in science, technology, engineering, and mathematics PCAST Washington, DC
50. Rybarczyk BJ, Walton KL, Grillo WH 2014 The development and implementation of an instrument to assess students’ data analysis skills in molecular biology J Microbiol Biol Educ 15 2 259 267 10.1128/jmbe.v15i2.703 http://dx.doi.org/10.1128/jmbe.v15i2.703
51. Sanders ER, Hirsch AM 2014 Immersing undergraduate students into research on the metagenomics of the plant rhizosphere: a pedagogical strategy to engage civic-mindedness and retain undergraduates in STEM Front Plant Sci 5 157 10.3389/fpls.2014.00157 24817868 4012186 http://dx.doi.org/10.3389/fpls.2014.00157
52. Semsar K, Knight JK, Birol G, Smith MK 2011 The Colorado learning attitudes about science survey (CLASS) for use in biology CBE Life Sci Educ 10 268 278 10.1187/cbe.10-10-0133 21885823 3164566 http://dx.doi.org/10.1187/cbe.10-10-0133
53. Seymour E, Wiese D, Hunter A, Daffinrud SM 2000 Creating a better mousetrap: on-line student assessment of their learning gains Paper presented at the National Meeting of the American Chemical Society San Francisco, CA
54. Shaffer CD, et al 2014 A course-based research experience: how benefits change with increased investment in instructional time CBE Life Sci Educ 13 111 130 24591510 3940452
55. Shortlidge EE, Bangera G, Brownell SE 2016 Faculty perspectives on developing and teaching course-based undergraduate research experiences BioScience 66 54 62 10.1093/biosci/biv167 http://dx.doi.org/10.1093/biosci/biv167
56. Sirum K, Humburg J 2011 The experimental design ability test (EDAT) Bioscene J Coll Biol Teach 37 8 16
57. Stein B, Haynes A, Redding M, Ennis T, Cecil M 2007 Assessing critical thinking in STEM and beyond 79 82 Innovations in e-learning, instruction technology, assessment, and engineering education Springer Netherlands 10.1007/978-1-4020-6262-9_14 http://dx.doi.org/10.1007/978-1-4020-6262-9_14
58. Stiggins RJ 2004 Classroom assessment for student learning: doing it right—using it well Assessment Training Institute Inc. Portland, OR
59. Theobald R, Freeman S 2014 Is it the intervention or the students? Using linear regression to control for student characteristics in undergraduate STEM education research CBE Life Sci Educ 13 41 48 24591502 3940461
60. Timmerman BEC, Strickland DC, Johnson RL, Payne JR 2011 Development of a ‘universal’ rubric for assessing undergraduates’ scientific reasoning skills using scientific writing Assess Eval Higher Educ 36 509 547 10.1080/02602930903540991 http://dx.doi.org/10.1080/02602930903540991
61. Torrance EP 1998 Torrance tests of creative thinking: norms-technical manual: figural (streamlined) forms A & B Scholastic Testing Service Inc. Bensenville, IL
62. Ward JR, Clarke HD, Horton JL 2014 Effects of a research-infused botanical curriculum on undergraduates’ content knowledge, STEM competencies, and attitudes toward plant sciences CBE Life Sci Educ 13 387 396 25185223 4152201
63. Weston TJ, Laursen SL 2015 The undergraduate research student self-assessment (URSSA): validation for use in program evaluation CBE Life Sci Educ 14 3 pii:ar33 26250563 4710391
64. Wiggins GP, McTighe J, Kiernan LJ, Frost F 1998 Understanding by design Association for Supervision and Curriculum Development Alexandria, VA

Supplemental Material

Loading

Article metrics loading...

/content/journal/jmbe/10.1128/jmbe.v17i3.1103
2016-12-02
2019-09-17

Abstract:

Integrating research experiences into undergraduate life sciences curricula in the form of course-based undergraduate research experiences (CUREs) can meet national calls for education reform by giving students the chance to “do science.” In this article, we provide a step-by-step practical guide to help instructors assess their CUREs using best practices in assessment. We recommend that instructors first identify their anticipated CURE learning outcomes, then work to identify an assessment instrument that aligns to those learning outcomes and critically evaluate the results from their course assessment. To aid instructors in becoming aware of what instruments have been developed, we have also synthesized a table of “off-the-shelf” assessment instruments that instructors could use to assess their own CUREs. However, we acknowledge that each CURE is unique and instructors may expect specific learning outcomes that cannot be assessed using existing assessment instruments, so we recommend that instructors consider developing their own assessments that are tightly aligned to the context of their CURE.

Highlighted Text: Show | Hide
Loading full text...

Full text loading...

/deliver/fulltext/jmbe/17/3/jmbe-17-399_091919_2.html?itemId=/content/journal/jmbe/10.1128/jmbe.v17i3.1103&mimeType=html&fmt=ahah

Figures

Image of FIGURE 1

Click to view

FIGURE 1

Guide to assessing course-based undergraduate research experiences (CUREs).

Source: J. Microbiol. Biol. Educ. December 2016 vol. 17 no. 3 399-408. doi:10.1128/jmbe.v17i3.1103
Download as Powerpoint

This is a required field
Please enter a valid email address
Please check the format of the address you have entered.
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error