1887

Aligning Objectives and Assessment in Responsible Conduct of Research Instruction

    Authors: Alison L. Antes1,*, James M. DuBois1
    VIEW AFFILIATIONS HIDE AFFILIATIONS
    Affiliations: 1: Division of General Medical Sciences, Washington University School of Medicine, St. Louis, MO 63110
    AUTHOR AND ARTICLE INFORMATION AUTHOR AND ARTICLE INFORMATION
    • Published 15 December 2014
    • aThe CITI training program alone states that over 6.4 million courses have been completed, with an average of 4.5 hours invested in each of their basic courses. See https://www.citiprogram.org/ (accessed on 5 September 2014). The U.S. Office of Research Integrity’s RCR Resource Development program awarded $1.5 million to various institutions to develop programs, and has spent over $1 million developing their own training programs, such as The Lab. See http://ori.hhs.gov/ (accessed on 5 September 2014).
    • *Corresponding author. Mailing address: Division of General Medical Sciences, Washington University School of Medicine, 660 South Euclid Avenue, Campus Box 8005, St. Louis, MO 63110. Phone: 314-362-6006. Fax: 314-454-5113. E-mail: aantes@dom.wustl.edu.
    • ©2014 Author(s). Published by the American Society for Microbiology.
    Source: J. Microbiol. Biol. Educ. December 2014 vol. 15 no. 2 108-116. doi:10.1128/jmbe.v15i2.852
MyBook is a cheap paperback edition of the original book and will be sold at uniform, low price.
  • HTML
    90.48 Kb
  • PDF
    246.76 Kb
  • XML

    Abstract:

    Efforts to advance research integrity in light of concerns about misbehavior in research rely heavily on education in the responsible conduct of research (RCR). However, there is limited evidence for the effectiveness of RCR instruction as a remedy. Assessment is essential in RCR education if the research community wishes to expend the effort of instructors, students, and trainees wisely. This article presents key considerations that instructors and course directors must consider in aligning learning objectives with instructional methods and assessment measures, and it provides illustrative examples. Above all, in order for RCR educators to assess outcomes more effectively, they must align assessment to their learning objectives and attend to the validity of the measures used.

Key Concept Ranking

Lead
0.58035713
Mismatch
0.55
Canning
0.5347343
Beta
0.51468176
Transcription
0.51468176
Slides
0.51468176
Stems
0.4739098
0.58035713

References & Citations

1. AAMC-AAU2008Protecting patients, preserving integrity, advancing health: accelerating the implementation of COI policies in human subjects research AAMC-AAUWashington, DC
2. Anderson MS, Horn AS, Risbey KR, Ronning EA, De Vries R, Martinson BC2007What do mentoring and training in the responsible conduct of research have to do with scientists’ misbehavior? Findings from a National Survey of NIH-funded scientistsAcad Med8285386010.1097/ACM.0b013e31812f764c17726390 http://dx.doi.org/10.1097/ACM.0b013e31812f764c
3. Anderson M, Ronning EA, De Vries R, Martinson B2010Extending the Mertonian norms: scientists’ subscription to norms of researchJ High Educ8136639310.1353/jhe.0.0095 http://dx.doi.org/10.1353/jhe.0.0095
4. Antes AL, Wang X, Mumford MD, Brown RP, Connelly S, Devenport LD2010Evaluating the effects that existing instruction on responsible conduct of research has on ethical decision makingAcad Med8551952610.1097/ACM.0b013e3181cd1cc520182131 http://dx.doi.org/10.1097/ACM.0b013e3181cd1cc5
5. Antes AL, et al2009A meta-analysis of ethics instruction effectiveness in the sciencesEthics Behav1937940210.1080/10508420903035380198383112762211 http://dx.doi.org/10.1080/10508420903035380
6. Antes AL2014A systematic approach to instruction in research ethicsAccount Res21506710.1080/08989621.2013.822269 http://dx.doi.org/10.1080/08989621.2013.822269
7. Bates R2004A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficenceEval Program Plann2734134710.1016/j.evalprogplan.2004.04.011 http://dx.doi.org/10.1016/j.evalprogplan.2004.04.011
8. Bebeau MJ, Rest JR, Yamoor CM1985Measuring dental students’ ethical sensitivityJ Dent Educ492252353857273
9. Bloom BS, Engelhart MD, Furst EJ, Hill WH, Krathwohl DR1956Taxonomy of educational objectives: the classification of educational goals. Handbook I: cognitive domainDavid McKay CompanyNew York, NY
10. Borenstein J, Drake MJ, Kirkman R, Swann JL2008The test of ethical sensitivity in science and engineering (TESSE): a discipline-specific assessment tool for awareness of ethical issuesAnnual ASEE Conference, American Society for Engineering EducationPittsburgh, PA
11. Clarkeburn H2002A test for ethical sensitivity in scienceJ Moral Educ3143945310.1080/0305724022000029662 http://dx.doi.org/10.1080/0305724022000029662
12. Cohen CM, Cohen SL2012Lab dynamics: management and leadership skills for scientists2nd edCold Spring Harbor Laboratory PressCold Spring Harbor, NY
13. DeVellis RF2003Scale development: theory and applicationsSageThousand Oaks, CA
14. DuBois JM2013Validating outcome measures for remediation of research wrongdoingOffice of Research Integrity Newsletter2142
15. Dubois JM, Dueker JM2009Teaching and assessing the responsible conduct of research: a Delphi Consensus Panel ReportJ Res Adm404970225001453322664
16. Fink LD2013Creating significant learning experiences: an integrated approach to designing college coursesJossey-BassSan Francisco, CA
17. Gould MS, Greenberg T, Velting DM, Shaffer D2003Youth suicide risk and preventive interventions: a review of the past 10 yearsJ Am Acad Child Adolesc Psychiatry4238640510.1097/01.CHI.0000046821.95464.CF12649626 http://dx.doi.org/10.1097/01.CHI.0000046821.95464.CF
18. Haladyna T, Downing S1986Validity of a taxonomy of multiple-choice item-writing rulesAppl Meas Educ2517810.1207/s15324818ame0201_4 http://dx.doi.org/10.1207/s15324818ame0201_4
19. Hicks J2013Opinion: ethics training in scienceScientist[Online.] http://www.the-scientist.com/?articles.view/articleNo/35543/title/Opinion--Ethics-Training-in-Science/
20. Hren D, Marusic M, Marusic A2011Regression of moral reasoning during medical education: combined design study to evaluate the effect of clinical study yearsPLoS ONE6e1740610.1371/journal.pone.0017406214792043068134 http://dx.doi.org/10.1371/journal.pone.0017406
21. Kalichman MW, Plemmons DK2007Reported goals for responsible conduct of research coursesAcad Med8284685210.1097/ACM.0b013e31812f78bf17726389 http://dx.doi.org/10.1097/ACM.0b013e31812f78bf
22. Kraiger K, Ford J, Salas E1993Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluationJ Appl Psychology7831132810.1037/0021-9010.78.2.311 http://dx.doi.org/10.1037/0021-9010.78.2.311
23. Krathwohl DR2002A revision of Bloom’s taxonomy: an overviewTheor Pract4121221810.1207/s15430421tip4104_2 http://dx.doi.org/10.1207/s15430421tip4104_2
24. Martinson B, Crain AL, Anderson M, DeVries R2009Institutions’ expectations for researchers’ self-funding, federal grant holding, and private industry involvement: manifold drivers of self-interest and researcher behaviorAcad Med841491149910.1097/ACM.0b013e3181bb2ca6198588023071700 http://dx.doi.org/10.1097/ACM.0b013e3181bb2ca6
25. Martinson BC, Thrush CR, Crain AL2013Development and validation of the Survey of Organizational Research Climate (SORC)Sci Eng Ethics1981383410.1007/s11948-012-9410-73594655 http://dx.doi.org/10.1007/s11948-012-9410-7
26. McCormack WT, Garvan CW2014Team-based learning instruction for responsible conduct of research positively impacts ethical decision-makingAccount Res21344910.1080/08989621.2013.822267 http://dx.doi.org/10.1080/08989621.2013.822267
27. Messick S1995Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaningAm Psychol5074174910.1037/0003-066X.50.9.741 http://dx.doi.org/10.1037/0003-066X.50.9.741
28. Mumford MD, et alA sensemaking approach to ethics training for scientists: preliminary evidence of training effectivenessEthics Behav18315339195785592705124
29. Mumford MD, et al2009Exposure to unethical career events: effects on decision-making, climate, and socializationEthics Behav1935137810.1080/10508420903035356199363232779529 http://dx.doi.org/10.1080/10508420903035356
30. Mumford MD, et al2006Validation of ethical decision-making measures: evidence for a new set of measuresEthics Behav1631934510.1207/s15327019eb1604_4 http://dx.doi.org/10.1207/s15327019eb1604_4
31. Myyry L, Helkama K2002The role of value priorities and professional ethics training in moral sensitivityJ Moral Educ31355010.1080/03057240120111427 http://dx.doi.org/10.1080/03057240120111427
32. Nasca T, Philibert I, Brigham T, Flynn T2012The next GME accreditation system: rationale and benefitsN Engl J Med3661051105610.1056/NEJMsr120011722356262 http://dx.doi.org/10.1056/NEJMsr1200117
33. Resnik D, Dinse GE2012Do U.S. research institutions meet or exceed federal mandates for instruction in responsible conduct of research? A national surveyAcad Med871237124210.1097/ACM.0b013e318260fe5c228368353430795 http://dx.doi.org/10.1097/ACM.0b013e318260fe5c
34. Resnik DB2014Editorial: does RCR education make students more ethical, and is this the right question to ask?Account Res2121121710.1080/08989621.2013.848800244227013965192 http://dx.doi.org/10.1080/08989621.2013.848800
35. Self DJ, Olivarez M, Baldwin DCJ1998The amount of small-group case-study discussion needed to improve moral reasoning skills of medical studentsAcad Med7352152310.1097/00001888-199805000-000199609864 http://dx.doi.org/10.1097/00001888-199805000-00019
36. Taylor HA, Kass NE, Ali J, Sisson S, Bertram A, Bhan A2012Development of a research ethics knowledge and analytical skills assessment toolJ Med Ethics3823624210.1136/medethics-2011-100025 http://dx.doi.org/10.1136/medethics-2011-100025
37. West SL, O’Neal KK2004Project D.A.R.E. outcome effectiveness revisitedAm J Public Health941027102910.2105/AJPH.94.6.1027152493101448384 http://dx.doi.org/10.2105/AJPH.94.6.1027
jmbe.v15i2.852.citations
jmbe/15/2
content/journal/jmbe/10.1128/jmbe.v15i2.852
Loading

Citations loading...

Supplemental Material

No supplementary material available for this content.

Loading

Article metrics loading...

/content/journal/jmbe/10.1128/jmbe.v15i2.852
2014-12-15
2017-10-23

Abstract:

Efforts to advance research integrity in light of concerns about misbehavior in research rely heavily on education in the responsible conduct of research (RCR). However, there is limited evidence for the effectiveness of RCR instruction as a remedy. Assessment is essential in RCR education if the research community wishes to expend the effort of instructors, students, and trainees wisely. This article presents key considerations that instructors and course directors must consider in aligning learning objectives with instructional methods and assessment measures, and it provides illustrative examples. Above all, in order for RCR educators to assess outcomes more effectively, they must align assessment to their learning objectives and attend to the validity of the measures used.

Highlighted Text: Show | Hide
Loading full text...

Full text loading...

/deliver/fulltext/jmbe/15/2/jmbe-15-108.xml.a.html?itemId=/content/journal/jmbe/10.1128/jmbe.v15i2.852&mimeType=html&fmt=ahah

This is a required field
Please enter a valid email address
Please check the format of the address you have entered.
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error