Introduction to Responsible Research Assessment Course

The DORA introductory course on responsible research assessment

The introductory responsible research assessment (RRA)  course aims to empower anyone to challenge existing assumptions around research quality and impact, by introducing them to the concept of responsible research assessment, its foundational principles, and how RRA aims to improve evaluation practices.

This course is free, self-paced, and designed for you to pick and choose which lessons are most relevant and useful. Each lesson includes a glossary of key terms and an annotated bibliography to help guide you if you wish to dive more deeply into different topics touched on during the lesson.

Who is this course for? This is an introductory course open to anyone, regardless of career level or discipline, seeking to learn about RRA. This course is designed for anyone working in research, research administration or leadership, research funding or policy, scholarly publishing or communication, or metrics providers who seek to drive positive change in the research system. Given that this topic is focused on those in the academic space, a familiarity with academia or higher education, research policy, and/or academic publishing is highly recommended.

What will you gain? Build a foundational understanding of RRA, gain insights into innovative tools and approaches such as Narrative CVs, and be inspired from real-world examples of successful RRA implementation from institutions worldwide.

Course content

By the end of this course, you should be able to:

  • understand the definition of RRA
  • identify the limitations of traditional research assessment methods
  • describe examples of how RRA can be applied
  • identify the key actors within the scholarly system that impact research assessment. 

We want to hear from you!

Before you take the course, we invite you to take a survey (here) to let us know what your knowledge level of the material is and what your expectations are going into the course. There is a survey link at the end of each lesson that will provide you space to give feedback on your knowledge has grown.

The surveys also provide space for feedback on the course content. The course is an evolving resource that we welcome your feedback on how we can improve it.

Important FAQs

  • Registration: You must register to take this course. Registration creates a profile, which allows you to track your progress through the course and access your certificates of completion for the course. You can access your profile by logging in from the course homepage, and you can delete your profile at any time. By providing your email address, you are opting in to receive communications about the course. The American Society for Cell Biology (ASCB) manages the DORA data and website, and all data is subject to the ASCB privacy policy. Please contact info@sfdora.org with any questions.
  • Navigation: Before starting the course, review the Navigation Guide.
  • Lesson Order: There is no requirement to complete the course in a particular order. You can access all of the course content by clicking through the course directory, which can be found on the course homepage or within each lesson. Below are our recommendations for navigating the content based on your level of familiarity with RRA:
    • New to RRA? We recommend you take the course in the order it is presented.
    • Familiar with RRA? If you are already familiar with the key foundational concepts of RRA, we welcome you to explore the course content that seems most useful or relevant to your context.
  • Knowledge checks: Throughout the lessons, you will encounter multiple choice quiz questions and reflective questions. They are not graded or reviewed by DORA staff.
  • Supporting materials: A suggested reading list and glossary is available for each lesson. These can be found in the “materials” tab on the course homepage or a the end of each Lesson.
  • Optional certificates: Certificates of achievement are available to you and can be obtained by taking the optional quiz at the end of each Lesson or at the end of the Course. After taking the final quiz for a lesson and/or the course, you will be given the option to download your certificate.

Because this course is open to everyone, you will be exposed to case studies, examples, and reflective questions for a wide range of contexts and actors in the academic system, like: early career researchers, librarians, research managers, research funders, professional societies, and more. While some examples might not be directly relevant to your specific context, practical and holistic understanding of the academic system that can contextualize reflections about research assessment principles and practices.

Disclaimer: Please note that this course uses the term “staff” when referring to anyone who is employed by an organization. In the case of research performing organizations, this term includes faculty, lab technicians, data stewards, etc.

This course was created by the Declaration on Research Assessment (DORA), a nonprofit initiative working to advocate for and support responsible research assessment (RRA). Unless otherwise indicated, this content is available under a Creative Commons Attribution License CC BY-NC 4.0. Logos are trademarks or registered trademarks of their respective organizations and may not be reused or reproduced without permission.

Under CC BY-NC 4.0, you are free to copy and redistribute the material in any medium or format. You must give appropriate credit , provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. You may not use the material for commercial purposes. If you remix, transform, or build upon the material, you may not distribute the modified material. You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

Course Content

Lesson 1: What is Responsible Research Assessment?
9 Topics
1 Quiz
1.1 The Problem that the Current System Faces
1.2 Who Conducts “Research Assessment”?
1.3 Where Does “Research Assessment” Occur?
1.4 Motivations for Modernizing Research Assessment
1.6 Put It All Together
1.7 Intersection with Other Efforts to Improve Academic Culture
1.8 Reflecting on Responsible Research Assessment
1.9 Lesson 1: Conclusion
Lesson 1 Quiz: Earn your Certificate of Achievement for this Lesson
6 Topics
1 Quiz
2.1 The Academic System: A Systems Approach
2.2 Understanding the Academic System
2.3 Understanding the Actors
2.5 Practical Examples
2.6 Lesson 2: Conclusion
Lesson 2 Quiz: Earn your Certificate of Achievement for this Lesson
12 Topics
1 Quiz
3.1 Key Moments in Research Assessment
3.2 Traditional Assessment Approaches
3.3 Scholarly Communications and RRA
3.4 What are Commonly Misused Quantitative Indicators?
3.5 Critique of Quantitative Indicators: Beyond the Numbers
3.7 Citation Counts
3.8 H-index
3.9 Field-normalized Citation Indicators
3.10 Principles for Responsible Use of Quantitative Indicators
3.11 Quantitative Indicators and Biases
3.12 Lesson 3: Conclusion
Lesson 3 Quiz: Earn your Certificate of Achievement for this Lesson
4.1 Traditional vs. Narrative CVs
4.2 Traditional vs. Bias-Mitigating Staff Search Panels
4.3 Traditional vs. Responsible Education on Quantitative Indicators
4.4 Reflecting on Responsible Research Assessment Applications
4.5 Lesson 4: Conclusion
Lesson 4 Quiz: Earn your Certificate of Achievement for this Lesson
Final Quiz
Final Quiz: Earn your Certificate of Achievement for the entire course

Share This

Copy Link to Clipboard

Copy