Introductory Course to Responsible Research Assessment

The DORA introductory course on responsible research assessment

The introductory responsible research assessment (RRA) course aims to empower anyone to challenge existing assumptions around research quality and impact, by introducing them to the concept of responsible research assessment, its foundational principles, and how RRA aims to improve evaluation practices.

This course is free, self-paced, and designed for you to pick and choose which lessons are most relevant and useful. Each lesson includes a glossary of key terms and an annotated bibliography to help guide you if you wish to dive more deeply into different topics touched on during the lesson.

Who is this course for? This is an introductory course open to anyone, regardless of career level or discipline, seeking to learn about RRA. This course is designed for anyone working in research, research administration or leadership, research funding or policy, scholarly publishing or communication, or metrics providers who seek to drive positive change in the research system. Given that this topic is focused on those in the academic space, a familiarity with academia or higher education, research policy, and/or academic publishing is highly recommended.

What will you gain? Build a foundational understanding of RRA, gain insights into innovative tools and approaches such as Narrative CVs, and be inspired from real-world examples of successful RRA implementation from institutions worldwide.

Course content

By the end of this course, you should be able to:

  • understand the definition of RRA
  • identify the limitations of traditional research assessment methods
  • describe examples of how RRA can be applied
  • identify the key actors within the scholarly system that impact research assessment. 

Because this course is open to everyone, you will be exposed to case studies, examples, and reflective questions for a wide range of contexts and actors in the academic system, like: early career researchers, librarians, research managers, research funders, professional societies, and more. While some examples might not be directly relevant to your specific context, we hope they will provide you with a more practical and holistic understanding of the academic system.

Disclaimer: Please note that this course uses the term “staff” when referring to anyone who is employed by an organization. In the case of research performing organizations, this term includes faculty, lab technicians, data stewards, etc.

This course was created by the Declaration on Research Assessment (DORA), a nonprofit initiative working to advocate for and support responsible research assessment (RRA). Unless otherwise indicated, this content is available under a Creative Commons Attribution License (CC BY-SA 4.0). Logos are trademarks or registered trademarks of their respective organizations and may not be reused or reproduced without permission.

Course Content

Lesson 1: What is Responsible Research Assessment (RRA)?
7 Topics
1 Quiz
The problem that the current system faces
Who Conducts “Research Assessment”?
Where does “Research Assessment” occur?
Motivations for modernizing research assessment
Intersection with Other Efforts to Improve Academic Culture
Put It All Together
Lesson 1: Conclusion
Lesson 1
Lesson 2: RRA Impacts Everyone in the Academic System
6 Topics
The Academic System: A Systems Problem
Understanding the Academic Ecosystem
Understanding the Actors
There is a global effort to support more RRA practices
Practical Examples
Lesson 2: Conclusion
Traditional Assessment Approaches
Scholarly Communications and RRA
Key Moments in Research Assessment
Critique of Quantitative Indicators: Beyond the Numbers
What are quantitative indicators?
Citation Counts
H-index
Field-normalized citation indicators
Principles for Responsible Use of Quantitative Indicators
Quantitative Indicators and Biases
Lesson 3: Conclusion
Lesson 4: How can RRA be applied to real-world assessment scenarios?
4 Topics
Traditional vs. Narrative CVs
Traditional vs. Bias-Mitigating Staff Search Panels
Traditional vs. Responsible Education on Quantitative Indicators
Lesson 4: Conclusion
Final Quiz
RRA Final Quiz

Share This

Copy Link to Clipboard

Copy