Resource Library

A collection of materials to facilitate the development of responsible research and researcher assessment policies and practices.

Search and Filter

Resource type

Intended audience


Journal articles
For: Research institutes
2020
Understanding the hiring dynamics of the academic job market is an important step for institutions wishing to enhance the transparency of their hiring process and attract talent. To establish the profile and perceptions of academic job seekers, the authors collected survey data from 317 early-career researchers who were in the process of applying for academic…
Good practicesPosition papers
For: Research institutes
2020
In support of the Dutch Recognition and Rewards Programme, Leiden University published a position paper “Academia in Motion: Recognition & Rewards at Leiden University” in 2021. In 2020, Leiden University’s Executive Board established a Recognition & Rewards steering committee made up of staff from a variety of positions and roles. The goals of the Recognition…
Journal articles
For: Research institutes
2020
To improve research assessment practices in academic institutions, it is critical to understand the institutional metrics used to assess research quality for promotion. This article examines traditional and non-traditional criteria used to assess biomedical scientists for promotion and tenure in 92 randomly selected international institutions. The study found that the evaluation of scientists emphasizes traditional…
Good practicesPosition papers
For: Research institutes
2021
In this article, Jonathan Grant outlines nine cases that highlight examples of new academic incentives at multiple levels (e.g., system, institution, and individual level). These include: System-Level Examples like the United Kingdom Research Excellence Framework (REF), which reviews the quality of research conducted at universities in the United Kingdom, including societal impact and research environment.…
Case studiesGood practices
For: Research institutes
2023
The ARRC team at the University of Cambridge is running a controlled trial to investigate the effects of using narrative CVs in postdoc recruitment. Narrative CVs aim to avoid placing a narrow emphasis on lists of achievements such as authored publications, awarded grants, etc. Using a narrative CV might allow researchers to highlight their wider…
Journal articles
For: FundersProfessional societiesResearch institutes
2020
A survey was conducted by Noémie Aubert Bonn and Wim Pinxten to understand how Flemish researchers work and how they would rate the relevance of specific research assessment indicators in career advancement and advancing science. Survey results suggested that current indicators used to assess career advancement (e.g., indicators of prestige like high journal impact factor…
Journal articles
For: Research institutes
2018
Six principles for hiring, promotion, and tenure were developed at a one-day workshop in Washington DC in January 2017 to address incentives and rewards in research assessment.
Advocacy resourcesGood practicesPolicies and guidance
For: FundersProfessional societiesResearch institutes
2022
This document from UNESCO is a roadmap for higher education, prepared for the “3rd World Higher Education Conference (WHEC2022).” Within the roadmap are “signposts for co-creating more open, inclusive, equitable and collaborative higher education systems that democratize access and knowledge.” Recognizing the evolution of and advancements in higher education, UNESCO has outlined 5 sections discussing…
Good practicesTools
For: FundersResearch institutes
2021
CIRAD developed the ImpresS method to assess the environmental and societal impact its research.
Good practicesPolicies and guidance
For: Journals and publishersResearch institutes
2023
Reviewers play a critical role in upholding research integrity within the expert review and funding process at the Canadian Cancer Society (CCS). The expert review encompasses a diverse group ranging from researchers, clinicians, patients, survivors, caregivers, decision-makers, and knowledge users, collectively offering a multifaceted evaluation of research grant applications. In alignment with DORA, CCS advocates…
Good practicesJournal articles
For: Journals and publishersResearch institutes
2023
This paper reviewed existing literature and international best practices and established consensus by Delphi survey on 10 key measures for assessing research quality and impact that align with DORA values. These measures were chosen from a pool of 50 compiled measures that emphasize diverse and holistic evaluations of research performance beyond traditional metrics like journal…
Position papers
For: Professional societiesResearch institutes
2018
The 2018 European University Association (EUA) roadmap was approved by the EUA Council at its meeting on 4 April 2018, in Zurich (Switzerland). This roadmap addresses the assessment of research outcomes, researchers and research units and organizations (laboratories, research centers and universities). The main objective of the roadmap is to raise awareness and support European…
Policies and guidancePosition papers
For: Research institutes
2023
This work-in-progress paper outlines actions taken to implement the University Research Assessment Project led by the Center for Interuniversity Development (CINDA). CINDA is a specialist Latin American and European network that includes universities from over 15 countries. CINDA members manage inter-university collaborations, generate and disseminate knowledge, and contribute to the development of higher education and university management…
Tools
For: Journals and publishersResearch institutes
2022
Preprints are an essential tool for accelerating scientific discovery as they provide early and free access to new findings. Since the COVID-19 pandemic, the usage of preprints have surged on a worldwide level and its availability allows discussion and assessment to be carried over to a wider community. However public participation is very low and…
Good practicesPosition papers
For: Professional societiesResearch institutes
2017
The Federation released a report in 2017 to support the ongoing conversation in Canada about the assessment of research impact in the Humanities and Social Sciences (HSS).
Position papers
For: Research institutes
2021
The Open Science movement has the potential to create opportunities to also reform scholarly assessment practices to acknowledge and reward publication in Open Access journals, data sharing, and a broader range of research outputs. The European University Association (EUA) conducted a survey from October 2020 to January 2021 of the level of development of Open…
Good practices
For: Research institutes
Ghent University published a vision statement for evaluating research based on eight principles agreed on by the University’s Board of Governors.
Initiatives
For: Professional societiesResearch institutes
2021
The Global Research Council (GRC) Responsible Research Assessment (RRA) working group, was established in 2021 to support the promotion and implementation of RRA practices in the international research and innovation system through the development of a collective understanding of RRA, and the sharing of guidance and best practices between research funding agencies worldwide. With a…
InitiativesPosition papers
For: Research institutes
2020
A working group set up by the Federation of Finnish Learned Societies produced guidelines to improve how researchers are assessed in Finland. The report provides a set of general principles (transparency, integrity, fairness, competence, and diversity) that apply throughout 13 recommended good practices to improve four aspects of researcher evaluation.
Advocacy resources
For: FundersProfessional societiesResearch institutes
2021
The Centre for Science and Technology Studies (CWTS) studies bibliometric and scientometric tools to support research assessment reform and strategic decision making for developing science policy. In March 2021, the CWTS published an infographic on “problems with the H-index and reasons for integrating other contributions into evaluations”. This infographic gives different examples of how the…
Initiatives
For: FundersResearch institutes
2019
The Helsinki Initiative has three tenets to recognize multilingualism in scholarly work. This includes the promotion of language diversity in research assessment, evaluation, and funding systems.
Good practices
For: Research institutes
In keeping with HHMI’s commitment to basic scientific discovery, the Institute employs outstanding researchers for renewable seven-year terms as HHMI Investigators.
Tools
For: Research institutes
The Humane Metrics Initiative (HuMetricsHSS) works to create and support values-enacted frameworks for understanding and evaluating all aspects of scholarly life with a focus on humanities and social sciences . Towards its goal of supporting stakeholders as they work to reform scholarly evaluation, HuMetricsHSS created a Workshop Kit to aid those who would like to…
ideas for ncv optimization
Tools
DORA-produced
For: FundersResearch institutes
2024
This one-page tip sheet is a part of the short report Using Narrative CVs: Identifying shared objectives and monitoring effectiveness. In February 2022, DORA organized the online workshop series “Using Narrative CVs: Identifying shared objectives and monitoring effectiveness” in partnership with FORGEN CoP, Science Foundation Ireland, the Swiss National Science Foundation, UK Research and Innovation,…
Journal articles
For: Research institutes
2021
In their working paper, authors Kimberlee Gai Weatherall and Rebecca Giblin review the use of metrics in university and research policy with a focus on Australia. The metrics reviewed include grant income, journal bibliometrics and citations by authors and courts. This review aims to create awareness among legal scholars “of the full range of ways…