Leveraging values to improve and align research assessment policies and practices

Universities cannot achieve their missions and visions if their stated values are out of line with research assessment policies and practices. Although most university mission statements specify research, teaching, and public service as their central commitments, contributions to research are often valued at the expense of teaching and public service. How serious is this misalignment and what can be done about it?

Read more

Societies’ Role in Improving Research Assessment

Scientific societies have a vested interest in research assessment as standard bearers for their profession. We represent members who are at all career stages and in many different career paths. Societies have multiple roles in the assessment infrastructure. They publish scientific journals; they host large and small meetings; they provide professional development training; they give recognition through awards and fellowships; and they set standards for the profession. Collectively, this gives societies a variety of leverage points to affect change.

Read more

Those who can, do; those who can’t, teach

The conundrum is easy to understand:  Conventional teaching assessments rely heavily on student feedback, which, whether through metrics or narrative comments, is often fraught with bias.  It is even more difficult to assess teaching when done in “engaged” settings, not in the classroom (e.g., for medical schools, in association with patient care).

Read more

The importance of research assessment to accelerate the development of global health innovations for emerging and neglected infectious diseases

Research assessment can be extremely useful as a tool to evaluate the quality and the impact of the activities needed to achieve the Sustainable Development Goals (SDGs). The SDGs, adopted in 2015 by the General Assembly of the United Nations, envision that by the year 2030 the world could be transformed.

Read more

How conceptual clarity can improve how we assess research

Current discourse on research assessment places high emphasis on “impact.” However, there are many different concepts of impact, and many different concepts of how research achieves impact. The resulting ambiguity and confusion confound efforts to improve research assessment. To reliably assess research, we need clarity about what it is we want to assess.

Read more

Research assessment as a human-centered design problem

Human-centered design is well-positioned to supplement the ongoing activity of sharing best practices and specific, successful examples of new research assessment strategies, contributing a deep understanding what matters to individuals and entities, and a perspective on realigning incentives, social norms, and points of leverage where we might redefine and reward what’s valued in the future.

Read more

#sfDORA community interview: recognizing data in research assessment

DORA community interviews provide an opportunity for supporters to discuss innovation in research assessment and to better understand how to initiate effective change in local communities. This time we are talking with the executive director of the Belmont Forum, Dr. Erica Key about recognizing data in research assessment. Please join our discussion at 11:00AM EDT on Wednesday, Aug. 28.

Read more