Case Study

The Ministry of Business, Innovation & Employment (MBIE) New Zealand

Adapted from a previous GRC Responsible Research Assessment case study   Compare case studies

The purpose of the Ministry of Business, Innovation & Employment (MBIE) is to grow New Zealand for all. It aims to build a strong economy by using the skills, knowledge and time of its people in conjunction with its natural resources, and financial and physical capital to improve the wellbeing of current and future generations.

This case study explains how and why, in 2023, the MBIE introduced the option for applicants to its Endeavour Fund to use a narrative CV format.

Who: Organization profile

Country New Zealand
Category Research Funding Organizations
Profile of institution public/government national agencies
Type of Research Supported Applied ResearchMission-orientedTranslational Research
Disciplinary Focus All
Organization of research evaluation Project/Grant level

What: What changed and the key elements of change

MBIE is responsible for the science sector in New Zealand, and specifically:

  • Managing New Zealand’s science and innovation systems through the investment of public funds and international connections relating to the science system.
  • Advising on science, innovation, investment and biotechnology policy.

In 2023 MBIE introduced the option for applicants to use a narrative CV format as part of an application to the Endeavour Fund, its largest competitive fund.  Following consultation with the science sector in New Zealand, the narrative CV format was made optional not mandatory, with applicants able to provide a more traditional academic CV with their application if desired.

The narrative CV enables applicants to include information in response to the following questions: 

  • How have you contributed to broader societal engagement and/or knowledge exchange?
  • How have you contributed to the generation, revitalization, preservation, and dissemination of knowledge?
  • How have you contributed to the development of individuals, collectives, iwi/hapū?
  • How have you contributed to the wider research or professional community?
  • How have you contributed nationally or internationally to the development of research and technology impact?

Information about more traditional academic scholarship can still be provided in other sections of the application (e.g. most recent/relevant significant qualifications, and/or recognition or merit-based roles, awards, and memberships).

Why: Motivation for change

In line with the global shift towards more narrative formats in funding applications, MBIE was keen to provide applicants with the ability to provide a more rounded view of their career and achievements. MBIE also has a Diversity in Science Statement that includes ensuring a diversity of people and perspectives in advisory, assessment and decision-making bodies. Furthermore, MBIE was keen to broaden its definition of an "academic" (and assessment criteria) to encourage applications for its funding from Māori and Pacific Peoples, and researchers communities who might have followed non-traditional career paths, including, for example, individuals who might have familial and community obligations, and/or pursued career breaks.

How: Processes and dynamics for developing, implementing and managing change

Planning and Implementation

The process to develop and implement the narrative CV in the Endeavour Fund involved:

  1. A workshop with Research Office staff from Universities and Crown Research Institutes to identify what information a narrative CV should contain.
  2. Developing a narrative CV template and seeking feedback from researchers through Research Office staff and Māori academics.
  3. Updating the narrative CV template following the feedback and developing four examples narrative CVs to test with assessors.
  4. Setting up a Three Agency Working Group with New Zealand’s two other main funders (Te Apārangi (the Royal Society) and the Health Research Council) to develop a narrative CV with common elements that all funders could potentially use and to make it easier for applicants.
  5. Meeting with global representatives to gather feedback and to develop guidance for applicants.
  6. Incorporating the feedback to develop the final version for inclusion in the Endeavour 2023 funding round.

To support implementation:

  1. The narrative CV template was designed to align with the guiding principles of the GRC Dimensions of Responsible Research Assessment.
  2. Accompanying guidance around the use of the narrative CV was straightforward and not too long.
  3. Because the narrative CV was optional, steps were taken to raise awareness and engagement in advance, so that applicants were already familiar with it when launched.
  4. Information about the implementation was included in communications materials (including social media) to accompany the launch.

Monitoring and Evaluation

A review of the use of narrative CVs was conducted once the Endeavour Round had been through its assessment phases but before decisions were announced. The review survey of assessors (who had received both a narrative CV and the more traditional format) found:

  • The assessors saw the narrative CV as most useful for those with non-academic roles in the projects or for academics who had followed non-traditional career paths.
  • The assessors mostly want to know if applicants are the right people to execute the proposed projects: applicants’ expertise and experience in relation to the application.
  • The usefulness of such a narrative format ultimately depends on the detail that applicants include and how what the CV offers is integrated with the rest of the application material.
  • Even if an individual narrative CV was considered ‘poor’, it did not always negatively affect the application because the influence of the CV as part of the totality of a team-based application is limited.
  • A narrative (subjective) CV format can be problematic because it is not always easy to fully trust what is written to be wholly accurate and true. It was seen by some to be insufficiently ‘fact-based’ and requiring external verification/validation.

Conclusions

  • The assessors did not advocate either strongly for or against narrative CVs. They appreciated its value for certain contexts (e.g. to support applicants with non-academic/non-traditional careers) but did not see it as a particular gamechanger in how they conduct assessments.
  • There was a lack of consensus among interviewees on whether the narrative CVs make their assessment tasks easier or harder.

Following the review, MBIE decided to continue to offer applicants the option to use a narrative CV in Endeavour Fund applications - as a way to support a diversity of applicants. In addition, the option to use a narrative CV was also extended to other funding schemes (e.g. the Aotearoa New Zealand Tāwhia te Mana Research Fellowships).

When: Timeline for development and implementation

April 2022 – Narrative CV project plan approved by Governance Group.
April-June 2022 – researched current CVs in use, analyzed what would work for the New Zealand context and developed an example to test with various groups.
June-July 2022 – workshopped the narrative CV with research office staff and tested with Māori academics as well as other stakeholders.
August-October 2022 – approval and implementation (through the calls to proposal and assessment information) of the narrative CV which was announced to the science sector as part of the Endeavour Roadshow where all the information on a current round is communicated through a Q&A event.