Unlike other expert groups in EDUC-WIDE, Research Assessment (RA) is a newcomer in EDUC—but that doesn’t make it any less significant. In fact, for those familiar with the field, this expert area presents a considerable challenge.
Research assessment practices within EDUC universities vary. Recent studies indicate that this diversity, and consequently the attitude to research assessment reforms, largely stems from differing geopolitical and cultural contexts. In former Soviet bloc countries (MUNI, PNU, UPECS), research performance evaluation has been in place since the early 20th century, driven by planned economic and ideological objectives. Meanwhile, more advanced countries developed assessment systems a little later basing them on international benchmarks such as rankings, impact factors, citation analysis, and global citation databases. By the time Widening countries adopted Western publication practices and performance evaluation standards, their advanced counterparts had already transitioned to peer-review-based assessments. Due to historical legacies, integrating qualitative evaluation into Widening countries' research cultures presents a greater challenge.
The first in-person meeting of the Research Assessment Expert Group (RAEG) took place in Brno on December 10–11, 2024. The session began with an overview of best (and worst) practices at EDUC universities in alignment with the CoARA commitments to Responsible Research Assessment (RRA). An external contribution came from Katarzyna Nawrot, who presented on responsible metrics as a representative of CoARA’s Responsible Metrics Working Group.
A complex task
The majority of the meeting focused on strategic priorities for Research Assessment – a complex task given the varying national frameworks. To name some of the priorities:
- Creating a network of evaluators (reviewers) within the EDUC Alliance.
- Developing guidelines on the appropriate and inappropriate use of bibliometrics.
- Establishing a career path template to support academic progression.
- Launching a PhD Alumni Association to foster long-term engagement and broaden criteria for excellent research fields.
“Despite clear differences in national approaches, the first RAEG meeting underscored a shared commitment among EDUC universities: to establish a fair and transparent framework for evaluating the quality, impact, and direction of academic research” concludes the WL Leader Michal Petr (MUNI).
Why does it matter?
Research assessment plays a crucial role in evaluating the significance of research outputs, allocating funding, guiding career progression, and ensuring accountability in academia. Effective assessment frameworks uphold high standards and drive innovation while addressing challenges such as bias and over-reliance on metrics.
Many institutions are now transitioning to holistic evaluation models, incorporating Open Science, collaboration, and broader societal impact into their research assessment strategies.