Sir
Your Editorial 'Experts still needed' (Nature 457, 7–8; 2009) is correct in that no metric alone can substitute for expert evaluation, because no single metric (including citation counts) is correlated strongly enough with expert judgements for it to take their place. But some individual metrics, such as citation counts, are nevertheless significantly correlated with expert judgements. It is likely that a battery of multiple metrics, when considered jointly, will be even more strongly correlated.
The UK Research Assessment Exercise (RAE) provides such an opportunity, alongside the wealth of potential performance indicators that are increasingly available online. Both enable a candidate battery of metrics — such as citations, co-citations, downloads, tags and growth/decay metrics — to be systematically validated against expert judgements, field by field. The 2008 RAE has also provided data that make it possible to do this validation exercise now, across all disciplines, on an important nationwide scale.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Harnad, S. Multiple metrics required to measure research performance. Nature 457, 785 (2009). https://doi.org/10.1038/457785a
Published:
Issue Date:
DOI: https://doi.org/10.1038/457785a
This article is cited by
-
Invasiveness, Intrusiveness and Influence: three new metrics to measure communication between political digital echo chambers
Social Network Analysis and Mining (2024)
