Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Research impact

We need negative metrics too

Research metrics are ambiguous — a paper may be cited for positive or negative reasons. Funding agencies and universities focus on positive impact in evaluating research, which increasingly includes alternative metrics ('altmetrics'; see Nature 493, 159 and Nature 495, 437–440; 2013). We think that researchers can generate a more complete account of their impact by including seemingly negative indicators — such as confrontations with important people or legal action — as well as those that seem positive.

To explore this idea, we at the Center for the Study of Interdisciplinarity discussed ways to evaluate the impact of our research activities. We began with common quantitative indicators of scholarly impact (number and place of publications, citation indexing measures, number and size of grant awards, and so on). Warming to our theme, we came up with several other possible indicators, including negative ones (see table for examples and for a complete list).

Table 1 Other possible indicators of impact

In this age of increasing demand for accountability, we believe that academics ought to own the impact of their research, rather than have it determined by someone else.

Author information



Corresponding author

Correspondence to J. Britt Holbrook.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Holbrook, J., Barr, K. & Brown, K. We need negative metrics too. Nature 497, 439 (2013).

Download citation

Further reading


Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing