News | Published:

Forensic software traces tweaks to images

Naturevolume 439pages520521 (2006) | Download Citation

Subjects

Fraud-busting program hunts for doctored pictures.

The editors of scientific journals could catch fraudulent images by using computer tools similar to those being developed for law enforcement and photojournalism, say computer scientists.

Recent fraud at the lab of stem-cell researcher Woo Suk Hwang (Nature 439, 122–123; 200610.1038/439122a) highlights the ease with which scientists can cook up fake images. In the South Korean team's 2005 Science paper, for example, two photographs in the same figure were found to be partial duplications.

The Hwang furore is encouraging journal editors to seek ways of detecting suspicious images before they are ever published. Such screening could identify outright fraud, as well as a far more pervasive practice in which biologists use programs such as Photoshop to tweak and smarten scientific images before publication (see Nature 434, 952–953; 2005).

At least one group of journals, published by the Rockefeller University Press (RUP), already carries out such image forensics by eye. Mike Rossner, managing editor of the Journal of Cell Biology in New York City, has trained a production editor to enlarge and scrutinize images for obvious but illegitimate changes, such as bands erased from a gel or cells slipped into a microscope image. This production editor checks manuscripts accepted for publication at the Journal of Cell Biology and two other RUP journals.

Artifice intelligence: programs can now detect manipulation in pictures. Credit: BSIP/SPL

But this is time consuming, and computer scientists say that computer algorithms could automatically scan digital images and ferret out signs of manipulation. The development of such systems, prompted by the explosive spread of digital cameras and imaging programs, is also of interest to lawyers and police, who want to check for tampered crime-scene images, as well as to news organizations keen to detect faked photos.

Partly funded by the FBI, Hany Farid at Dartmouth College in Hanover, New Hampshire, and his colleagues have designed a suite of ten mathematical techniques to scan images for the hallmarks of manipulation. For example, one algorithm searches for small clusters of identical pixels in an image, and so might reveal where an area of background has been copied and pasted over a blemish.

A second algorithm can identify whether part of an image has been expanded, perhaps to splice two photos seamlessly together. To do this, a program such as Photoshop generates new pixels by averaging the characteristics of the neighbouring ones — leaving a giveaway signature in the image.

Farid is currently converting his algorithms into a user-friendly form that can be attached to ImageJ, a free image-processing program distributed by the US National Institutes of Health. He is also consulting Adobe, the company that makes Photoshop, about whether the algorithms could be packaged together as a plug-in for the program, for use by different industries. This could help journal editors and reviewers, but also lab heads wanting to check the work of their team.

Rossner says he plans to trial Farid's system when it is complete. Editors at Nature are also consulting researchers about automatic tools for detecting image manipulation.

But there are drawbacks. Such a system could act only as a first line of policing to flag up suspicious images. And editors and technophiles alike agree that anyone determined to fabricate or alter images will be able to fool the forensics software — perhaps by using the very same detection algorithms to learn how. Eric Postma is a computer scientist who devises software to detect fine-art fraud at the University of Maastricht in the Netherlands. “It's always a race between two sides,” he says.

Authors

  1. Search for Helen Pearson in:

Related links

About this article

Publication history

Published

Issue Date

DOI

https://doi.org/10.1038/439520b

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Newsletter Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing