Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Volume 518 Issue 7540, 26 February 2015

The cover imagines attacks from inbound retro-styled sprites deflected by a deep Q-network agent controlled game-paddle, ‘seen� from the agent's perspective. For an artificial agent to be considered truly intelligent it needs to excel at a variety of tasks considered challenging for humans. To date, it has only been possible to create individual algorithms able to master a single discipline � for example, IBM’s Deep Blue beat the human world champion at chess but was not able to do anything else. Now a team working at Google’s DeepMind subsidiary has developed an artificial agent � dubbed a deep Q-network � that learns to play 49 classic Atari 2600 ‘arcade� games directly from sensory experience, achieving performance on a par with that of an expert human player. By combining reinforcement learning (selecting actions that maximize reward � in this case the game score) with deep learning (multilayered feature extraction from high-dimensional data � in this case the pixels), the game-playing agent takes artificial intelligence a step nearer the goal of systems capable of learning a diversity of challenging tasks from scratch. Cover illustration: Max Cant /Google DeepMind

Editorial

  • The final act in a long-running Italian saga should bring tighter controls on unproven stem-cell therapies, both at home and abroad.

    Editorial

    Advertisement

  • Details of a climate-change sceptic’s links to the energy industry make worrying reading.

    Editorial
  • The use of technologies that objectively measure pain must be carefully monitored.

    Editorial
Top of page ⤴

World View

  • For science to realize its potential in the Muslim world, attitudes need to change at a societal level, not just an individual one, says Dyna Rochmyaningsih.

    • Dyna Rochmyaningsih
    World View
Top of page ⤴

Research Highlights

Top of page ⤴

Social Selection

Top of page ⤴

Seven Days

  • The week in science: Head of Intergovernmental Panel on Climate Change resigns; Europe’s graphene project is on track; new killer virus discovered in United States.

    Seven Days
Top of page ⤴

News

Top of page ⤴

Correction

Top of page ⤴

News

Top of page ⤴

News Feature

Top of page ⤴

Comment

Top of page ⤴

Books & Arts

Top of page ⤴

Correspondence

Top of page ⤴

Obituary

Top of page ⤴

News & Views

  • An artificial-intelligence system uses machine learning from massive training sets to teach itself to play 49 classic computer games, demonstrating that it can adapt to a variety of tasks. See Letter p.529

    • Bernhard Schölkopf
    News & Views
  • A study of two Balkan ethnic groups living in close proximity finds that traditional knowledge about local plant resources helps communities to cope with periods of famine, and can promote the conservation of biodiversity.

    • Manuel Pardo-de-Santayana
    • Manuel J. Macía
    News & Views
  • Many experiments have probed the mechanisms by which transplanted stem cells give rise to all the cell types of the blood, but it emerges that the process is different in unperturbed conditions. See Letter p.542

    • Sidhartha Goyal
    • Peter W. Zandstra
    News & Views
  • Astronomers have discovered an extremely massive black hole from a time when the Universe was less than 900 million years old. The result provides insight into the growth of black holes and galaxies in the young Universe. See Letter p.512

    • Bram Venemans
    News & Views
  • The 'no-cloning' theorem of quantum mechanics forbids the perfect copying of properties of photons or electrons. But quantum teleportation allows their flawless transfer — now even for two properties simultaneously. See Letter p.516

    • Wolfgang Tittel
    News & Views
  • The m6A structural modification of RNA regulates gene expression. It has now been found to mediate an unusual control mechanism: by altering the structure of RNA, m6A allows a regulatory protein to bind to that RNA. See Letter p.560

    • Dominik Theler
    • Frédéric H.-T. Allain
    News & Views
Top of page ⤴

Article

  • A whole-genome sequencing analysis of 100 pancreatic ductal adenocarcinomas has discovered known and newly identified genetic drivers of pancreatic cancer; these genetic alterations can be classified into four subtypes, which raises the possibility of improved targeting of clinical treatments.

    • Nicola Waddell
    • Marina Pajic
    • Sean M. Grimmond
    Article
  • The emRiboSeq sequencing method is used to track polymerase activity genome-wide in vivo; despite Okazaki fragment processing, DNA synthesized by error-prone polymerase-α (Pol-α) is retained in vivo and comprises 1.5% of the genome, establishing Pol-α as an important source of genomic variability and providing a mechanism for site-specific variation in nucleotide substitution rates.

    • Martin A. M. Reijns
    • Harriet Kemp
    • Martin S. Taylor
    Article
  • The crystal structure of the RAG1–RAG2 heterotetramer forms a Y-shaped structure, with each arm containing a RAG1–RAG2 heterodimer; the overall structure is reminiscent of hairpin-forming transposases, attesting to its evolutionary history as a specialized form of a transposition activity.

    • Min-Sung Kim
    • Mikalai Lapkouski
    • Martin Gellert
    Article
Top of page ⤴

Letter

  • Observations of an ultraluminous quasar, SDSS J010013.02+280225.8, at redshift z = 6.30 show that the object has an optical and near-infrared luminosity a few times greater than those of previously known quasars at z > 6; the black hole that drives the quasar has a mass about 12 billion times that of the Sun.

    • Xue-Bing Wu
    • Feige Wang
    • Yuri Beletsky
    Letter
  • The quantum teleportation of composite quantum states of a single photon encoded in both spin and orbital angular momentum is achieved, with a teleportation fidelity above the classical limit, by quantum non-demolition measurement assisted discrimination of the Bell states describing the entanglement of the two degrees of freedom.

    • Xi-Lin Wang
    • Xin-Dong Cai
    • Jian-Wei Pan
    Letter
  • The temperature-sensitive miscibility of hydrocarbon, silicone and fluorocarbon liquids is used to establish a one-step method of making three- and four-phase complex emulsions with highly controllable morphologies that can be alternated between encapsulated and Janus configurations by varying the balance of interfacial tensions.

    • Lauren D. Zarzar
    • Vishnu Sresht
    • Timothy M. Swager
    Letter
  • Examination of amateur observations of Mars shows atmospheric plumes 200 to 250 kilometres high that are observed in the morning but not in the evening over a period of more than a week; our current understanding of Martian atmospheric dynamics and plume formation cannot account for the creation of such enormous plumes.

    • A. Sánchez-Lavega
    • A. García Muñoz
    • D. Peach
    Letter
  • An artificial agent is developed that learns to play a diverse range of classic Atari 2600 computer games directly from sensory experience, achieving a performance comparable to that of an expert human player; this work paves the way to building general-purpose learning algorithms that bridge the divide between perception and action.

    • Volodymyr Mnih
    • Koray Kavukcuoglu
    • Demis Hassabis
    Letter
  • A tissue with many of the defining features of vertebrate cellular cartilage is shown to form transiently in larvae of the invertebrate chordate amphioxus, indicating that the origin of the vertebrate head skeleton depended not on evolution of a new skeletal tissue, as is commonly thought, but on the spread of this tissue throughout the head.

    • David Jandzik
    • Aaron T. Garnett
    • Daniel M. Medeiros
    Letter
  • Inducible genetic labelling of haematopoietic stem cells (HSCs) and linked mathematical modelling show that at least 30% of all HSCs are productive, and that adult haematopoiesis is largely sustained by ‘short-term’ downstream stem cells that operate near self-renewal in the steady state; HSC fate mapping provides a quantitative model for better understanding of HSC functions in health and disease.

    • Katrin Busch
    • Kay Klapproth
    • Hans-Reimer Rodewald
    Letter
  • Somatic TP53 mutations are highly prevalent in therapy-related acute myeloid leukaemia and myelodysplastic syndrome, which arise as complications of cytotoxic chemotherapy or radiotherapy; although it was believed that these TP53 mutations are directly induced by cytotoxic therapy, new data indicate that they predate cytotoxic therapy and that haematopoietic progenitors harbouring these pre-existing mutations may selectively expand after exposure to chemotherapy or radiotherapy.

    • Terrence N. Wong
    • Giridharan Ramsingh
    • Richard K. Wilson
    Letter
Top of page ⤴

Feature

Top of page ⤴

Futures

Top of page ⤴

Innovations In

Top of page ⤴

Innovations In

  • The human body plays host to a vast and diverse microbial community. From metabolic regulation to immunologic maintenance, the microbiome performs functions vital to our health. Innovations in the Microbiomedistils the most critical Insights from the recent explosion in microbiome research. As science continues to unravel the host–microbiome relationship, clues are emerging for the treatment of disease.

    Innovations In
Top of page ⤴
Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Quick links