The Archon Genomics X Prize contest has been declared for January 2013. Larry Kedes and Grant Campany explain the selection of centenarian genomes for the contest and provide the rules by which the contestants will be judged.
First publicly proposed in October 2006, the Archon Genomics X PRIZE was designed to encourage radical breakthroughs, incentivizing a revolution for whole human genome sequencing technologies to become faster, more accurate and less expensive than any existing at that time. Because of the unprecedented success of the developers of sequencing technology, we are now able to make the competition more ambitious, revising the rules and goals to be challenging and the aims of the contest to be robust, while still fulfilling the X PRIZE Foundation's goals of benefiting humanity. To that end, on 3 January 2013, teams from around the world will compete against each other assessed by our official validation protocol (Supplementary Methods)—a new quality standard for whole genomic sequencing. The resulting reduplicated sequences may truly define a 'medical-grade' genome.
A head-to-head competition will take place from 3 January to 3 February 2013. The $10 million grand prize will be awarded to the team(s) able to sequence 100 human genomes within 30 days to an accuracy of 1 error per 1,000,000 bases, with 98% completeness, identification of insertions, deletions and rearrangements, and a complete haplotype, at an audited total cost of $1,000 per genome. The complete rules for the Archon Genomics X PRIZE presented by MEDCO are available as a supplement to this Commentary (Supplementary Note) and at the competition web site: http://genomics.xprize.org/.
We changed the contest length from 10 to 30 days after discussions with potential competitors who felt the short timeframe was a barrier. In addition, dramatic reductions in advertised prices prompted us to lower the allowable per-genome cost accordingly. The X PRIZE Foundation may make additional changes to the rules as public commentary or circumstances dictate.
The Archon Genomics X PRIZE presented by MEDCO also wants to recognize and celebrate the achievements of technology developers and users who might be able to meet some, but not all, of these grand challenges. Thus, if the grand prize is not awarded, the $10 million prize purse will be split between three category prizes for accuracy, completeness and haplotype phasing (see Table 1). For example, teams whose costs per genome are as much as $10,000 may compete for lesser 'best-in-class' prizes by satisfying just one of the criteria for accuracy, completeness or haplotyping while achieving minimum requirements in the other competition categories. The goal is to be as inclusive as possible, allowing teams engaged in developing or disseminating sequencing technology to demonstrate their capabilities. Each team achieving a best-in-class outcome will be recognized, but cash awards to these teams will be made only if there is not a grand prize winner.
Judging the genomes
Over the past two years, with the help and guidance of numerous collaborators, the Archon Genomics X PRIZE presented by MEDCO developed a method to fairly judge the accuracy and completeness of a whole human genome assembly submitted by teams competing for the $10 million prize. We call this method the Archon Genomics X PRIZE validation protocol (Supplementary Methods; hereafter referred to as the VP). The VP represents the first attempt to provide a universally applicable method that is independent of the technology used to sequence and is highly scalable. The initial announcement of a proposed VP (ref. 1) and the subsequent comments it engendered were instrumental in the crafting of the final approach.
The original VP (ref. 2) and some subsequently suggested modifications3 use an in-depth sampling technique, duplicate sequencing of randomly selected DNA segments by complementary next-generation sequencing techniques, verification of discrepancies by Sanger sequencing, detection of indels through selective paired-end technologies, and extensive, duplicative genotyping. These data will be integrated in a bioinformatics pipeline. The first step in implementing the VP will be to test it on two publicly available genomes (one male and one female). A summary of the methods to be used is shown in Figure 1. The genomes will be identified and the validation data and the software pipeline will be made available well in advance of the competition.
Opportunities for feedback and public discussion will be implemented. The ultimate goal of this method is to be able to declare winners of the competition through a transparent, fair and robust process without controversy.
The VP and its associated bioinformatics pipeline will be used for analyzing the 100 contest genomes. We will use a scoring matrix for determining whether contestant genomic assemblies either meet or exceed the required standards. We do not intend to compare the scores of winning submissions against one another: all submissions meeting or exceeding the contest standards will be declared eligible for awards.
The competition rules require every one of the 100 genomes sequenced to satisfy the minimum requirements for each competition category. Therefore, the use of a sampling technique to disqualify a team because the scoring matrix identified one or more genomes to be of lesser quality will indisputably be a correct disqualification. Of lesser concern is the remote risk that the public's post-contest analysis of a team's submitted sequences might reveal that the winning teams' unsampled segments were in significant error, because these segments were excluded by the validation protocol procedures.
The Archon Genomics X Prize presented by MEDCO will assess the validation methodology, as well as the extensive bioinformatics pipeline needed for evaluation, on two public genomes (see Fig. 1). These materials will be available to all interested parties in the Fall of 2012. This may be of particular interest for teams considering registering for the competition (for their self-evaluation purposes). This approach is designed to make the validation and scoring methods as transparent as possible.
At the conclusion of the competition, we will make certain that the 100 test samples themselves, as well as the validation protocol software pipeline, are openly available to the scientific community. This will allow organizations to self-test the capabilities of new technologies or modifications of existing technologies well into the future.
It is our hope the validation protocol could become the industry-wide standard for self-evaluation. In addition, it may well become a model for standardization of technology and certification of proficiency by professional organizations.
A 'medical-grade' genome
The 100 human genome samples to be sequenced in this competition will provide the research community with an unprecedented opportunity to analyze what will likely be the most deeply sequenced set of human genomes ever assembled. In addition, the redundant sequencing of the same set of genomes by multiple teams, using different technology platforms, will likely allow subsequent rapid corrections, generating a nearly error-free set of 100 human genomes.
Following the competition, all assembled genome sequences submitted by the teams will be deposited into a scientific database (dbGaP is currently being considered). Systematic errors inherent in any technology are likely to be complemented by other technologies. Discrepancies in both sequencing and genome assembly among competitors will be quickly identified, allowing follow-on experiments to rectify the differences as well as possibly clarify what led to the errors. Indeed, the outcome of such a large-scale approach will be close to the reality of 'medical-grade' genomes that could be used as models for clinical applications.
Introducing the “MEDCO 100 Over 100”
To help to promote the global educational mission of the Archon Genomics X Prize, we partnered with Medco Health Solutions (MEDCO). MEDCO has become the presenting sponsor of the Archon Genomics X Prize and the title sponsor of the “MEDCO 100 Over 100” program designed to enroll 100 centenarians into providing the competition sample set. The Archon Genomics X Prize and MEDCO intend to develop innovative campaigns to increase public awareness and understanding of the future of medicine and, for the benefit of the educational mission, make heroes of our 100 genomic pioneers.
The choice of centenarians as the subject genomes was made after broad consultation. There are sound fundamental principles as to why the resulting data could lead to important scientific discovery4.
To best identify the ideal composition of the MEDCO 100 Over 100 sample set, The Archon Genomics X Prize sponsored a 1-day workshop in May 2011 at the National Institutes of Health in Bethesda, Maryland, USA under the generous hospitality of the National Institute of Aging (NIA) (the NIA's participation and support does not imply endorsement by the NIA). The goals of the workshop were (i) to prioritize the characteristics of centenarians to be enrolled in the competition; (ii) to define the minimum and best practices for informed consent requirements for enrolled centenarians; (iii) to recognize scientific compromises that may have to be made to ensure a 100-genome sample set; (iv) to establish a minimum timeline for sample acquisition; and (v) to confirm the eventual sharing of contest data among sample contributors and scientific databases. The requirements for centenarians to be included in the MEDCO 100 Over 100 are detailed in Box 1.
A realistic choice of centenarian genomes
The contest genomes will be donated from 100 individuals who have achieved 100 years of age. Scientists at several centenarian research groups eagerly embraced the opportunity to contribute Institutional Review Board protocol-approved samples for this purpose. Extensive phenotypic data on these individuals will also be available and will be released along with the sequences themselves, thus allowing potential use of the data to further search for explanations of exceptional longevity.
A working group of centenarian and genetics experts will advise the Archon Genomics X PRIZE and MEDCO as to the advisability of including each submitted sample as a component of the MEDCO 100 Over 100.
We recognize that accumulating 100 such subjects and samples may prove difficult. The Archon Genomics X PRIZE, MEDCO and their advisors need to determine realistically the likely makeup of the sample set so that educational and outreach programs can be appropriately presented.
The actual subjects might differ from the intended ideal in that some of the subjects may already be deceased. Age verification and the full consent required might be difficult or impossible to obtain from some collections outside North America, with the effect of reducing the international participation and affecting the ethnic and geographic diversity originally sought. Ideally each subject of the MEDCO 100 Over 100 will have consented in language that allows identification of the subject through name, age, ethnicity and geographic location, and, when available, medical and pharmaceutical history, photographs and social history. Some fraction of subjects may not be fully consented or willing to consent for such full phenotype revelation or for personal identification. For deceased subjects, informed consent by responsible next of kin or proxy will be considered on a case-by-case basis.
To benefit humanity
The working hypothesis is that centenarians carry genetic variations that avoid or repress common ailments; discovery of such variants may lead to the discovery of drug targets as well as disease and protective mechanisms. Although it is still a hypothesis, the goal is very egalitarian: that the data emerging from this competition be usable by investigators in the field to examine the health problems of ordinary people, thus amplifying the universal reverence for the elderly and the benefits of healthy aging.
By establishing a wide-ranging set of new goals, the Archon Genomics X PRIZE presented by MEDCO believes that its original concept of incentivizing a major transformation in whole-genome sequencing technologies can still be met while broadening the impact of the contest through discovery and technology. Although most races can only have one winner, we believe that after this race, the competition will benefit an entire industry. The contestants will contribute to scientific knowledge and help prepare the groundwork for applied human medical genomics, thus paving the way for personalized medicine and medical breakthroughs to benefit all of us.
Kedes, L. & Liu, E. Nat. Genet. 42, 917–918 (2010).
Kedes, L., Sutton, G., Liu, E. & Jongeneel, V. Preprint available from Nature Precedingshttp://hdl.handle.net/10101/npre.2011.5731.1 (2011).
Zaranek, A.W., Clegg, T., Vandewege, W. & Thakuria, J. Preprint available from Nature Precedingshttp://dx.doi.org/10.1038/npre.2011.5766.1 (2011).
Perls, T. & Barzilai, N. Preprint available from Nature Precedingshttp://dx.doi.org/10.1038/npre.2011.5756.1 (2011).
We thank the NIA and its director, Richard Hodes, for hosting our conference. Thomas Perls (Boston University Medical Center) and Nir Barzilai (Albert Einstein College of Medicine) have been instrumental in guiding the competition on centenarian selection criteria. We have been able to offset some of the costs of developing and implementing the validation protocol through generous support from the John Templeton Foundation and from the Presenting Sponsorship of this PRIZE by MEDCO Health Solutions, Inc.
Larry Kedes and Grant Campany are paid consultants to the X PRIZE Foundation, Inc.
About this article
Cite this article
Kedes, L., Campany, G. The new date, new format, new goals and new sponsor of the Archon Genomics X PRIZE Competition. Nat Genet 43, 1055–1058 (2011). https://doi.org/10.1038/ng.988
This article is cited by
Science China Life Sciences (2013)
Nature Reviews Clinical Oncology (2012)