In spite of decades of linkage and association studies and its potential impact on human health, reliable prediction of an individual’s risk for heritable disease remains difficult. Large numbers of mapped loci do not explain substantial fractions of heritable variation, leaving an open question of whether accurate complex trait predictions can be achieved in practice. Here, we use a genome sequenced population of ∼7,000 yeast strains of high but varying relatedness, and predict growth traits from family information, effects of segregating genetic variants and growth in other environments with an average coefficient of determination R2 of 0.91. This accuracy exceeds narrow-sense heritability, approaches limits imposed by measurement repeatability and is higher than achieved with a single assay in the laboratory. Our results prove that very accurate prediction of complex traits is possible, and suggest that additional data from families rather than reference cohorts may be more useful for this purpose.
Disease incidence can be predicted based on the health record1, the family history2 or the genetic risk due to predisposing genetic variants segregating in the population3. Each of these sources of information carries signal about the trait, but is not sufficient for accurate prediction2,4,5. For example, the genetic variants mapped to a trait in genome-wide association studies do not estimate disease risk well, with the vast majority of the heritable variation not accounted for6,7. Even with very large numbers of mapped alleles8, purely genomic prediction accuracies still lag far behind narrow sense heritability estimates9.
An important question of whether this is due to paucity of data, or perhaps more fundamental limitations, can be attacked by predicting phenotypes in model organisms10,11. In particular, crosses of founders in the yeast system have circumvented many of the technical difficulties associated with human genetic analyses, and illuminated genetic basis of variation in molecular traits12,13,14, cellular phenotypes15,16,17, missing heritability18 and role of interactions19,20,21. Genome-based prediction has successfully explained most of the trait variation in two organism phenotypes using up to five mapped alleles20,22, and approached narrow-sense heritability accuracy in a large-scale cross18. For yeast, growth in various environments is an analogue of the health record, family history is approximated by phenotypes of closely related individuals, and risk variants can be mapped as for humans. Thus, we can test whether accurate phenotype prediction for more complex traits is possible in practice, and what the constraints are.
Here, we use a recent resource of over 7,000 diploid hybrid yeast strains of high relatedness23 to predict their growth phenotypes. Combining genetic and phenotypic data in a linear mixed model (LMM) framework, as well as using a recently introduced mixed random forest (MRF) approach, we predict growth traits with accuracies above their narrow-sense heritability, and approaching limits set by measurement repeatability. We find that both relatedness and variant-based predictions are greatly aided by availability of very close relatives, whereas information from a large number of more distant relatives fail to improve predictive performance when closer relatives are included. Our results suggest that prediction is improved by both data from closer relatives that share much of the genome, as well as additional phenotype measurements that can capture aspects of unique environment and effects too small to be detected by mapping.
We made use of 7,396 diploid hybrid Saccharomyces cerevisiae strains with phased whole-genome sequences from the collection of diploid phased outbred lines23. Owing to the two-stage crossing scheme (Fig. 1a), each of these hybrids has 170 relatives that share one chromosome in every chromosome pair (expected fraction of segregating site genotypes identical by state f=0.5), and 7,225 ones for which no complete chromosome is shared, but a substantial part of linkage blocks and allele combinations are (expected f=0.375, Fig. 1b). We refer to these levels of relatedness as ‘close’ and ‘distant’, respectively, noting that both classes correspond to close kinship. After filtering out individuals with aneuploidies and contamination, we retained 6,642 strains for analysis. Population growth of individual diploid hybrids was measured24 in nine environments in technical and biological duplicate, growth estimates were normalized against hundreds of densely spaced internal standards and the replicate average was used for analysis. The environments challenge different cellular functions, covering energy sources (for example, galactose), osmotic stress (for example, NaCl) and cancer drugs (for example, rapamycin, Supplementary Table 1). As reported before23, the phenotype means have large narrow-sense heritabilities (h2) and repeatabilities (H2, broad-sense heritability; median h2=80%, H2=94%, standard error=0.09, Supplementary Tables 2 and 3), and the traits are not independent (pairwise Pearson’s r2=0.01–0.49, Supplementary Fig. 1), reflecting shared genetic, epigenetic and environmental influences (Supplementary Fig. 2).
Accurate genome-aided phenotype prediction
We first tested how well different genomic and phenomic data predicted growth phenotypes in our population (Fig. 2a and Supplementary Fig. 3), and then combined them using LMMs25. We obtained predictions via fourfold cross-validation, with the training set randomly sampled from both close and distant relatives (Methods). One growth trait could be predicted from the rest with reasonable accuracy (Fig. 2b ‘P’, median R2=0.48), and the quality of prediction depends on the strength of pairwise correlations of the phenotypes. The genomic best linear unbiased predictor (BLUP), an additive model based on realized genetic relatedness alone, captures the pedigree structure in the population, and achieves prediction accuracies very close to the narrow-sense heritability estimates (Fig. 2b ‘BLUP’, median R2=0.77, 98% of h2 explained). These predictions are near-identical to a simple midparent approach (Pearson’s r2>0.99, Supplementary Fig. 4). Thus, the genetic similarity between individuals explains nearly all additively heritable variation in our population.
Next, we mapped quantitative trait loci (QTLs) in each environment, and asked how well they predict growth in that environment. A small number of single nucleotide polymorphisms (SNPs) with the largest effects explain a sizeable portion of additive variance, but for all traits the prediction accuracy remains lower than BLUP’s (for example, median R2=0.58 versus 0.81 for 10 QTLs, Supplementary Fig. 5). When up to 50 SNPs are included in the model, the accuracy reaches h2 (Fig. 2b, ‘QTLs’, median R2=0.78, 98% of h2 explained), with predictions very similar to BLUP (r2>0.97, Supplementary Fig. 6). Therefore, all tested methods that consider additive genetic effects reach the same, near-h2 performance, and there is no missing narrow-sense heritability in our experiment. Extending to the LMM framework to include genetic background, dominance and interaction effects gave a modest further improvement (median increase of R2 by 0.06), mainly due to dominance effects of strongest QTLs for allantoin and galactose (Fig. 2b, ‘LMM’, median R2=0.86).
We then included other phenotypes measured for the same individual as covariates in the model, and achieved median prediction accuracy of 0.91 (Fig. 2b ‘LMM+P’). To our knowledge, this is the highest for complex traits to date26,27, exceeding narrow-sense heritability for all nine phenotypes and approaching repeatability (Fig. 2c, 96% of H2 explained). For each of the measured traits, our predictions of the mean phenotype (that is, the average of four replicate measurements) have lower error than a single growth experiment (Fig. 2c). The combined model improves over others especially when a large proportion of heritable non-additive variation is not captured by interaction and dominance effects (Supplementary Fig. 2).
Predictions based on closer relatives are more accurate
So far, our predictions for each test individual were obtained from models that were trained with data from its close relatives that share half of the complete chromosomes. We observed that errors were larger when close relatives were not available (for example, Fig. 3b and Supplementary Fig. 7). Thus, we next compared two training scenarios—‘close relatives’, where each member of the test set has several close relatives in the training set (expected fraction of identical site genotypes f=0.5), and ‘distant relatives’, where test set individuals are not as closely related to anyone in the training set (expected f=0.375, Fig. 3a). When training on close relatives, predictions based on other traits of the same individual are slightly more accurate (median improvement=0.04, Fig. 3c, ‘P’), whereas BLUP performs substantially better. On average, BLUP achieves R2 of 0.14 when trained on distant relatives and 0.76 on close ones (Fig. 3c, ‘BLUP’). This difference is explained by the larger uncertainty of the predictive distribution based on distant relatives: the observed errors are near-perfectly calibrated to their model-derived standard errors (Fig. 4a, r2=0.96). Accuracy increases markedly even with a small number of close relatives included in the training data, whereas adding more distant relatives to close ones does not improve predictions (Fig. 4b, Supplementary Fig. 8). For example, adding on average just five close relatives per test individual rises the median R2 from 0.15 to 0.65, but complementing the training set of close relatives by all distant relatives has a negligible effect (median R2=0.79 versus 0.81).
Perhaps surprisingly, training on close relatives also improved QTL-based predictions. For near-monogenic traits (for example, growth in allantoin and galactose), the accuracies were similar for both training scenarios (Fig. 3c ‘QTLs’). However, for more complex traits, the QTL model trained on distant relatives reaches high accuracy in the training data, but does not perform well out of sample, with 61% median decrease in accuracy (respective decrease for close relatives is 3%, Fig. 4e). In this case, the prediction uncertainties are similar (Fig. 4c), and most of this difference is explained by model selection. When we mapped QTLs in close relatives, but estimated their weights on distant relatives, the prediction accuracy decreased from 0.73 to 0.65 compared with carrying out both procedures on close relatives (Fig. 4d and Supplementary Fig. 9). Conversely, mapping QTLs in distant relatives and fitting their weights in close relatives resulted in a much lower R2 of 0.31. Including close relatives in training gives a more faithful approximation of the phenotypic covariance structure (Supplementary Fig. 10), which explains the large gap between out-of-sample and in-sample performance for distant relatives (Fig. 4e). Notably, prediction accuracy drops substantially, even when just 1% of the training data changes (Fig. 4e, filled versus empty markers).
Combining genomic and phenotypic information (LMM+P) to predict from distant relatives gives accuracies similar to combining QTLs and phenotypic information. For traits where genomic prediction on distant relatives does not work well (for example, caffeine, glycine, phleomycin), this model performs similarly to using other phenotypes only or even slightly worse (median improvement 0.02, Fig. 3c ‘LMM+P’). However, for traits with large effect QTLs (allantoin, galactose, isoleucine), genetic information helps prediction even if BLUP is not accurate.
Prediction performance is consistent for alternative models
Other methods for genome-aided trait prediction have either included other phenotypes directly in the model or are compatible with doing so25,28,29. We confirmed that these prediction implementations give results that are concordant with ours. First, we tested the multi-trait LMM (MT-LMM) that jointly infers the effects of genotype and other phenotypes25. This method gave results nearly identical to the LMM+P approach on both close and distant relatives, in which we first regressed the effect of phenotypes, and then fit a genomic model on the residuals (Fig. 5a). Second, we applied the recently published MRF, which accounts for population structure and captures nonlinear genetic effects28, and can use the other measured phenotypes as predictors. This method also performed similar to the combined LMM (median R2 0.91 versus 0.91) for close relatives, with no consistent difference across the traits (Fig. 5b, top row). For distant relatives, the MRF had more accurate pure genomic predictions than a LMM for 8 of 9 traits, and when including phenotype information for both models, 4 of 9 traits (Fig. 5b, bottom row).
We predicted nine heritable traits in a population of 6,642 yeast strains of varying high relatedness, and achieved accuracies over 90%, very near the repeatability limit. To our knowledge, these are the most precise out-of-sample predictions of complex traits to date. There is almost no missing narrow- or broad-sense heritability, proving that very accurate genome-aided predictions can be obtained in practice, in contrast to relatively poor genomic prediction performance for human cohorts, for example, R2<0.16 using unrelated individuals, and <0.37 for close relatives9. Our predictions outperformed the traditional mid-parent approach that is limited to narrow-sense heritability, but has been predicted to remain unsurpassed in accuracy for humans30.
The improvement in predictive ability using phenotype data is due to capturing additional signal from the non-additive genetic and environmental components, reflecting the extent to which these are shared between the traits. Their relative contribution can somewhat be gauged from the additional accuracy of the LMM+P model over the standard LMM that accounts for mapped additive, dominance and interaction effects. The improvement is largest for traits that have a large gap between narrow and broad-sense heritabilities (phleomycin, hydroxyurea, glycine, isoleucine), which is not caused by a single dominant allele (galactose, allantoin). Any remaining difference is potentially due to both weak interaction and dominance effects not included in the LMM during model selection. Standardization, distribution of replicates across multiple pre-culture and experimental batches, and normalization of phenotypes to very densely spaced internal controls are expected to minimize the influence of shared environmental variation across plates24. A small contribution of shared environment is consistent with the phenotypic covariance decomposition (Supplementary Fig. 2), and sizes of variance components due to the 2nd and 3rd order interactions that are difficult to map23,31. Although we cannot completely exclude that a small fraction of the phenotype covariance reflects shared environmental variation, for example, in the form of nutrient access, initial population size or exposure to stress, the residual covariance has been empirically demonstrated to be smaller than our prediction improvements for most traits24. Regardless, additional measured phenotypes from the individual can clearly inform on all these sources of variation, circumventing the need to explicitly ascertain their effects.
Genomic prediction methods have recently been extended to include more fine-grained decomposition of trait variances, both for phenotypes (for example, multi-trait models25) and genotypes (partitioning sites by chromosome32, allele frequency33 or functional class34). In latter group, the genetic covariance matrix is partitioned by allele category, and a BLUP model is fit for each. BLUP is a linear combination of training data, with uncertainties stemming from genetic relatedness only for prediction. Accordingly, we found that genomic BLUP estimates became uncertain when closer relatives were unavailable (Fig. 4a), and prediction error increased. This source of error is not circumvented by the partitioning methods, as the relatedness-derived uncertainty remains, and therefore these approaches are unlikely to improve our suboptimal predictions for more distant relatives.
It is important to note that our study population does not share many of the features of human cohorts. We used data from a diallel cross, in which only two alleles are present at any locus, and their frequencies are close to 50%; there is no spectrum of low frequency and rare alleles. Further, due to the controlled phenotyping design, there is little environmental variation and the heritability estimates in our populations are therefore very high. Although this is atypical for most human traits, our results concern prediction accuracies relative to the heritabilities, regardless of their numerical value. Finally, human complex traits can be influenced by hundreds if not thousands of loci. Nevertheless, their combined predictive ability has remained far below the narrow-sense heritability estimates. We capture nearly all of the broad-sense heritability with the most precise models, demonstrating that knowledge of additional phenotypes helps estimate the combined influence of small effect alleles and interactions that are difficult to map. Therefore, making use of the accumulated personal phenotype data is also expected to improve human trait prediction.
When no very close relatives were available, and no single QTL explained a large fraction of variance, the pure genomic methods were inaccurate, even in our population of 6,642 individuals with high relatedness. At the same time, when the number of very close relatives in the training sample was sufficiently large, the predictions were not improved by adding all remaining more distant relatives. Thus, observing phenotypes for parental haplotypes in at least a few cases causes BLUP to upweight their contributions, and for QTL mapping to prioritize alleles that capture their signal. In concert, these observations suggest that efforts directed towards creating genotype-based scores using common variants to predict disease risk could benefit dramatically from being complemented by systematic collection of family history and relatedness data30,35,36. As information from as few as five close relatives gave large gains, we expect such an approach to be a cost-effective solution for achieving better prediction in a clinical setting with finite resources.
Panel design and phenotyping
172 haploid F12 segregants (86 MatA and 86 MatAlpha) from a cross between YPS128 and DVPBG6044 (ref. 37) were crossed in an all against all fashion to obtain 86 × 86=7,396 diploid hybrids using standard yeast protocols (Fig. 1). After removing strains spawning from one contaminated and eight aneuploid haploid founders, we were left with 81 × 82=6,642 crosses for analysis. The strains were grown in biological and technical duplicates (four measurements total) in 1536-position solid agar plate cultures, with all replicates on different plates and taken from two different pre-cultures to reduce systematic bias. Medium preparation, plate pouring, robotic pinning and pre-culture and experimental conditions were all extensively standardized to reduce systematic bias. Every fourth position was occupied by genetically identical internal controls in the form of the reference YPS128 strain, and the 384 controls on each plate were used to remove any remaining bias by normalization. Although complete randomization with respect to all known confounders (for example, plate position, fixture position, machine, pre-culture, temperature, humidity, neighbouring colony size, amount of light) and unknown sources of bias is not feasible, the dense grid of reference strains provides an excellent standard. We extracted the area under the growth curve relative to the starting point in each of the nine environments, converted the values to log-scale, and normalized them to a surface constructed from the surrounding internal YPS128 controls, as described earlier24. The four replicate values were then averaged to obtain the final phenotype (that is, mean growth) for each individual and environment. Panel design, genotyping, phenotyping and normalization are described in detail in refs 23, 24.
Modelling and predictions
We used a range of models to predict a trait of interest either on genomic information only, individual phenotypic information only or both.
Phenotype (‘P’). Let y be the vector containing the phenotype of interest for all N individuals, and let P1, …, P8 be the remaining phenotypes. We modelled y as to fit the phenotype weights β used for prediction.
Best linear unbiased predictor. Let xj be the genotype vector for SNP j=1, …, M, and let X be the genotype matrix X=(x1, …, xM). In the genomic BLUP model, with random coefficients and measurement noise . This model implies the multivariate Gaussian distribution , where is the realized genetic relatedness matrix, with the scaling constant c being the average diagonal value of XXT. Prediction for the test individual can be obtained by conditioning on the observed data in a standard way for multivariate normal distributions. When calculating the standard deviation of the predictive distribution (Fig. 4a), we averaged the variances on the predictive distributions (that is, averaged the diagonal elements of the covariance matrix of the predictive multivariate normal distribution) and reported the square root of this number.
Quantitative trait loci. To identify the strongest QTLs, we first carried out forward selection for up to 50 iterations in the linear regression model , where Qt denotes the selected collection of QTL indexes at iteration t. The number of QTLs in the final model was determined by out-of-sample prediction accuracy, with fourfold cross-validation on the training portion of data (hence, altogether a double cross-validation scheme).
Midparent. Let yij be the phenotype for individual who has parents i and j. Let Pi1 and Pj2 be the parental phenotype values. We model yij as the mid-parent value , where ɛij is uncorrelated noise. We first fit the parental values from the yij observed in training data, and used them to predict phenotypes of test individuals.
LMM with dominance and interaction effects. The LMM model combines additive, dominance and interaction effects with genetic relatedness, . The fixed effects (QTLs+dom+int) are constructed with forward selection among additive QTLs and interaction between all such SNP pairs xi and xj, where xi has previously been selected into the model. Although we miss interactions where neither locus has a significant additive effect, it has been shown that such occurrences are rare38, and their contribution to explaining variance is negligible19. By allowing self-interactions, we also incorporated dominance effects. We selected the final model by performing cross-validation on training data after each of the feature selection steps.
LMM including phenotypes (‘LMM+P’). The LMM+P model combines additive, dominance and interaction effects with genetic relatedness and other traits, . The fixed effects contains a genetic (QTLs+dom+int) and non-genetic (P) part. The latter includes the linear combination of all other traits P1, …, P8. First, we regress y on P, and then we construct the genetic component as described for the LMM model.
Multi-trait LMM. MT-LMMs model multiple phenotypes jointly. The correlation between two traits is modelled in two parts, via a genetic and non-genetic component as follows25. Let Y=[y!,…,y9] be the matrix for phenotypes y!,…,y9, and let F denote the fixed effects for each of these phenotypes, F=[f1,…,f9]. We used the same fixed effects fi that we constructed in the LMM model. Let C be the genetic covariance matrix between phenotypes and Σ the non-genetic one. Then according to the MT-LMM. To obtain MT-LMM predictions which correspond to the LMM+P model, we condition the multivariate normal distribution.
Mixed random forest. We applied the MRF approach28, available via LIMIX25. We ran the MRF with 25 trees and otherwise default settings. For genomic predictions (corresponding to the LMM model), we included all SNPs as potential features. For genomic and phenomic prediction (corresponding to the LMM+P model), we added also other phenotypes as potential features.
Training and obtaining predictions
All models were fitted with the Python package LIMIX25. We used four-fold cross-validation to obtain out-of-sample predictions for all 6642 individuals. We partitioned the set of all individuals into four folds analogously as shown in Fig 3a, i.e. by splitting the two sets of parents (i.e. one in rows, the other in columns) into two equally sized groups. We use each one of these four subsets of size N2 as a test set to obtain predictions and the remaining three as a training set to fit the models. First, we did not take into account the relatedness structure and divided individuals into subsets randomly (results in Fig. 2). Later, we distinguished between closely and distantly related individuals (results in Fig. 3). The latter correspond to siblings in a traditional sense, sharing many of the haplotype blocks (expected fraction of sites identical by state 0.375), whereas the former share one complete chromosome in each pair (expected fraction of sites identical by state 0.5). The four test sets remained the same as before, but instead of training on all 3N2 remaining individuals, we picked the N × N individuals who do not share a parent with anyone in the test set (‘distant relatives’), as well as sampled N2 from the 2N2 remaining individuals who do share one parent with someone in the test set (‘close relatives’).
Narrow-sense heritability was estimated from the genomic BLUP model as , when fitted to all of the data. To estimate repeatability, we fitted the following fixed effects model rij=yi+ɛij, where ri1, ri2, ri3, ri4 are the four replicate measurements for individual i, yi is the average rij value for this individual and ɛij∼N(0, σ2). Repeatability was estimated as 1−σ2/Var(r).
The data used in this study are available in the Supporting Information of Hallin et al.23 Analysis code is available at https://github.com/kasparmartens/y10k-prediction.
Code availability: All the code used in the current study is available at https://github.com/kasparmartens/y10k-prediction.
How to cite this article: Märtens, K. et al. Predicting quantitative traits from genome and phenome with near perfect accuracy. Nat. Commun. 7:11512 doi: 10.1038/ncomms11512 (2016).
We thank Francisco Salinas for technical help with large-scale crossing, Martin Zackrisson for much appreciated technical assistance with extraction and analysis of growth estimates, and Oliver Stegle, Cornelis Albers and Daniel Gaffney for comments on the text. K.M. was supported by the European Regional Development Fund through the BioMedIT project, J.H. by the Labex SIGNALIFE (ANR-11-LABX-0028-01), Swedish Research Council (grant numbers 325-2014-6547 and 621-2014-4605) and the Research Council of Norway (grant number 222364/F20), J.H. and G.L. by ATIP-Avenir (CNRS/INSERM), ARC (grant number SFI20111203947), FP7-PEOPLE-2012-CIG (grant number 322035), ANR (ANR-13-BSV6-0006-01) and Cancéropôle PACA (AAP emergence), Labex SIGNALIFE (ANR-11-LABX-0028-01), and L.P. by a Marie Curie International Outgoing Fellowship, the Wellcome Trust and Estonian Research Council (IUT34-4).
Supplementary Figures 1-10, Supplementary Tables 1-3 and Supplementary References
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/