Following our recent Opinion article (Pitfalls of predicting complex traits from SNPs. Nature Rev. Genet. 14, 507–515 (2013))1, we received correspondence by de los Campos and Sorensen (A commentary on Pitfalls of predicting complex traits from SNPs. Nature Rev. Genet. 14, 894 (2013))2. We thank them for their comments, which follows their recent work3. de los Campos and Sorensen agree that maximum prediction accuracy depends on h2M, which is defined as the variance explained by genotyped markers in the population. They claim that estimates of h2M in a finite sample (h2G-BLUP or h2G) may overestimate h2M, and that this is exacerbated for unrelated individuals. We respond by showing how and why we disagree with these claims.
h2G and h2G-BLUP are estimates of the same parameter from equivalent models4,5,6,7 and so, for the same data set, they must have the same value. Both measure the proportion of the phenotypic variance that is explained by the markers. This proportion depends on linkage disequilibrium (LD) between the single-nucleotide polymorphisms (SNPs) and causal variants (also known as quantitative trait loci (QTLs)). If the LD is imperfect, then h2M will be less than the conventional heritability (h2), which is the proportion of variance explained by all causal variants. The extent of LD depends on the relatedness of the sample of individuals used. If closely related individuals are included in the sample, there is long-range LD generated even between SNPs and QTLs on different chromosomes. Thus, inclusion of close relatives increases h2M and its estimates. Usually, the parameter we wish to estimate is the h2M among individuals who are no more closely related than randomly sampled individuals from the population8.
de los Campos and Sorensen state that the accuracy of prediction (R2TST) does not approach h2M even in an infinite sample. This is incorrect. R2TST depends on two factors — h2M and the accuracy with which the marker effects are estimated4,9. If the marker effects are estimated with no error, then R2TST = h2M. In practice, the accuracy of estimating SNP effects is usually low in humans, and this also explains the low R2TST that is often reported. Their recent study3 claims that “the estimated h2G did not provide a good indication of prediction R2”. In their simulations of unrelated individuals (GEN cohort; h2 = 0.8), they state that “when [non-causal] markers were used we observed only a small extent of missing heritability [h2G = 0.737, versus h2G = 0.773 for causal markers] but the reduction in R2 due to use of markers that were in imperfect LD with causal loci was dramatic [R2 = 0.071, versus R2 = 0.517 for causal markers]”. Even though the number of causal loci was the same, the number of markers differed: 300,000, corresponding to M = 60,000 independent markers versus M = 5,000 in the causal set. The following equation1 (where Nd is the sample size in the discovery sample) demonstrates that R2 decreases with higher M (which increases the variance of the estimated genetic relationships).
de los Campos and Sorensen say that R2TST is zero if the training and testing data sets are independent. This is a distracting statement because individuals within a species are always related to some degree. They also question our focus on the prediction accuracy that can be obtained in an independent validation sample. We disagree with the opinion of de los Campos and Sorensen that the prediction accuracy that can be obtained in a non-independent validation sample is a quantity of equal interest.
References
Wray, N. R. et al. Pitfalls of predicting complex traits from SNPs. Nature Rev. Genet. 14, 507–515 (2013).
de Los Campos, G. & Sorensen, D. A. A commentary on Pitfalls of predicting complex traits from SNPs. Nature Rev. Genet. 14, 894 (2013).
de Los Campos, G., Vazquez, A. I., Fernando, R., Klimentidis, Y. C. & Sorensen, D. Prediction of complex human traits using the genomic best linear unbiased predictor. PLoS Genet. 9, e1003608 (2013).
Goddard, M. E., Wray, N. R., Verbyla, K. L. & Visscher, P. M. Estimating effects and making predictions from genome-wide marker data. Statist. Sci. 24, 517–529 (2009).
Habier, D., Fernando, R. L. & Dekkers, J. C. The impact of genetic relationship information on genome-assisted breeding values. Genetics 177, 2389–2397 (2007).
VanRaden, P. M. Efficient methods to compute genomic predictions. J. Dairy Sci. 91, 4414–4423 (2008).
Goddard, M. E. Genomic Selection: predicion of accuracy and maximisation of long term response. Genetica 136, 245–257 (2009).
Yang, J. et al. Common SNPs explain a large proportion of the heritability for human height. Nature Genet. 42, 565–569 (2010).
Goddard, M. E., Hayes, B. J. & Meuwissen, T. H. Using the genomic relationship matrix to predict the accuracy of genomic selection. J. Anim. Breed.Genet. 128, 409–421 (2011).
Makowsky, R. et al. Beyond missing heritability: prediction of complex traits. PLoS Genet. 7, e1002051 (2011).
Janss, L., de Los Campos, G., Sheehan, N. & Sorensen, D. Inferences from genomic models in stratified populations. Genetics 192, 693–704 (2012).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
About this article
Cite this article
Wray, N., Yang, J., Hayes, B. et al. Author reply to A commentary on Pitfalls of predicting complex traits from SNPs. Nat Rev Genet 14, 894 (2013). https://doi.org/10.1038/nrg3457-c2
Published:
Issue Date:
DOI: https://doi.org/10.1038/nrg3457-c2