Correspondence | Published:

What do we mean when we talk about hybrid speciation?

In their recent article Nieto Feliner and colleagues discuss in detail our previous article “How common is homoploid hybrid speciation?” They conclude that our criteria for homoploid hybrid speciation are so stringent that they will cause researchers to overlook many of the important contributions of hybridization to evolution and speciation (Schumer et al. 2014; Nieto Feliner et al. 2017). In particular, the authors object to our proposal that for homoploid hybrid speciation to be invoked, there should be evidence that hybridization was important in generating reproductive isolation between hybrids and their parental species. We recognize that this view is one shared by many in the community (Seehausen 2013; Liu et al. 2014; Lavretsky et al. 2015; Nieto Feliner et al. 2017), yet it is still an area of avid discussion and disagreement among evolutionary biologists (Mavarez and Linares 2008; Hermansen et al. 2014; Capblancq et al. 2015; Payseur and Rieseberg 2016).

While Nieto Feliner et al. suggest that the criteria we propose for establishing homoploid hybrid speciation may limit our understanding of the importance of hybridization in evolution, we argue here that such an approach is in fact crucial for appreciating its importance.

As a field, our understanding of the extent of hybrid ancestry in the genome has far outpaced our progress in understanding its evolutionary impact. We view this as one of the major challenges in contemporary evolutionary biology. Whole-genome sequencing approaches in the past decade have revealed dozens of cases of hybridization that were previously unrecognized (Mallet 2005; Mallet 2008; Abbott et al. 2013), with anywhere from ~ 2% of the genome up to nearly 50% of the genome derived from admixture (e.g., Rieseberg et al. 2003a; Heliconius Genome 2012; Stukenbrock et al. 2012; Cui et al. 2013; Sankararaman et al. 2014; Trier et al. 2014; Vernot and Akey 2014; Sankararaman et al. 2016; Wall et al. 2016; Meier et al. 2017). These empirical observations have caused a massive shift in our views about the frequency and potential importance of hybridization in evolution. In contrast, we understand the ecological, evolutionary, or genetic factors shaping hybrid ancestry in the genome in only a handful of cases (e.g., Rieseberg et al. 2003a; Heliconius Genome 2012; Trier et al. 2014; Leducq et al. 2016).

Does empirical evidence of extensive hybrid ancestry in the genome mean that hybridization has played an important role in the diversification of that lineage? We focus on an example from our own work that we find particularly helpful in illustrating the complexity of this question. The genome of the swordtail fish Xiphophorus nezahualcoyotl is derived from admixture between a lineage ancestral to its sister species Xiphophorus montezumae and another species, Xiphophorus cortezi (we originally proposed this species as a possible case of hybrid speciation; Cui et al. 2013). We estimate that this hybridization resulted in mixture proportions of about 90% of the genome derived from the X. montezumae lineage and 10% from the X. cortezi lineage (Schumer et al. 2016). Strikingly, hybrid ancestry in X. nezahualcoyotl’s genome has apparently rapidly stabilized (i.e., fixed for one parental species ancestry or the other) and has done so uniformly across its range. This type of pattern is as or more extreme than genomic patterns that have been interpreted as evidence of hybrid speciation in other studies (e.g., Gompert et al. 2006; Buerkle and Rieseberg 2008; Stukenbrock et al. 2012). Importantly, X. nezahualcoyotl falls under the definition by Nieto Feliner et al. of a homoploid hybrid species—it is established, persistent, and morphologically and ecologically distinct from its parent species.

However, a closer examination of patterns of hybrid ancestry in X. nezahualcoyotl’s genome complicates this picture. We see evidence that hybrid ancestry from the X. cortezi lineage is systematically depleted from functionally important regions of the genome. Thus, with our current data, it is difficult to reject the alternative hypothesis that the extensive admixture we observe in X. nezahualcoyotl is the neutral remnant of a process of purging hybrid ancestry from the most functionally important regions of the genome.

Just because there is evidence for extensive selection against hybrid ancestry in the genome in cases like X. nezahualcoyotl does not mean other mechanisms are not at play—it is still possible that ecological, sexual, or genetic traits derived from hybridization have importantly shaped the evolution of this species and others—but this is a hypothesis that should be tested. Such cases highlight our view that as a field we have been making conclusions about the role of hybridization in speciation based on too little information. For example, using the definition proposed by Nieto Feliner et al., a case where an already ecologically and morphologically distinct species experiences neutral gene flow from a closely related species could satisfy the required evidence for hybrid speciation.

Several groups have implicitly used a more stringent definition than that proposed by Nieto Feliner and colleagues—specifically that the morphologically or ecologically distinct traits in the hybrid lineage are plausibly or demonstrably a result of hybridization between the two parental species. Though such observations can provide evidence that admixture has had phenotypic effects, it will also almost certainly be the case when large proportions of the genome are derived from hybridization. To us, the question remains of whether these hybridization-derived phenotypes promote isolation through mechanisms such as assortative mating, ecological, or genetic divergence or are simply byproducts of admixture.

One concern raised by Nieto Feliner et al. is that the criteria for homoploid hybrid speciation that we propose will lead to an under-appreciation of the importance of hybridization in generating new species because few species will be well-studied enough to satisfy these criteria. On the other hand, less-stringent definitions of hybrid speciation have led to a rapid increases in the number of proposed cases (see Fig. 2 from Schumer et al. 2014). Because so many species have hybrid ancestry in their genomes, and are also morphologically and ecologically distinct from the taxa from which this hybrid ancestry was derived (e.g., Cui et al. 2013; Li et al. 2016; Schumer et al. 2016; Malinsky et al. 2017; Meier et al. 2017; Tung and Barreiro 2017; Turissini and Matute 2017), the definition proposed by Nieto Feliner et al. could lead to the conclusion that a huge number of species originated by hybrid speciation instead of forms of speciation historically thought to be more common, particularly in animals (e.g., allopatric speciation followed by secondary gene flow; but see Grant 1971). Although possible—and it is important not to reject the possibility of hybrid speciation offhand—our argument is that we do not yet have enough information in most cases to link the presence of hybrid ancestry in the genome to the process of speciation by hybridization.

This highlights the crux of the problem from our perspective: despite a wealth of recent studies demonstrating the nature and extent of hybridization between species, many fewer ask about its function and the evolutionary processes shaping it. This is in part because we have just begun to ask these questions from a genomic perspective and much foundational work documenting the nature of the problem was needed. The challenge we face now is understanding the function of hybridization in the genome, how and in what scenarios hybrid ancestry experiences selection, and ultimately how it may contribute to speciation. On the one hand, hybridization may introduce genes that through recombination or epistasis generate phenotypic novelty that allows hybrids to thrive in new ecological niches (Gross and Rieseberg 2005; Rieseberg et al. 2003b), or provide sufficient “raw material” for the evolution of a novel hybrid lineage (Seehausen 2013). On the other, hybridization can unleash an avalanche of genetic conflict with deleterious effects (e.g., Masly and Presgraves 2007). Nor are these possibilities mutually exclusive, as exemplified by the work on human–Neanderthal admixture (Sankararaman et al. 2014; Vernot and Akey 2014; Juric et al. 2015; Racimo et al. 2015; Harris and Nielsen 2016). Teasing apart the impacts of selection against hybrid ancestry genome-wide and positive selection on individual hybrid traits is a complex challenge that will require new ideas, theory, and approaches, particularly because genome-wide signals of selection against hybridization may swamp out adaptive signals at fewer loci. Further, functional work addressing the evolutionary ecology of hybrid phenotypes can provide an important complement to this work (e.g., Rieseberg et al. 2003a). These approaches present substantial intellectual and technical challenges but will ultimately be necessary in moving as a field from understanding patterns of hybrid ancestry to understanding the evolutionary processes at play.

We think a notable parallel to the debate over homoploid hybrid speciation is the neutralist–selectionist debate in population genetics of the 1970s and 1980s. The neutral theory, which proposed that effectively all variation observed at the DNA level within and between species is either neutral or slightly deleterious, was an important model for understanding genetic variation (Kimura 1968; Kimura 1983), and provided clear, testable hypotheses for researchers searching for evidence of adaptation at the molecular level. Though it is now apparent that the neutral theory cannot explain many features of genetic variation, it provided a simple and powerful framework for understanding how evolutionary forces act on the genome and at the same time has allowed us to more clearly understand cases in which it fails (Kreitman 1996). We think a similar argument can be made about the importance of carefully evaluating alternative hypotheses in studies of hybrid speciation. For the neutralist–selectionist debate the development of new theory and methods in the last two decades (e.g., Hudson et al. 1987; Tajima 1989; McDonald and Kreitman 1991; Zhang et al. 1998), in combination with more data, has made it clear that neutral evolutionary processes fail to explain certain patterns in the data (Kreitman 1996; Fay and Wu 2001; Hahn 2008; Sella et al. 2009). Seriously considering the simple models of neutral or deleterious admixture when evaluating putative cases of hybrid speciation may similarly lead to new approaches that substantially change our views about the frequency of homoploid hybrid speciation. In other words, we acknowledge that our view that homoploid hybrid speciation is relatively rare (Schumer et al. 2014) could reflect a lack of the appropriate kind of evidence rather than the scarcity of the phenomenon. Distinguishing between these alternatives should be a key focus of research going forward.

One important issue raised by Nieto Feliner et al. is that their definition of homoploid hybrid speciation addresses the challenge faced by empiricists of understanding the evolution of genomes and species in the context of hybridization. Since hybridization is an important feature of the evolutionary history of these species, we agree that describing the nature of hybrid ancestry in a lineage is essential, but propose that it can be done without invoking a particular speciation mechanism in cases where direct evidence is lacking. Specifically, observing hybrid ancestry in the genome provides direct evidence that the species has an admixed genome (or even a genome of hybrid origin) but does not necessarily tell us about the evolutionary processes that gave rise to that species. Thus, although we fully agree with Nieto Feliner et al. that hybridization is an important force driving the evolution of genomes and species, we believe that understanding the evolutionary importance of hybridization requires acknowledging its ubiquity while carefully asking questions about its functional consequences, including whether hybridization frequently leads to reproductive isolation between hybrids and their parental species.


  1. Abbott R, Albach D, Ansell S, Arntzen JW, Baird SJE, Bierne N, Boughman JW, Brelsford A, Buerkle CA, Buggs R, Butlin RK, Dieckmann U, Eroukhmanoff F, Grill A, Cahan SH, Hermansen JS, Hewitt G, Hudson AG, Jiggins C, Jones J, Keller B, Marczewski T, Mallet J, Martinez-Rodriguez P, Moest M, Mullen S, Nichols R, Nolte AW, Parisod C, Pfennig K, Rice AM, Ritchie MG, Seifert B, Smadja CM, Stelkens R, Szymura JM, Vainola R, Wolf JBW, Zinner D (2013) Hybridization and speciation. J Evol Biol 26:229–246

  2. Buerkle CA, Rieseberg LH (2008) The rate of genome stabilization in homoploid hybrid species. Evolution 62:266–275

  3. Capblancq T, Despres L, Rioux D, Mavarez J (2015) Hybridization promotes speciation in Coenonympha butterflies. Mol Ecol 24:6209–6222

  4. Cui R, Schumer M, Kruesi K, Walter R, Andolfatto P, Rosenthal G (2013) Phylogenomics reveals extensive reticulate evolution in Xiphophorus fishes. Evolution 67:2166–2179

  5. Fay JC, Wu CI (2001) The neutral theory in the genomic era. Curr Opin Genet Dev 11:642–646

  6. Feliner GN, Alvarez I, Fuertes-Aguilar J, Heuertz M, Marques I, Moharrek F, Pineiro R, Riina R, Rossello JA, Soltis PS, Villa-Machio I (2017) Is homoploid hybrid speciation that rare? An empiricist’s view. Heredity 118:513–516

  7. Gompert Z, Fordyce JA, Forister ML, Shapiro AM, Nice CC (2006) Homoploid hybrid speciation in an extreme habitat. Science 314:1923–1925

  8. Grant V (1971) Plant Speciation. Columbia University Press, NY, NY, 435

  9. Gross BL, Rieseberg LH (2005) The ecological genetics of homoploid hybrid speciation. J Hered 96:241–252

  10. Hahn MW (2008) Toward a selection theory of molecular evolution. Evolution 62:255–265

  11. Harris K, Nielsen R (2016) The genetic cost of Neanderthal introgression. Genetics 203:881–891

  12. Heliconius Genome C (2012) Butterfly genome reveals promiscuous exchange of mimicry adaptations among species. Nature 487:94–98

  13. Hermansen JS, Haas F, Trier CN, Bailey RI, Nederbragt AJ, Marzal A, Sætre G-P (2014) Hybrid speciation through sorting of parental incompatibilities in Italian sparrows. Mol Ecol 23:5831–5842

  14. Hudson RR, Kreitman M, Aguade M (1987) A test of neutral molecular evolution based on nucleotide data. Genetics 116:153–159

  15. Juric I, Aeschbacher S, Coop G (2015) The strength of selection against Neanderthal introgression. PLoS Genet 12:e1006340

  16. Kimura M (1968) Evolutionary rate at molecular level. Nature 217:624–626

  17. Kimura M (1983) The neutral theory of molecular evolution. Cambridge University Press, Cambridge

  18. Kreitman M (1996) The neutral theory is dead. Long live the neutral theory. Bioessays 18:678–683

  19. Lavretsky P, Engilis A, Eadie JM, Peters JL (2015) Genetic admixture supports an ancient hybrid origin of the endangered Hawaiian duck. J Evol Biol 28:1005–1015

  20. Leducq JB, Nielly-Thibault L, Charron G, Eberlein C, Verta JP, Samani P, Sylvester K, Hittinger CT, Bell G, Landry CR (2016) Speciation driven by hybridization and chromosomal plasticity in a wild yeast. Nat Microbiol 1:15003

  21. Li G, Davis BW, Eizirik E, Murphy WJ (2016) Phylogenomic evidence for ancient hybridization in the genomes of living cats (Felidae). Genome Res 26:1–11

  22. Liu BB, Abbott RJ, Lu ZQ, Tian B, Liu JQ (2014) Diploid hybrid origin of Ostryopsis intermedia (Betulaceae) in the Qinghai-Tibet Plateau triggered by Quaternary climate change. Mol Ecol 23:3013–3027

  23. Malinsky M, Svardal H, Tyers A, Miska E, Genner M, Turner G, Durbin R (2017) Whole genome sequences of Malawi cichlids reveal multiple radiations interconnected by gene flow. bioRxiv.

  24. Mallet J (2005) Hybridization as an invasion of the genorne. Trends Ecol Evol 20:229–237

  25. Mallet J (2008) Hybridization, ecological races and the nature of species: empirical evidence for the ease of speciation. Philos Trans R Soc B Biol Sci 363:2971–2986

  26. Masly JP, Presgraves DC (2007) High-resolution genome-wide dissection of the two rules of speciation in Drosophila. PLoS Biol 5:1890–1898

  27. Mavarez J, Linares M (2008) Homoploid hybrid speciation in animals. Mol Ecol 17:4181–4185

  28. McDonald JH, Kreitman M (1991) Adaptive protein evolution at the Adh locus in Drosophila. Nature 351:652–654

  29. Meier JI, Marques DA, Mwaiko S, Wagner CE, Excoffier L, Seehausen O (2017) Ancient hybridization fuels rapid cichlid fish adaptive radiations. Nat Commun 8:14363

  30. Payseur BA, Rieseberg LH (2016) A genomic perspective on hybridization and speciation. Mol Ecol 25:2337–2360

  31. Racimo F, Sankararaman S, Nielsen R, Huerta-Sanchez E (2015) Evidence for archaic adaptive introgression in humans. Nat Rev Genet 16:359–371

  32. Rieseberg LH, Raymond O, Rosenthal DM, Lai Z, Livingstone K, Nakazato T, Durphy JL, Schwarzbach AE, Donovan LA, Lexer C (2003a) Major ecological transitions in wild sunflowers facilitated by hybridization. Science 301:1211–1216

  33. Rieseberg LH, Widmer A, Arntz AM, Burke JM (2003b) The genetic architecture necessary for transgressive segregation is common in both natural and domesticated populations. Philos Trans R Soc B 358:1141–1147

  34. Sankararaman S, Mallick S, Dannemann M, Prufer K, Kelso J, Paabo S, Patterson N, Reich D (2014) The genomic landscape of Neanderthal ancestry in present-day humans. Nature 507:354–357

  35. Sankararaman S, Mallick S, Patterson N, Reich D (2016) The combined landscape of Denisovan and Neanderthal ancestry in present-day humans. Curr Biol 26:1241–1247

  36. Schumer M, Cui RF, Powell DL, Rosenthal GG, Andolfatto P (2016) Ancient hybridization and genomic stabilization in a swordtail fish. Mol Ecol 25:2661–2679

  37. Schumer M, Rosenthal GG, Andolfatto P (2014) How common is homoploid hybrid speciation? Evolution 68:1553–1560

  38. Seehausen O (2013) Conditions when hybridization might predispose populations for adaptive radiation. J Evol Biol 26:279–281

  39. Sella G, Petrov DA, Przeworski M, Andolfatto P (2009) Pervasive natural selection in the Drosophila genome? PLoS Genet 5:e1000495

  40. Stukenbrock EH, Christiansen FB, Hansen TT, Dutheil JY, Schierup MH (2012) Fusion of two divergent fungal individuals led to the recent emergence of a unique widespread pathogen species. Proc Natl Acad Sci USA 109:10954–10959

  41. Tajima F (1989) Statistical method for testing the neutral mutation hypothesis by DNA polymorphism. Genetics 123:585–595

  42. Trier CN, Hermansen JS, Sætre G-P, Bailey RI (2014) Evidence for mito-nuclear and sex-linked reproductive barriers between the hybrid italian sparrow and its parent species. PLoS Genet 10:e1004075

  43. Tung J, Barreiro LB (2017) The contribution of admixture to primate evolution. Curr Opin Genet Dev 47:61–68

  44. Turissini DA, Matute DR (2017) Fine scale mapping of genomic introgressions within the Drosophila yakuba clade. PLoS Genet 13:e1006971

  45. Vernot B, Akey JM (2014) Resurrecting surviving Neandertal lineages from modern human genomes. Science 343:1017–1021

  46. Wall JD, Schlebusch SA, Alberts SC, Cox LA, Snyder-Mackler N, Nevonen KA, Carbone L, Tung J (2016) Genomewide ancestry and divergence patterns from low-coverage sequencing data reveal a complex history of admixture in wild baboons. Mol Ecol 25:3469–3483

  47. Zhang JZ, Rosenberg HF, Nei M (1998) Positive Darwinian selection after gene duplication in primate ribonuclease genes. Proc Natl Acad Sci USA 95:3708–3713

Download references


We thank Gonzalo Nieto Feliner and one anonymous reviewer for helpful feedback on this manuscript. We thank Graham Coop, Daniel Matute, Alisa Sedghifar, and Molly Przeworski for helpful discussion of this topic. This work was supported by a Harvard Milton Fund grant to MS and a Hanna H. Gray fellowship from Howard Hughes Medical Institute to MS.

Author information

Conflict of interests

The authors declare that they have no conflict of interest.

Correspondence to Molly Schumer.

Rights and permissions

To obtain permission to re-use content from this article visit RightsLink.

About this article

Further reading