Introduction

Evolutionary transitions to self-fertilisation (selfing) from self-incompatible ancestors are frequent in plants (Barrett 2002; Charlesworth 2006; Igic et al. 2008; Shimizu and Tsuchimatsu 2015). The first step in such transitions is the breakdown of self-incompatibility, rendering individuals self-compatible. In species with a genetically controlled self-incompatibility system, self-compatible individuals tend to occur at low frequency in some populations, suggesting that the breakdown of self-incompatibility is not exceptional (e.g., Tsukamoto et al. 2003, Busch et al. 2010, Foxe et al. 2010). However, although individuals with high selfing rates theoretically have an immediate transmission advantage over obligately outcrossing (self-incompatible) individuals (Fisher 1941; Stone et al. 2014), the breakdown of self-incompatibility only rarely leads to shifts to higher selfing rates at the population level (e.g., Foxe et al. 2010; Mable et al. 2017).

It is generally thought that this is because selfed-progeny tend to have reduced fitness relative to outcrossed progeny. Such inbreeding depression is expected because of the increased homozygosity associated with selfing (Wright et al. 2013), which leads to increased expression of recessive deleterious alleles in selfers (Charlesworth and Willis 2009). Classical models predict that inbreeding depression of more than 50% (i.e., a more than 50% reduction in fitness of selfed- relative to crossed-progeny) should cancel out the transmission advantage of selfers and prevent the evolution of selfing (Kondrashov 1985; Lande and Schemske 1985; Porcher and Lande 2005), although selfing could evolve with much higher levels of inbreeding depression under conditions where reproductive assurance is important (reviewed by Busch and Delph 2012). On the other hand, inbreeding depression of less than 50% should not be sufficient to negate the transmission advantage of selfers, and should thus not prevent the evolution of selfing (Porcher and Lande 2005; Busch and Delph 2012). The magnitude of inbreeding depression therefore plays a key role in determining how prone outcrossing populations are to evolve higher selfing rates.

In line with theory (e.g., Charlesworth and Charlesworth 1987), self-incompatible species tend to suffer significant inbreeding depression (δ > 0), but there is considerable variation both among and within species (reviewed in Sletvold et al. 2013, also see Bellanger et al. 2015; Carleial et al. 2017). Estimates across species ranged from δ = 0.23 in Phlox drummondii (Levin 1984; Levin and Bulinska-Radomska 1988) to the theoretical maximum of δ = 1 in Campanula rapunculoides (Vogler et al. 2001). Inbreeding-depression estimates (0.30 < δ < 0.35) for North American Arabidopsis lyrata outcrossing populations were relatively low compared with European populations (Sletvold et al. 2013). This has been invoked as an explanation for why the breakdown of self-incompatibility could lead to the evolution of high selfing rates in some of the North American populations (Carleial et al. 2017). However, it remains unclear why selfing does not always evolve in cases where inbreeding depression is well below the δ = 0.5 threshold.

A potential explanation for this may be that previous experimental setups have underestimated the true level of inbreeding depression, because they have excluded competitive interactions. Particularly intraspecific competition is a major factor driving population dynamics (Schoener 1973), which often even outweighs the effects of interspecific competition (Connell 1983; de Villemereuil and Lopez-Sepulcre 2011). Direct competition between crossed and selfed siblings is expected to magnify inbreeding depression, because stronger individuals are likely to suppress the weaker ones (Agrawal and Whitlock 2010). One would expect this effect to be most important in species that lack adaptations to facilitate seed dispersal, and that produce relatively large numbers of seeds. In several species meeting these criteria, inbreeding depression was stronger when juvenile plants derived from cross- and self-fertilisation were forced to compete directly: the grasses Agrostis tenuis and Anthoxanthum odoratum (Antonovics 1968); and the forbs Mimulus guttatus (Carr and Dudash 1995), Plantago coronopus (Koelewijn 2004) and Hibiscus trionum (Lhamo et al. 2006). Although a mini-review based on 20 species suggested that the pattern is far from universal (Appendix 1 in Willi et al. 2007), broader support comes from plant species that have seeds with adaptations to disperse (e.g., Crepis sancta, Cheptou et al. 2001). This underscores the importance of considering competitive interactions during juvenile plant growth in studies of inbreeding depression.

In this study, we performed a greenhouse experiment to assess the performance and estimate inbreeding depression for plants from outcrossing and selfing populations of A. lyrata subsp. lyrata. This is of particular interest to understand why selfing has only evolved in some populations, despite the presence of some self-compatible individuals in most populations (Foxe et al. 2010). Given that seeds do not have any adaptations to promote dispersal, A. lyrata is a species where one would expect intensive competition between siblings. However, this has not been taken into account in previous studies of inbreeding depression. Therefore, we assessed inbreeding depression both with and without direct competitive interactions between selfed and crossed siblings that were planted as seedlings. We used both below- and above-ground biomass as proxies of performance. Specifically, we addressed the following questions: (1) Does sibling competition magnify inbreeding depression? (2) Are there differences between mating systems in performance and inbreeding depression, and are the patterns similar for below- and above-ground biomass?

Materials and methods

Study species and seed material

A. lyrata subsp. lyrata is a member of the mustard family (Brassicaceae), and occurs on sandy and rocky shores and serpentine soils. It is usually self-incompatible and outcrossing, but some populations in the Great Lakes region of North America have become self-compatible and undergone a transition to selfing (Mable et al. 2005; Mable and Adam 2007; Foxe et al. 2010). To estimate inbreeding depression by measuring the performance of selfed- relative to crossed-progeny (Ågren and Schemske 1993), we used a previously described seed collection (Carleial et al. 2017) of crossed- and selfed-progeny from multiple mother plants. For all mother plants, crossed-progeny had been produced by siring mother plants with pollen from a haphazardly chosen plant from the same population. For mother plants from outcrossing populations, to by-pass self-incompatibility, selfed-progeny had been obtained by placing self-pollinated plants in CO2-enriched air (Nakanishii et al. 1969). For mother plants from selfing populations, although these can self-fertilise without special treatment, selfed-progeny had been produced in the same way (in CO2-enriched air). In addition, to test for potential side effects of CO2-enrichment, selfed-progeny had also been produced under ambient conditions, which was obviously only possible for plants from selfing populations. Our experiment included 107 seed families from six outcrossing populations (53 CO2-selfed and 54 crossed, from 7 to 10 mother plants per population) and 123 seed families from six selfing populations (36 CO2-selfed, 44 ambient-selfed and 43 crossed, 2 to 10 mother plants per population) (Table S1).

Experimental design

On 24 March 2015, for germination of crossed- and selfed-progeny, we filled square plastic pots (7 × 7 × 6.5 cm, Pöppelmann, Germany) with potting soil (Pikiererde®, Einheitserdewerke Patzer GmbH, Sinntal-Altengronau, Germany; pH 5.8; 2.0 g/l KCl; 340 mg/l N; 380 mg/l P2O6; 420 mg/l K2O; 200 mg/l S; 700 mg/l Mg). We sowed up to 20 seeds from each of the 230 seed families in three to four pots per family (five seeds per pot). Pots were randomly assigned to positions in a growth chamber for germination. After 7 days in darkness at 4 °C, growth-chamber settings were set to 21 °C (day) 15 °C (night) with a 14 h photoperiod.

Twenty-three days after sowing, we selected seedlings with similar germination time for the experiment. Square 1 l pots (12 × 12 × 7 cm, Pöppelmann, Germany) filled with the same potting soil used for germination served as experimental units (each with one or two plants). From each CO2-self and cross-family, two seedlings were planted alone as a control (i.e., in two separate pots), two were planted as focal plants to compete with a seedling of the opposite cross type from the same mother (resulting in two pots with two siblings with different cross types: cross vs. self), two served as competitor for a focal plant of the opposite cross type from the same mother (Fig. 1). For selfing populations, to confirm previous findings that CO2 during pollination does not affect growth of progeny (Carleial et al. 2017), our experiment also included selfed seedlings from seed families produced under ambient conditions. These were planted in the same way as the CO2-self progeny (Fig. 1). For some seed families, insufficient seeds germinated, so that the final experiment included 750 of the originally planned 992 pots (see Fig. 1 for details). Pots were randomly assigned to positions on four greenhouse benches in the botanical garden of the University of Konstanz (temperature between 16 and 18 °C and with no additional lighting), watered ad libitum and fertilised once per week with 0.1% (w/v) Scotts Universol® Blue solution (Everris International B. V., Waardenburg, Netherlands).

Fig. 1
figure 1

Experimental design. Crossed- and selfed plants from six outcrossing and six selfing populations of A. lyrata were grown alone (no competition) or in competition with each other (competition). All crossed plants were raised from seeds produced by cross-pollination under ambient conditions (cross), and selfed plants were raised from seeds produced by self-pollination under CO2-enriched environment (self [CO2]) or under ambient conditions (self [amb]). Actual sample sizes are indicated below each pot. Numbers in brackets indicate the planned sample size based on seed availability, which was not achieved, mainly because not all seeds germinated

Measurements

To test whether selfed and outcrossed plants differ in belowground (root) biomass production, we separately harvested the below- and above-ground biomass of the first set of replicate plants (375 pots) four weeks after transplanting, when the roots of the competitors could still be separated. For each plant, we first cut off the aboveground tissue at the substrate surface and placed it in a paper bag. We then washed and cleaned the belowground tissue before putting it in a separate paper bag. The plant samples were dried at 70 °C for at least 3 days in an oven with ventilation. We then determined the biomass to the nearest microgram for belowground plant parts and to the nearest 0.1 mg for aboveground plant parts.

To test whether selfed and outcrossed plants differed in further development and reproductive traits, the remaining pots were kept for another 7 weeks. On 2 July 2015 (11 weeks after transplanting), we performed the final harvest of the experiment. We scored for each plant whether it had reached the bolting stage (i.e., whether it had started to form an inflorescence). To quantify the investment in sexual reproduction (reproductive potential), we counted the number of flowers (including open flowers and spent flowers, but not flower buds). To allow assessing vegetative and inflorescence biomass, we separately collected the rosette leaves and the inflorescences. The plant parts were dried at 70 °C for at least 3 days, and weighed to the nearest 0.1 mg to estimate reproductive biomass. As the roots of the competing plants could not be separated (the fine, fragile roots were completely intertwined at this stage), we did not harvest the belowground biomass.

Statistical analyses

Our procedural control indicated that CO2-enrichment did not have side effects on any of our measures of plant performance (no significant difference between CO2-selfed and ambient-selfed progeny for any of the traits, Table S2). Therefore, we pooled selfed-progeny produced under ambient and CO2-enriched conditions for further analyses. To assess whether sibling competition magnified inbreeding depression, whether there were differences between mating systems in performance and inbreeding depression, we used generalised linear mixed effects models in R 3.4.3 (R Core Team 2017) using the lmer and glmer functions as implemented in the package ‘lme4’ (Bates et al. 2015). For belowground biomass, aboveground biomass and inflorescence biomass, the models had a Gaussian error distribution. To improve normality and homogeneity of the residuals, we square-root transformed biomass data prior to analysis. For bolting and the number of flowers, models had a binomial error term and a negative binomial error term, respectively (we used the bobyqa optimiser with a maximum of 10,000 iterations to fit these models). For all models, the fixed effects included mating system (outcrossing vs. selfing), cross type (self vs. cross), competition (with vs. without) and all two- and three-way interactions. These interactions specifically tested whether inbreeding depression differs between mating systems and is affected by competition. To account for non-independence of plants from the same population and for non-independence of plants from the same mother plant, all models included population (nested in mating system) and mother plant (nested within population) as random effects.

Significant effects of cross type (as a main effect or an interaction) indicate significant inbreeding depression. To facilitate interpretation of the actual magnitudes of inbreeding depression, we calculated inbreeding depression coefficients (δ) for the four factorial combinations of mating system × competition for each trait for each population separately. These coefficients were calculated using the following formula: δ = (Wout − Wself)/max(Wout, Wself), in which Wout and Wself are the mean fitness estimates for crossed- and selfed-progeny, respectively (Ågren and Schemske 1993).

Results

Plant vegetative performance

Plants resulting from self-fertilisation (i.e., selfed plants, including CO2-self and ambient-self) produced significantly less biomass than their siblings resulting from cross-fertilisation (i.e., crossed plants) (significant effect of cross type for all biomass traits; Table 1). In other words, there was significant inbreeding depression for growth. The inbreeding depression was similar in magnitude for belowground biomass (δ = 0.12 for plants grown alone) and aboveground biomass (δ = 0.11 for plants grown alone) of 4-week old plants (an analysis of total biomass produced very similar results and is presented in Table S3, Fig S1) and for aboveground biomass (δ = 0.08 for plants grown alone) of 11-week old plants (Fig. 2).

Table 1 Linear mixed model analysis to test for inbreeding depression for vegetative performance for six outcrossing and six selfing populations of A. lyrata
Fig. 2
figure 2

Vegetative performance of crossed- and selfed-progeny grown alone (no competition) or in competition with each other (competition) for plants from six outcrossing and six selfing populations of A. lyrata. Proxies for vegetative performance were (a) belowground biomass and (b) aboveground biomass in 4-week old plants, and (c) aboveground biomass in 11-week old plants. Error bars are standard errors of the mean of population means. Inbreeding depression values (δ) are the means of δ estimates for each population (see Fig. S3)

Inbreeding depression did not differ between outcrossing and selfing populations (no significant interactions between cross type and mating system, Table 1). Outcrossing and selfing populations produced similar amounts of biomass (no significant effect of mating system in Table 1 for all biomass traits). Competition between siblings caused a significant reduction in biomass (significant effect of competition; Table 1; Fig. 2). However, competition did not increase the magnitude of inbreeding depression (no significant interaction between cross type and competition, Table 1; Fig. 2).

Plant reproductive potential

At the time of harvest, 244 out of 359 experimental plants had reached the bolting stage (i.e., they had started to form an inflorescence). There was significant inbreeding depression for bolting in outcrossing populations (δ = 0.14 for plants grown alone), but not in plants from selfing populations (δ = −0.02 for plants grown alone, significant interaction between cross type and mating system; Table 2; Fig. 3a). There was no significant inbreeding depression for inflorescence biomass (no significant effects of cross type or its interactions; Table 2). Competition significantly reduced bolting of plants and inflorescence biomass (significant effect of competition; Table 2), but did not magnify inbreeding depression (no significant interactions of competition with cross type; Table 2). In the subset of plants that had open and spent flowers (n = 154), there was no significant inbreeding depression for number of flowers (no significant effects of cross type or its interactions; Table S4), although the two- and three-way interactions with cross type were only marginally non-significant (Table S4).

Table 2 Linear mixed model analysis to test for inbreeding depression for reproductive potential for six outcrossing and six selfing populations of A. lyrata
Fig. 3
figure 3

Reproductive potential of crossed- and selfed-progeny grown alone (no competition) or in competition with each other (competition) for plants from six outcrossing and six selfing populations of A. lyrata. Proxies of reproductive potential were (a) bolting (b) inflorescence biomass. All reproductive traits were assessed in 11-week old plants. Error bars are standard errors of the mean of population means. Inbreeding depression values (δ) are the means of δ estimates for each population (see Fig. S3)

Variation in inbreeding depression between populations

There was considerable variation in the magnitude of inbreeding depression and the effect of competition among populations (Fig. 4). Although a few population-specific point-estimates exceeded δ = 0.5 with competition, the inbreeding estimates were generally well below δ = 0.5 and not consistently different between outcrossing and selfing populations.

Fig. 4
figure 4

Inbreeding depression (δ) without and with sibling competition for outcrossing and selfing populations of A. lyrata for vegetative performance (below- and above-ground biomass of 4-week old plants, and aboveground biomass in 11-week old plants) and reproductive potential (bolting, inflorescence biomass and number of flowers in 11-week old plants). For each population, δ was calculated as δ=(Wout − Wself)/max(Wout, Wself), in which Wout and Wself are the mean fitness estimates for crossed- and selfed-progeny, respectively. For reference, the dashed lines represent no inbreeding depression (δ = 0) and the theoretical threshold (δ = 0.5) below which the automatic transmission advantage of selfers should drive the evolution of selfing. aNone of the available crossed seeds from KTT germinated (Table S5), so population-specific estimates of inbreeding depression for biomass could only be calculated for five selfing populations; bNone of the crossed plants from population LPT had bolted by the end of the experiment (Table S5), so population-specific estimates of inbreeding depression for reproductive traits could only be calculated for four selfing populations; cNone of crossed plants from population IND (no competition) and TSS (competition) flowered in the end of this experiment (Table S5), so population-specific estimates of inbreeding depression for number of flower could only be calculated for four outcrossing populations

Discussion

Our findings show that both selfing and outcrossing populations of North American A. lyrata suffer significant inbreeding depression for biomass and bolting of plants, but not for inflorescence biomass and number of flowers. The magnitude of inbreeding depression did not differ between selfing and outcrossing populations, and was below the critical δ = 0.5 threshold for evolution of selfing. Importantly, sibling competition (between crossed- and selfed-progeny) did not significantly change the magnitude of inbreeding depression.

Inbreeding depression in North American populations of A. lyrata

Although direct competition between crossed and selfed siblings had a strong negative effect on plant performance, sibling competition did not magnify inbreeding depression in outcrossing and selfing populations of North American A. lyrata. This shows that previous estimates of inbreeding depression based on experiments that excluded competition (Carleial et al. 2017; Stift et al. 2013) are not biased downward for that reason. Since drought and inducing defence in a previous study on A. lyrata also did not magnify inbreeding depression (Carleial et al. 2017), our findings suggest that the consistently observed relatively low estimates of inbreeding depression for aboveground biomass (aboveground biomass: δ = 0.11 for 4-week old plants and 0.08 for 11-week old plants, Fig. 2; cumulative vegetative performance δ = 0.30 in Carleial et al. 2017) are indeed realistic estimates of the true inbreeding depression in North American A. lyrata. This contrasts with inbreeding-depression estimates for European A. lyrata that were considerably higher (aboveground biomass: δ = 0.32; cumulative vegetative performance δ = 0.51; Sletvold et al. 2013). Since inbreeding depression represents the only immediate cost of selfing that can offset the transmission advantage of selfers (Kondrashov 1985; Lande and Schemske 1985; Porcher and Lande 2005), these findings may thus help understand why the evolution of selfing could occur in North American A. lyrata.

The relatively modest magnitude of inbreeding depression likely reflects the evolutionary history of North American A. lyrata subspecies, as multiple lines of evidence suggest that the subspecies has experienced a strong bottleneck (Ross-Ibarra et al. 2008; Mable et al. 2017). Small effective population sizes during such bottlenecks should have led to substantial purging by exposing strongly deleterious recessive mutations to selection (Lynch et al. 1995; Pujol et al. 2009). One would thus expect that inbreeding depression in bottlenecked species, such as North American A. lyrata is predominantly caused by mildly deleterious mutations. As a consequence, additional reductions in effective population size associated with selfing (Busch and Schoen 2008; Wright et al. 2013) are not expected to lead to strong additional purging. This likely explains why North American selfing populations of A. lyrata still suffered from significant inbreeding depression for biomass traits, with little (Carleial et al. 2017) or no evidence (this study) for purging.

Competition and inbreeding depression

Our experiment revealed no evidence for any interaction of intraspecific competition and inbreeding depression for biomass. Previous work had suggested that the magnitude of inbreeding depression is generally not affected by interspecific competition (Willi et al. 2007), but it had remained unclear whether this also applies to intraspecific competition. As there should be less niche partitioning within species than among species, intraspecific competitive effects should generally be stronger (Barabás et al. 2016; Case 2000), and thus may also aggravate inbreeding depression more strongly. In hindsight, a possible reason why intraspecific competition did not magnify inbreeding depression for biomass could be that our design only forced the plants to compete for belowground resources, but not for light. Belowground competition is usually symmetric, and thus reduces growth of the competing plants proportional to their size (Weiner and Thomas 1986). In other words, under symmetric competition, the size differences between competitors remain stable. Aboveground competition, on the other hand, is usually asymmetric, because the taller individuals overshadow and thereby suppress the growth of the smaller ones, increasing the size differences between the competing plants (Weiner and Thomas 1986). It would therefore be interesting to test whether sibling competition does magnify inbreeding depression if there is increased competition for light.

The absence of an interaction between competition and inbreeding depression may also be related to the pairwise competition inherent to our setup. In the Great Lakes region of eastern North America, A.lyrata occurs in sand dunes, rocky outcrops and alvars (limestone pavements), where plants can occur at relatively high densities of up to 9.4 individuals per m2 (Mable et al. 2005; Mable and Adam 2007). Thus, one would expect density-dependent competition to be important. Moreover, as single plants can produce more than 100 siliques each containing up to 45 without any specific dispersal mechanism, one would expect strong density-dependent competition around mother plants during germination of seedlings. Our experimental setup only forced competition between siblings of different cross types (cross vs. self), but in nature competition within cross type (self vs. self; cross vs. cross) may also be important. In this respect, future studies should consider a setup with varying densities and combinations of crossed- and selfed-progeny to more realistically capture the above- and below-ground competitive interactions that prevail under natural conditions.

Biomass is typically used as a proxy for performance in perennial and self-incompatible plants, such as A. lyrata, (e.g., Løe 2006; Sandring and Ågren 2009). As it is often impossible to harvest all belowground plant parts, biomass estimates are usually for aboveground parts only. We managed to also determine belowground biomass, but only in 4-week old plants, because at that stage it was still possible to separately harvest roots from competing plants. This showed that sibling competition had a strong negative effect on both below- and above-ground biomass (Table 1), confirming that plants were indeed competing. However, both for below- and above-ground biomass (and thus also for total biomass; Fig S1, Table S3) the magnitude of inbreeding depression was independent of competition.

Limited inbreeding depression for reproductive traits

Biomass is generally a good predictor of lifetime-performance in self-incompatible species (Løe 2006; Sandring and Ågren 2009). Therefore, one may have expected that our reproductive traits would show similar patterns as biomass. However, this was not the case, as we detected hardly any inbreeding depression for bolting of plants (for plants grown alone, δ = 0.14 in outcrossing populations, but δ = −0.02 in selfing populations; Fig. 3, Table 2) and no significant inbreeding depression for inflorescence biomass and number of flowers (Fig. 3, Fig. S2, Table 2, Table S4). Although intuitively closer to “real” fitness, it is important to note that our measures estimate the reproductive potential (not the reproductive output) during the limited time of our experiment. However, in self-incompatible perennial species in which seed set depends on cross-pollination by pollinators, there may only be a very weak correlation between reproductive potential and actual seed set.

Data archiving

Data available from the Dryad Digital Repository https://doi.org/10.5061/dryad.6474895 (Li et al. 2019).