Introduction

Global demand for fish products is expected to reach 186 M Tn by 2030 mostly driven by aquafeeds used in fish farming1. Aquafeeds represent the main cost in fish farming, and are also the area where sustainability can improve the most2. The main source of protein and lipids in aquafeeds has traditionally been marine groundfish and small pelagics, as they provide a good balance of the essential amino acids and the omega-3 fatty acids needed by virtually every commercially farmed fish3, and the high quality fish fillets needed for human consumption4. However, groundfish and small pelagics have declined worldwide as a consequence of the increasing demands made by aquaculture industry5.

In response to a shortage of wild fish, the aquafeed industry turned to plant-based ingredients due to their wider availability, lower costs and established knowledge from their use in human and livestock nutrition6,7. Plant oils from soyabean, linseed, flaxseeds, canola, palm and coconut became the prime candidates to replace marine oils, but their use in aquafeeds has several nutritional limitations as well as their own sustainability issues8. Livestock across the globe already rely heavily on plant oils, and there are fears that further demand from aquaculture could increase prices and lead to farmland expansion, putting more pressure on natural habitats9. Proteins derived from plants typically lack some of the essential amino acids present in fish meal, and some contain anti-nutritional factors, which can induce inflammatory effects with adverse effects on health, welfare and productivity10, while plant oils are typically deficient in n-3 LC-PUFA (omega-3) fatty acids11. These limitations are particularly problematic for marine farmed fish, as they cannot synthesize omega-3 fatty acids efficiently and must rely on the diet to obtain them12.

In a quest to find more sustainable alternatives to fish products, and more suitable sources of omega-3 fatty acids than plant oils, photosynthetic microalgae and cyanobacteria have received increasing attention13. The protein content and fatty acid composition of some microalgae are similar to those provided by marine pelagic fish, and are more nutritious and healthier for human consumption those derived from terrestrial plants14. Recent developments in algal biotechnology have also made the production of microalgae cheaper and more readily available15, but there are still challenges concerning upscaling, and knowledge gaps that have prevented their wider use. Early research on microalgae as aquafeeds focused on their use as feed additives, mostly as live cells, but there is increasing interest in their potential value as full or partial replacements of fish oil16 or protein17. Recent research has tended to focus on microalgae extracts as they are typically more digestible and less likely to include anti-nutrients than whole algae16,18,19, while large scale production of purified microalgae oils for incorporation into aquafeeds has become more efficient20.

One microalgae in particular, the genus Arthrospira (Spirulina), has received much attention as it has a protein content similar to that of marine fish22 as well as a high digestibility due to the lack of a cellulose cell wall23,24. With a global annual production of 3,000 Tn dry weight, the Spirulina market was worth $394 million in 2019, and is growing at a rate of ~ 10% annually. It is one of the most intensively farmed microalgae in aquaculture and the species that offers some of the best options for fish protein replacement25. However, Spirulina cannot be used as replacement for fish oil, as this requires microalgae with different nutritional profiles. The genus Schizochytrium is rich in omega 3 fatty acids, especially DHA26,27, and is already produced on an industrial scale as a food supplement28. It can also be incorporated into aquafeeds to improve the DHA content of the fish fillet16 and can be produced in the large quantities required by the salmon farming industry29.

A combination of Spirulina and Schizochytrium could be used as a replacement of fish protein and fish oil in aquafeeds27, but there is little guidance on optimal levels of replacement, and uncertainty regarding the extent to which the benefits of using microalgae can be generalised across different fish species. Production costs of live microalgae for aquafeeds currently range between 300 and 600 €/kg, and although these could be reduced by 60–80% with upscaling30, they are still more expensive than animal feedstuffs16. Crucially, there is no information regarding variation in effect sizes (i.e. variation in the magnitude of any purported microalgae nutritional benefits) and therefore it is not possible to assess to what extent the high costs of producing microalgae can be compensated by improved growth or enhanced fillet quality.

To address these questions, we carried a systematic review followed by a metanalysis on the effects of using Spirulina and Schizochytrium as replacement of fish protein and fish oil in fish feeds. Our aims were three: (1) to assess the extent of variation in the nutritional benefits of two of the main microalgae used in aquafeeds, (2) to gain insights into sources of heterogeneity and (3) to assess the existence of publication bias against negative results as this might have exaggerated the nutritional benefits of microalgae-enriched diets.

Methods

Selection criteria for the systematic review

We adopted the PRISMA protocol (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) as described by Moher et al.31 for the systematic literature review (Fig. 1). We searched Google Scholar with the keywords “Spirulina” AND “SGR” (Specific Growth Rate) AND “fish” AND “aquaculture” AND “Arthrospira” for the Spirulina analysis. This search string returned 627 results. For the Schizochytrium analysis, we searched for the keywords “Schizochytrium” AND “omega-3” AND “fish” AND “aquaculture”, obtaining 1150 results. The searches were carried out on 08/11/2019 and the timeline was set between the years 2000 and 2019 (inclusive), as before 2000 microalgae were used mainly as whole feed rather than as replacements in aquafeeds.

Figure 1
figure 1

PRISMA workflow used to select publications for inclusion in the meta- analysis of nutritional benefits of microalgae in fish. SpSpirulina dataset, ScSchizochytrium dataset.

We used three criteria for selecting articles for subsequent analysis: (1) primary peer-reviewed research papers (i.e. we excluded reviews) carried out on finfish and written in English, (2) studies in which microalgae were used as partial replacement in fish feeds, and not as sole nutrients, and (3) studies that reported the Specific Growth Rate (SGR) for Spirulina, or the omega-3 content in the fish fillet for Schizochytrium, along with standard errors (or standard deviations) and sample size.

Data extraction

The following data were obtained from the selected papers: (1) first author and year of publication, (2) mean value of the specific growth rate (SGR, for the Spirulina dataset) or omega-3 content of the fillet (for the Schizochytrium dataset) for the treatment (Me) and control groups (Mc), (3) standard deviations of Me and Mc, denoted as Se or Sc, (4) number of fish sampled from the treatment (Ne) and control (Nc) groups; when fish were sampled as a batch each batch counted as one sample only, (5) scientific name and family, (6) habitat (freshwater—FW; saltwater—SW), (7) diet (carnivorous, C; omnivorous, O; herbivorous, H), (8) initial mass of the fish (g), (9) replacement level, expressed as %, of fish meal or fish oil and plant oil replaced with microalgae, (10) duration of the trial (days), (11) level of replication (number of tanks); (12) fish density (No. fish per tank) and (13) type of data (data obtained from individual fish, or pooled from batch measurements).

Data analysis

We used R v3.5.1.32 for all statistical analysis. Study effect sizes were calculated as standardized mean differences (SMD) between the micro-algae enriched diet and the control diet (without micro-algae) adjusted for small sample size via Hedges’ g correction33. After inspection of the data, a random effects model was chosen to derive the overall effect34, since a single underlying common effect (fixed effect model) could not be assumed. Although a random effects model has wider confidence intervals than a model that assumes a common fixed effect, it is more realistic and also enabled us to examine how effect sizes varied across populations35. To fit the random model, we used the in between-study-variance HKSJ estimator method36 in the meta and metafor R packages. Forest plots were used to visualize the outputs of the meta-analysis.

We examined three measures of heterogeneity among studies: Cohran’s Q, with a cut-off of P = 0.1037, the I2 index which varies from < 25% to > 75% for small and substantial levels of heterogeneity, respectively37, and tau-squared (τ2), which represents the between-study variance38.

Evidence for publication bias was assessed by inspection of funnel plots39, followed by Egger’s linear regression test of funnel plot asymmetry40 and by the P-curve method41. Funnel plots compare the observed distribution of effect sizes on the x-axis against their standard error on the y-axis, which is typically inverted. In the absence of publication bias, studies should be contained within a symmetrical funnel at both sides of the pooled effect size. Studies that lie outside the funnel might indicate the existence of publication bias, although high heterogeneity can also result in asymmetrical funnels41. The P-curve method compares the significance level of the significant effect sizes against a theoretical left skewed and flat distributions, on the assumption that the most significant results should also be the rarest42,43. It can be used as a diagnostic tool for assessing the presence of publication bias, although it is also affected by high study heterogeneity41, and is most useful when heterogeneity is small to moderate (i.e. I2 < 50%).

Dose-dependent effects (i.e. to what extent the nutritional benefits of micro-algae depended on replacement levels) were assessed via mixed-effects meta-regression with the Sidik-Jonkman estimator for τ2 in the dmetar R package, using replacement, fish size, family, habitat, and feeding guild as predictors. Inspection of AIC values was used to arrive at the minimal adequate model.

Outlier detection

We employed two methods to detect potential outliers and overly influential studies using the dmetar R package41: the ‘find.outliers’ function using a random effects model and “baujat” plots to help identify studies with a large overall contribution to the overall heterogeneity and a large influence on the pooled results44. Models were refitted after exclusion of outliers and overly influential points.

Subgroup analysis

To gain insights into potential sources of variation in the benefits of using microalgae we carried out a subgroup analysis according to fish family, habitat (freshwater or marine), broad feeding guild (carnivore, omnivore, herbivore) and type of measurements (data collected from individual fish or pooled from a batch).

Ethics statement

Our study did not involve any new experimental work on living animals, it compiled and analysed data already in the public domain. The study was approved by Swansea University College of Science Ethics Committee with number STAFF_BIOL_2119_160123150855_3 and complies with the ARRIVE guidelines for reporting research involving animals (https://arriveguidelines.org).

Results

Effects of Spirulina replacement on specific growth rate (SGR)

We found 36 quantitative studies on the effects of Spirulina replacement on fish growth (representing k = 101 control-treatment comparisons) that met the selection criteria and that were published during the period 2000–2019. These were carried out in 17 species belonging to 11 different fish families, mostly juveniles (weight range = 0.02–131 g) living in freshwater (88%), and having a herbivore or omnivore diet, including tilapia (Oreochromis sp.—37% of studies), various cyprinids (10% of studies) and catfishes (8% of studies). In most cases (83%), studies were carried out in triplicate tanks and involved an average of 34 individuals per tank (SD = 62), with feeding trials typically lasting between 70 and 120 days (Table 1). Replacement levels of Spirulina varied from 0.025 to 45% (mean = 8.9%, SD = 9.9).

Table 1 Results of feeding studies assessing the effects of Spirulina replacement on Specific Growth Rate (SGR, %) of farmed fish.

Effect sizes

Standardized mean differences (SMD), corrected for small sample sizes, varied between − 2.78 and 15.93. The pooled SMD of the random effects model was 1.21 (95% CI 0.71–1.70), which was significantly different from zero (t = 4.83, P < 0.001), and indicated that Spirulina inclusion in the diet had a positive effect on fish growth (Fig. 2). However, heterogeneity between studies was very high (Q = 2732, df = 100, P < 0.001; I2 = 96.3% τ2 = 6.26) and the prediction interval was wide (95% CI 3.78–6.16), indicating that negative effects on growth cannot be ruled out in future studies. Just over 48% of control-treatment comparisons (49/101) were statistically significant, involving 19 of the 36 independent studies (53%). The average replacement of fish meal with Spirulina that yielded an improvement in SGR was 8.42% (SD = 10.26), but enhanced growth was detected with Spirulina replacement as low as 0.025% in rainbow trout (Oncorhynchus mykiss)45.

Figure 2
figure 2

Forest plot summarizing the effect of Spirulina replacement on the Specific Growth Rate (SGR) of farmed finfish. Each trial (n = 101) is represented by a square whose size is proportional to its relative weight, its width represents the 95% CI, the horizontal line the 99% CI, and the center the Standardized Mean Difference (SMD) corrected for small sample size (Hedge’s g). The grey diamond at the bottom represents the overall effect extending over the 95% CI. The solid vertical line denotes the zero effect, and the dotted vertical line the SMD under a random effects model.

Dose-dependent effects

Results of meta-regression by mixed-effects modelling indicates that there is a significant positive relationship between Spirulina replacement level and specific growth rate while statistically controlling for variation among fish families (F11,89 = 4.629, P < 0.001; Fig. 3). The minimal adequate model included Spirulina replacement and family as the only significant predictors of changes in specific growth rate. Initial size (t = − 0.685, P = 0.495) and habitat (t = − 1.754, P = 0.083) were not significant, while feeding guild was redundant, and were dropped from the full main effects model.

Figure 3
figure 3

Bubble plot showing the estimated regression slope of the meta-regression on the effect of Spirulina replacement (%) on the Standardized Mean Difference in Specific Growth Rate (%). The size of the points is proportional to the weight of each study.

A 1% increase in Spirulina inclusion is expected to result in a 0.07% mean increase in SGR (95% CI 0.03–0.12%; Fig. 3), although the model only accounted for 29.4% of the observed heterogeneity and the amount of residual heterogeneity was high (QE = 2143.6, df = 89, P < 0.001). Inspection of estimates indicated that negative impacts were also possible. Two families, Bagridae (t = − 2.277, P = 0.025) and Cyprinidae (t = − 2.043, P = 0.044) deviated significantly from the general trend and showed a reduction in growth with increasing Spirulina replacement levels, while one family, Salmonidae, showed a near significant negative effect (t = − 1.909, P = 0.059).

Validity of results

A strong asymmetry was observed in the funnel plot (Fig. 4), which might be indicative of publication bias. Several studies reporting large effects were more precise than one might expect and clustered at the bottom right corner, far outside the boundaries of the funnel. A linear regression test of funnel plot asymmetry (Egger’s test) confirmed the observed asymmetry (t99 = 5.37, P < 0.001; bias coefficient = 7.04, SE = 1.31). However, caution must be exercised as the high level of heterogeneity in the data set likely also contributed to the asymmetry observed in the funnel plot.

Figure 4
figure 4

Funnel plot showing the relationship between the SMD and the standard error (inverted scale) for the effects of Spirulina replacement on specific growth rate (SGR). Each point represents a treatment–control comparison and the dotted vertical line denotes the global SMD under a random effects model. An asymmetric distribution of points outside the funnel might be indicative of publication bias.

Results from the P-curve analysis indicated that the distribution of significant results was significantly right skewed according to all three tests (P binomial < 0.001, full curve P < 0.001; half curve P < 0.001), while results from the flatness test could not reject the hypothesis that the distribution of significant results was dependent on the significance level (P binomial > 0.999, full curve P > 0.999; half curve P > 0.999). Overall, the evidential value suggests that the observed results are driven by a true underlying effect and do not appear to have been affected by publication bias in the form of P-hacking.

Inspection of Baujat diagnostic plots detected five results which were overly influential (two from the same study) and which also contributed greatly to the overall heterogeneity (Fig. 5), while formal outlier analysis detected 70 extreme results. Reanalysis of the data without the overly influential points resulted in a pooled SMD of 1.09 (95% CI 0.60–1.57) which is still significantly different from zero (t = 4.44, P < 0.001). Similarly, removal of outliers resulted in a statistically significant SMD of 0.86 (95% CI 0.64–1.07; t = 8.14, P < 0.001). These results indicated a significant positive effect of Spirulina on fish growth which was robust to the presence of extreme values, although heterogeneity even without outliers continued to be high (I2 = 76.8%, Q = 129.6, df = 30, P < 0.001) suggesting that there were underlying structural differences between studies beyond sampling error.

Figure 5
figure 5

Baujat bubble plot used to identify potential outliers in the Spirulina data set, showing the contribution of each study to the overall heterogeneity and its influence under a random effects model. The size of each point is proportional to its relative weight in the meta-analysis. Five trials in the upper right corner accounted for a large share of the observed heterogeneity and were also overly influential which merited further scrutiny.

Subgroup analysis

To gain insights into the sources of heterogeneity, we conducted a subgroup analysis. Significant differences in Spirulina effects were found with respect to fish family (Q = 53.42, df = 10, P < 0.001) and habitat (Q = 7.11, df = 1, P = 0.008), but not with respect to feeding guild (P = 0.305) or type of measurements (P = 0.098; Table 2). Of the 11 fish families examined, three families (Cichlidae, Clariidae and Mugilidae) showed a statistically significant increase on growth, this effect being strongest for Mugilidae (SMD = 5.11; 95% CI 1.09–9.12), followed by Cichlidae (SMD = 1.20; 95% CI 0.60–1.80) and Clariidae (SMD = 0.23; 95% CI 0.10–0.36).

Table 2 Sources of heterogeneity and subgroup analysis in the Spirulina dataset according to a random effects model.

Differences were also found between freshwater and marine species, both displaying a significant increase in growth following Spirulina inclusion, the positive effect on growth being ~ 5 times greater in marine fish (SMD = 3.56; 95% CI 1.34–5.78) than in freshwater fish (SMD = 0.70; 95% CI 0.38–1.02). Significant Spirulina benefits on growth were found for omnivores and herbivores, but not for carnivores. Studies that weighed fish individually were also more likely to reveal a positive effect of Spirulina on growth than those which used batch weighing (Table 2).

Although the subgroup analysis uncovered some of the sources of variation, substantial heterogeneity persisted both between and within groups. Six families (Acipenseridae, Cichlidae, Mugilidae, Oplegnathidae, Salmonidae, Serranidae).

showed substantial heterogeneity (I2 > 75%), three families showed moderate heterogeneity (I2 = 25–75%; Cyprinidae, Osphronemidae, Serrasalmidae) and only two families displayed modest heterogeneity (I2 < 25%; Bagridae, Clariidae). Variation among habitats, feeding guilds, and types of measurement were all substantial and not markedly different from the overall level of heterogeneity observed in the entire data set (I2 = 96%). This suggests that other sources of variation were at play beyond those that could be accounted for in the analysis.

Effects of Schizochytrium replacement on fillet omega-3 content

We found 14 quantitative studies on the effects of Schizochytrium replacement on omega-3 fillet content, representing k = 43 control-treatment comparisons, that met the selection criteria. Schizochytrium studies were carried out in 10 species belonging to 9 different fish families. Study subjects ranged in size between 0.02 g and 850 g (mean = 65.7 g, SD = 183.3) and consisted of both juveniles and adults of marine and freshwater species in equal measure, although most results referred to carnivorous species (65%), such as Atlantic salmon (Salmo salar—21% of studies) and red drum (Sciaenops ocellatus—14% of studies). In most cases (79%), studies were carried out in triplicate tanks and involved an average of 132 individuals per tank (SD = 371), with feeding trials lasting between 21 and 133 days (mean = 64 days, SD = 25.8; Table 3). Replacement levels of Schizochytrium varied from 2 to 100% (mean = 42.6%, SD = 30.8).

Table 3 Results of feeding studies assessing the effects of Schizochytrium replacement on the omega-3 content of the fish fillet.

Effect sizes

Standardized mean differences (SMD), corrected for small sample sizes, varied between − 7.6 and 15.6 and resulted in a pooled SMD of 0.621 (95% CI − 0.51–1.76) which is not significantly different from zero (t = 1.11, P = 0.274), and indicated that Schizochytrium inclusion in the diet maintained the omega-3 fillet content (Fig. 6). However, as with results for Spirulina, heterogeneity between studies was very high (Q = 37.7, df = 42, P < 0.001; I2 = 88.9 τ2 = 13.67) and the prediction interval was very wide (95% CI 6.93–8.18), indicating that both negative and positive effects on omega-3 fillet content are possible. Over 60% of control-treatment comparisons (23/43) were statistically different from zero, involving 6 of the 14 independent studies (43%). The average replacement of fish and plant oil with Schizochytrium oil that yielded an improvement in omega-3 fillet content was 16.2% (SD = 21.1), but positive effects were reported with Schizochytrium replacement as low as 10% in Nile tilapia46.

Figure 6
figure 6

Forest plot summarizing the effect of Schizochytrium replacement on the omega-3 fillet content of farmed finfish. Each trial (n = 43) is represented by a square whose size is proportional to its relative weight, its width represents the 95% CI, the horizontal line the 99% CI, and the center the Standardized Mean Difference (SMD) corrected for small sample size (Hedge’s g). The grey diamond at the bottom represents the overall effect extending over the 95% CI. The solid vertical line denotes the zero effect, and the dotted vertical line the SMD under a random effects model.

Dose-dependent effects

The level of Schizochytrium replacement was not a significant predictor of omega-3 fillet content (t = 1.574, df = 32, P = 0.125; Fig. 7), but some differences were found among families. The family Terapontidae (Scortum barcoo, the Jade perch) showed a positive dose–effect (t = 2.60, df = 32, P = 0.014), although this was based on only two points from a single study47 and the amount of residual heterogeneity was high (QE = 222.53, df = 33, P < 0.001). Initial size was not a significant predictor of omega-3 fillet content (t = 0.102, df = 32, P = 0.919) and the best model only accounted for 20.8% of the observed heterogeneity (F9,33 = 2.252, P = 0.043), driven by family effects.

Figure 7
figure 7

Bubble plot showing the estimated regression slope of the meta-regression on the effect of Schizochytrium replacement (%) on the Standardized Mean Difference in the omega-3 fillet content. The size of the points is proportional to the weight of each study.

Validity of results

As with Spirulina, a funnel plot of the Schizochytrium SMDs against their standard errors produced an asymmetric pattern (Fig. 8) that might indicate the existence of publication bias. However, the results of an Egger’s test of funnel plot asymmetry was not significant (t41 = 0.55, P = 0.583; bias coefficient = 0.44, SE = 0.80), suggesting there was no conclusive evidence of publication bias.

Figure 8
figure 8

Funnel plot showing the relationship between the SMD and the standard error (inverted scale) for the effects of Schizochytrium replacement on omega-3 fillet content. Each point represents a treatment–control comparison and the dotted vertical line denotes the global SMD under a random effects model. An asymmetric distribution of points outside the funnel might be indicative of publication bias.

Results from the P-curve test indicated that the distribution of significant results was significantly right skewed (P binomial < 0.001, full curve P < 0.001; half curve P < 0.001), which were confirmed by the flatness test (P binomial > 0.999, full curve P > 0.999; half curve P > 0.999). The evidential value indicated that the observed results were robust and unlikely to have been affected by publication bias. Inspection of Baujat diagnostic plots detected one overly influential result (Fig. 9), while formal outlier analysis detected 14 extreme results. Reanalysis of the data without the overly influential point resulted in a pooled SMD of 0.63 (95% CI − 0.54; 1.80) which was not significantly different from zero (t = 1.09, P = 0.284). Removal of the 14 potential outliers resulted in a pooled SMD of 0.410 (95% CI 0.005–0.815) which was only marginally statistically significant (t = 2.08, P = 0.047).

Figure 9
figure 9

Baujat bubble plot used to identify potential outliers in the Schizochytrium data set, showing the contribution of each study to the overall heterogeneity and its influence under a random effects model. The size of each point is proportional to its relative weight in the meta-analysis. One trial in the upper left corner was overly influential which merited further scrutiny.

Taken together the results indicated that although there was no convincing evidence of a positive effect of Schizochytrium, its inclusion did not cause a loss of omega-3 content in the fish fillet. Heterogeneity, however, was substantial even when outliers were removed (I2 = 74.4%, Q = 109.2, df = 28, P < 0.001).

Subgroup analysis

Significant differences were found in Schizochytrium effects with respect to fish family (Q = 61.70, df = 8, P < 0.001), but not with respect to habitat (Q = 1.59, df = 1, P = 0.208), feeding guild (Q = 5.96, df = 2, P = 0.051) or type of measurements (Q = 0.75, df = 1, P = 0.387; Table 4). Of the 9 fish families examined, two families showed a statistically significant effect of Schizochytrium on omega-3 content (Ictaluridare SMD = 0.530; Serranidae SMD = 1.123) but the sample size was very small, the benefits modest and the uncertainty high.

Table 4 Sources of heterogeneity and subgroup analysis in the Schizochytrium dataset according to a random effects model.

Discussion

Microalgae offer a potential solution to the growing need for more sustainable alternatives to fishmeal and fish oils in aquafeeds, and for healthier, more nutritional substitutes to plant oils16, but high production costs and wide variation in the purported benefits have so far hampered a greater uptake by industry48,49,50. The potential of microalgae to serve as sustainable replacement of animal or plant based protein and oils in aquafeeds has been extensively reviewed in recent years21,51,52,53,54,55,56,57,58,59, but surprisingly there is no quantitative global assessment of their nutritional benefits. Without a statistical analysis, it is difficult to determine to what extent the nutritional benefits of microalgae can be extrapolated across species or depend on inclusion levels. For example, some authors have reported negative impacts of Spirulina at high inclusion levels in some species, while others have found no such constraints51. To address these issues, we conducted a rigorous meta-analysis on the nutritional benefits of incorporating two of the most important microalgae, Spirulina and Schizochytrium, into aquafeeds for use in fish farming, assessed the extent and sources of variation, and critically examined various potential sources of bias.

Benefits of Spirulina replacement on fish growth

The results of our meta-analysis showed that partial replacement of fish meal with Spirulina can have a significant positive effect on fish growth, with benefits being apparent from very modest inclusion levels, 1% and less45. However, growth benefits were dose-dependent and higher inclusion levels of Spirulina resulted in better growth, 45% being the maximum Spirulina replacement considered. Growth was improved in 71% of the 17 species examined, but the best results occurred among the Cichlidae (tilapias), Clariidae (airbreathing catfishes), and Mugilidae (mullets), species which are all herbivorous.

Negative results were also found, although these instances were rare. Loss of weight compared to controls following replacement with Spirulina was reported in 5% of studies (Fig. 10) and involved three species: Nile tilapia at 2–2.7% replacement60,61, mullet at 3.9% replacement62 and rainbow trout at 0.1–4% replacement45,63. In most cases (95%), however, Spirulina either improved growth or had no negative effect compared to controls, and replacements of up to 40–45% have been used without detrimental impacts in several species62,64,65,66.

Figure 10
figure 10

Breakdown of study outcomes (SMDs) under a random effects model for the Schizochytrium and Spirulina meta-analyses, showing the proportion of statistically significant negative effects, no effect, and positive effects along with the 95% binomial CI. The distribution of non-negative outcomes is significantly better for Spirulina than for Schizochytrium studies (χ2 = 11.197, df = 2, P = 0.004).

Benefits of Schizochytrium replacement on omega-3 fillet content

Ingestion of suitable sources of omega-3 PUFA is essential for proper egg development and offspring survival67 and Schizochytrium represents a sustainable and rich source of DHA for maturing fish68. Moreover, given the importance of the early environmental conditions for subsequent development69,70, the essential fatty acids provided by Schizochytrium and other similar thraustochytrids can have long-term beneficial effects on fish health and growth, as seen in Siberian sturgeon71, Nile tilapia26,27,46,72, red sea bream73, channel catfish74, and jade perch47.

We did not find a positive global increase in omega-3 in the fish fillet compared to controls, but the mean SMD was not statistically different from zero, indicating that replacement of fish or plant oil with Schizochytrium oil is possible without a significant loss of omega-3 content. Indeed, positive or neutral (i.e., zero-effect) results were reported in 74% of the trials (Fig. 10). The 26% of cases where the omega-3 content of the fish fillet deteriorated after Schizochytrium inclusion referred to studies involving five species: red drum75, hybrid striped bass76, Atlantic salmon77, red seabream78, and gilt-head bream79. The absence of a dose effect means that 100% substitution of animal or plant oils with Schizochytrium oil is possible and should not decrease the nutritional value of the fish fillet, as demonstrated for Nile tilapia26, although variability is very high and the prediction interval wide, which introduces considerable uncertainty on the expected results.

Heterogeneity between studies and sources of variation

We found substantial heterogeneity in the results of fish feeding studies using Spirulina (I2 = 96%) and Schizochytrium (I2 = 89%). The relative frequency of different outcomes (positive, neutral, and negative results) differed significantly between Spirulina and Schizochytrium studies (χ2 = 11.197, df = 2, P = 0.004; Fig. 10). Non-negative results (i.e. positive plus neutral) were more common for Spirulina effects on growth (94%) than for Schizochytrium effects on omega-3 fillet content (74%), confirming the results of the two meta-analyses, which yielded a significant non-zero global effect for Spirulina (95% CI SMD = 0.71–1.70) but included zero in the case of Schizochytrium (95% CI SMD = − 0.51–1.76). Highly variable outcomes are common in microalgal studies. For example, Ahmad et al.80 reported 36% significant improvements in 11 studies that examined changes in growth or fillet quality following inclusion of Chlorella vulgaris in aquafeeds, 36% with no discernible benefit, and 27% negative effects, which were apparently exacerbated at high inclusion levels.

High heterogeneity in meta-analysis is problematic because it makes it difficult to generalize across contexts35,81. Heterogeneity can be caused by clinical (or structural) differences between subjects and how they respond to treatments, but also by methodological differences in study design, and by statistical variation in intervention effects82,83. We dealt with high heterogeneity by performing meta-regression and by conducting subgroup analysis84. We found that family effects were the main source of heterogeneity, but this only explained a small part of the observed variation (~ 24–27%). Most of the variation could not be explained by differences in the way different fish families responded to microalgae replacement, or by variation in microalgae inclusion levels, differences in fish size, habitat, feeding guild or the way the data were recorded.

It is likely that other, unaccounted, biotic and abiotic sources of variation contributed to the high observed level of heterogeneity85. For example, fish growth can vary enormously depending on sex and stocking density86, water temperature87, photoperiod88, light intensity89, tank size90, tank colour89, social status91, trial duration, seasonality and feeding rates92. These are likely to differ between studies but are seldom reported. Likewise, substantial variation has also been reported in the fatty acid composition of fish fed identical diets under communal rearing conditions93, suggesting that individual differences in deposition of omega-3 can be substantial. The nutritional value of micro-algae also differs between strains and producers94, depending on culture conditions95, geographic location96 and post-harvest treatment97,98,99, adding additional sources of unaccounted variation.

Publication bias

We found no clear evidence of systematic publication bias. Plotting effect sizes against standard error of the estimates resulted in asymmetric funnel plots for both Spirulina and Schizochytrium which can be indicative of publication bias100. However, asymmetry could not be confirmed by the more explicit Egger’s tests40 in the case of Schizochytrium and the results of p-curve analysis42 indicated that there was sufficient evidential value for both micro-algae, suggesting there was an underlying true effect. Publication bias could have been masked by high study heterogeneity which may have diminished the power of the p-curve method101, but our sensitivity analysis indicates that the pooled effect sizes calculated for Spirulina and Schizochytrium were robust to the exclusion of outliers and overly influential points.

Wider benefits of using microalgae in aquafeeds

There are over 40 different species of micro-algae used in fish farming, but these are mostly used to feed rotifers and copepods to wean fish larvae, or are administered live directly to fish reared in ‘green waters’30,102. Only ~ 19 microalgae are used as part of formulated aquafeeds16,103, the production being dominated by freshwater species such as Spirulina, which is the dominant species with 41% of the global market due its ease of culture, nutrient profile and high yield104.

Although live microalgae are a staple feed in many fish hatcheries105, ingestion rates are difficult to control in ‘green waters’ and their use is typically restricted to larval stages. In contrast microalgae-based aquafeeds can be used at all stages of fish development, offering superior control over feeding, necessary for precision aquaculture106. Also, unlike plant-based aquafeeds that are difficult to be accepted by carnivorous species107, microalgae incorporated into aquafeeds can be used to feed both carnivorous and herbivorous species59. Many microalgae have rigid cell walls which results in low digestibility108, but new technical solutions are being developed to overcome this challenge59,109,110.

Not all species are as rich in omega-3 PUFA as Schizochytrium26, or have the high protein content of Spirulina (~ 63–65%) to replace fish meal98, but combining different microalgae can overcome this limitation. For example, Schizochytrium represents a good source of DHA for maturing fish, but is poor in EPA68, but by combining it with oil from Nannochloropsis which is rich in EPA111 an appropriate balance of omega-3 fatty acids can be ensured, necessary for the production of high quality gametes112. Likewise, while Schizochytrium oil possess a nutritional profile comparable to fish oil26,27,96, Spirulina lacks essential amino-acids compared to fish meal, which can potentially reduce growth at high inclusion levels for some species21,113. Thus, different combinations of microalgae may be required to meet the nutritional needs of different fish species114. Yet, few studies have compared the benefits of combining different proportions of microalgae and this is an area where more research is clearly needed.

One advantage of microalgae over plant-based aquafeeds is that their benefits are not limited to enhanced growth or nutritional value, but can also extend to fish health16,115. Microalgae are increasingly being considered for their therapeutic properties, in addition to their nutritional aspects116. For example, Spirulina and Chlorella can boost the immune system of fish80,117, and Spirulina may also have anti-viral properties118. Incorporation of Spirulina in the fish diet was reported to enhance hepatic antioxidant function and disease resistance in coral trout, Plectropomus leopardus119, great sturgeon Huso huso120, Nile tilapia60,121,122, African catfish123, mullet124, as well as in several cyprinids24,125 and salmonids 45,126. Inclusion of Spirulina at 8–10% was also found to increase fecundity in three-spot gourami127.

Maximizing the value of feeding studies using microalgae

Microalgae can provide substantial benefits to aquaculture nutrition but only if results can be replicated and can be used by the aquafeed industry7,8. In common with other meta-analysis in aquaculture128, we found it difficult to extract the necessary information from fish feeding trials to ascertain effect sizes. A surprisingly large number of studies did not provide enough information to replicate the work, or to ascertain the experimental validity of the results. Of 1474 studies we screened, only 3% were eligible for analysis. Few studies adhered to accepted guidelines for reporting fish feeding trials, failing to report mean effects, sample sizes and measures of variability129, or ethical considerations130.

In the studies reviewed, 14% of trials involved batch measurements in the case of Spirulina and 23% in the case of Schizochytrium, and this may have also introduced some biases. Batch measurements are not recommended as they can mask important sources of variation, reduce sample size (and thus statistical power) and may result in inflated effect sizes, which can be misleading. It might be beneficial for future meta-analysis to weigh studies by some measure of reliability41,81.

The unit of replication should also take into account the nested nature of the data and the statistical power to detect differences, particularly in growth studies131,132. For example, there is little benefit in using triplicate tanks if tank effects are ignored and data are pooled. Fish can now be individually marked since a young age133, which is essential for precision fish farming106, and tank effects can be accounted for using linear mixed effects models131.

All results we reviewed were based on feeding trials typically carried out in comparatively small tanks or enclosures under relatively low densities, which are unlikely to be representative of commercial conditions. Given the high heterogeneity found in effect sizes, there is some uncertainty about the wider applicability of the reported results. There is clearly a need to examine the performance of algae-enriched aquafeeds under commercially relevant conditions that extend over longer time periods than the average 60-day feeding trial to ascertain the validity and potential limitations of upscaling134.

Outlook and conclusions

Although our meta-analyses examined the nutritional benefits of only two species of microalgae, these represent the main ones, and were the only ones with enough quantitative data on nutritional benefits. The results indicate that inclusion of Spirulina in the fish diet improves specific growth rate overall, while replacement of fish or plant oil with Schizochytrium oil is possible without loss of omega-3 content in the fish fillet in the majority of studies and species examined. However, the results were very heterogenous and the nutritional benefits depended on fish species, and in the case of Spirulina also on inclusion levels.

The Aquaculture industry will be worth $50.6 billion by 2026135, the main cost of which will continue to be the cost of aquafeeds136. The use of microalgae in aquafeeds is still more expensive than using fishmeal, fish oils or plant crops48 but the price of fish meal has increased more than 200% over the last two decades137. As microalgae production becomes cheaper and more efficient20, microalgal-based aquafeeds will become more competitive138. Production of Spirulina is expected to be worth $4.6 billion by 2027139, mostly driven by the nutraceutical, food and beverage segment, but also by aquaculture140. To speed the transition towards more sustainable, zero-catch aquafeeds, we recommend that feeding trials using microalgae are conducted under commercially relevant conditions and that the raw data and full rearing details are fully reported to facilitate comparative analyses.