Article | Open | Published:

A non-smooth tumor margin on preoperative imaging assesses microvascular invasion of hepatocellular carcinoma: A systematic review and meta-analysis

Scientific Reportsvolume 7, Article number: 15375 (2017) | Download Citation

Abstract

Microvascular invasion (MVI) is rarely diagnosed preoperatively in hepatocellular carcinoma (HCC). The aim of this meta-analysis is to assess the diagnostic power of a non-smooth tumor margin on preoperative imaging for MVI. We performed a literature search using the PubMed, Embase and Cochrane Library databases, and 11 studies were included involving 618 MVI-positive cases and 1030 MVI-negative cases. Considerable heterogeneity was found, and was indicated to be attributable to the mean patient ages in the included studies. In subgroups of studies with a mean patient age older than 60 years and studies with computed tomography (CT) as the imaging method (as opposed to magnetic resonance imaging (MRI)), heterogeneity was low, and the diagnostic odds ratio (DOR) of the single two-dimensional imaging feature for MVI was 21.30 (95% CI [12.52, 36.23]) and 28.78 (95% CI [13.92, 59.36]), respectively; this power was equivalent to or greater than that of certain multivariable-based scoring systems. In conclusion, a non-smooth tumor margin on preoperative imaging is of great value for MVI assessment and should be considered for inclusion in future scoring systems.

Introduction

Hepatocellular carcinoma (HCC) is the third-leading cause of cancer-related deaths worldwide1; even with treatment with potentially curative therapies, HCC has a 5-year recurrence rate of approximately 35–70%2. Vascular invasion is direct evidence of the biological aggressiveness of a tumor. Microvascular invasion (MVI), which is defined as tumor invasion of a portal vein radicle, the large capsule vessel or a vascular space lined by endothelial cells, is detectable only by microscopy3. Relative to other HCC patients, patients with MVI have a markedly higher risk of early recurrence and poor postsurgical survival3,4, even in cases involving small, solitary HCC tumors5,6. Moreover, patients who do not satisfy the Milan criteria can nonetheless exhibit excellent outcomes if they are confirmed to be negative for MVI7.

The gold standard for diagnosing MVI is a histological examination, which requires extensive sampling. A noninvasive evaluation system capable of preoperatively identifying MVI would be of great clinical value for better determining optimal therapeutic strategies. If MVI is detected, an adjuvant therapy such as sorafenib treatment8 or trans-arterial chemoembolization (TACE)9 could be used, given that these approaches have been reported to improve survival for HCC patients with MVI.

Several promising markers of MVI have been identified, although assessments of such markers involve technically demanding methods, including genetic testing, protein analysis and radiographic examination. A non-smooth tumor margin, which manifests as a lobulated or irregularly shaped tumor with the focal/multifocal outgrowth of nodules protruding into the non-tumor parenchyma10,11, is a two-dimensional imaging feature observable via even the simplest imaging methods, including ultrasonography. Moreover, this feature has been reported to be strongly related to elevated MVI risk and has even been identified as the only significant factor in a multivariable analysis10,12,13,14. To better understand this topic, we performed a review of the diagnostic performance of a non-smooth tumor margin for preoperative MVI assessment.

Results

Study selection

We identified a total of 1101 studies using our search strategy (Fig. 1). Studies as duplicated reports, reviews, case reports, editorials or conference abstracts were excluded (351 studies). After titles and abstracts were reviewed, 685 studies were excluded for examining non-primary HCC, being in vitro experiments or unrelated to MVI estimation. The remaining 65 studies were subjected to full-text review, and 59 of these studies were excluded for overlapping population (3 studies), sample size smaller than 30 (1 study), involving gross analyses of non-smooth tumor margins (7 studies), or containing no valid extractable data for our meta-analysis (48 studies). Six studies were selected for inclusion, and 5 additional studies were included after reviewing citations of the retrieved articles.

Figure 1
Figure 1

Flow chart diagram presenting the selection of eligible studies.

Study characteristics

Characteristics of the 11 studies are presented in Table 1, and additional information is presented in Table 1 of the Supplementary materials. The included studies were published between 2009 and 2016. In total, 618 pathologically diagnosed MVI-positive patients and 1030 MVI-negative patients were included in this meta-analysis. Two15,16 of the included studies were performed in European populations, and the remaining nine studies were performed in Asian populations. One study17 assessed HCC patients treated via liver transplantation, 8 studies assessed HCC patients treated via liver resection, and two10,16 studies included HCC patients treated via either modality. Tumor margins were evaluated using computed tomography (CT), magnetic resonance imaging (MRI), and either of these approaches in two studies10,12, 7 studies, and two studies14,15, respectively. In Witjes et al.16, 22% of patients received preoperative radiofrequency ablation (RFA) or trans-arterial chemoembolization (TACE). Patients with macrovascular invasion and patients who received preoperative anti-tumor treatment were excluded from the remaining studies, with the exception of the study by Kim et al.11, which did not clearly address this issue.

Table 1 Characteristics of the 11 included studies.

Heterogeneity test and meta-regression analysis

The Spearman correlation coefficient was 0.06, and the corresponding P value was 0.85, suggesting the absence of threshold effect-derived heterogeneity. However, the inconsistency indexI2 was 89.1%, indicating heterogeneity due to non-threshold effects. Meta-regression analysis indicated that the patients’ mean age may have contributed to this high heterogeneity. QUADAS score summaries are presented in Table 1 and Fig. 2. The QUADAS score varies from 6 to 13, which indicated that other potential contributors to the heterogeneity resulted from the risk bias in patient selection due to the inappropriate inclusion and exclusion of patients (Ariizumi et al.13 included patients of recurrent HCC with a history of hepatectomy; and Yang et al.18 excluded patients with interval between MRI and surgery longer than 14 days). This risk bias may indirectly impact on the mean age and patient percentage with a positive imaging parameter. We adopted a clinical perspective and conducted sensitivity and subgroup analyses based on the patients’ mean age, with a threshold of 60 years; imaging method; and the percentage of patients with a non-smooth tumor margin.

Figure 2
Figure 2

Quality of included studies according to QUADAS-2 guidelines. Risk of bias and applicability concerns of each included study. Proportion of studies with risk of bias; proportion of studies with regarding applicability. The risk bias mainly raised from patient selection due to inappropriate inclusion and exclusion, and determined as “high”. Another source of bias was indefinite report of blind method and interval between imaging and MVI pathological detection, and determined as “unclear”.

Accuracy of a non-smooth tumor margin for predicting MVI

High heterogeneity among studies precluded the pooling of data to obtain a summary result. As indicated in Table 2, subgroup analysis stratified by age with a threshold of 60 years showed that a non-smooth tumor margin has strong diagnostic power for MVI in studies with a mean patient age older than 60. In particular, the DOR of a non-smooth tumor margin could reach 21.30 (95% CI [12.52, 36.23]), with an area under the curve (AUC) as high as 0.90. And the summary sensitivity and specificity of the subgroup of age older than 60 was 0.81[0.72, 0.89] and 0.81[0.73, 0.87], respectively (Fig. 3 and Fig. 4). A non-smooth tumor margin had stronger diagnostic power when CT was used for imaging (2 studies) than when MRI was the imaging approach, and strong diagnostic power was also observed in the studies which included greater than 53% patients with a non-smooth tumor margin (2 studies), with DORs in this case reaching 19.42 (95% CI [7.53, 50.16]) and 28.78 (95% CI [13.92, 59.36]), respectively. Table 3 presents a comparison between using the single factor of a non-smooth tumor margin and using multivariable scoring systems for MVI assessment. Six scoring systems were identified19,20,21,22,23,24, and the comparison indicated that for the subgroups of patients older than 60 and patients who underwent CT imaging, a non-smooth tumor margin exhibited excellent diagnostic power. This power was equivalent to or greater than the diagnostic powers calculated for certain multivariable scoring systems.

Table 2 Pooled results of subgroup analysis.
Figure 3
Figure 3

Forest plots of sensitivity and exact 95% confidence interval for subgroups of age ≥ 60 and age <60. CI: confidence interval. TP: true-positive, FP: false-positive, FN: false-negative, TN: true-negative. The summary sensitivity was 0.81[0.72, 0.89] for the subgroup of age older than 60, and 0.37[0.23, 0.54] for that of age younger than 60.

Figure 4
Figure 4

Forest plots of specificity and exact 95% confidence interval for subgroups of age ≥ 60 and age <60. CI: confidence interval. TP (true-positive), FP (false-positive), FN (false-negative), TN (true-negative). The summary specificity was 0.81[0.73, 0.87] for the subgroup of age older than 60, and 0.76[0.70, 0.81] for that of age younger than 60.

Table 3 Comparisons with multivariable based scoring system.

Discussion

Preoperative MVI assessment has become clinically possible given the discovery of associations between a pathological diagnosis of MVI and imaging/clinical features, proteomics characteristics and gene signatures2,25,26,27. Pathologically, MVI has been reported to most frequently present at the site of extranodal extension10,12. Moreover, a non-smooth tumor margin can be regarded as indicative of HCC’s aggressive biological tendencies to invade the tumor capsule and protrude into the non-tumoral parenchyma. In this meta-analysis, we systematically reviewed studies evaluating the diagnostic accuracy of a non-smooth tumor margin for MVI. High heterogeneity among the included studies precluded the pooling of results to draw clinically applicable findings. However, the subgroups of studies with a mean patient age older than 60 years and studies involving CT imaging exhibited low heterogeneity and indicated that the diagnostic power of a non-smooth tumor margin for MVI was strong. This diagnostic power was found to be equivalent to or even greater than the diagnostic powers of certain multivariable-based scoring systems. This result shows that a non-smooth tumor margin is a promising indicator of preoperative MVI assessment. The diagnostic accuracy for MVI may be further improved by constructing a model that includes a non-smooth tumor margin in addition to other factors.

Several considerations warrant attention. First, image interpretation is equipment dependent. Our study reveals that CT is superior to MRI with respect to evaluating a non-smooth tumor margin for MVI assessment. This result is reasonable given that CT has better spatial resolution than MRI and that spatial resolution is extremely important for distinguishing between non-smooth and smooth tumor margins. However, only 2 studies from the same research group (with different patient populations) addressed the use of CT to evaluate tumor margins for MVI assessment; therefore, the pooled result is incompletely convincing, and more high-quality evidence is needed to reach more definitive conclusions. One possible explanation for why the subgroup of studies with a mean patient age older than 60 years exhibited relatively good pooled results is that CT was used for imaging at a higher rate in these studies than in studies involving younger patients (82% and 0%, respectively). Our study revealed that CT was a better assessment approach than MRI in the context of tumor margin evaluation, although ultrasonography may also play an important role given its advantage of enabling the scanning of additional sections compared to CT and MR. In our opinion, the intercostal or subcostal scanning of ultrasonography can obtain sections along multiple axis of the tumor, which is superior in examining irregular shaped tumors. Moreover, ultrasonography is economical and does not result in radiation exposure. However, to date, no published study has used ultrasonography for MVI-related assessments of tumor margins.

The results related to patients with a non-smooth tumor margin larger than 53% point to the most important limitation of our analysis. Image interpretation is both equipment dependent and operator dependent. Yamashita et al.6 reported that relative to pathological diagnosis, imaging diagnosis of a non-smooth tumor margin has a sensitivity of only 54%. Controversy exists with respect to evaluations of a non-smooth tumor margin. In 2 studies with nearly the same eligibility criteria, Chou et al.10,12 reported finding a non-smooth tumor margin in different percentages (53% and 39%, respectively) of patients from the same ethnic group, indicating that tumor margins may be misjudged and that the association of a non-smooth tumor margin with MVI risk may have been underestimated (odds ratios of 33.0 and 12.5, respectively). This possibility is consistent with the results of our meta-analysis. There are several additional limitations of the present study. First, considerable heterogeneity among studies was observed. Clinical heterogeneity (for example, ethnographic characteristics) may limit the reliability of pooled results. Moreover, a limited number of studies were included in this meta-analysis, and most of these studies had small sample sizes. Additional large-scale and high-quality studies are necessary to reach more definitive conclusions. In summary, our study reveals that a non-smooth tumor margin is a promising two-dimensional imaging feature for the preoperative assessment of MVI. Further investigation of this association is required, and this feature should be considered in the construction of future scoring systems.

Methods

Search strategy

Pertinent studies were identified by searching the PubMed, Embase, and Cochrane Library databases for articles published by April 12, 2017. No language or other restrictions were imposed. This search involved the use of “hepatocellular carcinoma” as a MeSH term and a free term and “microvascular invasion” as a free term combined with the search terms “margin”, “boundary”, “irregular”, “lobulated”, “confluence”, “infiltrative” and “extension”. The full search strategy is described in the Supplementary materials.


Inclusion and exclusion criteria

Clinical trials addressing the use of a non-smooth tumor margin for the preoperative evaluation of MVI in HCC patients were considered for inclusion. Studies were required to report sufficient data to construct a diagnostic 2 × 2 table. Investigations of non-primary HCC, studies involving gross analyses (without imaging) of non-smooth tumor margins and trials with sample sizes smaller than 30 subjects were excluded. When multiple publications assessed the same population, only data from the most recent comprehensive report were included. A literature flow diagram is depicted in Fig. 1.


Data extraction and quality assessment

All identified studies were screened for eligibility by one author (Y.H.), and a sample of 20% of these studies was independently assessed by another author (X.W.H.) to ensure consistent application of the eligibility criteria. Potentially eligible citations from retrieved articles were reviewed to identify additional studies. Both investigators (Y.H. and X.W.H.) used QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) to evaluate level of evidence and reached consensus28. Two authors (H.T.H. and Q.Z.) independently extracted the following data from each included study: the first author’s last name, publication year, country, sample size, mean age and possible sources of bias. These variables included mean tumor size, the percentage of male or MVI-positive patients and patients with a non-smooth tumor margin, the inclusion of patients with macrovascular invasion, the administration of preoperative anti-tumor treatment, surgical modality (i.e., resection or transplantation) and imaging modality. Data were extracted as true positives (TP), false positives (FP), false negatives (FN) and true negatives (TN) to form a diagnostic 2 × 2 table. Disagreements during study selection, data extraction and quality assessment were resolved by consensus, with arbitration by a third author as needed (W.W.).


Statistical analysis

We used R (version 3.2.5; The R Foundation for Statistical Computing, Vienna, Austria) and Meta-Disc 1.4 for Windows (XI Cochrane Colloquium, Barcelona, Spain) for all statistical analyses. Summary results are presented in terms of sensitivity (SEN), specificity (SPE), positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and area under the receiver operating characteristic curve (AUC-ROC). Heterogeneity due to the threshold effect was investigated using the Spearman correlation coefficient in Meta-Disc 1.4. A strong positive correlation (P < 0.05) suggested a significant threshold effect. Heterogeneity caused by non-threshold effects was measured using the inconsistency index I2, with I2 < 50% indicating heterogeneity among studies. In cases involving heterogeneity, the DerSimonian-Laird method was used to calculate estimates. A meta-regression was performed to evaluate possible sources of bias listed in the Supplementary material (Table 1) and QUADAS scores, which were the basis for subgroup analyses. All tests of statistical significance were two-sided, and the chosen threshold for statistical significance was 0.05.

Additional information

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Ferlay, J. et al. Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008. International journal of cancer 127, 2893–2917, https://doi.org/10.1002/ijc.25516 (2010).

  2. 2.

    Banerjee, S. et al. A computed tomography radiogenomic biomarker predicts microvascular invasion and clinical outcomes in hepatocellular carcinoma. Hepatology 62, 792–800, https://doi.org/10.1002/hep.27877 %/ (c) 2015 by the American Association for the Study of Liver Diseases (2015).

  3. 3.

    Roayaie, S. et al. A System of Classifying Microvascular Invasion to Predict Outcome After Resection in Patients With Hepatocellular Carcinoma. Gastroenterology 137, 850–855, https://doi.org/10.1053/j.gastro.2009.06.003 (2009).

  4. 4.

    Sumie, S. et al. The significance of classifying microvascular invasion in patients with hepatocellular carcinoma. Annals of surgical oncology 21, 1002–1009, https://doi.org/10.1245/s10434-013-3376-9 (2014).

  5. 5.

    Du, M. et al. Microvascular invasion (MVI) is a poorer prognostic predictor for small hepatocellular carcinoma. BMC cancer 14, 38, https://doi.org/10.1186/1471-2407-14-38 (2014).

  6. 6.

    Yamashita, Y. et al. Predictors for Microinvasion of Small Hepatocellular Carcinoma <  = 2 cm. Annals of surgical oncology 19, 2027–2034, https://doi.org/10.1245/s10434-011-2195-0 (2012).

  7. 7.

    Mazzaferro, V. et al. Predicting survival after liver transplantation in patients with hepatocellular carcinoma beyond the Milan criteria: a retrospective, exploratory analysis. The Lancet. Oncology 10, 35–43, https://doi.org/10.1016/s1470-2045(08)70284-5 (2009).

  8. 8.

    Mendez-Sanchez, N., Vasquez-Fernandez, F., Zamora-Valdes, D. & Uribe, M. Sorafenib, a systemic therapy for hepatocellular carcinoma. Annals of hepatology 7, 46–51 (2008).

  9. 9.

    Sun, J. J. et al. Postoperative Adjuvant Transcatheter Arterial Chemoembolization After R0 Hepatectomy Improves Outcomes of Patients Who have Hepatocellular Carcinoma with Microvascular Invasion. Annals of surgical oncology 23, 1344–1351, https://doi.org/10.1245/s10434-015-5008-z (2016).

  10. 10.

    Chou, C. T. et al. Prediction of microvascular invasion of hepatocellular carcinoma: preoperative CT and histopathologic correlation. AJR Am J Roentgenol 203, W253–259, https://doi.org/10.2214/ajr.13.10595 (2014).

  11. 11.

    Kim, H. et al. Can microvessel invasion of hepatocellular carcinoma be predicted by pre-operative MRI? Eur Radiol 19, 1744–1751, https://doi.org/10.1007/s00330-009-1331-8 (2009).

  12. 12.

    Chou, C. T. et al. Prediction of microvascular invasion of hepatocellular carcinoma by pre-operative CT imaging. British Journal of Radiology 85, 778–783, https://doi.org/10.1259/bjr/65897774 (2012).

  13. 13.

    Ariizumi, S. et al. A non-smooth tumor margin in the hepatobiliary phase of gadoxetic acid disodium (Gd-EOB-DTPA)-enhanced magnetic resonance imaging predicts microscopic portal vein invasion, intrahepatic metastasis, and early recurrence after hepatectomy in patients with hepatocellular carcinoma. Journal of hepato-biliary-pancreatic sciences 18, 575–585, https://doi.org/10.1007/s00534-010-0369-y (2011).

  14. 14.

    Wu, T. H. et al. A non-smooth tumor margin on preoperative imaging predicts microvascular invasion of hepatocellular carcinoma. Surgery Today, 1–7, https://doi.org/10.1007/s00595-016-1320-x (2016).

  15. 15.

    Renzulli, M. et al. Can current preoperative imaging be used to detect microvascular invasion of hepatocellular Carcinoma? Radiology 279, 432–442, https://doi.org/10.1148/radiol.2015150998 (2016).

  16. 16.

    Witjes, C. D. et al. Histological differentiation grade and microvascular invasion of hepatocellular carcinoma predicted by dynamic contrast-enhanced MRI. Journal of magnetic resonance imaging: JMRI 36, 641–647, https://doi.org/10.1002/jmri.23681 (2012).

  17. 17.

    Ahn, S. Y. et al. Prediction of microvascular invasion of hepatocellular carcinoma using gadoxetic acid-enhanced MR and (18)F-FDG PET/CT. Abdom Imaging 40, 843–851, https://doi.org/10.1007/s00261-014-0256-0 (2015).

  18. 18.

    Yang, C. et al. Microvascular invasion in hepatocellular carcinoma: is it predictable with a new, preoperative application of diffusion-weighted imaging? Clinical imaging 41, 101–105, https://doi.org/10.1016/j.clinimag.2016.10.004 (2016).

  19. 19.

    Lei, Z. et al. Nomogram for preoperative estimation of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma within the milan criteria. JAMA Surgery 151, 356–363, https://doi.org/10.1001/jamasurg.2015.4257 (2016).

  20. 20.

    Liu, M. et al. A preoperative measurement of serum microRNA-125b may predict the presence of microvascular invasion in hepatocellular carcinomas patients. Translational Oncology 9, 167–172, https://doi.org/10.1016/j.tranon.2016.03.002 (2016).

  21. 21.

    Miyata, R. et al. Accuracy of preoperative prediction of microinvasion of portal vein in hepatocellular carcinoma using superparamagnetic iron oxide-enhanced magnetic resonance imaging and computed tomography during hepatic angiography. Journal of gastroenterology 41, 987–995, https://doi.org/10.1007/s00535-006-1890-2 (2006).

  22. 22.

    Shirabe, K. et al. The predictors of microvascular invasion in candidates for liver transplantation with hepatocellular carcinoma-with special reference to the serum levels of des-gamma-carboxy prothrombin. J Surg Oncol 95, 235–240, https://doi.org/10.1002/jso.20655 (2007).

  23. 23.

    You, Z., Chen, L. P. & Ye, H. Predictors of microvascular invasion in patients with solitary small hepatitis B related hepatocellular carcinoma. Pak. J. Med. Sci. 30, 331–334 (2014).

  24. 24.

    Zhao, W. C. et al. Preoperative predictors of microvascular invasion in multinodular hepatocellular carcinoma. Eur J Surg Oncol 39, 858–864, https://doi.org/10.1016/j.ejso.2013.04.003 %/ Copyright (c) 2013Elsevier Ltd. All rights reserved (2013).

  25. 25.

    Allen, J. C. et al. The transcriptomic G1-G6 signature of hepatocellular carcinoma in an Asian population Association of G3 with microvascular invasion. Medicine (United States) 95, https://doi.org/10.1097/MD.0000000000005263 (2016).

  26. 26.

    Pote, N. et al. Imaging mass spectrometry reveals modified forms of histone H4 as new biomarkers of microvascular invasion in hepatocellular carcinomas. Hepatology 58, 983–994, https://doi.org/10.1002/hep.26433 (2013).

  27. 27.

    Minguez, B. et al. Gene-expression signature of vascular invasion in hepatocellular carcinoma. Journal of hepatology 55, 1325–1331, https://doi.org/10.1016/j.jhep.2011.02.034 (2011).

  28. 28.

    Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M. & Kleijnen, J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC medical research methodology 3, 25, https://doi.org/10.1186/1471-2288-3-25 (2003).

  29. 29.

    Xu, P. et al. Microvascular invasion in small hepatocellular carcinoma: is it predictable with preoperative diffusion-weighted imaging?J Gastroenterol Hepatol 29, 330-336, doi:10.1111/jgh.12358%/ (c) 2013 Journal of Gastroenterology and Hepatology Foundation and Wiley Publishing Asia Pty Ltd. (2014).

  30. 30.

    Zhao, H. et al. Development and validation of a novel predictive scoring model for microvascular invasion in patients with hepatocellular carcinoma. Eur J Radiol 88, 32–40, https://doi.org/10.1016/j.ejrad.2016.12.030 (2017).

Download references

Author information

Author notes

  1. HangTong Hu and Qiao Zheng contributed equally to this work.

Affiliations

  1. Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China

    • HangTong Hu
    • , Qiao Zheng
    • , Yang Huang
    • , Xiao Wen Huang
    • , Zhi Cheng Lai
    • , JingYa Liu
    • , XiaoYan Xie
    • , Wei Wang
    •  & Ming De Lu
  2. Department of Radiology, the First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China

    • Shi Ting Feng
  3. Department of Hepatobiliary Surgery, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China

    • Ming De Lu

Authors

  1. Search for HangTong Hu in:

  2. Search for Qiao Zheng in:

  3. Search for Yang Huang in:

  4. Search for Xiao Wen Huang in:

  5. Search for Zhi Cheng Lai in:

  6. Search for JingYa Liu in:

  7. Search for XiaoYan Xie in:

  8. Search for Shi Ting Feng in:

  9. Search for Wei Wang in:

  10. Search for Ming De Lu in:

Contributions

W.W. and S.T.F. conceived and designed the study strategy; X.Y.X. and M.D.L. contributed for manuscript revision; Y.H. and X.W.H. worked for study search, selection, and assessed the study quality; H.T.H. and Q.Z. worked equally in data extraction, analysis and manuscript preparation as the principal investigators; Z.C.L. and J.Y.L. prepared the tables and all figures. W.W. also worked as the supervisor and made arbitration for all possible disagreements. All authors have read and approved the content.

Competing Interests

The authors declare that they have no competing interests.

Corresponding authors

Correspondence to Shi Ting Feng or Wei Wang.

Electronic supplementary material

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/s41598-017-15491-6

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.