Abstract
There is a paucity of data on management strategies and clinical outcomes after recurrent venous thromboembolism (VTE). In a multicenter registry enrolling 3027 patients with acute symptomatic VTE, the current study population was divided into the following 3 groups: (1) First recurrent VTE during anticoagulation therapy (N = 110); (2) First recurrent VTE after discontinuation of anticoagulation therapy (N = 116); and (3) No recurrent VTE (N = 2801). Patients with first recurrent VTE during anticoagulation therapy more often had active cancer (45, 25 and 22%, P < 0.001). Among 110 patients with first recurrent VTE during anticoagulation therapy, 84 patients (76%) received warfarin at recurrent VTE with the median prothrombin time-international normalized ratio (PT-INR) value at recurrent VTE of 1.6, although patients with active cancer had a significantly higher median PT-INR value at recurrent VTE compared with those without active cancer (2.0 versus 1.4, P < 0.001). Within 90 days after recurrent VTE, 23 patients (20.9%) during anticoagulation therapy and 24 patients (20.7%) after discontinuation of anticoagulation therapy died. Active cancer was a major cause of recurrent VTE during anticoagulation therapy as a patient-related factor, while sub-optimal intensity of anticoagulation therapy was a major cause of recurrent VTE during anticoagulation therapy as a treatment-related factor, particularly in patients without active cancer.
Similar content being viewed by others
Introduction
Venous thromboembolism (VTE), including pulmonary embolism (PE) and deep vein thrombosis (DVT), is one of major health problems all over the world with a yearly incidence of around one case per 1000 person-years1. VTE has a long-term risk of recurrence, and the risk of recurrence after 5 years was reported to be 20–25% in unselected cohorts of patients with VTE2. Thus, the prevention of recurrence by anticoagulation therapy is important3. The risk of recurrence is highest in the acute phase after VTE diagnosis, and it decreases rapidly after initiation of anticoagulation therapy4. Nevertheless, a certain number of patients could develop recurrent VTE beyond the acute phase irrespective of the status of anticoagulation therapy. Moreover, recurrent VTE was reported to have a considerable impact on mortality (relative risk ratio: 3.24)5. However, evidence on the optimal management strategies after recurrent VTE is scarce6. Consequently, the current VTE guidelines provide limited recommendations based on low-quality evidence for the management strategies after recurrent VTE especially during anticoagulation therapy7,8,9,10. Data on the current real-world management strategies and outcomes after recurrent VTE would be important for understanding the current issues and unmet needs in patients with recurrent VTE like other cardiovascular diseases. Thus, we aimed to investigate the clinical characteristics, management strategies and outcomes of recurrent VTE, using a large practice-based large observational study in Japan.
Methods
Study population
The COMMAND VTE (COntemporary ManageMent AND outcomes in patients with Venous ThromboEmbolism) Registry is a physician-initiated, retrospective, multicenter cohort study in which consecutive patients with acute symptomatic VTE among 29 centers in Japan were included between January 2010 and August 2014. The design of the registry was previously reported in detail11,12. We searched the hospital databases for clinical diagnosis and imaging examinations, and enrolled consecutive patients who met the definition of acute symptomatic VTE diagnosed within 31 days from symptom onset during the study period13.
We enrolled 3027 consecutive patients with acute symptomatic VTE after screening of the consecutive 19,634 patients with suspected VTE for eligibility through chart review by the physicians at each institution. According to the occurrence of recurrent VTE during the entire follow-up period and the status of anticoagulation therapy at the time of the recurrent VTE event, the current study population was divided into the following 3 groups; (1) First recurrent VTE during anticoagulation therapy; (2) First recurrent VTE after discontinuation of anticoagulation therapy; and (3) No recurrent VTE during the follow-up period (Fig. 1). Recurrent VTE was defined as PE and/or DVT with symptoms accompanied by confirmation of new thrombus or exacerbation of the thrombus by objective imaging examinations or autopsy14.
Ethics approval and consent to participate
The ethics committee of primary institution; Kyoto University Hospital Ethics Committee approved the research protocol (Approval number R0493). The relevant review boards or ethics committees in all other 28 participating centers (Supplementary Appendix 1) also approved the research protocol. All procedures followed were in accordance with the Declaration of Helsinki. Written informed consent from each patient was waived because we used clinical information obtained in routine clinical practice and none of the patients refused to participate in the study when contacted for follow-up, which was approved by the ethics committee of the principal institution (Kyoto University Hospital Ethics Committee; the approval number R0493). This method is concordant with the guidelines for epidemiological studies issued by the Ministry of Health, Labor, and Welfare in Japan.
Data collection and definitions for patient characteristics
Detailed methodology of data collection in the COMMAND VTE Registry was previously reported11. Just briefly, data were collected from the hospital charts or hospital databases according to the pre-specified definitions. The physicians at each institution were responsible for data entry into an electronic case report form with additional monitoring for the quality of data at the general office of the registry. Patients with active cancer were defined as those on treatment for cancer such as chemotherapy or radiotherapy, those scheduled to undergo cancer-surgery, those with metastasis to other organs, and/or those with terminal cancer (expected life expectancy of 6 months or less) at the time of the diagnosis. Data for prothrombin time-international normalized ratio (PT-INR) during follow-up in patients receiving warfarin were collected from the hospital charts of the centers where the index VTE was diagnosed. The presumed stable PT-INR values for warfarin users was evaluated as the first PT-INR between 1 and 6 months after VTE diagnosis. The detailed definitions of patient characteristics are described in Supplementary Appendix 2.
Clinical follow-up and endpoints
Detailed methodology of clinical follow-up in the COMMAND VTE Registry was previously reported11. In the current study, we evaluated the clinical outcomes at 90 days after the first recurrent VTE events, and all the clinical outcomes were evaluated irrespective of the status of anticoagulation therapy after the first recurrent VTE.
The primary outcome measure in the current study was all-cause death at 90 days after the first recurrent VTE. The independent clinical event committee (Supplementary Appendix 3) unaware of the patient characteristics reviewed all the death events, and classified the causes of death as due to PE, due to bleeding events, due to cancers, due to cardiac causes, due to other non-cardiac causes, or due to unknown causes15. Death was judged to be due to PE (fatal PE) if it was confirmed by autopsy or if death followed a clinically severe PE after first recurrent PE events. Death was judged to be bleeding related if it followed an intracranial hemorrhage or a bleeding episode leading to hemodynamic deterioration. Death in patients with the end-stage cancer without a specific cause of death was regarded as cancer in origin. Death was judged to be due to cardiac events, if it followed acute myocardial infarction, heart failure, or ventricular arrhythmia. Final classifications for the causes of deaths were made on the basis of the full consensus of the independent clinical event committee.
The secondary outcome measures in the current study were recurrent VTE and major bleeding at 90 days after the first recurrent VTE. Recurrent VTE was defined as PE and/or DVT with symptoms accompanied by objective imaging examinations or autopsy14. Major bleeding was defined as International Society of Thrombosis and Hemostasis (ISTH) major bleeding, which consisted of a reduction in the hemoglobin level by at least 2 g/dL, transfusion of at least 2 units of blood or symptomatic bleeding in a critical area or organ16.
Statistical analysis
In the current study, we evaluated the baseline characteristics among the 3 groups. Characteristics, management strategies, and outcomes of the first recurrent VTE were compared between the 2 groups of patients who had recurrent VTE during and after discontinuation of anticoagulation therapy. Moreover, we conducted an exploratory analysis for first recurrent VTE during anticoagulation therapy comparing patients with and without active cancer. Categorical variables are presented as numbers and percentages, and continuous variables are presented as the mean and standard deviation or the median and interquartile range (IQR) based on their distributions. Categorical variables were compared using the chi-squared test when appropriate; otherwise, Fisher’s exact test was used. Continuous variables were compared using Wilcoxon’s rank sum test between the 2 groups and one-way analysis of variance or Kruskal–Wallis test based on their distributions among the 3 groups. The 90-day clinical outcomes after the first recurrent VTE are presented as the number of events and incidences with 95% confidence intervals (CI). All statistical analyses were conducted using JMP version 14.0.0 (SAS Institute Inc., Cary, NC, USA; https://www.jmp.com/en_gb/software/new-release/preview-jmp14.html). All reported P-values were 2-tailed, and P-values < 0.05 were considered statistically significant.
Results
Patient characteristics
The mean age of the study population was 67 years, 61% were women, and mean body weight and body mass index were 57.9 kg and 23.2 kg/m2, respectively. There were 110 patients (3.6%) with first recurrent VTE during anticoagulation therapy, 116 patients (3.8%) with first recurrent VTE after discontinuation of anticoagulation therapy, and 2801 patients (93%) without recurrent VTE during the follow-up period (Fig. 1).
The patient characteristics were different in several aspects across the 3 groups (Table 1). Patients with first recurrent VTE during anticoagulation therapy were younger than patients with first recurrent VTE after discontinuation of anticoagulation therapy, and patients without recurrent VTE during the follow-up period (62.4, 63.9 and 67.5 years, P < 0.001), and more often had active cancer (45, 25 and 22%, P < 0.001) and thrombophilia (12, 5.2 and 4.6%, P = 0.002).
First recurrent VTE events and management strategies
Regarding the timing of first recurrent VTE, 60% (66 patients) of first recurrent VTE during anticoagulation therapy and 19% (22 patients) of first recurrent VTE after discontinuation of anticoagulation therapy occurred within 90 days after the VTE diagnosis (Table 2). Among 110 patients with first recurrent VTE during anticoagulation therapy, 84 patients (76%) received warfarin at first recurrent VTE with the median PT-INR value at recurrent VTE events of 1.6. Regarding the anticoagulation strategies after first recurrent VTE events, 85 patients (77%) continued the same anticoagulant as used at the first recurrent VTE event, whereas 25 patients (23%) switched to a different anticoagulant.
Among patients with first recurrent VTE during anticoagulation therapy, patients with active cancer had a significantly higher median PT-INR value at recurrent VTE for warfarin users compared with those without active cancer (2.0 versus 1.4, P < 0.001) (Table 3).
Clinical outcomes after first recurrent VTE events
Among the patients with recurrent VTE, 23 patients (20.9%) during anticoagulation therapy, and 24 patients (20.7%) after discontinuation of anticoagulation therapy died within 90 days after the first recurrent VTE events (Table 4). Of the 23 deaths after first recurrent VTE during anticoagulation therapy, deaths due to PE (fatal PE) accounted for 13 (57%), and deaths due to cancer accounted for 9 (39%). Of the 24 deaths after first recurrent VTE after discontinuation of anticoagulation therapy, deaths due to PE (fatal PE) accounted for 6 (25%), and deaths due to cancer accounted for 11 (46%). Patients with first recurrent VTE during anticoagulation therapy experienced recurrent VTE in 1 patients (0.9%) and major bleeding in 9 patients (8.2%) at 90 days after the first recurrent VTE events (Table 4). Patients with first recurrent VTE after discontinuation of anticoagulation therapy experienced recurrent VTE in 1 patients (0.9%) and major bleeding in 8 patients (6.9%) at 90 days after the first recurrent VTE events.
Among the patients with first recurrent VTE during anticoagulation therapy, 15 patients (30.6%) with active cancer, and 8 patients (13.1%) without active cancer died within 90 days after the first recurrent VTE events (Table 5). Of the 15 deaths among patients with active cancer, deaths due to PE (fatal PE) accounted for 5 (33%) and deaths due to cancer accounted for 9 (60%), while all 8 deaths among patients without active cancer were due to PE (fatal PE).
Discussion
The main findings of the current study were as follows; (1) Patients with first recurrent VTE during anticoagulation therapy had a significantly higher prevalence of active cancer compared with those after discontinuation of anticoagulation therapy; (2) The PT-INR value for warfarin users at recurrent VTE events in patients during anticoagulation therapy was significantly higher in patients with active cancer than in patients without active cancer; (3) Approximately 20% of patients died within 90 days after the first recurrent VTE events, and fatal PE and cancer were the major causes of deaths.
Generally, recurrent VTE after discontinuation of anticoagulation therapy might be managed by restart of anticoagulation therapy with indefinite duration7,8,9,10. The clinical dilemma is the optimal anticoagulation strategies for recurrent VTE during anticoagulation therapy6. Recurrent VTE in the acute phase soon after initiation of anticoagulation therapy seems to be managed by more aggressive antithrombotic therapy including thrombolysis, increased intensity of anticoagulation therapy, and switching from oral anticoagulants to parenteral anticoagulants. However, currently, there have been no randomized clinical trials that have evaluated management strategies for patients with recurrent VTE during anticoagulant therapy. Potential causes of recurrent VTE during anticoagulation therapy could be divided into patient-related factors and treatment-related factors6. The investigation of the potential causes could be important to consider the appropriate management strategies after recurrent VTE during anticoagulation therapy.
Several patient-related factors including cancer, thrombophilia, autoimmune disease, pregnancy, and vascular abnormalities were reported as the causes of recurrent VTE17,18,19,20,21. Of these, the most important patient-related factor is thought to be active cancer9. A previous study reported that 31% of patients with recurrent VTE during anticoagulation therapy had active cancers17. Consistent with the previous report, the current study showed a high prevalence (45%) of patients with recurrent VTE during anticoagulation therapy. Patients with active cancer were reported to receive sub-optimal intensity of anticoagulation therapy for warfarin users due to high-bleeding risk and drug interactions of anti-cancer drug22. However, the current study showed that warfarin users with active cancer had higher PT-INR values compared with those without, suggesting the importance of active cancer as the patient-related factor of recurrent VTE on appropriate anticoagulation therapy. There might be no established anticoagulation strategies for patients with recurrent VTE during appropriate anticoagulation therapy. A current guideline weakly recommends switching from oral anticoagulants to low molecular weight heparin (LMWH) at least temporarily and increasing the dose of LMWH for LMWH users based on a low level of evidence9, although there are no recommendations for long-term anticoagulation strategies. The current study showed that a majority of patients with recurrent VTE during anticoagulation therapy were treated with parenteral anticoagulation therapy or thrombolysis in the acute phase, and continued the same anticoagulant as used at the recurrent VTE event beyond the acute phase.
Treatment-related factors could include sub-therapeutic intensity of warfarin, inappropriate reduced dosage of direct oral anticoagulants (DOAC), concomitant drugs that reduce anticoagulant effect, and patient adherence to drug9. The recommended target PT-INR for VTE in the Japanese guidelines is 2.0 (range, 1.5–2.5) without established evidences7, which is lower than the target value (PT-INR, 2.5; range, 2.0–3.0) used in other Western countries8,9,10. The current study showed that there was no significant difference in the median presumed stable PT-INR values for warfarin users among the 3 groups (1.8, 1.8 and 1.8, P = 0.57). However, the current study also showed that the median PT-INR value at recurrent VTE events for warfarin users was 1.6 and more than half of patients had PT-INR values less than 2.0 at recurrent VTE events, and low PT-INR value at recurrent VTE events was more remarkable in patients without active cancer. These results could suggest that sub-therapeutic intensity of warfarin might be one of the causes of recurrent VTE during anticoagulation therapy as treatment-related factor especially in patients without active cancer. Clinicians should be notified for the importance of maintenance of appropriate intensity of anticoagulation therapy during the follow-up. These issues should be confirmed by further studies in the future.
The clinical outcomes after recurrent VTE could also be important in considering the appropriate management strategies after recurrent VTE. A previous study reported that patients with recurrent VTE on vitamin K antagonists (warfarin) therapy have a worse prognosis with an increased risk of both further recurrences (6.8%) and major bleeding (2.3%) at 3 months compared with patients with recurrent VTE during vitamin K antagonists therapy17. Another study reported that a considerably high risk of recurrence (8.6%) and major bleeding (1.4%) during 3 months in 70 cancer patients with recurrent VTE during anticoagulation therapy who either switched from warfarin to LMWH or had their LMWH dose increased23. The current study showed a relatively low risk of further recurrence (0.9%) and high risk of major bleeding (8.2%) at 90 days in patients with recurrent VTE during anticoagulation therapy. There results could be partly due to a relatively frequent usage of thrombolysis in the acute phase (15%) and different ethnicity between Whites and Asians24. The current study also showed that a considerably high proportion of patients (20.9%) died within 90 days after the recurrent VTE during anticoagulation therapy and fatal PE and cancer were major causes of deaths. A major cause of death was cancer among patients with active cancer, while all deaths among patients without active cancer was fatal PE. Clinicians should be careful for avoiding inappropriate anticoagulation strategies to prevent recurrent fatal PE.
Study limitations
The current study has several limitations. First, the current study was an observational study, which can be subject to various biases inherent to observational study design. The therapeutic decision-making was left to the discretion of the attending physicians, which could have influences on clinical outcomes after recurrent VTE events. Second, detailed management strategies after recurrent VTE such as dosing of heparin and warfarin were not evaluated in the current study. Third, demographics, practice patterns as well as clinical outcomes in patients with VTE in Japan may be different from those outside Japan. Finally, the current study was conducted before introduction of DOACs for VTE in Japan. Thus, it should be interpreted with caution whether the present results could be extrapolated to patients treated with DOACs.
Conclusions
In this real-world large registry, active cancer was a major cause of recurrent VTE during anticoagulation therapy as a patient-related factor, while sub-optimal intensity of anticoagulation therapy was a major cause of recurrent VTE during anticoagulation therapy as a treatment-related factor, particularly in patients without active cancer.
Data availability
If the relevant review board or ethics committee approve the data sharing and all investigators of the COMMAND VTE Registry give their consent, the deidentified participant data will be shared on a request basis through the principal investigator (Yugo Yamashita: yyamashi@kuhp.kyoto-u.ac.jp). Study protocol and statistical analysis plan will also be available. The data will be shared as Excel files via E-mail during the proposed investigation period.
References
Naess, I. A. et al. Incidence and mortality of venous thrombosis: A population-based study. J. Thromb. Haemost. 5(4), 692–699 (2007).
Hansson, P. O., Sorbo, J. & Eriksson, H. Recurrent venous thromboembolism after deep vein thrombosis: Incidence and risk factors. Arch. Intern. Med. 160(6), 769–774 (2000).
Kyrle, P. A., Rosendaal, F. R. & Eichinger, S. Risk assessment for recurrent venous thrombosis. Lancet 376(9757), 2032–2039 (2010).
Heit, J. A. et al. Predictors of recurrence after deep vein thrombosis and pulmonary embolism: A population-based cohort study. Arch. Intern. Med. 160(6), 761–768 (2000).
Yamashita, Y. et al. The association of recurrence and bleeding events with mortality after venous thromboembolism: From the COMMAND VTE registry. Int. J. Cardiol. 292, 198–204 (2019).
Schulman, S. How I treat recurrent venous thromboembolism in patients receiving anticoagulant therapy. Blood 129(25), 3285–3293 (2017).
Group JCSJW. Guidelines for the diagnosis, treatment and prevention of pulmonary thromboembolism and deep vein thrombosis (JCS 2009). Circ J 2011; 75(5): 1258–81.
Jaff, M. R. et al. Management of massive and submassive pulmonary embolism, iliofemoral deep vein thrombosis, and chronic thromboembolic pulmonary hypertension: A scientific statement from the American Heart Association. Circulation 123(16), 1788–1830 (2011).
Kearon, C. et al. Antithrombotic therapy for VTE disease: CHEST guideline and expert panel report. Chest 149(2), 315–352 (2016).
Konstantinides, S. V. et al. 2019 ESC guidelines for the diagnosis and management of acute pulmonary embolism developed in collaboration with the European Respiratory Society (ERS). Eur. Heart J. 41(4), 543–603 (2020).
Yamashita, Y. et al. Anticoagulation therapy for venous thromboembolism in the real world- from the COMMAND VTE registry. Circ. J. 82(5), 1262–1270 (2018).
Yamashita, Y. et al. Usefulness of simplified pulmonary embolism severity index score for identification of patients with low-risk pulmonary embolism and active cancer: From the COMMAND VTE registry. Chest 157(3), 636–644 (2020).
Goldhaber, S. Z., Visani, L. & De Rosa, M. Acute pulmonary embolism: Clinical outcomes in the International Cooperative Pulmonary Embolism Registry (ICOPER). Lancet 353(9162), 1386–1389 (1999).
Hokusai, V. T. E. I. et al. Edoxaban versus warfarin for the treatment of symptomatic venous thromboembolism. N. Engl. J. Med. 369(15), 1406–1415 (2013).
Faller, N. et al. Predictors and causes of long-term mortality in elderly patients with acute venous thromboembolism: A prospective cohort study. Am. J. Med. 130(2), 198–206 (2017).
Schulman, S. et al. Definition of major bleeding in clinical investigations of antihemostatic medicinal products in non-surgical patients. J. Thromb. Haemost. 3(4), 692–694 (2005).
Lobo, J. L. et al. Recurrent venous thromboembolism during coumarin therapy. Data from the computerised registry of patients with venous thromboembolism. Br. J. Haematol. 138(3), 400–403 (2007).
Springer, J. & Villa-Forte, A. Thrombosis in vasculitis. Curr. Opin. Rheumatol. 25(1), 19–25 (2013).
Yamashita, Y. et al. Autoimmune disorders and venous thromboembolism: An update from the COMMAND VTE registry. Eur. J. Intern. Med. 84, 106–108 (2021).
Katz, D. & Beilin, Y. Disorders of coagulation in pregnancy. Br. J. Anaesth. 115(Suppl 2), 75–88 (2015).
Goldenberg, N. A. et al. Percutaneous mechanical and pharmacomechanical thrombolysis for occlusive deep vein thrombosis of the proximal limb in adolescent subjects: Findings from an institution-based prospective inception cohort study of pediatric venous thromboembolism. J. Vasc. Interv. Radiol. 22(2), 121–132 (2011).
Sakamoto, J. et al. Cancer-associated venous thromboembolism in the real world- from the COMMAND VTE registry. Circ. J. 83(11), 2271–2281 (2019).
Carrier, M. et al. Dose escalation of low molecular weight heparin to manage recurrent venous thromboembolic events despite systemic anticoagulation in cancer patients. J. Thromb. Haemost. 7(5), 760–765 (2009).
Yamashita, Y. et al. Difference between Japanese and White patients with acute pulmonary embolism. Thromb. Res. 204, 52–56 (2021).
Acknowledgements
We appreciate the support and collaboration of the co-investigators participating in the COMMAND VTE Registry. We are indebted to the independent clinical research organization (Research Institute for Production Development, Kyoto, Japan) for technical support.
Funding
This research was supported by the independent clinical research organization (Research Institute for Production Development, Kyoto, Japan) and research funding from Mitsubishi Tanabe Pharma Corporation. The research funding had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.
Author information
Authors and Affiliations
Contributions
Y.Y. contributed to the design of the study, the analysis and interpretation of data, and drafted the manuscript. T.M. and T.K. contributed to the design of the study, and interpretation of data, and drafted the manuscript. All other authors contributed to acquisition and interpretation of data, and reviewed the manuscript.
Corresponding authors
Ethics declarations
Competing interests
Dr. Yamashita received lecture fees from Daiichi-Sankyo, Bristol-Myers Squibb, Pfizer, and Bayer Healthcare. Dr Morimoto reports lecturer's fees from Bristol-Myers Squibb, Daiichi Sankyo, Japan Lifeline, Kowa, Kyocera, Novartis, and Toray; manuscript fees from Bristol-Myers Squibb and Kowa; advisory board for Sanofi. Dr. Akao received lecture fees from Pfizer, Bristol-Myers Squibb, Boehringer Ingelheim, Bayer Healthcare and Daiichi-Sankyo. Dr. Nishimoto received lecture fees from Daiichi-Sankyo, Bristol-Myers Squibb, Pfizer, and Bayer Healthcare. All other authors have reported that they have no relationships relevant to the contents of this paper to disclose.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Yamashita, Y., Morimoto, T., Kadota, K. et al. Clinical characteristics, management strategies and outcomes of patients with recurrent venous thromboembolism in the real world. Sci Rep 12, 22437 (2022). https://doi.org/10.1038/s41598-022-26947-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-26947-9
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.