Association Between Radiomics Signature and Disease-Free Survival in Conventional Papillary Thyroid Carcinoma

Patients with papillary thyroid carcinoma (PTC) would benefit from risk stratification tools that can aid in planning personalized treatment and follow-up. The aim of this study was to develop a conventional ultrasound (US)-based radiomics signature to estimate disease-free survival (DFS) in patients with conventional PTC. Imaging features were extracted from the pretreatment US images of 768 patients with conventional PTC who were treated between January 2004 and February 2006. The median follow-up period was 117.3 months, with 85 (11.1%) events. A radiomics signature (Rad-score) was generated by using the least absolute shrinkage and selection operator (LASSO) method in Cox regression. The Rad-score was significantly associated with DFS (hazard ratio [HR], 3.087; P < 0.001), independent of clinicopathologic risk factors. A radiomics model which incorporated the Rad-score demonstrated better performance in the estimation of DFS (C-index: 0.777; 95% confidence interval [CI]: 0.735, 0.829) than the clinicopathologic model (C-index: 0.721; 95% CI: 0.675, 0.780). In conclusion, radiomics features from pretreatment US may be potential imaging biomarkers for risk stratification in patients with conventional PTC.


Assessment of the Incremental Value of the Radiomics Signature in DFS prediction.
The clinicopathologic model for predicting disease-free survival yielded a C-index of 0.721 (95% CI: 0.675, 0.780). We created a radiomics model that integrated the radiomics signature with all clinicopathologic data, and found that adding the radiomics signature to the clinicopathologic model yielded an improvement of 0.056 (95% CI: 0.023, 0.096) in the C-index, showing improved classification accuracy for disease-free survival (Table 3).

Discussion
In the current study, we evaluated the ability of multi-feature-based radiomics to help estimate disease-free survival in patients with conventional PTC. To our knowledge, this is the first study to apply radiomics in the estimation of prognosis in patients with PTC. The radiomics signature was identified as an independent prognostic factor, and added incremental value to other clinico-pathologic risk factors when estimating individualized disease-free survival. Our study demonstrates the potential of applying a radiomics approach to conventional PTC.
As PTC is generally associated with an excellent long-term mortality, setting disease-free survival from recurrence or persistent disease as the focus endpoint for risk stratification, rather than mortality, would benefit more patients by potentially aiding in individualized treatment and management. In efforts to achieve such risk-stratification, previous researchers have focused on identifying clinico-pathologic risk factors associated with recurrent or persistent disease [19][20][21][22] . Yet, these studies generally included various histologic subtypes and used conventional risk factors which are only obtainable after treatment is completed. In our study, we found that the radiomics signature, which is obtained from preoperative images, was independently associated with disease-free survival (HR = 3.087) and could provide more prognostic information prior to the initiation of treatment. Although radiomics has shown potential in other cancers, research in thyroid cancer has been relatively limited. Previous studies on radiomics in thyroid disease have mostly focused on differentiating benign and malignant nodules or detecting lymph node metastasis by using relatively simple histogram and texture analysis techniques 14  were reduced to 40 potential predictors through the LASSO cox regression model, which is known as a useful method for feature selection in high-dimensional data 13,24 . Whereas previous staging systems and nomograms, including the American Joint Committee on Cancer (AJC) tumor node metastasis (TNM) staging system, have shown excellent discriminatory ability for mortality prediction with AUC values of 0.89-0.98, the AUC values of nomograms for recurrence prediction in thyroid cancer have been slightly lower, ranging from 0.72-0.76 19,[25][26][27][28][29] . In our study, the radiomics signature that combined multiple individual imaging features significantly improved the predictive accuracy of the clinicopathologic model, yielding a C-index of 0.777 (95% CI: 0.735, 0.829). Our study suggests that combining radomics data with other clinicopathologic risk factors may increase the power of decision support models, and aid in achieving personalized estimation of disease-free survival in PTC.
There are some limitations to this study, such as the retrospective nature of its data collection and the relatively small sample size. Another limitation is the lack of external validation and a separate validation data set. Therefore, further studies are needed to overcome these limitations and to validate our results for better generalization. Although the prospective cohort study design would be the preferred study design of such research, the long wait required to analyze survival outcome in PTC, due to its generally excellent prognosis, makes such research daunting to perform. In addition, the small number of events makes it difficult to yield reliable results with smaller data sets. Although we were unable to perform such an independent validation, to our knowledge, this is the first study to apply multi-feature-based radiomics in the estimation of prognosis in patients with PTC.
Our results indicate that radiomics has the potential to be a tool for risk stratification, but further validation is needed.
In conclusion, our preliminary study shows that the identified radiomics signature has the potential to be used as a biomarker for risk stratification in patients with conventional PTC. The radiomics model, which incorporated the radiomics signature with clinicopathologic data, showed a significant improvement in discrimination performance for evaluating disease-free survival. Although promising, these are preliminary results and further validation is required on a larger and independent data set before clinical application. After validation, the radiomics signature may serve as a potential tool to guide individualized management for patients with PTC, of whom the majority will have excellent prognosis.

patients.
The institutional review board of Severance hospital approved this retrospective study and the requirement for informed consent was waived. Our institutional database was reviewed to identify patients with histologically confirmed conventional papillary thyroid carcinoma who underwent preoperative US and thyroid surgery from January 2004 to February 2006. In total, 768 patients were identified (648 women and 120 men; median age, 45 years [range, 17-80 years]; tumor size, 16 mm [range, 2-65 mm]) and comprised our study population. Among the study patients, 299 patients were included in a prior study which compared the diagnostic accuracy of preoperative staging using US imaging and CT 30 , and 469 patients were included in a prior study which investigated whether conventional US features were associated with tumor recurrence in PTC 31 . surgery and Follow-up. Total or near-total thyroidectomy was performed in patients who had multiple tumors, extrathyroidal invasion or lymph node metastasis (LNM) on either preoperative or intraoperative findings. Central compartment neck dissection including the paratracheal, pretracheal, and prelaryngeal lymph nodes is routinely performed at our institution. Bilateral central compartment neck dissection was performed in patients who underwent total or near-total thyroidectomy and ipsilateral central compartment neck dissection was performed in patients who underwent hemithyroidectomy. Lateral compartment neck dissection was performed in selected patients with lateral LNM diagnosed by preoperative US-guided fine-needle aspiration. If suspicious LNs were found during surgery, intraoperative frozen biopsy was performed. In patients confirmed to have lateral LNM, lateral neck compartments including levels 2, 3, 4 and anterior level 5 were dissected.
For postoperative follow-up, clinical examination, neck US, chest radiographs, and measurements of serum thyroid-stimulating hormone (TSH), free T4, thyroglobulin (Tg), and anti-Tg antibody were recommended annually. For patients with suspected recurrence chest computed tomography (CT), magnetic resonance imaging (MRI), whole body bone scan or fluorodeoxyglucose positron emission tomography (PET) was performed at the discretion of the physician.
Clinicopathologic data including age, gender, pathological tumor size, cervical lymph node metastasis (LNM), gross extrathyroidal extension, surgery method (total or near-total thyroidectomy, hemithyroidectomy, and hemithyroidectomy with contralateral subtotal thyroidectomy), and radioiodine ablation dose were collected from medical records. Medical records and imaging studies during postoperative surveillance were reviewed for patient outcome.
No evidence of disease was defined as no biochemical (suppressed thyroglobulin (Tg) < 1 ng/mL, stimulated Tg < 2 ng/mL, with negative anti-Tg antibodies) or structural recurrences (no evidence of disease on US, cross-sectional and/or nuclear imaging) during follow-up 32 . Distant metastasis was defined as the development of thyroid cancer foci at distant organs located in areas other than the neck, which was either confirmed with biopsy or clinically suspected based on various imaging studies. Recurrence/persistence of disease was defined by biochemical, structural or functional evidence of disease that was detected with/without a period of any evidence of disease since initial surgery 32 . Disease-free survival was defined as the time of interval (in months) between initial surgery and occurrence of recurrence/persistence or the date of last clinical follow-up. The radiomics feature extraction methodology is described in Appendix E1 (online). Texture feature extraction was performed by in-house texture analysis algorithms implemented in MATLAB 2016b (The MathWorks, Inc., Natick, Massachusetts, United States). After saving the ROI-segmented US images as JPG images, the images were then converted into grayscale intensity images by eliminating the hue and saturation information while retaining luminance. A total of 730 candidate radomics features, using GLCM and GLRLM texture matrices, single-level discrete 2D wavelet transform and so forth, were generated from a single US image (Fig. 1). Each image was normalized for direct comparison between patients. statistical Analysis. To select radiomics features, we used the least absolute shrinkage and selection operator (LASSO) method in Cox regression to select the most useful prognostic imaging features for disease-free survival. The LASSO method is a penalized technique for variable selection that is suitable for the regression of high-dimensional data 33 .
In the LASSO Cox regression analysis, 10-fold cross-validation was used to avoid overfitting and to estimate errors of partial likelihood deviance, which is a goodness-of-fit statistic in Cox regression. Additionally, the whole process of partitioning and estimating through cross-validation was repeated 100 times. In each validation step, features were selected by using minimum criteria-i.e., optimal tuning parameter of the LASSO that minimized the partial likelihood deviance was selected and we took the average as the final coefficients for each feature 34 . A larger average coefficient indicates a more relevant feature. Repeated cross-validation can reduce variation caused by the randomness of partitioning the sample into 10-folds as well as estimates of prediction error.
A radiomics score (Rad score) was calculated for each patient as a linear combination of selected features that were weighted by their respective coefficients. The number of features chosen to calculate the radiomics score was determined by the mean number of features selected through 100 repeated cross-validation.
To estimate the association between disease-free survival and radiomics features with clinicopathologic factors, univariable and multivariable Cox proportional hazard regressions were performed. Hazard ratios with 95% confidence interval (CI) for each variable were estimated. To evaluate the incremental prognostic value of the radiomics score when added to clinicopathologic factors, Harrell's C-index was calculated and compared using the bootstrap method with 1,000 resampling. The significance of the incremental values of the radiomics score was determined using 95% CI for the difference in C-index.