Image-guided prostate interventions often require the registration of preoperative magnetic resonance (MR) images to real-time transrectal ultrasound (TRUS) images to provide high-quality guidance. One of the main challenges for registering MR images to TRUS images is how to estimate the TRUS-probe-induced prostate deformation that occurs during TRUS imaging. The combined statistical and biomechanical modeling approach shows promise for the adequate estimation of prostate deformation. However, the right setting of the biomechanical parameters is very crucial for realistic deformation modeling. We propose a patient-specific deformation model equipped with personalized biomechanical parameters obtained from shear wave elastography to reliably predict the prostate deformation during image-guided interventions. Using data acquired from a prostate phantom and twelve patients with suspected prostate cancer, we compared the prostate deformation model with and without patient-specific biomechanical parameters in terms of deformation estimation accuracy. The results show that the patient-specific deformation model possesses favorable model ability, and outperforms the model without patient-specific biomechanical parameters. The employment of the patient-specific biomechanical parameters obtained from elastography for deformation modeling shows promise for providing more precise deformation estimation in applications that use computer-assisted image-guided intervention systems.
Prostate cancer is the most common noncutaneous cancer and the second leading cause of cancer death in men1. Currently, the routine clinical modality for imaging the prostate, especially for image-guided prostate biopsy and treatments, is transrectal ultrasound (TRUS) because it is safe, portable, and inexpensive. However, some challenges still face surgeons when performing TRUS-guided prostate interventions. One of them is how to locate the targets accurately, given the poorly distinguishing capability of tumors using TRUS imaging. In practice, we can solve this problem either by accurately predicting the prostate deformation and precisely practicing the intervention in a simulation before the interventions or by fusing preoperative magnetic resonance (MR) images with the TRUS images to increase the accuracy of the interventions. Both of these computer-assisted solutions need an accurate model to estimate the prostate deformation so that the surgeons can easily track the targets and perform the operation. However, developing such a deformation model is difficult. Deformations of the prostate are inevitable and various during TRUS imaging because of the insertion of TRUS probe (see Fig. 1), such diverse deformations that occur in TRUS images are difficult to compensate when performing the MR-TRUS registration. On the other hand, each patient’s prostate tissue has specific biomechanical properties, especially when there are pathological changes within the prostate. Furthermore, different regions of the prostate gland may have different biomechanical properties2, making the deformation of this inhomogeneous gland difficult to estimate.
In the last decade, prostate deformation modeling has been investigated as a solution for image-guided prostate interventions. Two main methodological categories have been studied: biomechanical modeling and statistical modeling. Because it is easy to implement, the mass-spring model (MSM) initially came to dominate the biomechanical models3,4. However, MSMs are usually not consistent with the governing equations of biomechanical systems and thus could not produce reliable results for deformation estimation. The other stream of biomechanical models uses finite element (FE) methods. Bharatha et al.5 employed a linear elastic materials model to estimate the deformation between pre- and intraoperative prostate images. However, linear models cannot adequately model large deformations of the prostate6. When non-linear models are applied, the time performance of FE methods is usually not satisfactory for intraoperative guidance7. In addition, acquiring patient-specific biomechanical parameters to ensure the accuracy of FE models is difficult.
On the other hand, statistical modeling methods have been proposed for predicting the deformation by analyzing a set of training data and generating a statistical model, which can be applied in real-time applications. Dam et al.8 trained the prostate shape model from real patient data. However, collecting training data from a large number of patients is very difficult. Later, Hu et al.9 proposed an FE-based statistical motion model (SMM) to predict prostate deformation. Unfortunately, the biomechanical parameters that were used to generate the deformation instances were randomly sampled within a specific range. This limitation may reduce the robustness of this method, especially because pathological changes may cause the biomechanical parameters to be outside the predetermined range.
Nevertheless, combining a statistical model with a biomechanical model with patient-specific parameters shows promise for achieving an adequate model of prostate deformation. Because collecting a sufficient number of representatives of the population as training data is essential for building an effective statistical model but collecting a large number of patient data is often difficult in clinical practice, biomechanical modeling shows promise as a way to generate sufficient data for statistical analysis. On the other hand, to achieve a physically appropriate biomechanical model, determining the biomechanical parameters of prostate tissue is important10. However, the tissue properties of prostate vary from one person to another, and even appear quite distinctive in the different prostate zones of the same subject. Traditional methods either employ a specific value obtained from certain reports of biomechanical experiments or else apply randomly sampled values within a wide range to build the biomechanical model. Unfortunately, neither scheme is sufficient to build an accurate model for a patient-specific system. The former is obviously not patient-specific, and the latter is not sufficiently robust, especially when there are pathological changes in the prostate. In recent years, shear wave elastography (SWE)2 has emerged as an important and widely available imaging modality for lesion detection through tissue elastic variations, and shown to be a valuable complementary tool to the conventional TRUS and MR for prostate diagnosis. Unlike conventional elastography methods, which measure relative stiffness, SWE computes the quantitative shear modulus via the shear wave propagation velocity through the tissues. Furthermore, compared with traditional elastography techniques, SWE is able to measure the quantitative shear modulus with high intra- and inter-observer reproducibility, and thus is less operator-dependent. Therefore, we employed SWE to measure the in vivo biomechanical parameters of the prostate and assigned them to an FE model to form a patient-specific deformation model.
The main contribution of this research is to investigate the impact of employing patient-specific biomechanical parameters obtained from SWE data for prostate deformation modeling, by comparing the performance of deformation model constructed with and without patient-specific biomechanical parameters. We further implemented a non-linear elastic material model to describe the non-linear stress-strain behavior of the prostate when undergoing TRUS-probe-induced deformations. Details are described in the method section. The experimental results show that the patient-specific deformation model outperforms the model without patient-specific biomechanical parameters in terms of deformation estimation accuracy.
Impact of biomechanical parameter setting on deformation modeling
The 2D prostate phantom images with and without probe induced deformation are shown in Fig. 2. The Young’s modulus of the phantom prostate gland is 28 kPa obtained with SWE. The hypoechoic region inside the prostate is a synthetic lesion with Young’s modulus of 17 kPa. By adopting these biomechanical values, together with the calculated probe insertion information, the deformation of prostate was modeled and illustrated in Fig. 2(c). The prostate gland, as well as the inner lesion region, were deformed more realistically and similarly toward the realistic deformation, whereas the modeling deficiency with improper tissue parameter (100 kPa) can be found in Fig. 2(d). On the other hand, Fig. 3 shows the Hausdorff distance values between various modeled deformations via different Young’s moduli and the realistic deformation. As shown in Fig. 3, the most accurate deformation modeling can be achieved with the parameters measured from the SWE. Furthermore, it can be observed that when the Young’s modulus was progressively deviated away from the patient-specific value, the modeled deformation also gradually derailed from the realistic deformation. It can be found in the Figs 2 and 3 that the use of the phantom-specific parameter measured from SWE attains the best modeling result that is closest to the real case.
Impact of patient-specific deformation model on MR-TRUS registration
To illustrate the effect of biomechanical parameter setting on the deformation estimation, we systematically perturbed the biomechanical parameters of inner and outer prostate with positive and negative offsets from the SWE measures for the model-guided MR-TRUS registration on all the patient data. For the perturbing of outer prostate, the parameter of inner prostate was fixed as SWE the measurement, whereas the outer prostate parameter was similarly unchanged while perturbing the parameter of inner prostate.
Figure 4 visualizes one target TRUS slice, MR slice and the corresponding registered MR slice obtained using the patient-specific deformation model. The detailed relations between the parameter settings on inner and outer prostate and resulted registration performances of each patient are listed in Tables 1 and 2. Specifically, the mean and standard deviation of TRE values are reported. Table 3 further summarizes the registration performances with respect to the changes of inner and outer tissue parameters, and demonstrates the statistical significance (p-values of two-tailed student tests) between the registration results of using changed tissue parameter and unchanged SWE measurement.
It can be observed from Tables 1 and 2 that the employment of the SWE measures of the inner and outer prostate can averagely yield satisfactory deformation estimation accuracy. It can also be observed from Table 3 that for the setting of biomechanical parameters, the performance differences of target registration will be statistically significant if the defined parameter is averagely deviated beyond 15 kPa from the SWE measurement.
We proposed a deformation model for estimating patient-specific prostate deformation during image-guided interventions. We employed shear wave elastography to obtain the patient-specific biomechanical parameters. Coupled with a non-linear elastic material model, these biomechanical parameters are beneficial for generating a realistic deformation model for practical applications. The experimental results demonstrated the superior performance of our proposed deformation model over the traditional model without patient-specific biomechanical parameters in terms of deformation estimation accuracy.
Precise measurements of tissue properties have been shown to be crucial for a realistic biomechanical modeling7,10. To demonstrate the necessity of adopting patient-specific parameters for the accurate deformation modeling, we conducted twofold experiments. First, a prostate phantom-based validation experiment was conducted. The different deformation results in Fig. 2 demonstrate the importance of setting precise biomechanical parameters for deformation modeling. Furthermore, it can be observed from Fig. 3 that the most accurate deformation modeling can be attained with the patient-specific parameters, whereas deficient deformation results happened when modeling with improper biomechanical parameters. Second, we conducted model-guided MR-TRUS registrations to compare the deformation model with and without patient-specific biomechanical parameters in terms of deformation estimation accuracy. The comparison results in Tables 1 and 2 demonstrate that the patient-specific deformation model with SWE measurement is able to provide the most accurate deformation estimation for MR-TRUS registration. Table 3 further demonstrates the performance differences of the MR-TRUS registration can be statistically significant if the biomechanical setting is deviated beyond 15 kPa from the patient-specific value. Figure 5 displays the Young’s modulus for the inner and outer prostate glands of 10 healthy men and 12 patients and shows that the biomechanical parameters vary greatly between the two different prostate regions, as well as between different subjects. This further indicates the importance and necessity of employing patient-specific biomechanical parameters in deformation estimations.
Although the deformation model we developed in this study was primarily designed for the purpose of estimating prostate deformation, it is a general modeling method that makes use of SWE data and has the potential for being applied in other clinical applications for the following reasons. First, shear wave elastography is widely utilized in clinical diagnosis and has become a valuable method for imaging the prostate, liver, thyroid, breast, etc., complementing conventional ultrasound and MR11. Second, combined biomechanical and statistical modeling methods have already been used for estimating the deformation of breast12 and liver13. However, these methods often used the same biomechanical properties for different patients, a practice which may lead to an inaccurate deformation estimation due to large individual differences. Therefore, since in vivo personalized biomechanical parameters can be acquired by readily accessible SWE, our patient-specific deformation modeling method should be easily adapted for these clinical applications to improve their accuracy of deformation estimation.
Experiments were carried out on the datasets obtained from a prostate phantom and twelve patients with suspected prostate cancer at the First Affiliated Hospital of Sun Yat-Sen University. The study protocol was reviewed and approved by the Ethics Committee of Sun Yat-Sen University and informed consent was obtained from all patients. The methods were carried out in accordance with the approved guidelines. A set of MR, TRUS, and SWE data were acquired from each patient. The MR images were applied to construct the geometric model of the prostate; the SWE data were employed to obtain the patient-specific biomechanical parameters; the TRUS images that showed the deformed prostate were used to evaluate the deformation estimation performance of the proposed deformation model through the MR-TRUS registration. The T2-weighted MR images were acquired using a 3.0 Tesla Siemens TrioTim MR-scanner (Erlangen, Germany) with a 32 channels body coil. The MR voxel size was 0.625 × 0.625 × 3.6 mm3 in x-, y- and z-direction. The 3D TRUS images were obtained by a Mindray DC-8 ultrasound system (Shenzhen, China) with an integrated 3D TRUS probe. The TRUS voxel size was 0.5 × 0.5 × 0.5 mm3 in x-, y- and z-direction. The shear wave elastography images were acquired using a Supersonic Aixplorer (Aix-en-Provence, France) ultrasound system. The Supersonic Aixplorer provides the Q-Box tool which can calculate the average Young’s modulus within an operator selected region. The average Young’s moduli of inner and outer prostate were obtained separately by sampling several Q-Boxes within the corresponding glands. To ensure the accuracy, the Q-Boxes were selected by experienced doctors.
Patient-specific biomechanical modeling
Our modeling framework consisted of two steps (see Fig. 6). We first constructed a patient-specific biomechanical model based on anatomical meshes derived from MR images and biomechanical parameters acquired from ultrasound elastography. Then, we used principal component analysis (PCA) to generate a statistical deformation model from a set of patient-specific biomechanical models with randomly sampled boundary conditions.
When undergoing image-guided interventions, the prostate often deforms, primarily due to the insertion of the TRUS probe. Previous mass-spring and finite element methods modeled using linear elastic models have not been able to simulate such large deformations. In our implementation, we assumed that the involved tissues are elastic/hyperelastic isochoric materials and employed a neo-Hookean model to formulate the biomechanical behaviors of the prostate. Many studies have applied this model to predict the non-linear stress-strain behaviors of materials undergoing large deformations14. We briefly introduce this model and its key parameters here; readers can refer to14 for more details. In the neo-Hookean model, the strain energy density Ws is formulated as:
where is the isochoric-elastic right Cauchy-Green deformation tensor, is the first invariant of and is equal to the trace of , Jel is the elastic volume ratio, G is the shear modulus and K is the bulk modulus. The and Jel can be calculated from the elastic deformation tensor Fel:
where Cel = FelTFel, is the elastic right Cauchy-Green deformation tensor and (u is the displacement vector and I is the unit matrix). On the other hand, with the strain energy density Ws, the second Piola-Kirchhoff stress can be calculated as:
Finally, the displacement u can be figured out from the S via Ws. Combining equations (1, 2, 3, 4), it is clearly that the specific deformation of the prostate can be calculated given the patient-specific biomechanical parameters (G and K) and the boundary conditions (prostate geometry and external forces). Details of the implementation follow.
Assigning an accurate shear modulus G and bulk modulus K to the solver is essential. These two moduli are material-dependent and can be calculated by Young’s modulus E and Poisson’s ratio ν:
For the Poisson’s ratio ν, we assume that the prostate is nearly incompressible and simply set it to be a constant 0.49515. However, acquiring an accurate Young’s modulus E for a specific patient can be challenging, especially because different regions of the prostate have different biomechanical characteristics. In addition, these properties vary from patient to patient2. In this research we employed quantitative shear wave elastography (SWE)16 to obtain a patient-specific Young’s modulus of the prostate. Figure 7 shows the prostate shear wave elastography images from two patients. The stiffness of the inner and outer glands is obviously different, but within either the inner or outer gland, the change in stiffness is quite small. In addition, the stiffness of the prostate varied greatly from patient to patient. These observations are consistent with a previous study on the biomechanical properties of the prostate2. We obtained the Young’s modulus for the inner and outer glands of each patient from the acquired SWE data by averaging the Young’s modulus values within the inner gland and within the outer gland. Finally, the shear modulus G and bulk modulus K were calculated and assigned to the neo-Hookean model.
To obtain the information for the geometric model, we segmented the prostate and bladder gland using data from MR images via an interactive segmentation software: SmartPaint17. In clinical practice, the prostate is usually divided into two parts: the inner gland and the outer gland, which have obviously different biomechanical properties. For this reason, in order to model the biomechanical behaviors of the prostate more accurately, an experienced physician further segmented and refined the outer and inner gland regions. The refined segmentation results were converted into triangulated surface meshes using an adaptive skeleton climbing method18, which can overcome the gap-filling problem in traditional marching cubes algorithms. Then the noise on the surface meshes was removed by employing a recently developed coarse-to-fine normal filtering scheme19. Thus, patient-specific geometric models with accurate anatomic features and relationships were generated.
The boundary conditions define the external forces and restrictions exerted on the prostate during TRUS-guided interventions. The insertion of the TRUS probe is the main cause of prostate deformation. To realistically model the interactions between the TRUS probe and the prostate, the front end of the TRUS probe was reconstructed based on its physical shape. Then the prostate and 3D TRUS probe models were set as mechanical contact pairs in our implementation. Other boundary conditions, such as the patient’s position and the pelvic bone surface, have little influence on the deformation of the prostate20. Therefore, we did not consider these boundary conditions in our implementation.
We employed COMSOL, an FE analysis software, to calculate the deformation of the prostate. We input the governing equations and the material-dependent parameters to the non-linear FE solver embedded in COMSOL. In our implementation environment, each deformation modeling took about 15 seconds to calculate the mesh displacement.
Combined statistical and biomechanical modeling
Although the anatomic geometry and biomechanical parameters are patient-specific for deformation modeling, the conditions of the TRUS probe insertion are very difficult to measure in vivo. To this end, we further employed the statistical modeling method to analyze the deformations under different probe insertion situations. To collect data that was representative of the population for statistical modeling, we conducted Q (Q = 100 is an empirical value in our implementation) biomechanical modelings for each patient using the same anatomic model and biomechanical parameters, but different settings for the probe insertion conditions. Through such personalized biomechanical modeling, each modeled result was able to efficiently represent the patient-specific prostate deformation induced by a particular insertion of the TRUS probe. Afterwards, the patient-specific deformation model for each patient was calculated by statistically analyzing the Q modeled deformation instances using PCA method.
Validation of the impact of patient-specific biomechanical parameter setting on deformation modeling
Two experiments were conducted to validate the impact of patient-specific biomechanical parameter setting on deformation modeling.
Impact of biomechanical parameter setting on deformation modeling
To analyze the effect of the biomechanical parameter setting on the accuracy of deformation modeling, a validation experiment was first carried on one prostate phantom Model 053-AEF (CIRS, Norfolk, USA). Two specific TRUS image sets were acquired for the quantitative analysis on the efficacy of using patient-specific biomechanical parameters. First, one TRUS prostate image set, denoted as P1, without probe-induced deformation was obtained and manually segmented as the basis for the parameterized deformation modeling. The other TRUS image set (P2) was acquired with the in-plane deformation caused by the probe insertion. The position of the TRUS probe was recorded by the electromagnetic tracking sensor attached to the probe, thus the probe movement information can be accurately calculated. Our objective is to illustrate that whether the deformation modeling result on P1 by adopting patient-specific biomechanical parameters is similar to the realistic prostate deformation on P2. To quantitatively demonstrate the influence of the biomechanical parameter setting for deformation modeling, eight uniformly sampled elasticity values from a specific range ([9, 230] kPa) of tissue parameter as recommended in Hu’s work9 were used to generate the respective deformation results. Meanwhile, the deformation modeling with the biomechanical parameter measured with SWE was also performed. We further compared the realistic deformation (P2) and the modeling results with the Hausdorff distance that can quantitatively illustrate the differences between the modeled and realistic phantom boundaries.
Application to MR-TRUS registration for prostate interventions
We employed the patient-specific deformation model to perform model-guided MR-TRUS registration21 on twelve patients, which is of high interest in image-guided intervention systems, to evaluate its ability to estimate the deformation. Given the manually segmented TRUS and MR prostate surface point sets, we integrated the patient-specific deformation model into a robust point matching (RPM) framework22 to register MR surface with TRUS surface in order to realize the volumetric prostate deformation. The registration algorithm proceeds by (1) establishing correspondence between MR and TRUS surface point sets using RPM, and (2) by estimating the deformation required to register the corresponding surface points using proposed deformation model. Processes (1) and (2) are embedded within an annealing scheme to dually update for registering MR surface with TRUS surface. The dual process is ended until certain Temperature is reached. Finally, based on the registered surfaces, the MR images can be warped to the TRUS images.
The target registration error (TRE)23, defined as the Euclidean distance between corresponding, manually-identified intrinsic landmarks in MR and TRUS images, was measured to evaluate the accuracy of the model-based registration. All the landmarks used for the TRE calculation were manually extracted by a urological physician with extensive experience in interpreting MR and TRUS prostate images. The locations of centers that corresponded to small nodules, cysts, and calcifications inside the prostate were selected as landmarks in both the MR and TRUS images. For each patient, 4–6 pairs of corresponding landmarks were manually extracted. And totally 61 pairs of landmarks were extracted from twelve patients for the TRE calculation.
How to cite this article: Wang, Y. et al. Patient-specific Deformation Modelling via Elastography: Application to Image-guided Prostate Interventions. Sci. Rep. 6, 27386; doi: 10.1038/srep27386 (2016).
The work described in this paper was supported in part by a grant from the Research Grants Council of Hong Kong (CUHK 14202514), in part by a grant from the Shenzhen-Hong Kong Innovation Circle Funding Program (No. SGLH20131010151755080 and GHP/002/13SZ), in part by a grant from Ministry of Science and Technology of the People’s Republic of China under the Singapore-China 9th Joint Research Programme (Project No. 2013DFG12900), in part by a grant from the Shenzhen-Hong Kong Innovation Circle Funding Program (No. JSE201109150013A), and in part by a grant from the National Natural Science Foundation of China (No. 61571304).