Abstract
We present a multistage neural network approach for 3D reconstruction of coronary artery trees from uncalibrated 2D Xray angiography images. This method uses several binarized images from different angles to reconstruct a 3D coronary tree without any knowledge of image acquisition parameters. The method consists of a single backbone network and separate stages for vessel centerline and radius reconstruction. The output is an analytical matrix representation of the coronary tree suitable for downstream applications such as hemodynamic modeling of local vessel narrowing (i.e., stenosis). The network was trained using a dataset of synthetic coronary trees from a vessel generator informed by both clinical image data and literature values on coronary anatomy. Our multistage network achieved subpixel accuracy in reconstructing vessel radius (RMSE = 0.16 ± 0.07 mm) and stenosis radius (MAE = 0.27 ± 0.18 mm), the most important feature used to inform diagnostic decisions. The network also led to 52% and 38% reduction in vessel centerline reconstruction errors compared to a singlestage network and projective geometrybased methods, respectively. Our method demonstrated robustness to overcome challenges such as vessel foreshortening or overlap in the input images. This work is an important step towards automated analysis of anatomic and functional disease severity in the coronary arteries.
Similar content being viewed by others
Introduction
The coronary circulation is divided between the right and left coronary trees, each of which supply blood to different regions of the heart muscle^{1}. Coronary Artery Disease (CAD) occurs when atherosclerotic plaque accumulates in the coronary arteries, leading to a local narrowing known as stenosis^{2}. The most common imaging modality used to diagnose CAD is Xray angiography, in which 2D Xray images are acquired as radioopaque dye is injected into the coronaries. This allows the cardiologist to visualize and estimate diameter reduction at regions of stenosis.
Although anatomical assessment of stenosis severity is the most common diagnostic practice, functional metrics which take hemodynamic parameters into account through the use of invasive pressure wires placed in the coronaries, such as fractional flow reserve (FFR) and instantaneous wavefree ratio (iFR), have led to better diagnostic outcomes^{3,4}. In recent years, there have been numerous efforts to derive computational estimates of those metrics or to propose new metrics such as quantitative flow ratio (QFR) that do not rely on invasive pressure wires^{5,6,7,8,9,10}. A key step in generating computational estimates through modeling approaches is defining the coronary tree geometry of the patient. Creating such a 3D model is relatively straightforward when using 3D medical image data such as computed tomography angiography (CTA). However, 2D Xray angiography requires a method to accurately reconstruct the 3D geometry from a series of images.
Many groups have proposed coronary reconstruction algorithms using the principles of projective geometry and stereovision^{11,12,13,14,15,16,17,18,19,20,21,22,23,24,25}. An overview of these methods is given in "Related work". Despite their success, projectionbased methods have several limitations such as their reliance on user input to identify corresponding vessels or features in all the input images. They also either require precise hardware calibration during image acquisition or algorithms to correct the recorded acquisition angles, since recorded angles and distances can have up to a 10% tolerance^{26}. Furthermore, projectionbased methods are susceptible to how clearly visible all coronary branches are in each angiography image. For example, overlapping branches and vessel foreshortening are two challenges which can introduce uncertainty into the reconstructed 3D geometry.
Recently, a few groups have performed 3D reconstruction of coronary trees from Xray angiography images using a combination of machine learning and projective geometry. Bappy et al.^{27} and Jiang et al.^{9} used neural networks to automate coronary segmentation, a key preprocessing step to identify the vessels in the angiography images. They then used projective geometry methods to reconstruct the 3D coronary tree given the segmented angiography images as input. This approach eliminated some drawbacks of previous methods by automating vessel segmentation and point correspondence; however, they are still susceptible to errors in recorded image acquisition angle or reconstruction error due to vessel foreshortening. A fully machine learningbased method has the potential to perform automated reconstruction without the need for imaging calibration. Unlike traditional projectionbased methods, a deep learning method has the potential to perform well even on challenging input images with vessel foreshortening or overlap.
The main contribution of this work is a multistage neural network for 3D reconstruction from 2D segmented Xray angiographic images which outputs an analytical representation of a 3D coronary tree. To our knowledge, this work is the first purely machine learning approach for 3D coronary tree reconstruction using Xray angiography alone. Both Bappy et al.^{27} and Jiang et al.^{9} used machine learning for vessel segmentation; however, both relied on projective geometry for the 3D reconstruction task. Here, we have used a neural network to directly learn the 3D geometry of a coronary tree without relying on projective geometry principles. The major advantage of this method is that it does not require knowledge of precise imaging angles, thereby eliminating the need for calibration or correction algorithms to determine imaging parameters. Another advantage is that the neural network could potentially overcome limitations in the input image such as vessel foreshortening, which can hamper projectionbased reconstruction. The neural network was trained using analytical 3D coronary trees from a synthetic vessel generator. The advantage of such an analytical representation of the geometry is that it makes it easy to perform parametric hemodynamic analyses. A proofofconcept example of such analysis is also included here.
In this work, we demonstrate smaller reconstruction errors compared to a singlestage neural network ("Multistage versus singlestage reconstruction performance") and traditional projectionbased methods ("Multistage centerline reconstruction against a projectionbased method"). Proofofconcept hemodynamic analyses showed that acceptable errors were achieved for the clinical quantities of interest despite modest errors in the 3D geometric reconstruction ("Reconstruction of coronary trees").
Related work
We now present an overview of 3D coronary reconstruction from single or biplane Xray angiography images. Typically, two or three 2D Xray angiography images are acquired from different angles to visualize the coronary arteries. First, the position of the Xray sources and image planes must be located in 3D space using the parameters recorded during image acquisition. Then, the 3D geometry of the vessels can then be recovered using one of two broad classes of methods: centerline projectionbased methods and deformable modelbased methods. A comparison of methods from the last 10 years is given in Table 1. A more indepth review of these coronary reconstruction methods can be found in^{28}.
In the first set of algorithms, epipolar geometry or other constraints are used to identify corresponding vessel centerline points or segments in the 2D angiography images. These points or segments are projected into 3D space to recover the shape of the vessels^{11,12,13,14,15,16,17,18,19,20,21}. Many of these algorithms employ segmentation or Hessianbased filtering of the Xray angiography images as a preprocessing step to identify the 2D vessel centerline points more easily. Meanwhile, the second class of methods projects a template 3D vessel onto the angiographic images and uses an energy function such as generalized gradient vector flow to iteratively deform the 3D template until it aligns with the projected images^{22,23,24,25}. The initial template is often a cylinder representing a single vessel, which is projected onto each of the input images. An energy function is used to deform the 2D projection to match the angiography images, and the forces from the 2D images are projected and applied to the 3D template. This iterative process is repeated for each branch.
More recently, Bappy et al.^{27} developed a method for automatic coronary reconstruction using biplane angiograms acquired 90° apart. First, a multiresolution UNet was used for fast coronary segmentation. Vessel centerlines were extracted and automatically paired using branch endpoints and features, then projected into 3D space. Jiang et al.^{9} used a combination of Xray angiography and IVUS images for their reconstruction method. Their method involved directly extracting vessel centerlines from the angiography images by calculating the first and second derivatives of the image, and using a deep neural network to segment vessel contours from the IVUS images. Centerlines were projected using pointtopoint correspondence to generate the 3D centerline, while IVUS images were realigned and used to accurately reconstruct the vessel lumen. While these methods used neural networks for segmentation, they still relied on projective geometry for 3D reconstruction. We aim to improve upon previous work by using neural networks for the 3D reconstruction task itself. In addition to eliminating the need for image calibration procedures or algorithms, a deep learning method would improve the automation and speed of coronary reconstruction.
Methods
Multistage neural network design
We present a multistage neural network for 3D reconstruction of coronary trees. In order to reconstruct the 3D coronaries from several 2D angiography images, we must first identify the vessel boundaries or centerlines in each input image. Segmentation algorithms^{11,14,15,16,17,20}, wavepropagation^{12}, splinefitting to userdefined control points^{13,24}, or active contour methods^{22,25} are typically used to delineate the vessels or their centerlines. Therefore, the input to our network is two or three segmented angiograms for a given coronary tree, with a Euclidean distance transform applied to create a smooth field that implicitly encodes both vessel centerlines and radii (see Fig. 1). The input images have dimension 512 × 512, which is the typical size of a clinical Xray angiogram image. In this work, segmented or binarized angiograms were directly created by our synthetic data generator, where the 0 pixels correspond to the background and the 1 pixels correspond to the vessels ("Synthetic dataset generation"). For clinical angiograms, we have previously developed a vessel segmentation neural network known as AngioNet^{29} which can convert the desired clinical images into segmented binary angiograms. Since no angle or distance information is provided to the neural network as an input, image calibration or parameter correction algorithms are not required.
The multistage neural network was designed to reconstruct both vessel centerlines (stage 1) and radii (stage 2) for each branch in the coronary tree. We refer to the network as multistage because it has two separate regression heads, or multilayer perceptrons (MLP), to learn the 3D vessel centerline coordinates and radii. This approach is in contrast to a singlestage network with a single regression head to learn both the centerline coordinates and radii. The centerline and radius stages both shared a convolutional neural network backbone to learn relevant features of the coronary tree from the input images. In this work, we chose to use ResNet 101^{30} as the backbone network, however any network that is appropriate for image feature extraction can be substituted. Some examples of other backbone networks are given in "Effect of multistage network backbone". While the convolutional layers of the ResNet backbone can learn imagebased features relevant to the vessel geometry, a multilayer perceptron (MLP) is better suited to solve the regression problems of identifying the 3D coordinates of the vessel centerline and corresponding radii. Therefore, we replaced the final layer of the backbone network with separate MLPs for the centerline and radius stages, as follows.
In the centerline stage, the final fully connected layer of the backbone network was replaced by a multilayer perceptron (MLP) with Rectified Linear Unit (ReLU) activation and batch normalization between layers. The MLP was composed of 4 hidden layers, where the first 3 layers had 1024 neurons and the last layer had 512 neurons. The output of the centerline MLP was a \(M*N*3\) linear layer, containing \(N\) centerline points for each of the \(M\) branches in the binarized angiogram. This output vector was reshaped into a matrix before computing the loss.
Meanwhile, the radius stage replaced the final layer of the backbone with a separate MLP for each branch, for a total of \(M\) MLPs. The radius MLPs were composed of 3 hidden layers with 128 neurons each, with batch normalization and ReLU activation between each hidden layer. The output of each MLP was a vector of radii of dimension \(N\). The MLP for each branch was trained separately to improve the network’s ability to capture sudden reductions in vessel radii at regions of stenosis. Without this step, stenoses are likely to be overlooked since they make up a small portion of the points in the coronary tree.
The outputs of both stages were concatenated to form an \(M\times N\times 4\) matrix, where the last dimension encodes the 3D centerline coordinate and radius for each point as \((x,y,z,r)\). The centerline points and their corresponding radii in the vessel matrix can be used to compute the surface of each tubular vessel, which is visualized in Fig. 1 as the reconstructed 3D vessel geometry.
The radius stage was trained using the mean squared error as the loss function:
where \(y\) is the ground truth and \(\widehat{y}\) is the neural network prediction, and \(n\) is the total number of points in the coronary trees (\(M*N*batch size\)). Conversely, the centerline stage was trained using the same loss function with an additional length regularization term:
where \(\lambda \) is the regularization rate, \({S}_{y}\) is the overall arclength of each ground truth branch, and \({S}_{\widehat{y}}\) is the arclength of each predicted branch, summed over the total number of branches. This vessel length regularization term was included because vessel length is an important determinant of the pressure gradient through a vessel, an important indicator of disease severity. In this work, \(\lambda \) was set to 0.1. In practice, the regularization term should be normalized by the batch size; therefore a \(1/batch\_size\) term is also absorbed into \(\lambda \).
An Adam optimizer with learning rate 5e−4 and weight decay (L2 regularization) was used to train both stages. Batch size was set to 8 and the multistage network was trained for 300 epochs. For the radius MLPs, the backbone was frozen after the initial 300 epochs and each branch MLP was trained for an additional 50 epochs. We did not observe a notable improvement in accuracy when retraining the backbone network for the centerline and radius tasks.
We now present the singlestage counterpart to our multistage network for comparison. The singlestage network architecture was composed of the backbone network and a single MLP which outputs an \(M\times N\times 4\) matrix containing both the centerlines and their radii (Fig. 1). The loss function of the singlestage network was a weighted MSE loss:
Here, \(y\) and \(\widehat{y}\) represent the ground truth and predicted centerline coordinates while \(r\) and \(\widehat{r}\) represent the radii along the centerlines. The regularization parameter \(\mu \) was chosen such that the centerline and radius terms were of the same order of magnitude. The singlestage network was trained using the same hyperparameters as the multistage network to make a fair comparison: Adam optimizer with learning rate 5e4, L2 regularization, and a batch size of 8.
Synthetic dataset generation
To train the proposed multistaged neural network, we require hundreds or thousands of ground truth 3D coronary trees and their corresponding segmented 2D angiograms. In practice, this means that we must identify thousands of patients with both 3D CTA data and 2D Xray angiograms, which is typically not feasible in singlecenter studies such as ours. Another challenge of using clinical image data as input is that the coronaries deform in each frame of an Xray angiography series due to the contraction of the heart. This necessitates temporal registration of frames from multiple angiographic series to create a valid set of input images for 3D coronary tree reconstruction. To produce a large enough dataset and eliminate external sources of error such as temporal registration, we devised a method to produce a sufficiently large training dataset consisting of 5000 static 3D coronary tree geometries and their corresponding sets of 2D projections. While we have used synthetic data to train and validate our 3D reconstruction network, the use of synthetic projection images as input does not preclude future clinical application. A segmentation algorithm or neural network such as AngioNet^{29} could be used to convert clinical angiograms obtained during routine patient care in the future into a suitable input for our network.
This work focuses on 3D reconstruction of the right coronary tree as the large anatomical variation in the left coronary arteries^{31} makes reconstruction more challenging. The method includes two steps: (1) a synthetic 3D coronary tree generator, and (2) a projection algorithm to create sets of segmented angiograms. A brief description of these steps is provided next.
Step 1: Synthetic 3D coronary tree generator: Fig. 2 provides an overview of the coronary tree generator. Each synthetic tree was composed of the four main branches of the right coronary tree, namely the right main coronary artery (RCA), sinoatrial node branch (SA), acute marginal branch (AM), and posteriordescending artery (PDA). The posterolateral ventricular branch (PLV) is implicitly included as part of the RCA, which bifurcates into the PDA and PLV branches. The CTA images used to inform the synthetic data generator were acquired at the University of Michigan hospital. All data were deidentified and collected retrospectively according to ethical guidelines, and the study protocol was approved by University of Michigan IRBMED (HUM00155491).
The steps to produce synthetic vessel centerlines and radii were as follows:

1.
Vessel centerline splines and radii are manually extracted from 3D CTA images using Cardiovascular Modelling and Simulation (CRIMSON)^{32} software.

2.
The range of values for centerline control points and vessel radius (\({r}_{max}\), \({r}_{min}\)) are determined for each branch from the patientspecific data

3.
New centerline points and vessel radii are randomly sampled from the ranges computed in step 1. The centerline spline is interpolated to have \(N\) points \((x,y,z)\), creating an \(N\times 3\) matrix. The radius vector contains \(N\) linearly decreasing radii between \({r}_{max}\) and \({r}_{min}\). Stenoses with 20–90% diameter reduction are randomly introduced in the radius vector.

4.
Sampled centerlines and radii for each of the \(M\) branches are combined to form a single \(M\times N\times 4\) matrix. The centerline points and their corresponding radii can be used to compute and visualize the vessel surface, pictured in Step 3 of Fig. 2.
The resulting coronary trees were augmented with random rotation, shear, and/or warping. This algorithm was refined through repeated iterations with a boardcertified interventional cardiologist to generate realistic trees. Further details of the clinical and mathematical assumptions used to inform synthetic data generation are given in Appendix A. Once the coronary tree geometries are defined by the \(M\times N\times 4\) matrix, the next step is to create synthetic angiograms of each tree.
Step 2: Projection algorithm: Conebeam projections of each coronary tree were generated from 5 views to mimic the Xray angiogram acquisition process. In Fig. 3, a 3D coronary tree surface is shown in blue at the origin. The coronary tree surface points are computed from the \(M\times N\times 4\) matrix of centerline points and radii. We then determine the placement of the Xray sources and their corresponding image planes around the 3D coronary tree. Image acquisition angles were randomly sampled from 20degree windows around commonly used clinical values. A cone beam of rays, marked by gray dotted lines in Fig. 3, are used to project the 3D geometry onto the image planes. Rays that pass through the 3D vessel surface and hit the detector or image plane are marked by a 1 and rays that do not intersect with the 3D model are 0s. This produces the binary 512 × 512 projection images shown in Fig. 3.
Out of the 5 views, 3 were randomly chosen for training. A Euclidean distance transform was applied to the projection images, which were then input into the neural network. The data generated in this fashion were split into 4500 coronary trees and their corresponding projections for training and 500 for validation (90–10 training split). The dataset was thus composed of 5000 total synthetically generated coronary trees, each defined by an \(M\times N\times 4\) matrix containing its centerline points and radii (the ground truth), as well as 3 synthetic angiography images from different angles (the network input).
Results
In this section, we present several methods to evaluate the performance of the proposed method. We first compared the reconstruction error of our multistage network against a singlestage neural network to demonstrate the advantages of the multistage approach. We then performed a headtohead comparison between our neural network reconstruction method and a projectionbased method. Both comparisons were performed on single vessel geometries for simplicity. Next, we examined the performance of the method in reconstructing right coronary trees. Lastly, an analysis of how geometric reconstruction error affects hemodynamics is presented.
Multistage versus singlestage reconstruction performance
A key design feature of our network is its multistage nature, which considers the tasks of centerline and radius reconstruction separately. The importance of this feature is illustrated in this section via a comparison between the single and multistage networks. The performance of both networks was evaluated using 10 distinct RCA synthetic vessels. For each synthetic vessel, stenosis between 20 and 90%, with increments of 5%, were introduced, for a total of 150 unique vessel geometries. Reconstruction error was assessed for each geometry. An example of a vessel geometry with 70% stenosis and its single and multistage reconstructions is shown in Fig. 4A. On average, the root mean squared error (RMSE) of the multistage network centerline was 52% lower than the singlestage centerline RMSE, see Table 2 and Fig. 4B.
As for radius reconstruction accuracy, mean absolute error (MAE) at the stenosis was evaluated instead of RMSE in the whole vessel due to the importance of accurately predicting stenosis severity (Table 2). For both networks, the MAE increased with the stenosis severity (Fig. 4B). However, the singlestage network effectively failed to detect the stenosis for all levels of stenosis (Fig. 4A), resulting in extremely large MAE errors (over 1.5 mm) for severe stenoses with over 80% diameter reduction.
Multistage centerline reconstruction against a projectionbased method
We now compare the performance of our multistage neural network against a projectionbased method in the simplest case of a single vessel centerline reconstruction from 2 projection images. In this example, the projectionbased approach was a combination of the algorithms proposed by Banerjee et al.^{11} and Vukicevic et al.^{12}. Briefly, a point cloud approach^{11} was used to automatically identify up to 10 possible corresponding points for each centerline point in the reference projection image. The set of possible corresponding points was further refined using the reprojection error and ordering constraint cost function proposed in^{12}. Matched points from both images were then backprojected and interpolated with a bspline to create a 3D centerline.
The dataset of synthetic projection images for this comparison was defined as follows. 5 synthetic RCA vessels were first created. We considered a spherical coordinate system \((\theta ,\phi )\), where \(\theta \) and \(\phi \) are the azimuthal and elevation angles, respectively. For a given vessel, the first projection image in every pair was fixed at \(\theta =45^\circ , \phi =0\). The second image was defined using six different intervals \(\Delta \theta \in [15^\circ , 90^\circ ]\), for a total of 30 different pairs of projection images (5 different vessels, 6 different angles between projection images for each vessel), see Fig. 5A. The reconstruction error as a function of the angle between projection images, \(\Delta \theta \), was compared between both methods.
As seen in Fig. 5B, the centerline RMSE and standard deviation was lower in the neural network approach compared to the projectionbased method for all tested angles and vessels: 2.12 ± 0.05 mm and 3.49 ± 0.44 mm, respectively. Figure 5C shows two examples of the same vessel reconstructed using 2 pairs of projection images with different \(\Delta \theta \). The ground truth centerline (blue), neural network centerline (red), and projectionbased centerline (brown) are shown. The neural network centerline followed the average path of the ground truth centerline, although it failed to capture some of the bends along its path (red arrows). Meanwhile, the brown arrows indicate gaps or regions of uncertainty in the centerline reconstructed using projectionbased methods.
Reconstruction of coronary trees
In this section, we measure the accuracy of the proposed method for coronary tree reconstruction, using the validation set of 500 synthetic coronary trees defined in "Synthetic dataset generation". Figure 6 shows several examples of reconstructed coronary tree centerlines (red) and their corresponding ground truth (blue). We observed that the neural network learned the mean centerline path of each vessel in the tree; however, as in the single vessel case, the predicted vessels were not as tortuous as the ground truth centerlines. The RMSE between the ground truth and predicted centerline points in the validation set was 2.57 ± 0.78 mm. The MAE in vessel length was 8.83 ± 4.81 mm. Optimal values for vessel length reconstruction were obtained with a regularization length parameter \(\lambda =0.1\) (see Eq. (2)), which led to a 47% decrease in vessel length error (16.36 ± 2.88 mm) compared to the same network trained without length regularization in the loss function. Larger values of \(\lambda \) resulted in overconstraining the vessel length and inaccurate paths for the different branches, whereas smaller values of \(\lambda \) resulted in weaker enforcement of the vessel length.
We now consider the error in vessel radius along the centerline for all 2000 branches (500 trees with 4 branches each). The RMSE of the vessel radius was 0.16 ± 0.07 mm, which corresponds to subpixel resolution. The error in radius was larger when comparing minimum stenosis diameter (MAE = 0.27 ± 0.18 mm), particularly for severe stenoses greater than 70% diameter reduction, consistent with the behavior reported for single vessel reconstruction in "Multistage versus singlestage reconstruction performance". Figure 7 shows examples of radius reconstruction (red dots) along normalized centerline position of the main RCA (blue) in vessels without stenosis (top panel), two cases of a single stenosis (mid panel), and a case with two stenoses (bottom panel). Panel A demonstrates that the neural network accurately captures the tapering of the vessel along its length. Panel B shows that the neural network accurately predicts the severity and location of the stenosis, although with some oscillations apparent in regions outside the stenosis, or a slight shift in the stenosis location. Lastly, in panel C the neural network approximates serial stenoses as a single, longer stenosis with an error of 0.3 mm in stenosis severity. Some oscillations remain apparent in the region outside the stenosis.
Effect of multistage network backbone
In this work, we chose to use ResNet 101 as the feature extraction backbone network; however, other feature extraction networks can also be used in our multistage network framework. Here, we investigate the performance of using EfficientNet v2^{33}, a smaller backbone network than ResNet 101, and ViT (Vision Transformer)^{34}, a larger network and one that uses attention modules instead of convolutional layers for image feature extraction. Table 3 summarizes the centerline MSE and radius MAE at the stenosis for each backbone.
The three networks produce similar errors on centerline reconstruction and overall radius reconstruction, however ResNet 101 achieves the smallest error on stenosis radius reconstruction. Figure 8 shows several representative examples of coronary centerline and radius reconstruction. All three backbones follow the general path of the vessel centerline but fail to capture the tortuosity of the vessels, similar to the results of "Reconstruction of coronary trees". Furthermore, the examples of radius reconstruction show that Efficientnet v2 has not learned the best image features to reconstruct radius since it predicts the same average waveform for all input images. On the other hand, ViT can accurately determine the position but not the severity of stenoses. ViT also demonstrates a systematic error in estimating the maximum vessel radius. ResNet101 outperforms both EfficientNet v2 and ViT at estimating stenosis severity.
Effect of reconstruction error on hemodynamics
In the previous examples, we established the performance of the multistage neural network to reconstruct centerline and radius of vessels in coronary artery trees. However, as stated in the introduction, functional assessment of vessel disease has recently received significant attention. In this section, we investigate the quality of our proposed multistage neural network from a functional standpoint. Towards that end, we simulate the physics of blood flow and pressure in the reconstructed coronary trees using computational fluid dynamics (CFD) simulations and compare the results against known ground truth CFD data. Specifically, we compare distributions of pressure down the RCA vessel in ground truth coronary trees (known synthetic geometries) and their reconstructions. The pressure field is the basis to calculate wellestablished functional metrics of CAD such as FFR, iFR, and QFR^{4,6,35}.
CFD simulations with consistent inflow and outflow boundary conditions were run using the validated opensource software CRIMSON^{32}. Two examples are discussed: (1) a healthy coronary tree without stenosis, and (2) a diseased tree with one stenosis. Details of simulation parameters (e.g., inflow and outflow boundary conditions, fluid properties such as density and viscosity, etc.) are given in Appendix B. Results are summarized in Fig. 9.
Results for the healthy coronary tree are given in the top panel of Fig. 9. The left column depicts solution maps of pressure calculated via CFD analysis for ground truth and reconstructed geometries. The center and right columns show the radius and pressure, respectively, versus normalized centerline position in the ground truth (blue) and reconstructed (red) geometries. In the top panel, there is no stenosis and the changes in pressure down the RCA are small. The pressure gradients over the ground truth and reconstructed RCA vessels are DP_{GT} = 9.8 mmHg and DP_{R} = 8.4 mmHg, resulting in a difference between pressure gradient estimates of \(\Delta P=\Delta {P}_{GT}\Delta {P}_{R}\) = 1.4 mmHg (or only 1.2% of the ground truth inflow pressure).
In the diseased coronary tree, the pressure gradients over the ground truth and reconstructed RCA vessels are DP_{GT} = 18.8 mmHg and DP_{R} = 14.3 mmHg, resulting in an error of \(\Delta P\)= 4.5 mmHg. Additionally, the pressures in the reconstructed geometry were approximately 10 mmHg lower than the pressures in the ground truth. This is due to the differences in reconstructed radius in the proximal portion of the vessel, as well as the decreased tortuosity (and therefore decreased resistance) of the reconstructed coronary tree compared to the ground truth.
The larger pressure error in the stenosis case compared to the healthy case can be attributed to the radius reconstruction error at the stenosis. Given a vessel with radius \(a\), its resistance \(R\) is inversely proportional to its radius to the power of four (\(R \sim 1/a^{4}\)). Thus, relatively small errors in radius reconstruction have substantial impacts on vessel resistance and therefore pressure drop across the vessel. The ground truth stenotic geometry had serial 51% and 57% stenoses. However, the neural network approximated these 2 stenoses as a single, longer, 53% stenosis, corresponding to a radius error of 0.07 mm (see center column Fig. 8). The ratio of pressures on either side of the stenosis (a surrogate of FFR), was 0.886 in the ground truth and 0.895 in the reconstructed vessel. Therefore, despite the 10 mmHg difference in inlet pressure, there was only a 1% error in the clinical quantity of interest.
Discussion
Reconstructing 3D geometries from sets of 2D image data is a challenging task that often necessitates accurate knowledge of imaging parameters such as angles and distances during image acquisition. Uncertainty of these parameters poses a large challenge for projective geometry approaches to reconstruct the coronaries from Xray angiography images; therefore, we have developed and tested a novel multistage neural network method for 3D coronary reconstruction.
Considerations of neural network design
The most salient feature of the proposed network is its multistage nature, which enables accurate reconstruction of centerline paths and vessel radii. When considering the singlestage approach to reconstructing vessel geometry, we observed that the network was able to accurately capture the trend of linearly decreasing radius along the vessel but could not capture the stenoses ("Multistage versus singlestage reconstruction performance"). This is likely because the stenosis radii make up less than 2% of the \(N\times 4\) vessel matrix; the stenoses had such a small contribution to the loss function that the network did not learn to predict them. In the multistage approach, the stenosis radii had a much larger contribution to the loss function since the mean squared error of the radii was optimized separately from the centerlines. The network was therefore able to learn and accurately reconstruct stenosis severity.
This observation motivated going one step further for the coronary trees and using a separate MLP to learn the radii for each vessel. This was necessary since not all vessel branches contained stenoses; if the network was trained to predict the radii of all branches at the same time, the stenoses would once again make up less than 2% of the \(M\times N\) output matrix. A major challenge of reconstructing stenoses is that, while they are the most important diagnostic feature of the image, they only make up a small proportion of the vessel matrix. The multistage approach described in this work amplifies the impact of the stenoses and thus improves prediction accuracy.
The size of the MLPs for the centerline and radius tasks was determined by testing networks with a varying number of hidden layers and neurons per layer. Networks with 128, 256, 512, 1024, 2048, and 4096 neurons in each of 1–4 hidden layers were evaluated for both centerline and radius accuracy. For the centerline MLPs, the minimum error was achieved when using 4 hidden layers. The number of neurons per layer did not greatly affect mean squared error, which ranged from 2.72 to 2.91 mm in the validation set of 500 synthetic coronary trees. Therefore, a network with 1024 neurons per layer was chosen as it was of the same order of magnitude as the network output size (\(M\)*\(N\)*3).
For the radius MLPs, the lowest error was achieved in networks with 3 hidden layers. Interestingly, although overall mean squared error for the radii was similar for networks with different widths (0.02–0.03 mm), smaller networks performed better at regions of stenosis. The MAE at the stenosis for a network with 128 neurons was 0.27 mm, compared to 0.40 mm and 0.42 mm for networks with 2048 and 4096 neurons, respectively. Thus, we determined that the optimal size for the radius network was 3 hidden layers with 128 neurons each.
Comparison with projectionbased methods of reconstruction
3D reconstruction of coronary trees from 2D Xray angiographic images has been generally performed using projective geometry and stereovision techniques^{11,12,13,14,25}. Despite their success, projectionbased methods have limitations such as the need to identify corresponding features in the input images, and precise information on the image acquisition angles. Overlapping branches and foreshortening are two key challenges leading to uncertainty in the reconstructed geometry using projective geometry methods.
The key contribution of this paper is a neural network for reconstructing 3D coronary trees that aims to overcome the limitations of projective geometry methods. Our network was trained over a wide range of angles between images \(\Delta \theta \) with the purpose of making it robust (and therefore relatively insensitive to this parameter). In "Multistage centerline reconstruction against a projectionbased method", we compared the performance of our multistage neural network against a projectionbased method in a synthetic dataset of pairs of projection images with angles between images \(\Delta \theta \in \left[15^\circ , 90^\circ \right]\). Our network’s RMSE was on average 39% lower than the projection method across all values of \(\Delta \theta ,\) even though the neural network was not trained on images at these specific projection angles. Together with the lower standard deviation, this could indicate that the neural network is more robust to different characteristics of the input images. For instance, different amounts of foreshortening or overlap may occur for a given vessel when projections are taken at different angles. While the projection method reconstructions are less accurate when the input images have high levels of foreshortening or overlap, the neural network could learn universal characteristics of the RCA vessel shape to overcome these challenges and maintain similar accuracy for all input images.
The higher robustness to foreshortening and overlap in the input images of the neural network method is further supported by the qualitative examples in Fig. 5C. The brown arrows, which point to gaps or regions of uncertainty in the projection method centerline, correspond to regions on the input image where the vessel is highly foreshortened or bending at an angle that obscures other parts of the vessel. The neural network interpolates the 3D centerline in these regions, resulting in a continuous path.
The main limitation of the neural network compared to projection methods is that it does not capture all the bends in the vessel centerline path despite accurately following the average path. The lack of tortuosity leads to a shorter reconstructed vessel than the ground truth, despite the length regularization term in the loss function (Eq. 2). This behavior could be a consequence of the network learning the features of a typical 3D RCA shape. While these features ensure that the network can interpolate the 3D centerline even when the input images are challenging, they also may cause the network to predict similar, smooth centerline paths for all inputs. Meanwhile, the projectionbased method can accurately capture the details specific to each centerline path using the features of the input images.
The neural network was trained using a MSE loss, which only accounts for pointwise differences between ground truth and reconstructed centerlines. A loss function that incorporates more global shape information such as curvature in addition to the vessel length regularization could improve the centerline path accuracy.
Reconstruction of coronary trees
When applying the multistage neural network to reconstructing a whole coronary tree, the reconstructions captured the average path of all branches in the tree but underestimated their tortuosity, similar to the behavior observed for singlevessel reconstruction. This appears to correspond to a wellknown curvefitting regression phenomenon: when the network is not large enough to capture the full complexity of a dataset, it tends to predict its average behavior. We hypothesized that increasing the complexity of the neural network by increasing the size of the MLP may alleviate this issue. We tested this hypothesis by performing a scaling study in "Considerations of neural network design" to test the performance of networks with 128–4096 neurons in each of 1–4 hidden layers. From this scaling study, we observed 1% decrease in RMSE between the 4096 × 4 network and 128 × 1 network. Therefore, the computational overhead of increasing the MLP size did not justify the modest decrease in error. As discussed in "Comparison with projectionbased methods of reconstruction", a loss function which incorporates global shape may be a more effective strategy to improve centerline accuracy.
As seen in "Effect of multistage network backbone", changing the backbone of the multistage neural network does little to affect the quality of centerline reconstruction. Since the tested backbone networks were of different sizes and classes (convolutional networks: ResNet and EfficientNet v2, transformer: ViT), this further indicates that changing the loss function or the encoding of the centerline coordinates may be more effective than simply changing the network architecture.
Another challenge of coronary tree reconstruction compared to single vessel reconstruction was to accurately predict stenoses radius. As described in "Considerations of neural network design", employing a multistage approach, and training a separate MLP for each vessel branch enabled the network to learn how to predict stenoses. Despite this, the MAE at the stenosis was higher for coronary trees (0.27 mm) compared to a single vessel (0.12 mm). This may be due to the random projection angles, as overlapping branches may have obscured the stenosis in some of the input images.
While changing the network backbone had little effect on centerline coordinate reconstruction, a much larger effect was observed in stenosis radius reconstruction. In Fig. 8, we observe that EfficientNet v2 is unable to learn the nuances of vessel radius from the image features, and thus predicts the same output for all inputs. Since it was the smallest network tested, we can conclude that the backbone network must be sufficiently large to distinguish details such as stenosis radius from the image features. Although ViT was a larger network than ResNet 101, it also failed to accurately capture stenosis radius. The reason for this may be that the input for a transformer network is downsampled, in this case from a 512 × 512 image to a 385 × 385 image, to reduce the computational complexity of the attention mechanism. The downsampling step may obscure the relevant radius information implicit in the input images. Transformers could still be effective feature extraction networks, perhaps coupled with convolutional layers as a preprocessing step to reduce the dimensions of the input without losing information.
Effect of reconstruction error on hemodynamics
The last application example explored the impact of geometric reconstruction errors on hemodynamic indices such as pressure. The simple test examples demonstrated that gradients of pressure (a surrogate of FFR) compared well between ground truth and reconstructed geometries, even though the neural network centerlines were not as tortuous as the ground truth.
The error in radius had a much larger impact on the pressure drop than the centerline error, particularly errors in stenosis radius. As seen in the stenosis example, the neural network approximated two serial stenoses (51% and 57% radius reduction) as a single stenosis with 53% radius reduction. Despite only a 0.07 mm difference in stenosis radius, there was a noticeable difference in pressure profiles across the stenosis between the 2 geometries. However, the gradients of pressure across the stenosis were relatively similar between the 2 cases (less than 1% difference). We hypothesize that accurately capturing the overall vessel lengths and stenosis radii contributed to the accurate estimation of gradients across the vessels. However, at higher levels of stenosis, even small errors in reconstructed radius can lead to large differences in pressure gradients across the vessels.
Given the high sensitivity of vessel resistance to the reconstructed vessel radius (\(R\sim 1/{a}^{4}\)), it is critically important to accurately determine vessel radius at the stenosis. The main limitation of improving radius estimation is the resolution of the Xray angiography image. In an angiogram, the difference between a 70 and 75% stenosis cannot be distinguished since it is smaller than the pixel resolution, and thus the projections of both levels of stenosis appear identical. It is therefore difficult to differentiate between stenoses at a higher resolution even with a deep neural network. Superresolution algorithms are a potential solution, as they have successfully been used to overcome the limitations of pixel size in magnetic resonance imaging^{36,37,38}.
Future work
Future work will focus on increasing the scope of the dataset to match realworld data more closely. In terms of synthetic data generation, we will expand our tree generator to incorporate further variations in the number and types of branches in the right and left coronary trees. One assumption of our synthetic dataset is that the patient is not moved between image acquisitions; however, in the catheterization lab, it is common practice to move the patient table during image acquisition to follow the flow of injected dye. Since the motion is controlled via a joystick and not often recorded, clinical angiograms are challenging to use as inputs for projectionbased reconstruction methods because they require precise knowledge of image acquisition parameters. Neural networks may therefore provide a robust alternative for 3D reconstruction of coronary trees when those parameters are unknown. We can mimic the clinical workflow in our synthetic data generation by randomly translating the synthetic 3D coronary tree while generating binary angiography images. This would help our method to generalize better to clinical data since we would eliminate the assumption that the patient is not moved between image acquisitions. Radius reconstruction, particularly at the stenosis, can be improved by alternate strategies to encode the 3D coronary geometry and stenoses. Although we found that training a separate MLP to learn the radius along each branch led to better stenosis reconstruction, this strategy may become infeasible in tree structures with many branches. Changing the matrix representation of the coronary tree to emphasize stenoses could lead to better performance using one radius MLP. For example, the vessel radii could be encoded in a vector containing the proximal radius, distal radius, and parametric position and severity of the stenoses for each branch.
As discussed in "Reconstruction of coronary trees", we can improve centerline reconstruction by changing the loss function to incorporate more global characteristics of the vessels such curvature or tortuosity. Although we did not find that changing the backbone of our network led to significant improvements in centerline reconstruction in this work, it is possible that new developments in image feature extraction such as the focal modulation mechanism of FocalNet^{39} could benefit our multistage network as well.
Besides the synthetic projection images considered in this paper, our multistage neural network can be applied to clinical Xray angiograms that have been processed with a segmentation algorithm to create binary input images. Clinical angiograms bring additional challenges, such as the motion of the coronary tree during the cardiac cycle. Care must be taken to identify angiographic frames acquired at the same point in the cardiac cycle to reconstruct a valid 3D coronary tree from clinical images.
In conclusion, in this work we have presented a proofofconcept of a multistage neural network that can be used for 3D reconstruction of coronary trees from sets of uncalibrated Xray angiography images, with subpixel resolution of vessel radius. We have demonstrated that reconstruction error is at an acceptable level to accurately model hemodynamic quantities such as pressure gradients across a vessel.
Code availability
The code for the synthetic coronary generator can be found on GitHub: https://github.com/kritiyer/vessel_tree_generator/.
References
Nichols, W. W., O’Rourke, M. F., Vlachopoulos, C., & McDonald, D. A. McDonald’s Blood Flow in Arteries : Theoretical, Experimental and Clinical Principles. London: Hodder Arnold, 2011. Accessed: Apr. 16, 2019. [Online]. Available: https://www.crcpress.com/McDonaldsBloodFlowinArteriesTheoreticalExperimentalandClinical/VlachopoulosORourkeNichols/p/book/9780340985014
Pijls, N. H., van Son, J. A., Kirkeeide, R. L., De Bruyne, B. & Gould, K. L. Experimental basis of determining maximum coronary, myocardial, and collateral blood flow by pressure measurements for assessing functional stenosis severity before and after percutaneous transluminal coronary angioplasty. Circulation 87(4), 1354–1367. https://doi.org/10.1161/01.CIR.87.4.1354 (1993).
Fearon, W. F. et al. Clinical outcomes and costeffectiveness of fractional flow reserveguided percutaneous coronary intervention in patients with stable coronary artery disease: Threeyear followup of the FAME 2 trial (fractional flow reserve versus angiography for multivessel evaluation). Circulation 137(5), 480–487. https://doi.org/10.1161/CIRCULATIONAHA.117.031907 (2018).
Götberg, M. et al. Instantaneous wavefree ratio versus fractional flow reserve to guide PCI. N. Engl. J. Med. 376(19), 1813–1823. https://doi.org/10.1056/NEJMoa1616540 (2017).
Fearon, W. F. et al. Accuracy of fractional flow reserve derived from coronary angiography. Circulation https://doi.org/10.1161/CIRCULATIONAHA.118.037350 (2019).
Xu, B. et al. Diagnostic accuracy of angiographybased quantitative flow ratio measurements for online assessment of coronary stenosis. J. Am. Coll. Cardiol. 70(25), 3077–3087. https://doi.org/10.1016/j.jacc.2017.10.035 (2017).
Carson, J. M., Roobottom, C., Alcock, R. & Nithiarasu, P. Computational instantaneous wavefree ratio (IFR) for patientspecific coronary artery stenoses using 1D network models. Int. J. Num. Methods Biomed. Eng. 35(11), e3255. https://doi.org/10.1002/cnm.3255 (2019).
Taylor, C. A., Fonte, T. A. & Min, J. K. Computational fluid dynamics applied to cardiac computed tomography for noninvasive quantification of fractional flow reserve: Scientific basis. J. Am. Coll. Cardiol. 61(22), 2233–2241. https://doi.org/10.1016/j.jacc.2012.11.083 (2013).
Jiang, J. et al. Fractional flow reserve for coronary stenosis assessment derived from fusion of intravascular ultrasound and Xray angiography. Quant Imaging Med. Surg. 11(11), 4543–4555. https://doi.org/10.21037/qims201324 (2021).
Li, J. et al. Accuracy of computational pressurefluid dynamics applied to coronary angiography to derive fractional flow reserve: FLASH FFR. Cardiovasc. Res. 116(7), 1349–1356. https://doi.org/10.1093/cvr/cvz289 (2020).
Banerjee, A. et al. Pointcloud method for automated 3D coronary tree reconstruction from multiple nonsimultaneous angiographic projections. IEEE Trans. Med. Imaging 39(4), 1278–1290. https://doi.org/10.1109/TMI.2019.2944092 (2020).
Vukicevic, A. M. et al. Threedimensional reconstruction and NURBSbased structured meshing of coronary arteries from the conventional Xray angiography projection images. Sci. Rep. 8(1), 1. https://doi.org/10.1038/s41598018194409 (2018).
Bourantas, C. V. et al. A method for 3D reconstruction of coronary arteries using biplane angiography and intravascular ultrasound images. Comput. Med. Imaging Graph. 29(8), 597–606. https://doi.org/10.1016/j.compmedimag.2005.07.001 (2005).
Chen, S. J. & Carroll, J. D. 3D Reconstruction of coronary arterial tree to optimize angiographic visualization. IEEE Trans. Med. Imaging 19(4), 318–336. https://doi.org/10.1109/42.848183 (2000).
Blondel, C., Malandain, G., Vaillant, R. & Ayache, N. Reconstruction of coronary arteries from a single rotational Xray projection sequence. IEEE Trans. Med. Imaging 25(5), 653–663. https://doi.org/10.1109/TMI.2006.873224 (2006).
Cardenes, R., Novikov, A., Gunn, J., Hose, R., & Frangi, A. F. 3D reconstruction of coronary arteries from rotational Xray angiography. In 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI), May 2012, 618–621. https://doi.org/10.1109/ISBI.2012.6235624 (2012).
Galassi, F. et al. 3D reconstruction of coronary arteries from 2D angiographic projections using nonuniform rational basis splines (NURBS) for accurate modelling of coronary stenoses. PLoS ONE https://doi.org/10.1371/journal.pone.0190650 (2018).
Hoffmann, K. R. et al. A system for determination of 3D vessel tree centerlines from biplane images. Int. J. Cardiovasc. Imaging 16(5), 315–330. https://doi.org/10.1023/A:1026528209003 (2000).
Jandt, U., Schäfer, D., Grass, M. & Rasche, V. Automatic generation of 3D coronary artery centerlines using rotational Xray angiography. Med. Image Anal. 13(6), 846–858. https://doi.org/10.1016/j.media.2009.07.010 (2009).
Liao, R., Luc, D., Sun, Y. & Kirchberg, K. 3D reconstruction of the coronary artery tree from multiple views of a rotational Xray angiography. Int. J. Cardiovasc. Imaging 26(7), 733–749. https://doi.org/10.1007/s1055400995280 (2010).
Movassaghi, B., Rasche, V., Grass, M., Viergever, M. A. & Niessen, W. J. A quantitative analysis of 3D coronary modeling from two or more projection images. IEEE Trans. Med. Imaging 23(12), 1517–1531. https://doi.org/10.1109/TMI.2004.837340 (2004).
Cong, W. et al. Quantitative analysis of deformable modelbased 3D reconstruction of coronary artery from multiple angiograms. IEEE Trans. Biomed. Eng. 62(8), 2079–2090. https://doi.org/10.1109/TBME.2015.2408633 (2015).
Zheng, S., Meiying, T. & Jian, S. Sequential reconstruction of vessel skeletons from Xray coronary angiographic sequences. Comput. Med. Imaging Graph. 34(5), 333–345. https://doi.org/10.1016/j.compmedimag.2009.12.004 (2010).
Canero, C., Vilarino, F., Mauri, J. & Radeva, P. Predictive (un)distortion model and 3D reconstruction by biplane snakes. IEEE Trans. Med. Imaging 21(9), 1188–1201. https://doi.org/10.1109/TMI.2002.804421 (2002).
Yang, J. et al. External force backprojective composition and globally deformable optimization for 3D coronary artery reconstruction. Phys. Med. Biol. 59(4), 975–1003. https://doi.org/10.1088/00319155/59/4/975 (2014).
Siemens, A. G. Artis Q/Q.zen/zeego system owners manual (2015).
Bappy, D. M., Hong, A., Choi, E., Park, J.O. & Kim, C.S. Automated threedimensional vessel reconstruction based on deep segmentation and biplane angiographic projections. Comput. Med. Imaging Graph. 92, 101956. https://doi.org/10.1016/j.compmedimag.2021.101956 (2021).
Çimen, S., Gooya, A., Grass, M. & Frangi, A. F. Reconstruction of coronary arteries from Xray angiography: A review. Med. Image Anal. 32, 46–68. https://doi.org/10.1016/j.media.2016.02.007 (2016).
Iyer, K. et al. AngioNet: A convolutional neural network for vessel segmentation in Xray angiography. Sci. Rep. 11(1), 1. https://doi.org/10.1038/s41598021973558 (2021).
He, K., Zhang, X., Ren, S., & Sun, J. Deep residual learning for image recognition. Accessed: Apr. 27, 2018. [Online]. Available: http://arxiv.org/abs/1512.03385 (2015).
Cademartiri, F. et al. Prevalence of anatomical variants and coronary anomalies in 543 consecutive patients studied with 64slice CT coronary angiography. Eur. Radiol. 18(4), 781–791. https://doi.org/10.1007/s0033000708219 (2008).
Arthurs, C. J. et al. CRIMSON: An opensource software framework for cardiovascular integrated modelling and simulation. PLOS Comput. Biol. 17(5), e1008881. https://doi.org/10.1371/journal.pcbi.1008881 (2021).
Tan, M., & Le, Q. V. EfficientNetV2: Smaller models and faster training. https://doi.org/10.48550/arXiv.2104.00298 (2021).
Dosovitskiy, A., et al. An image is worth 16 × 16 words: Transformers for image recognition at scale. https://doi.org/10.48550/arXiv.2010.11929 (2021).
Pijls, N. H. et al. Measurement of fractional flow reserve to assess the functional severity of coronaryartery stenoses. N. Engl. J. Med. 334(26), 1703–1708. https://doi.org/10.1056/NEJM199606273342604 (1996).
Ferdian, E., et al. Cerebrovascular superresolution 4D Flow MRI—using deep learning to noninvasively quantify velocity, flow, and relative pressure. bioRxiv, p. 2021.08.25.457611. https://doi.org/10.1101/2021.08.25.457611 (2021).
Chen, Y., Shi, F., Christodoulou, A. G., Xie, Y., Zhou, Z., & Li, D. Efficient and accurate MRI superresolution using a generative adversarial network and 3D multilevel densely connected network. In Frangi, A. F., Schnabel, J. A., Davatzikos, C., AlberolaLópez, C., Fichtinger, G., eds., Medical image computing and computer assisted intervention—MICCAI 2018, Lecture Notes in Computer Science. Cham: Springer International Publishing, pp. 91–99. https://doi.org/10.1007/9783030009281_11 (2018).
Greenspan, H., Oz, G., Kiryati, N. & Peled, S. MRI interslice reconstruction using superresolution. Magn. Reson. Imaging 20(5), 437–446. https://doi.org/10.1016/S0730725X(02)005118 (2002).
Yang, J., Li, C., Dai, X., Yuan, L., & Gao, J. Focal modulation networks. arXiv, Nov. 05. https://doi.org/10.48550/arXiv.2203.11926 (2022).
Acknowledgements
The authors acknowledge the Precision Health at the University of Michigan for providing costfree, member access to GPUs and computing resources on the Armis2 cluster—necessary resources to support the neural network training reported in this publication. Computing resources for hemodynamics simulations were provided by the National Science Foundation [Grant 1531752], Acquisition of Conflux. This work was supported by the National Science Foundation Graduate Research Fellowship Program [DGE1841052] and Rackham Merit Fellowship.
Author information
Authors and Affiliations
Contributions
K.I. was responsible for the data generation code, neural network design and training, and writing the main manuscript. R.R.N. contributed to neural network design and experimental setup, B.K.N. oversaw synthetic data generation, and C.A.F. oversaw computational hemodynamic simulations. All authors reviewed the manuscript text and figures.
Corresponding author
Ethics declarations
Competing interests
CAF and BKN are founders of AngioInsight, Inc, a startup company which uses machine learning and signal processing to assist physicians with angiography interpretation. AngioInsight did not sponsor this work. This work is a part of a patent which has been filed by the University of Michigan, US patent 11,386,563 Anatomical and Functional Assessment of Coronary Artery Disease Using Machine Learning. All other authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Iyer, K., Nallamothu, B.K., Figueroa, C.A. et al. A multistage neural network approach for coronary 3D reconstruction from uncalibrated Xray angiography images. Sci Rep 13, 17603 (2023). https://doi.org/10.1038/s41598023446332
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598023446332
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.