Abstract
The analysis of turbulence in plasmas is fundamental in fusion research. Despite extensive progress in theoretical modeling in the past 15 years, we still lack a complete and consistent understanding of turbulence in magnetic confinement devices, such as tokamaks. Experimental studies are challenging due to the diverse processes that drive the high-speed dynamics of turbulent phenomena. This work presents a novel application of motion tracking to identify and track turbulent filaments in fusion plasmas, called blobs, in a high-frequency video obtained from Gas Puff Imaging diagnostics. We compare four baseline methods (RAFT, Mask R-CNN, GMA, and Flow Walk) trained on synthetic data and then test on synthetic and real-world data obtained from plasmas in the Tokamak à Configuration Variable (TCV). The blob regime identified from an analysis of blob trajectories agrees with state-of-the-art conditional averaging methods for each of the baseline methods employed, giving confidence in the accuracy of these techniques. By making a dataset and benchmark publicly available, we aim to lower the entry barrier to tokamak plasma research, thereby greatly broadening the community of scientists and engineers who might apply their talents to this endeavor.
Similar content being viewed by others
Introduction
Due to the enormous quantity of energy released by the fusion reaction, the virtually inexhaustible fuel supply on earth, and its carbon-free nature, nuclear fusion is a highly desirable energy source with the potential to help reduce the adverse effects of climate change. Fusion research is, therefore, an ongoing worldwide effort1,2.
In order to approach the conditions necessary for sufficient fusion reactivity, the fuel—a mixture of heavy isotopes of hydrogen—must be raised to extremely high temperatures, above 100 million degrees Celsius1,3—for comparison, the core of the sun is roughly 15 million degrees Celsius. Under these conditions, the fuel, like all stars, is in the plasma state and must be isolated from material surfaces. Several confinement schemes have been explored over the past 70 years. Of these, the tokamak device, a scheme first developed in the 1950s, is the best-performing fusion reactor design concept to date . It uses powerful magnetic fields of several to over 10 Tesla to confine the hot plasma—for comparison, this is several times the field strength of magnetic resonance imaging machines (MRIs). The Tokamak à Configuration Variable (TCV)4, sited at EPFL in Lausanne, Switzerland and shown in Fig. 1, is an example of such a device and provides the data presented here.
The research addressed in this paper involves phenomena that occur around the boundary of the magnetically confined plasma within TCV. The boundary is where the magnetic field-line geometry transitions from being “closed” to “open”. The “closed” region is where the field lines do not intersect material surfaces, forming closed flux surfaces. The “open” region is where the field lines ultimately intersect material surfaces, resulting in a rapid loss of the particles and energy that reach those field lines. Around this boundary (called the Last Closed Flux Surface or LCFS) is a region of enhanced turbulent transport across the field lines (“perpendicular” transport). Therefore, the transport occurring here is of great interest because of its role in plasma confinement and dealing with the exhaust heat and particle loads on the intersected material surfaces.
Researchers use a technique called Gas-Puff Imaging (GPI)5 to visualize the phenomena occurring at and around the plasma boundary in both space and time. A small amount of neutral gas is locally injected into the region of interest. The visible-light emissions resulting from the interaction of the plasma with this gas cloud are captured along sight lines that are tangential to the local magnetic field. Analysis of the time sequences of the images produced by this technique is the primary subject of this work. At TCV, the 2D GPI data are collected at frame rates of \(\sim\) 2 MHz, significantly faster than the turbulence timescales of interest. The images represent what is occurring perpendicular to the direction of the local magnetic field lines. This is illustrated schematically in Figure 2 (left), showing cross-sections of plasma flux surfaces and the TCV vacuum vessel. (The center-line of this toroidally symmetric plasma geometry is to the left of the figure.) A \(\sim 50 \times 40\) mm cross-section of plasma, spanning the LCFS at the outer edge of the plasma, is imaged with a \(12 \times 10\) pixel array. The images’ motion from left to right increases the radial coordinate and moves away from the closed flux surfaces. The most prominent features in the image sequences are (1) a bright band of emission that is aligned with the LCFS and (2) the expulsion of features from the LCFS region that are brighter than their surroundings and the subsequent motion of these features. In the literature, these features are commonly called “filaments” (because they are actually extended in the third dimension, along the magnetic field lines) or “blobs” (because of their appearance in cross-section in the images)6. These filaments are strong perturbations (of order 1) in the local plasma conditions, with elevated electron temperature and density7,8. They have typical auto-correlation times of roughly 10 \(\upmu\)s and, therefore, can exist as distinct features for multiple frames, but their shape and intensity can gradually change frame-to-frame. In this work, we are mainly interested in the detection and tracking of these “blob” features.
The primary problem we are addressing in this paper is how to process these image sequences in ways that will ultimately allow estimation of the contributions of this blob transport to the heat and particle fluxes leaving the confined plasma. We are also addressing how to process the images to facilitate continued and more detailed comparisons of the experimental observations with theoretical models of blob dynamics. The theoretical models predict scalings for the relation between blob size and radial velocity depending on key plasma parameters, such as local temperature and collisionality9,10.
This primary problem is essential since the expulsion and transport of these objects represent particle and energy loss from the confined plasma. This has enormous consequences for the interaction of the hot plasma with the plasma-facing material surfaces that are in place to accept the exhaust heat and particles. Parallel heat fluxes of hundreds of MW/m\(^2\) are obtained in the narrow exhaust channels of present-day devices11, and the parallel heat fluxes will be even higher in the near-future net-energy-gain tokamaks like SPARC12 and ITER13. The radially-outward motion of the blobs can broaden this exhaust channel, thereby reducing the peak heat- and particle fluxes, the desired circumstance. However, the same motion can also increase an undesired plasma interaction with the other plasma-facing components. These considerations constitute the highest-level motivations for an accurate assessment of the blobs’ occurrence, size, and motion. Combining knowledge of the occurrence frequency, size, and radial velocity with temperature and density within the blobs allows quantitative estimations of radial particle- and energy fluxes. The additional problem that we are addressing, facilitating closer experimental comparisons with theoretical models of blob transport, is essential for experimental validation tests of these models. These tests of the models (e.g.,14) are made more valuable with accurate determinations of the size, shape, and motion of blobs.
Traditional approaches to blob analysis include a family of conditional averaging methods, custom-made workflows that track high signal regions, and spatio-temporal cross-correlation techniques5,14,15. The conditional averaging methods and the cross-correlation techniques have the limitations of only providing averaged characteristics of blobs. The custom-made workflows are non-standardized and are not benchmarked. The data sets that we are working with typically include \(\sim 10^5\) sequential images, having been recorded over a time-subset shorter than the \(\sim 1\) s plasma pulse on TCV. 30 such plasma discharges can be produced per each working day at TCV; hence this data throughput is too high for human by-eye analysis. Machine learning allows accurate and efficient analysis of turbulence characteristics utilizing these extensive datasets.
This work presents a novel application of four well-known, standardized, and benchmarked tracking methods to track blobs in GPI images. These methods are trained to reproduce identification of blobs by humans as close as possible since human subjectivity isolates blobs from the non-blobs in the GPI images. We evaluate their performance by comparing them to the brightness-threshold contours and human detection/tracking using a limited set of real-data images. In “Methods” we describe the four models: (1) optical flow detection using Recurrent All-pairs Field Transforms (RAFT)16; (2) mask detection using Mask Region-based Convolutional Neural Network (Mask R-CNN)17 in combination with Bayesian optimization18 for tuning the hyperparameters in the training; (3) optical flow detection using Global Motion Aggregation (GMA)19; and (4) optical flow detection using Flow Walk20,21. In Methods we also define the performance metrics and the workflow. The performance comparisons are given in Results, as is a description of the results obtained by human detection, which shows some ambiguity in what constitutes a blob in real experimental data. Finally, the trained models are applied to an active plasma-physics research topic, i.e., finding the regime of the blob dynamics, as described in Myra et al.9,10, and the models’ results are compared with the result from a Conditional Average Sampling (CAS) method that has been used previously for this purpose14. The work is summarized in Conclusions.
Methods
We train our models on synthetic data and test them on synthetic and real data. Synthetic data affords several advantages for training a model. First, our models use optical flow vectors (RAFT, GMA, Flow Walk) or masks (Mask R-CNN) of the blob objects as ground-truth features that humans cannot adequately label. The user has perfect knowledge of and control over these features and noise in the synthetic dataset. By contrast, feature recognition in available real data may be prohibitively costly to process, hard to reproduce, poor quality, and not representative of general phenomenology. Second, synthetic datasets of arbitrary size and complexity can be made more generic than a small, real, vetted dataset, such that a model may be trained to recognize features that do not appear in available real data but might appear more broadly. There are a few edge cases in the real data to be covered in training. Events such as splitting or merging blobs often occur but not often in real data. We further iterate upon the generation of synthetic data by adding, removing, or emphasizing characteristics like these events. Moreover, synthetic data is more efficient in acquisition and storage than real data. Real GPI data is costly to acquire; blob dynamics vary with the plasma condition, and we need to run many experiments to generate a significant variety of blob dynamics in the real world. Also, the algorithm to create the synthetic data is more compact than a large real dataset and is easily adapted to other situations where the effort expended in processing the real dataset cannot be reused. Therefore, by using synthetic data, we can have inexpensive, variable, and unlimited data generation22,23,24.
An essential goal of this contribution is to solicit greater participation in fusion research from the broader machine-learning community. Toward this end, we make our synthetic training dataset and a real dataset available to benchmark performance against other models. We hope this may inspire readers not only to evaluate their model performance against this fusion-relevant task but to seek out and engage more generally to help solve critical problems in the field of fusion energy.
Dataset
Real data
Each experimental GPI video is a length t series of grayscale images with \(12\times 10\) pixels, where t is the number of frames in the video. A snapshot of an experimental GPI video is shown in Fig. 2 (middle), which shows a blob (as a bright spot on the bottom-right), and the Last Closed Flux Surface (LCFS), which is also approximately the position of a shear layer, across which the vertical plasma background flow reverses direction. Before inputting the experimental GPI data into the models, we standardize the amplitude ranges between 0 and 1 and remaps the images to a finer spatial grid. We subtract the mean brightness from the individual pixel brightnesses and divide the result by the standard deviation. It is also clipped by \(\frac{1}{n}\sum _{t=1}^{n} C_{min}\left( t\right)\) and \(\frac{1}{n}\sum _{t=1}^{n} C_{max}\left( t\right)\), where n is the total number of frames, and \(C_{min}\left( t\right)\) and \(C_{max}\left( t\right)\) are the minimum and maximum (standardized) brightnesses of the frame at time t, respectively. In addition, although the GPI sensors output data with \(12\times 10\) pixels per frame, the images become better interpreted by the models when we upsample their resolution, in the present case, to \(256\times 256\) pixels per frame. We use radial basis function (RBF) interpolation with a cubic function. This degree of upsampling allows adequate detail during analysis without being too computationally demanding. We design the models to receive inputs and produce outputs at this resolution.
Synthetic data
We maintain the same upsampling convention as real data by generating synthetic data for training at \(256\times 256\) pixels per frame. We approximate blobs in the synthetic data as ellipses, and a blob’s size and speed at each moment are randomized so that a random process forms the trajectory. Here, the ellipse boundary is chosen to be the full width at half maximum (FWHM) of the brightness since the blob sizes are conventionally estimated as the FWHM of the density perturbation25 which is approximately proportional to the brightness in the GPI data. Besides blobs, we simulate background flows as slowly moving, elongated ellipses. Figure 2 (right) shows a snapshot of such a synthetic video. We also simulate complex instances in the real GPI data for these synthetic data, such as merging and splitting blobs. The brightness of the synthetic data ranges between 0 and 1. We save the mask of blobs and the velocities at pixels in blobs as an optical flow image for every frame. We use these images as labels for training.
Benchmark
Our solution combines optical flow/mask detection with Tracking-by-detection to achieve accurate identification and tracking of the blobs. We provide and compare four baselines for detecting blobs and measuring performance using standard and specialized metrics.
Baselines
RAFT
Recurrent all-pairs field transforms (RAFT)16 computes optical flow by extracting features of pixels and building multiscale 4D correlation volumes for all pairs of pixels. RAFT iteratively updates an optical flow field using a recurrent unit that uses the correlation volumes.
Mask R-CNN with BO
We applied mask region-based convolutional neural network (mask R-CNN)17, which computes segmented masks of the data. Bayesian optimization is used to find the hyperparameter values that minimize the loss of the mask R-CNN during the training. We apply Bayesian optimization18 with two levels of hyperparameters: (1) learning rate, momentum, weight decay, and number of epochs; and (2) data augmentation transformations \(P_{horizontalFlip}\), \(P_{scale}\), \(P_{translate}\), \(P_{shear}\), \(P_{rotate}\), as well as dropout probability \(P_{dropout}\) of each dropout layer in the model. The exploration ranges for each hyperparameter are in the “Supplementary information”. We first optimize the group one hyperparameters and then keep those values fixed while optimizing the second group of hyperparameters.
GMA
We also implemented global motion aggregation (GMA)19 to estimate hidden motions. It finds long-range dependencies between pixels in an image and performs global aggregation of corresponding motion features using a transformer model. GMA is tailored to perform well on occluded regions which is not the case in our application, so this feature is not exploited. Nonetheless, we implemented GMA for comparison.
Flow walk
Flow Walk learns pixel trajectories with multiscale contrastive random walks by computing the transition matrix between frames in a coarse-to-fine manner20,21. Flow Walk works well on detecting pixel-level changes of objects with high spatial frequencies, which is not the feature that appears on our data, as we are tracking smooth blobs. As with GMA, we implemented Flow Walk for comparison.
Tracking-by-detection
After detecting blobs in each frame, temporal coherence between frames is enforced based on a tracking-by-detection workflow (illustrated in the “Supplementary information”) using any of the baselines, which consists of four steps:
-
1.
Object detection from the model. Given the input image sequence, the masks of blobs are predicted for each frame by the model.
-
2.
Feature extraction. We select the objects to be tracked (i.e., blob objects) by discarding predictions with scores below a threshold.
-
3.
Pairwise cost. We exploit the temporal coherence of the images by computing the pairwise cost between the objects in the current and previous frames using the VIoU cost metric.
-
4.
Bipartite matching. Using the cost matrix from the previous step, we assign unique correspondence between objects with the constraint that no object receives more than one assignment. If a new object appears in an isolated frame (i.e., it has no correspondence either in the previous or the next frame), it is ignored and discarded as a noise fluctuation. When a new object appears in the current frame with no correspondence in the previous frame but with a match in the next frame, we start a new track. By keeping track of the active and finished tracks, we assign IDs to the blobs in the video and record their trajectories.
Performance metrics
We use standard and specialized metrics to evaluate performance.
-
Endpoint error (EPE): The standard error measure for evaluating optical flow is defined by \(\frac{1}{n}\sum \Vert \vec {v}_{est}-\vec {v}_{gt}\Vert\), where n is the number of pixels in the image, \(\vec {v}_{est}\) is the estimated flow field and \(\vec {v}_{gt}\) is the proxy ground truth flow field.
-
Volumetric IoU (VIoU): Object detection algorithms usually use intersection over union (IoU) metrics to evaluate the prediction quality. For the prediction/ground-truth pair (e.g., bounding boxes, mask), the IoU is computed as the ratio between the intersection and union areas. While this approach is quite robust when dealing with the mask detection of solid objects with well-defined, sharp boundaries, IoU can mislead our application’s score when the intersection area has a low brightness level, which is intuitively a poor prediction. Note that the boundary definition of blob features within the images is a function of the brightness threshold. Since this threshold may vary from experiment to experiment, in our case, it is more appropriate to describe the blob shape as a volume, with volumetric IoU (VIoU), using the brightness level for the third axis (illustrated in the “Supplementary information”), and defined as:
$$\begin{aligned} VIoU=\frac{\sum _{x,y\in A_{intersection}} B_{x, y}}{\sum _{x,y\in A_{union}} B_{x, y}} \end{aligned}$$(1)
where \(B_{x, y}\) is the brightness at pixel located at \(\left( x, y\right)\), and \(A_{intersection}\) and \(A_{union}\) are, respectively, the set of pixels inside the intersection and union of the predicted/ground-truth blob mask.
Results
We present results in four parts: (1) training results for each model described in Training, (2) testing scores of the trained models on both synthetic and real GPI data shown in Testing and blob tracking, (3) furthermore, the models are evaluated based on human-labeled blobs to demonstrate their validity in Evaluation by human-labeled blobs, (4) the tracking information from each model is used to identify the regime of the blob dynamics in Identification of blob regimes to perform a task that addresses an active plasma-physics research topic.
Training
We train the tracking models using 30 synthetic videos, each with 200 frames. We split the frames into training data (95validation data (5the original implementation with default hyperparameters for RAFT and GMA. For Mask R-CNN, we find hyperparameters by Bayesian optimization (see the “Supplementary information”). For Flow Walk, we implemented the training pipeline from RAFT. The training scores based on the Performance metrics are shown in the “Supplementary information”, where RAFT is the best among the four models.
Testing and blob tracking
We test the models on synthetic and real GPI data and summarize the results in Table 1. For the real GPI data, we only compute VIoU since there are no labels in optical flows. Among the four models, RAFT performs best on real data.
Figure 3 shows an example of blob tracking by RAFT on real experimental data. RAFT takes two images as input: the current and the next frame. It then predicts optical flows for each pixel, as shown in the middle of Fig. 3. The color of each pixel indicates the velocity of the predicted optical flow, corresponding to the color palette shown at the bottom left. In order to identify the mask of the blobs from the map of optical flows, which is not segmented, the algorithm computes a set of contours of different values of the magnitude of optical flows in each frame. We merge contours that overlap within VIoU \(>\alpha\). We find \(\alpha = 0.2\) suitable for our purposes. For each contour, we compute the VIoU using the blue contour in the figure, which is the contour of \(\beta \times B_{max}\), where \(B_{max}\) is the maximum (standardized) brightness inside the red contour. Then the contours which give a VIoU greater than \(\gamma = 0.8\) and \(B_{max}\) greater than \(\beta = 0.7\) are chosen to be tracked. The user sets the hyperparameters \(\alpha\), \(\beta\), and \(\gamma\) based on the GPI data, and we set them as above for the data used in this work. In Fig. 3 (right), the blob ID (Blob 5) is assigned by the Tracking-by-detection. In order to enforce temporal coherence in blob detection, only blobs with a lifetime longer than 15 frames (corresponding to 7.5 micro-seconds in real data) are chosen and drawn in the output video. Unlike the optical flow prediction models, Mask R-CNN outputs segmented masks of objects, and therefore the contour of an object is already obtained (i.e., we do not need to scan the values of contours). The rest of the tracking is the same as above.
Evaluation by human-labeled blobs
For the testing score on real data shown in Table 1, the label (blue contour in Fig. 3 (right)) is dependent on the prediction (red contour). In other words, the label is drawn only for the predicted objects, and the model performance is thus evaluated only for structures detected by our tracking models (i.e., there are only true positives). In general, there is some subjectivity in identifying blobs in real data. Therefore, we quantified how close the machine-predicted blobs are to the human-labeled blobs selected by different domain experts. We consider as “ground-truth” the cases that human labelers have identified as blobs. We cover cases with false positives (the model identified a blob where the human identified none), true negatives (did not identify a blob where there was none), false negatives (did not identify a blob where there was one), as well as true positives (identified a blob where there was one), as defined in Fig. 4. Each of the three domain experts separately labeled the blobs in 3000 frames by hand, and our blob-tracking models are evaluated against these human-labeled experimental data based on F1 score, False Discovery Rate (FDR), and accuracy, as shown in Fig. 5. These are the average per-frame scores (i.e., the average across the frames), and we did not use the score across all frames, which can be dominated by outlier frames that may contain many blobs. Figure 6 displays the corresponding confusion matrices. In this result, RAFT, Mask R-CNN, and GMA achieved high accuracy (0.807, 0.813, and 0.740 on average, respectively), while Flow Walk was less accurate (0.611 on average). Here, the accuracy of 0.611 in Flow Walk is seemingly high, misleading because Flow Walk gave few predictions (low TP and FP in Fig. 6). This is because the data is skewed to true negatives as many frames have no blobs, which is seen from the high true negatives of confusion matrices in Fig. 6. Thus, accuracy is not the best metric for the data used. F1 score and FDR are more suitable for our purposes because they are independent of true negatives. Indeed, other scores of Flow Walk are as expected; the F1 score is low (0.036 on average) and the FDR is high (0.645 on average). RAFT and Mask R-CNN show decently high F1 scores and low FDR. GMA underperformed RAFT and Mask R-CNN in all metrics, but the scores are fairly good. These observations are consistent across the comparisons with the three labelers’ results. Overall, blobs predicted by three models (RAFT, Mask R-CNN, and GMA) are quite similar to human-labeled blobs, exhibiting fairly good scores in Fig. 5.
The trained models’ average running times per frame (without post-processing) are milliseconds. Specifically, 104, 50, 109, and 23 ms for RAFT, Mask R-CNN, GMA, and Flow Walk, respectively, using 4 GPUs. For RAFT and GMA, there are 12 iterations for each frame following the default setup, and we run 1 iteration for Mask R-CNN and Flow Walk. This indicates that \(\sim 3\) h (RAFT, GMA) and \(\sim 1\) h (Mask R-CNN, Flow Walk) would be needed to process \(10^5\) images. This can become faster if we reduce the number of iterations or downsample the input image at the expense of the model’s performance. The post-processing takes seconds, precisely 12, 11, and 9 s per frame for RAFT, GMA, and Flow Walk, respectively, and \(\sim 300\) h for \(10^5\) images. This is not short because of the search for the contour value to be drawn from the optical flow for the blob contour prediction. For Mask R-CNN, the per-frame post-processing time is 1 second, much faster than the other three optical flow models. This is because Mask R-CNN gives segmented masks, and there is no need to find a contour value. Therefore, RAFT, GMA, and Flow Walk can be run for a small subset of the data (\(\sim\)1000 frames), and Mask R-CNN can be run for the data with a larger number of frames. Despite the long computation time, the post-processing provides information of blobs for every frame, whereas CAS only provides average results in a relatively shorter time.
Identification of blob regimes
The trained models can now estimate various blob parameters, such as their size, speed, and occurrence frequency in real GPI data. Here, we use such information to identify the regime of the blob dynamics for two different plasma conditions. The regime is identified based on location in the diagram in Figure 7. Here, \(\Theta\) (a normalized blob size) and \(\Lambda\) (a normalized plasma collisionality, which is proportional to the electron-ion collision frequency) are defined as in9,10
where
\({\hat{a}}\) and \({\hat{v}}\) are the blob’s normalized radius and radial speed, respectively. Here, \(n_e\) and \(T_e\) are the local electron density and temperature, respectively, \(L_{\Vert }\) is the parallel connection length, \(a_b\) is the blob radius, R is the major radius of the tokamak, \(\rho _{s}\) is the ion sound Larmor radius, \(v_R\) is the radial speed of the blob, and \(c_s\) is the sound speed. Our blob-tracking models allow us to estimate \(a_b\) and \(v_R\). Other plasma parameters are measured using other diagnostics. There are four regimes in the diagram, named “resistive ballooning” (RB), “resistive X-point” (RX), “connected ideal-interchange” (\(C_i\)), and “connected sheath” (\(C_s\)). Theory predicts different scaling relationships between the normalized radial speed (\({\hat{v}}\)) and the radius (\({\hat{a}}\)) of the blob depending upon regime (see Fig. 7). We have evaluated \(\Theta\) and \(\Lambda\) for two different plasma conditions (Plasma 1 and Plasma 2) using a traditional method (CAS) and our four blob-tracking models (RAFT, Mask R-CNN, GMA, and Flow Walk). This evaluation locates the two plasmas within the theory-defined regimes, as shown in Fig. 7. We identify plasma 1 and 2 as being within \(C_s\) and RX regimes, respectively, unanimously by four methods (CAS, RAFT, Mask R-CNN, and GMA) except Flow Walk. The closeness of the data points between the traditional method and the blob-tracking models demonstrates the validity of the machine learning approach in blob-tracking applied to an important research investigation. Note that the bars around the centroids for the blob-tracking models are not error bars but rather the spread in actual blob statistics. This is an advantage of the blob-tracking methods since they allow statistics derived from individual blob measurements, whereas CAS can only yield average results. Flow Walk’s large spread is due to its poor prediction performance, as shown previously in Fig. 5.
Conclusions
We introduce a dataset and benchmark for tracking turbulent structures, called blobs, in Gas Puff Imaging data from the boundary region of magnetically confined tokamak plasmas created in TCV. We experimented with four baseline models based on RAFT, Mask R-CNN, GMA, and Flow Walk, trained on synthetic data, and tested on synthetic and real data. The synthetic data mimic the realistic movement and evolution of blobs found in actual GPI videos of the TCV boundary plasma. We optimize the training hyperparameters by Bayesian optimization. The trained models show high VIoU testing scores on both synthetic and real data and high accuracy scores on human-labeled real data. As a demonstration of the validity of our tracking models, we achieve (nearly) unanimous identification of the regime of the blob dynamics for two different plasma conditions using blob statistics estimated by tracking models and the traditional CAS method. At least two of these models (RAFT and Mask R-CNN) are reliable tools for identifying and tracking blobs, which allow the estimation of various measures of blob dynamics connected to the levels and effects of turbulence on the edge of tokamak plasmas. This characterization of edge turbulence can further our understanding of transport processes in the plasma boundary, contributing to essential knowledge for the practical generation of fusion energy.
Data availability
In the spirit of reproducible research, we make our data, models, and code publicly available at https://github.com/harryh5427/GPI-blob-tracking.
References
Bécoulet, A., Butler, E. & Whyte, D. G. Star Power: ITER and the International Quest for Fusion Energy (The MIT Press, 2021).
Ball, P. The chase for fusion energy. Nature. https://www.nature.com/immersive/d41586-021-03401-w/index.html. Accessed 21 June 2022. (2021).
Tester, J. et al. Sustainable Energy: Choosing Among Options (MIT Press, 2012).
Reimerdes, H. et al. Overview of the TCV tokamak experimental programme. Nuclear Fusion 62, 042018. https://doi.org/10.1088/1741-4326/ac369b (2022).
Zweben, S. J., Terry, J. L., Stotler, D. P. & Maqueda, R. J. Invited review article: Gas puff imaging diagnostics of edge plasma turbulence in magnetic fusion devices. Rev. Sci. Instrum. 88, 041101 (2017).
D’Ippolito, D. A., Myra, J. R. & Zweben, S. J. Convective transport by intermittent blob-filaments: Comparison of theory and experiment. Phys. Plasmas. https://doi.org/10.1063/1.3594609 (2011).
Agostini, M. et al. Fast thermal helium beam diagnostic for measurements of edge electron profiles and fluctuations. Rev. Sci. Instrum. 86, 123513. https://doi.org/10.1063/1.4939003 (2015).
Kube, R. et al. Intermittent electron density and temperature fluctuations and associated fluxes in the Alcator C-Mod scrape-off layer. Plasma Phys. Controlled Fusion. https://doi.org/10.1088/1361-6587/aab726 (2018).
Myra, J. R. et al. Blob birth and transport in the tokamak edge plasma: Analysis of imaging data. Phys. Plasmas. 13, 092509. https://doi.org/10.1063/1.2355668 (2006).
Myra, J. R., Russell, D. A. & D’Ippolito, D. A. Collisionality and magnetic geometry effects on tokamak edge turbulent transport. I. A two-region model with application to blobs. Phys. Plasmas. 13, 112502. https://doi.org/10.1063/1.2364858 (2006).
Brunner, D., LaBombard, B., Kuang, A. & Terry, J. High-resolution heat flux width measurements at reactor-level magnetic fields and observation of a unified width scaling across confinement regimes in the Alcator C-Mod tokamak. Nuclear Fusion 58, 094002. https://doi.org/10.1088/1741-4326/aad0d6 (2018).
Kuang, A. Q. et al. Divertor heat flux challenge and mitigation in SPARC. J. Plasma Phys. 86, 865860505. https://doi.org/10.1017/S0022377820001117 (2020).
Goldston, R. Theoretical aspects and practical implications of the heuristic drift SOL model. J. Nuclear Mater. 463, 397–400. https://doi.org/10.1016/j.jnucmat.2014.10.080 (2015).
Offeddu, N. et al. Cross-field and parallel dynamics of SOL filaments in TCV. Nucl. Fusion. 62, 096014. https://doi.org/10.1088/1741-4326/ac7ed7 (2022).
Häcker, R., Fuchert, G., Carralero, D. & Manz, P. Estimation of the plasma blob occurrence rate. Phys. Plasmas. 25, 012315. https://doi.org/10.1063/1.5008301 (2018).
Teed, Z. & Deng, J. RAFT: Recurrent all-pairs field transforms for optical flow. in European Conference on Computer Vision, 402–419 (Springer, 2020).
He, K., Gkioxari, G., Dollár, P. & Girshick, R. Mask R-CNN. in Proceedings of the IEEE International Conference on Computer Vision, 2961–2969 (2017).
Balandat, M. et al. Botorch: A framework for efficient monte-carlo bayesian optimization. Advances in Neural Information Processing Systems 2020-December (2020). Funding Information: Andrew Gordon Wilson is supported by NSF I-DISRE 193471, NIH R01 DA048764-01A1, NSF IIS-1910266, and NSF 1922658 NRT-HDR: FUTURE Foundations, Translation, and Responsibility for Data Science. Publisher Copyright: \({\copyright }\) 2020 Neural information processing systems foundation. All rights reserved.; 34th Conference on Neural Information Processing Systems, NeurIPS 2020 ; Conference date: 06-12-2020 Through 12-12-2020.
Jiang, S., Campbell, D., Lu, Y., Li, H. & Hartley, R. Learning to estimate hidden motions with global motion aggregation. in Proceedings of the IEEE/CVF International Conference on Computer Vision, 9772–9781 (2021).
Bian, Z., Jabri, A., Efros, A. A. & Owens, A. Learning pixel trajectories with multiscale contrastive random walks. CoRR. abs/2201.08379 (2022). 2201.08379.
Bian, Z., Jabri, A., Efros, A. A. & Owens, A. Learning pixel trajectories with multiscale contrastive random walks. in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2022).
Nikolenko, S. I. Synthetic Data for Deep Learning Vol. 174 (Springer, 2021).
Andrews, C., Sirazitdinova, E., Hedges, D., Robinson, M. & Kulkarni, S. Tutorial on creating and using synthetic data for computer vision applications (2022).
Wood, E., Fidler, S., Urtasun, R. & Laserson, J. Workshop on machine learning with synthetic data (2022).
Fuchert, G., Carralero, D., Manz, P., Stroth, U. & E. Wolfrum. Towards a quantitative prediction of the blob detection rate. Plasma Phys. Controlled Fusion. 58, 054006. https://doi.org/10.1088/0741-3335/58/5/054006 (2016).
Acknowledgements
The support from the US Department of Energy, Fusion Energy Sciences, awards DE-SC0014264 and DE-SC0020327, are gratefully acknowledged. This work was supported in part by the Swiss National Science Foundation. Also, this work has been carried out within the framework of the EUROfusion Consortium, funded by the European Union via the Euratom Research and Training Programme (Grant Agreement No 101052200-EUROfusion). Views and opinions expressed are, however those of the author(s) only and do not necessarily reflect those of the European Union or the European Commission. Neither the European Union nor the European Commission can be held responsible for them.
Author information
Authors and Affiliations
Contributions
W.H. constructed the initial concept of the study, curated the dataset, and wrote the code. W.H. and I.D. defined the benchmark and reviewed the code. All authors provided ideas and analyzed the results. W.H., R.A.P., R.V.L., N.O., T.G., C.T., J.T., and I.D. contributed to the writing and all authors reviewed the manuscript. W.H., I.D., and R.V.L. created figures.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Han, W., Pietersen, R.A., Villamor-Lora, R. et al. Tracking blobs in the turbulent edge plasma of a tokamak fusion device. Sci Rep 12, 18142 (2022). https://doi.org/10.1038/s41598-022-21671-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-21671-w
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.