Abstract
Spatiotemporal tracking of tracer particles or objects of interest can reveal localized behaviors in biological and physical systems. However, existing tracking algorithms are most effective for relatively low numbers of particles that undergo displacements smaller than their typical interparticle separation distance. Here, we demonstrate a single particle tracking algorithm to reconstruct large complex motion fields with large particle numbers, orders of magnitude larger than previously tractably resolvable, thus opening the door for attaining very high Nyquist spatial frequency motion recovery in the images. Our key innovations are feature vectors that encode nearest neighbor positions, a rigorous outlier removal scheme, and an iterative deformation warping scheme. We test this technique for its accuracy and computational efficacy using synthetically and experimentally generated 3D particle images, including nonaffine deformation fields in soft materials, complex fluid flows, and cellgenerated deformations. We augment this algorithm with additional particle information (e.g., color, size, or shape) to further enhance tracking accuracy for high gradient and large displacement fields. These applications demonstrate that this versatile technique can rapidly track unprecedented numbers of particles to resolve large and complex motion fields in 2D and 3D images, particularly when spatial correlations exist.
Introduction
Comprehensive tracking of tracer particle trajectories can elucidate complex behaviors in soft materials, fluid flows, and biological motion by resolving local inhomogeneities in space and time. For instance, the displacement of fiducial markers embedded within a solid or fluid medium can reveal local microrheological properties^{1,2,3,4,5,6,7}, cellgenerated deformations within a soft biomaterial^{8,9,10,11,12,13,14,15,16,17,18}, or turbulent flows utilized for biological propulsion^{19,20,21}. Moreover, directly tracking biological objects of interest such as single molecules^{22,23,24}, viruses and bacteria^{25,26,27,28,29}, and motile cells^{30,31,32,33} can reveal collective phenomena and heterogeneous phenotypes. However, particle tracking is computationally expensive and requires careful optimization of imaging conditions and thus remains highly challenging. The unambiguous resolution of particle motion typically requires displacements smaller than half of the interparticle spacing, often necessitating frequent timelapse imaging^{34,35}. Consequently, existing algorithms are inefficient when tracking large numbers of particles (tens of thousands or more) undergoing large motion over an extended duration or many image frames. New tracking algorithms exhibiting ultrahigh efficiency and accuracy based on computer vision techniques are necessary for extreme motion fields in physical and biological systems.
Single particle tracking (SPT) methods are typically based on a two step process: 1) particle positions are identified at each time frame, then 2) particle positions are linked together into trajectories over consecutive frames. Particles can be reliably localized with subpixel accuracy in both 2D and 3D images using Gaussian fitting methods^{36,37,38} based either on a nonlinear least squared criterion or maximum likelihood estimator, or the radial symmetry method^{39,40}. Once located, the particles can be tracked using approaches including nearest neighbor search, relaxation methods^{41,42}, feature vector based methods^{12,34}, and more classical minimization of a specific motion cost function^{43,44} using the sum of squared distances across time points. These methods accurately track particles subjected to small motion fields. However, tracking large particle motions presents a significant challenge due to the uncertainty of assigning new positions to identical particles. Moreover, they are not computationally efficient when tracking large numbers of particles undergoing large amplitude motion fields. Although some applicationspecific algorithms can capture large displacements^{45}, these methods require inference of a priori knowledge of the underpinning physics behind the motion and thus are not readily adaptable to general motion fields of unknown character.
Complex motion fields can also be measured using correlationbased methods like digital image correlation (DIC) or particle image velocimetry (PIV), which do not require explicit information about particle positions. These correlationbased image subset matching methods are widely used^{46,47}, but the inherent averaging nature of subsetmatching schemes smooths out high frequency information^{48,49,50}, and are computationally expensive since mathematical operations are applied across the entire 2D image or 3D volume^{51,52}. Instead, SPT reconstructs a complex deformation field based on the spatially discretized motion of tracer particles. To resolve high spatial frequency information, high particle seeding densities are necessary. According to the Nyquist criterion, SPT methods have a theoretical spatial frequency recovery limit with the smallest resolvable wavelength twice the interparticle separation distance^{11}. Increasing the overall particle seeding density reduces the interparticle separation, which then limits the relative displacements that can be accurately and efficiently resolved using existing algorithms. This establishes a tradeoff whereby higher particle densities permit high spatial resolution but lower particle densities are needed to resolve large displacements. These issues are expected to worsen as camera sensors increase in size, allowing greater numbers of particles within a given field of view.
Here, we present a new particle tracking scheme called Topologybased Particle Tracking (TPT) to address the challenges of current SPT methods in reconstructing complex, large motion fields with high computational efficiency and spatial resolution. Our approach utilizes feature vectors that encode nearest neighbor positions, a rigorous outlier removal scheme, and an iterative deformation warping scheme^{51}. TPT is designed to perform optimally for motion fields that exhibit some spatial correlations, although it can also be employed to track purely random motions. We demonstrate that our general purpose method accurately tracks a large number of particles undergoing large and high spatial gradient displacements with high computational efficiency. By including descriptive, multiattribute information about the particles, e.g. particle color, size or shape, in addition to their geometric position, we show that the displacement resolution of our technique can be significantly enhanced for more accurate detection of large motion fields. Furthermore, we characterize the performance and versatility of our algorithm using a combination of simulated and experimental images, including nonaffine deformations of soft materials, complex fluid flows, and cellgenerated substrate deformations.
Results
Particle Tracking Using Feature Vectors with Relative Neighbor Positions
Topologybased Particle Tracking (TPT) utilizes feature vectors in a threestep algorithm (Fig. 1). First, particles centers are localized. Second, particles are linked between consecutive image frames using a new particle descriptor (feature vector), which encodes the spatial positions of their nearest neighbor particles for each time frame. Third, particles in consecutive time frames are compared using an iterative warping scheme to track large particle motions in time^{51}. These three steps will be described in greater detail using a conceptual example of particles displaced by a 3D motion field.
The first step in most tracking schemes is the detection and localization of particle centers within each image (Fig. 1). We utilize image thresholding based on a userspecified cutoff to segment particle voxels from background voxels in the images. The particle centroids are then rapidly localized with subvoxel accuracy using the radial symmetry method^{39,40}.
The second step associates the particle positions in the reference (t = t_{ o }) and deformed volumes (t = t_{ o } + 1) with a “particle descriptor” or feature vector, based on the relative spatial positions of their nearestneighbor particles (Fig. 1). This step defines a unique local particle signature based on the topological arrangement of randomly located neighbors, which aids in linking consecutive particle positions in time. For each particle, the positions of n nearest neighbor particles are stored. A spherical shell with a radius equal to the distance of the farthest particle from the particle of interest is then created around each particle. This spherical shell is further divided into k concentric shells of equal volume. Each of the concentric shells is further split into eight octants using the basis vectors in the reference volume, dividing the space around the particle of interest into 8k bins. The relative positions of the n neighboring particles is encoded into the particle descriptor by binning these particles into the 8k bins. The design of this feature descriptor is advantageous since it encodes the relative spatial positions of neighboring particles. This allows these particles sufficient freedom to rearrange during deformation while retaining a similar feature descriptor, since particles tend to remain within the same bin.
Particle positions are linked together in time by partitioning the reference (t = t_{ o }) and the deformed (t = t_{ o } + 1) volumes into subsets. The particles are linked onetoone from the reference image subset to the corresponding deformed image subset such that a chosen particle pair has the minimum L^{2} particle descriptor distance. The algorithm enforces onetoone particle linking conditions by discarding any particle links which are not bijective. An outlier removal procedure on particle links then eliminates potential false links. We utilize the neighborhood similarity test, which evaluates whether a particle linkage is plausible based on whether at least p of q neighbors are conserved between the reference and deformed volumes, in addition to the universal median test^{53}, which removes potential outliers by eliminating particle displacements above a userdefined value based on the normalized residual of the median neighbor particle displacement. The links verified by these two tests are stored as successful particle matches.
The third step in our algorithm uses an iterative deformation warping (IDM) scheme to accurately and efficiently track large and complex particle displacements^{51}. IDM resolves any general nonlinear deformation by iteratively warping the reference and deformed images using a linearized displacement field until they converge to the same final configuration. The technique is adapted to deform particle positions in the reference and deformed images until the particle positions coincide. In addition to improving the large particle displacement recovery process, IDM also improves the similarity of particle descriptors in the reference and deformed volumes, further enhancing the accuracy of particle linking. The whole process of the particle matching and deformation warping is iteratively performed on decreasing subset sizes from 256 to 16 voxels to reduce the overall search region until the convergence criteria is fulfilled. The detailed description of various steps in the algorithm can be found in the Methods section and Supplementary Note 7.
Tracking Accuracy and Efficiency in Resolving Complex Motion Fields
The performance of our TPT algorithm was evaluated by synthetically generating a 3D volume of 512 × 512 × 192 voxels, with a signaltonoise ratio (SNr) of 25, that contained 50,000 randomly distributed, identicallysized spherical particles with a particle density of 9.94 × 10^{−4} particles/voxel^{3} (Supplementary Figure 1). These voxel intensities were further sampled from a Poisson distribution in order to simulate shot noise during experimental image acquisition.
To generate the deformed volume, the particles were then displaced by a sinusoidal field of linearly decreasing amplitude and spatial wavelength from 200 to 10 voxels (Fig. 2a). The complexity of the displacement field arises because it has both a region of large displacement and high spatial frequency motion. To quantify the displacement magnitude between an image pair, the displacement parameter d is defined as the ratio of maximum displacement magnitude u_{ max } to mean interparticle separation distance r_{ o }, i.e., \(d=\frac{{u}_{max}}{{r}_{o}}\). For the particle seeding density shown in the images, the particle separation distance is r_{ o } = 6.217 voxels. For “small” displacements of d < 0.5, a nearest neighbor search will be sufficient to track all particles, assuming a uniform volumetric particle distribution. However, accurate particle tracking becomes challenging for d > 0.5, as the true particle link is not necessarily the nearest neighboring particle in the local neighbor search. Thus, we evaluated the performance of this algorithm and other current SPT techniques as a function of increasing d for the prescribed displacement field (Fig. 2a). In particular, we considered three available methods, Legant et al.’s featurevector based tracking method^{12,15}, Jaqaman et al.’s linear assignment problem (LAP)based algorithm^{24} implemented in TrackMate^{54}, and a featurevectorbased relaxation method (FVRM)^{34}.
The algorithm performance was evaluated using positive and false positive linkages as the displacement parameter (d) was systematically varied. The recovery ratio η_{ r } is defined as the ratio of the total number of detected particle links found by the algorithm to the total number of existing particle links in between an image pair (Fig. 2b). For d < 1.5, TPT, FVRM, and TrackMate exhibit very high recovery ratios η_{ r } ~ 1. As d increases further, the recovery ratio remains nearly unity for TPT and Trackmate out to d ~ 2.7, while FVRM decreases to η_{ r } ~ 0.9. Legant et al.’s method has the lowest η_{ r }, which also decreases with increasing d. The mismatch ratio η_{ m } is the ratio of false particle links found by the algorithm to the total number of particle links detected by the algorithm. TPT does not find any falsepositive links η_{ m } ~ 0 for d < 1.5, but increases to a maximum of η_{ m } ~ 6 × 10^{−3} for d = 2.7. For FVRM, η_{ m } ~ 9 × 10^{−3} for d = 0.3, which increases roughly exponentially up to η_{ m } ~10^{−1} for d = 2.7. Finally, Legant et al.’s method remains roughly constant at η_{ m } ~ 10^{−2} over this range of d, while TrackMate increases from η_{ m } ~ 10^{−2} at d = 0.3 to η_{ m } ~ 0.6 at d = 2.7. Overall, these metrics indicate that TPT enables accurate tracking at high particle densities even for motion fields with very large displacement information.
In addition to tracking large deformations, the number of particles that can be efficiently tracked must be considered. Tracking a significant number of particles (~10^{4}) undergoing large deformations, i.e., d > 0.5 can be prohibitively expensive, particularly for large numbers of timelapse images. The computational efficiency as a function of the total number of tracked particles was evaluated using the same displacement field as before (Fig. 2a, d = 2.1). For all algorithms, the execution time is small for low particle densities and increases significantly with the number of particles (Fig. 2d). For high seeding densities, our TPT has the fastest execution time, tracking 10^{5} particles in 215.3 seconds. This is approximately 10 times faster than Legant et al.’s method, which is the second fastest method. As shown in Fig. 2d, for the given motion field our TPT’s execution time approximately scales as O(n^{1.08}), where n is the number of particles in the images.
At present and to the best of our knowledge, the only motion tracking techniques that perform similarly for large particle numbers are correlationbased methods. However, correlationbased methods tend to underresolve high spatial frequency motion content due to the intrinsic averaging nature of their subsetbased image matching routines. To show this effect, we considered a sinusoidal displacement field with a magnitude of 0.1 voxels with a linearly decreasing spatial frequency from 100 to 10 voxels. This displacement field is prescribed to an image of size 512 × 512 × 192 voxels embedded with 50,000 particles and a SNr of 25. We compare the prescribed displacement field against the high spatial frequency displacement content recovered by TPT and fast iterative digital volume correlation (FIDVC)^{51}, a correlation based method (Fig. 2e). FIDVC progressively underpredicts the true displacement magnitude with increasing spatial frequency and fails to recover the highest spatial frequency displacement content. In comparison, TPT recovers the high spatial frequency motion but has a larger standard deviation in its resolved motion field than FIDVC, since TPT does not any employ intrinsic spatial averaging or noise suppression calculations. TPT also showed a significant speed improvement over the correlation based FIDVC method, as TPT and FIDVC measured the displacements in 45.2 seconds and 391.3 seconds, respectively.
Recent advancements in camera sensor technology have enabled larger fields of view, allowing more particles to be imaged per field of view. For instance, EMCCD cameras typically have sensor sizes of 512 × 512 pixels (0.26 MPx) or better. The firstorder estimate for the Nyquist spatial resolution of the recovered motion field is twice the mean interparticle spacing. To resolve a motion field at Nyquist spatial resolution of 16 pixels, corresponding to a resolution of a single particle by four pixels in each dimension, approximately ~10^{3} particles must be tracked for a single 512 × 512 pixel 2D image, but ~2 × 10^{4} particles must be tracked in a 512 × 512 × 192 voxel 3D volume (Fig. 2f; details in Supplementary Note 2). Existing particle tracking algorithms exhibit adequate performance for 10^{4} particles (Fig. 2d). Yet recent developments in sCMOS camera technology with sensor sizes of 2048 × 2048 pixels (4.2 MPx), corresponding to tracking 3 × 10^{5} particles per 3D volume (2048 × 2048 × 192 voxels), which becomes impractical for existing algorithms (Fig. 2f). Future research may use even greater camera resolution, requiring larger numbers of particles to be tracked, perhaps 10^{6} or more. The efficient performance of this algorithm for large displacements and high particle numbers is thus highly promising for emerging imaging technologies. Moreover, it should be noted that this algorithm is parallelized and parallel computing could be utilized to further reduce execution time, if needed.
We have also compared the performance of TPT to resolve random particle motion against other SPT algorithms (Supplementary Note 5). TrackMate, followed by TPT, had the most accurate tracking performance. The execution time of TPT was at least an order of magnitude faster than the second fastest method, and TPT and TrackMate had similar particle tracking accuracy for small random particle motion (d < 0.25). Thus, TPT is preferable for applications involving a high number of particles undergoing small random motion. In addition, we evaluated the performance of TPT for timelapse data where particles randomly appeared and disappeared between image frames, which simulates experiments where particles merge and split (Supplementary Note 6). TPT achieved a η_{ r } ~ 0.98 and η_{ m } ~ 7 × 10^{−5} between image frame 0 and image frame 5 for 10% of particles randomly seeded and removed in each image frame. TPT showed that it could accurately track particles over timelapse images even when a large fraction of particles appeared and disappeared between image frames.
Large Deformation Tracking in NonAffine Soft Materials and Fluid Flows
To highlight the versatility of our TPT algorithm, we chose two examples of potential interest to the biological and physical sciences communities. The first example examines the reconstruction capability of our technique to accurately capture both affine and nonaffine motion fields in an idealized soft material undergoing a nominally applied homogeneous shear deformation (Fig. 3a–d). The second example investigates the resolution capability of TPT to recover a complex, interacting fluid flow field across a stack of periodicallyspaced cylinders at Reynolds number Re = 10,000 (Fig. 4a–f). These examples are simulated using synthetically produced images from analytically (example 1) and computationally (example 2) derived motion fields.
Particle tracking microrheology in soft materials enables resolution of nonaffine deformations due to inhomogeneities in network architecture or enthalpic deformations of structural components (i.e. semiflexible or rigid polymers), which cannot be elucidated using bulk rheology^{55}. We synthetically generate a 3D image set of 512 × 512 × 192 voxels seeded with 50,000 particles undergoing a nominal shear (γ) deformation of 10%. Onto this homogeneous deformation, we superimpose random displacement vectors to create a nonaffine displacement field as might occur in fibrous materials such as collagen or fibrin (Fig. 3a). The regularly spaced bands in displacement contours measured by TPT (Fig. 3b) indicate that it recovered the affine, finite (γ = 0.1) homogeneous shear displacement field accurately. The uneven and jagged border between the bands arises from the nonaffinity in particle displacements. The 3D image pair was generated with a SNr of 25 and TPT reconstructed the displacement field with a mean absolute displacement error of 0.145 ± 0.825 voxels. Concurrently, TPT resolved most of the nonaffine displacement components of the prescribed displacement field, as seen in the histogram of the superimposed nonaffine displacement in Fig. 3c. Similarly, Fig. 3d visualizes the randomness in the prescribed nonaffine displacement field in a subset of the 3D images, showing that TPT resolves most of the nonaffine displacement components. TPT tracked the particles in the images with a recovery ratio of 0.922 and a mismatch ratio of 0.0184, indicating high accuracy in resolving the prescribed nonaffine shear motion field. TPT maintained similar accuracy across various applied shear deformations as the extent of nonaffinity was varied (Supplementary Note 4).
Experimental fluid dynamics is another research area that commonly employs various SPT techniques to reconstruct complex velocity fields by tracking fiducial particles within the fluid flow. Examples include measuring fluid flow fields around bats^{19}, jellyfish^{20}, or bacteria^{29}. The motion fields are usually recovered either by particle image velocimetry (PIV) or particle tracking velocimetry (PTV) methods. As a correlation based technique, PIV has limited capability in capturing high spatial gradient flow fields^{56} (Fig. 2e). PTV can improve the spatial resolution of the measured flow field^{56,57}, but twoframe PTV techniques are limited to small particle displacements^{42}. PTV techniques usually require multiframe information to resolve large particle displacements^{57}, which imposes experimental challenges.
To show TPT’s ability to recover large and high spatial gradient displacement data encountered in an unsteady, complex flow field between two image frames, we simulate a 2D flow around a stack of periodically spaced cylinders in COMSOL (Fig. 4a). The numerical simulation details are described in the Methods section. The flow passing between the cylinders creates a complex motion field of varying spatial frequencies, with large displacements (peak value of 1.42 times the mean particlespacing) as well as steep gradients (peak value of 2.9) (Fig. 4b). At a particular time, the displacement field is extracted from the simulation and prescribed to a synthetic 2D particle image pair. The displacement field is then reconstructed from the particle motion using TPT and FIDIC^{51} (Fig. 4c,e) and compared with the original displacement field (Fig. 4d,f). The errors for TPT are mostly localized around the cylinder borders mainly because of scattered data interpolation scheme limitations. The error contribution in the recovered displacement field from the particle mismatch is relatively small as the mismatch ratio was 1.33 × 10^{−4}. TPT and FIDIC resolve the displacement field with a mean absolute error of 0.0325 ± 0.147 pixels and 0.0387 ± 0.133 pixels, respectively. The particles were tracked with a recovery ratio of 0.965, showing TPT’s ability to accurately resolve the complex displacement field imposed. The computational times for TPT and FIDIC to resolve the displacements were 76.1 seconds and 81.6 seconds, respectively.
Improved Tracking Accuracy Using MultiAttribute Particles
Accurate reconstruction of complex, high spatial frequency displacement content requires high particle seeding densities to reduce the Nyquist limit. However, increasing particle seeding density reduces the interparticle separation distance, and thus challenges the ability of stateoftheart tracking algorithms, including our own, to resolve very large deformations. Thus, a tradeoff exists between resolving large deformations and recovering high spatial frequency displacement information. While TPT can accurately track large displacements, its recovery ratio, as with other SPT techniques, decreases dramatically as the imposed displacements become too large. To improve the tracking performance of our TPT algorithm for these larger displacements, we enhanced TPT by taking advantage of any additional particle information available beyond spatial positioning. For example, such multiattribute information can include the particle fluorescent emission wavelength (color), size or shape, et cetera. To benchmark the performance increase of utilizing multiattribute particle information we synthetically generated a volumetric image pair of size 512 × 512 × 192 voxels seeded with 60,000 identical particles. Next, we augment the monodispersed solution of particles by prescribing one additional distinguishing attribute to a 10,000 particles subset and another attribute to the remaining 50,000 particles, creating two particle groups with low and high seeding densities (Fig. 5a). Experimentally, as we show later, particles of different colors or different sizes are used. The dualattribute synthetic particle images are prescribed the original displacement field from Fig. 2a. The particles at low seeding density have larger interparticle spacing, and thus will provide higher accuracy in resolving large displacements at low spatial frequency, whereas the high seeding density particles with small interparticle spacing provide the best estimate in the high spatial frequency content recovery process. We first track the particles at low seeding densities to resolve large deformations with low spatial frequency content in the applied motion field. Then, we use the iterative deformation warping scheme^{51} to deform the positions of all particles, including the ones at the high seeding densities according to this field. Finally, particles at the high densities are accurately tracked to recover the high spatial frequency and displacement gradient content. Multicolor particles have been previously used to increase the spatial resolution of the motion field measurement^{11}. Now, our approach uses multiattribute particles to resolve large displacement content at high spatial resolution, and thus provides a more general methodology for including any distinguishing particle characteristics in addition to color and position.
The inclusion of a single additional attribute improves the tracking capability of the TPT algorithm significantly, with the most improvement seen in the recovery ratio, η_{ r } (Fig. 5b). For d < 2, η_{ r } is comparable for identical and dualattribute particle tracking. Nevertheless, for d > 3, the demonstrated dualattribute particle tracking permits higher recovery ratios, reaching η_{ r } = 0.75 at d = 4.5, roughly 50% better than monodispersed particles. The mismatch ratio η_{ m } is roughly consistent for dualattribute and identical particle tracking with varying d (Fig. 5c). The details of the outlier removal scheme explains this trend. This step removes false particle matches, hence controlling the mismatch ratio. Since the outlier removal scheme is unmodified between identical particle and dualattribute cases, both have similar mismatch ratios. This conceptual example uses color as a multiattribute property, but the feature descriptor can straightforwardly be used with any other particle property.
Improved Resolution of CellGenerated Substrate Deformations
Finally, we analyze experimental images of cellgenerated deformations using our TPT algorithm. Adherent mammalian cells use focal adhesions to apply highly localized forces to soft biomaterial substrates, causing displacements with large magnitudes and steep gradients^{16,58,59}. To reconstruct this complex motion field accurately, particle tracking algorithms capable of high spatial resolution are required^{60}. Our experimental system consists of a fluorescentlylabeled breast cancer cell (MDAMB231, metastatic breast adenocarcinoma stably transfected with a green fluorescent protein) adherent to a collagenI conjugated soft polyacrylamide (PA) gel (stiffness ≈1.5 kPa) (Fig. 6a). Two sets of polystyrene microspheres with distinct size and fluorescent label are embedded within the PA gel. 2 μm blue tracer particles are injected at a low seeding density of 1.01 × 10^{−5} particles/voxel (Fig. 6b) and 1 μm red particles are injected at a high seeding density of 6.38 × 10^{−4} particles/voxel (Fig. 6c). The dualattribute particles, as described earlier, help TPT to recover both the large and high gradient displacement content. A 3D volumetric image pair of size 512 × 512 × 101 voxels was recorded via a standard confocal microscope (see Methods), and our 3D TPT algorithm tracked the particles in the images to recover the displacement within the PA substrate.
The breast cancer cell exhibited an elongated, spindlelike morphology representative of a mesenchymal morphology in sparsely plated culture conditions^{61}. In particular, near the trailing edge (Fig. 6d, left), the adhesive contact is associated with a relatively sharp spatial gradient deformation (\({\rm{\partial }}{u}_{p}/{\rm{\partial }}\xi =0.15\), where ξ is the distance to the pseudopod tip) (Fig. 6e,f). These localized large deformations are typically observed near adhesive and focal contacts in various adherent cell types^{16,58,59}. The TPT surface displacement field along the cell body can be compared with the featurevector based relaxation method (FVRM)^{34}, another stateoftheart SPT technique used to measure cellgenerated deformations^{18}. In general, both methods yield similar displacement field estimates. However, in comparison to TPT, FVRM underpredicted the peak displacement magnitude by 15% (Fig. 6g). Behind the trailing edge along the cell body axis (ξ ~ 40), both TPT and FVRM yield comparable displacement magnitudes of ~1 μm at a displacement gradient magnitude of 0.09. Near the pseudopod, at ξ = 0, FVRM underestimates the magnitude of the displacement field by ~1 μm relative to TPT. Moreover, ahead of the trailing edge at ξ < 0, TPT resolved a higher gradient magnitude of 0.15 compared to 0.12 using FVRM. These results indicate that TPT better recovers large deformations and high gradient displacements. TPT recovered the displacement field with an SNr of 48. We calculated the displacement SNr as the ratio of peak particle displacement magnitude (3.7) to the noise floor of the particle displacement (0.077). Furthermore, TPT tracked 11,247 beads inside the image pair in 27.67 seconds, which is approximately 15 times faster than FVRM (Fig. 6h). The accuracy and efficiency of tracking particles with TPT is promising for traction force microscopy applications, among others. The accuracy and computational efficiency advancement of our TPT method will become more pronounced with higher native image resolution and higher particle seeding densities for resolving motion fields at very high Nyquist spatial resolution (Fig. 1e,g).
Discussion
TPT is a new featurevectorbased particle tracking algorithm for large displacements and particle numbers that uses feature descriptors that encode the relative spatial positions of neighboring particles. This approach improves on existing tracking algorithms by incorporating this newly developed feature descriptor, rigorous outlier removal schemes, and an iterative deformation warping method^{51}. This algorithm was evaluated computationally using a frequencyvarying sinusoidal displacement field, a model soft material with affine and nonaffine deformations, and a spatially heterogeneous fluid flow through a periodic array of cylinders. This algorithm was applied to reconstruct 3D cellgenerated substrate deformations of a mesenchymal cancer cell. We show that this algorithm exhibits greatly improved performance relative to existing algorithms, with high recovery ratios for large displacement information, mismatch ratios that are over an order of magnitude smaller, and computational efficiency at least an order of magnitude faster. This performance can be further augmented for large displacements through multiattribute particles, which encode additional information about each particle. We show a 50% improvement in recovery ratio utilizing two types of particles with different colors, at low and high seeding densities. In principle, this algorithm could also be improved using orthogonal features such as additional colors, particle sizes, shapes, etc.
We envision that TPT can be generalized more broadly to other physical and biological systems of interest. First, we have demonstrated TPT for threedimensional volumes, but it can be utilized similarly for twodimensional images. Second, TPT has been used to track particle motion based on two consecutive time steps, but an extension to multitime point tracking is straightforward. With timelapse data, multiframe particle trajectories can increase accuracy by predicting particle positions in successive frames. This information, in conjunction with the iterative deformation warping, reduces the particle search region enhancing the overall tracking performance. Third, our particle tracking scheme can be extended to track any feature or object, if it can be detected and localized within the images. This is also an inherent, and important, limitation of TPT: it requires particles or other detectable features to be localized within each image for subsequent tracking. In that regard, correlationbased methods are advantageous, as they only need random intensity speckle patterns within the input images. TPT also makes use of the randomness of the relative particle positions to track the particles and therefore is not optimized for regularly arranged particles or particle lattices. Finally, TPT is optimized for large numbers of particles, so tracking performance is similar to current SPT techniques for small numbers of particles. It should be noted that TPT leverages spatial correlations in particle motion to efficiently resolve large displacements. Thus, TPT enables large performance improvements for directed motion and affine displacements, but can also resolve random and nonaffine dynamics.
Single particle tracking algorithms are widely used in biological and physical research and have seen many advances over the past recent years^{62}. Nevertheless, existing particle tracking algorithms are challenged by large and complex motion fields with high particle seeding densities. We address this technology gap using feature vectors and an iterative deformation warping scheme, which enable high accuracy in recovering large displacement content, high computational efficacy and the use of multiattribute particle characteristics. Future microscopy applications may use increasingly large particle numbers. For instance, superresolution microscopy techniques circumvent the diffractionlimited pointspread function, which limited both the spatial resolution of the motion field and the particle seeding density^{58}. New structured illumination techniques could conceivably resolve extremely high particle seeding densities with separations below the spatial resolution limit. Simultaneously, increases in camera sensor size could result in unprecedented numbers of particles in the field of view, necessitating high computational efficiency to track the motion field at very high Nyquist spatial frequency. The algorithm demonstrated here is highly promising to meet these emerging technical challenges for ultrahigh resolution light microscopy. Overall, we envision that TPT will provide the community with a robust, fast and flexible means of tracking complex, two and three dimensional motion fields.
Methods
Simulated 3D particle images
The performance of our TPT algorithm is characterized using a pair of synthetically generated volumetric images of size 512 × 512 × 192 voxels (Supplementary Figure 1). In each reference volume (t = t_{ o }), unless otherwise stated, 50,000 spherical beads are randomly seeded using a 3D Gaussian intensity profile as an approximation for the optical system’s actual point spread function (PSF). The PSF with amplitude A and standard deviation σ is expressed as
The PSF with a standard deviation σ = 1 approximates a spherical particle in the image, with a diameter equal to about 5 voxels (Supplementary Figure 2). To avoid particle overlap in the images, a Poisson disc sampling algorithm is used to seed particles in the images with a minimum separation distance between particles equal to the particle diameter. The particle position in the deformed image is calculated via the imposed displacement field, and the spherical particles are similarly seeded at these positions in the deformed image. To generate the simulated images for each signaltonoise ratio (SNr), we scale the image intensity such that the peak image intensity is equal to the SNr squared. Then each voxel intensity is replaced by a random number drawn from a Poisson’s distribution with its mean equal to the original intensity.
TPT algorithm
Particle Detection and Center Localization
The first step in our TPT algorithm focuses on proper particle detection and center localization using the previously published subpixelaccurate radial symmetry method^{39,40}. First, the image is converted into a binary image using a userdefined threshold value, such that only the central region of the particle is segmented as several bright voxels, and the adjacent particle voxels are separated by at least one dark voxel. In the binary image, the simplyconnected regions of bright pixels, corresponding to the particle, are computed. Based on the expected particle size, a minimum and maximum number of voxels dependent on the particle size are used to identify connected components of the particles in the image and eliminate noise or multiplyconnected particles. This step essentially serves as a userdefined exclusion rule.
Next, an estimate of the particle’s center is constructed from a basic centroid calculation of each of the selected connected components. Then the radial symmetry method is employed using a greyscale image subset around the voxellevel estimate of the particle’s center to compute the actual center position with subpixel accuracy. The particle detection scheme is fully userconfigurable to accommodate most commonly used geometric shapes, not just spherical and circular ones.
Particle Linking
TPT is a featurevector based particle tracking method, which utilizes the randomness of the particle locations to create a particledescriptor based on the spatial positions of neighboring particles. The particles are linked between two image frames such that each particle pair has the smallest L^{2} particle descriptor distance. The particle descriptor and particle linking process is described in the Results section. To remove false particle links produced during the particle matching step, TPT utilizes the similarity of neighborhood test and a displacement outlier removal scheme. The similarity of neighborhood test uses the idea that when a particle moves between image frames, it should be surrounded by some of the same neighboring particles. To assure neighborhood similarity, the condition that at least p out of q nearest neighboring particles are the same from the reference and deformed frames needs to be satisfied. The image dimensionality, displacement field, and particle seeding density dictate appropriate values for p and q. In our studies, p = 2 and q = 5 perform well for a variety of displacement fields and particle seeding densities in our 3D images. Additionally, displacements computed from each particle link are analyzed using the universal median test^{53} to remove potential outliers. The links verified by these two tests are converted to successful particle matches.
Iterative Deformation Warping
TPT uses the iterative deformation warping scheme^{51} to track large motion fields as shown in Fig. 1. Let the particle positions in the reference and deformed images in the k^{th} iteration of deformation warping be \({x}_{i}^{k}\) and \({y}_{i}^{k}\), respectively. From matched particle pairs, the displacement field at matched particle positions in the reference image is calculated as \({u}_{i}^{m}={y}_{i}^{m}{x}_{i}^{m}\). This displacement field is linearly interpolated to all particle positions x_{ i } and y_{ i } as \({u}_{i}^{k}\) for the k^{th} iteration of deformation warping. The particle positions in the reference and deformed frames are updated in the k^{th} + 1 iteration step as
The particle matching and iterative deformation warping scheme are then iteratively used to track particles on decreasing image subset sizes until the convergence criteria are achieved.
As a final step, the displacements from the tracked particles are interpolated to predict the positions of untracked particles in the reference frame within a userdefined search radius. If a single particle is found within the search radius, and is verified by the earlier outlier removal schemes, the particle pair is added to the list of successful particle matches. This final step improves the recovery ratio of the TPT algorithm.
Implementation
A parallelized version of our TPT algorithm is implemented in Matlab 2017a, and this algorithm is freely available on our Github page (https://github.com/FranckLab/).
Hardware
All computations for execution time estimates for the various algorithms were performed on a PC with an Intel i7 6700 K clocked at 4.0 GHz and 32 GB of memory.
Simulation of nonaffine shear deformation
The nonaffine shear deformation is generated by applying a homogeneous simple shear deformation of 10% nominal shearing strain along the xy direction of a volumetric image of size 512 × 512 × 192 voxels as shown in Fig. 4c. Superimposed on the affine displacement field, is a nonaffine displacement field of a normal distribution with a mean of zero and a standard deviation of 0.75 voxels along the x, y and z directions. The displacement field was prescribed to the 50,000 particles randomly seeded into synthetically generated images.
CFD simulation of fluid flow around cylinders
A 2D fluid flow around a stack of periodicallyspaced cylinders is simulated using COMSOL Multiphysics 5.2 (Burlington, MA, USA) (Fig. 4f). The computations were performed using the singlephase, timedependent (unsteady) laminar flow physics module. We use a smoothed step function to ramp up the inlet velocity to 1 m.s^{−1}. The fluid is modeled as incompressible with a density of 1 kg.m^{−3} and dynamic viscosity of 1 × 10^{−4} kg.m^{−1}.s^{−1}. The Eulerian mesh is produced using Comsol’s physicscontrolled mesh sequence type with element size set to extremely fine, resulting in a final mesh of 80,638 domain elements and 1078 boundary elements. The fluid displacement field from Comsol model is prescribed to 45,000 particles randomly embedded in a synthetically generated image pair of size 2048 × 2048 pixels.
Experimental Method
Preparation of Polyacrylamide Substrates
Soft polyacrylamide (PA) gels were prepared as previously described by Toyjanova et al.^{17}. in 24well glass bottom plates (Cellvis, P241.5HN). Each well was activated via treatment with 0.5% (v/v) of (3aminopropyl)triethoxysilane (Sigma Aldrich) in ethanol, followed by 0.5% glutaraldehyde (Polysciences, Inc) in deionized water. Hydrophobic cover glass (12 mm diameter, Fisher Scientific) was also prepared by dipping in a solution of 97% (v/v) hexanes (Fisher Scientific), 2.5% (v/v) (tridecafluoro1,1,2,2tetrahydrooctyl)triethoxysilane (Gelest), and 0.5% (v/v) glacial acetic acid (Sigma Aldrich), which was allowed to dry at room temperature. Next, a PA gel solution was prepared using 3% acrylamide (40% w/v, BioRad) and 0.2% N,Nmethylenebisacrylamide (2% w/v, BioRad) to yield a gel with final stiffness of ~1.5 kPa^{17}. Two different color fluorescent beads were also incorporated into the PA gel solution to improve tracking by using multiattribute particles for TPT. Carboxylate modified microspheres (FluoSpheres) were added at a final concentration of 14% and 2%, for 1.0 μm diameter red fluorescent (580/605 nm) and 2.0 μm diameter bluegreen fluorescent (430/465 nm) beads, respectively. We used beads of different sizes due to the lack of availability of both color beads at 1.0 μm diameter. In experiments, we utilized only the color to differentiate between the beads. Next, 12 μL of PA gel solution was pipetted into the activated glass well and flattened with the hydrophobic round cover glass to yield a PA gel of ~70 μm in thickness. The PA solution was allowed to completely gel (30 minutes) before removal of the hydrophobic coverslip. Gels were kept hydrated in phosphate buffered saline (1X PBS) prior to functionalization for cell studies.
Functionalization of Polyacrylamide Substrates for Cell Adhesion
To facilitate cell adhesion to PA gels, the bifunctional crosslinker sulfoSANPAH was deposited onto the gel surface, enabling subsequent collagen I conjugation. PBS was removed from the PA gels in 24well plates and a solution of 1 mg.mL^{−1} sulfoSANPAH (ThermoFisher Scientific) in deionized water was added on top of each gel to yield 25 μg.cm^{−2} sulfoSANPAH. Next, the plate was exposed to UV light for 15 minutes for photoactivation of the crosslinker, the darkened sulfoSANPAH solution was removed, and the process was repeated for a second coating of sulfoSANPAH. After the second deposition, sulfoSANPAH was removed and the wells were washed several times in 1X PBS to remove unreacted sulfoSANPAH. PA gels were then incubated with a dilute solution of rat tail collagen I (Fisher Scientific) in 0.02 N acetic acid overnight at 4°C, to yield a final protein coating of 5 μg.cm^{−2}. The next day, PA gels were washed twice with 1X PBS to remove residual collagen I and acetic acid.
3D Traction Force Microscopy with Breast Cancer Cells
Human metastatic breast adenocarcinoma cells (MDAMB231) were used for TFM studies. MDAMB231 cells with cytoplasmic greenfluorescent protein (GFP) expression were a generous gift from S. Javaid and D. Haber from the Massachusetts General Hospital. Cells were cultured in growth media containing Dulbecco’s Modified Eagle’s medium (DMEM) with Lglutamine, 4.5 g.L^{−1} glucose, sodium pyruvate (Fisher Scientific, MT10013CV) and supplemented with 10% fetal bovine serum and 1% penicillin/streptomycin (Fisher Scientific). Cells were maintained at 37°C and 5% CO_{2} in a humidified incubator. The 24well plates with collagen I coated soft PA gels were equilibrated with 500 μL MDAMB231 growth medium for 30 minutes at 37 °C. Media was aspirated from the wells and MDAMB231 GFPcytoplasm cells were seeded onto PA gels at a density of 3,125 cells cm^{−2} in a total volume of 1 mL of media per well. Cells were allowed to settle and adhere overnight prior to timelapse fluorescence microscopy. Cells and PA gels were imaged using a Nikon AR1 confocal system mounted on a TiEclipse inverted optical microscope controlled by NISElements Nikon Software with a S Plan Fluor ELWD 20 × Ph1 ADM objective (NA = 0.45; Nikon). The blue beads, cells and red beads were excited using lasers of wavelength 405 nm, 488 nm and 561 nm, respectively. A confocal image stack of 512 × 512 × 101 voxels (321.9 × 321.9 × 60.0 μm^{3}) with a zstep of 0.60 μm was recorded every 30 minutes for 2 hours, and cells were maintained at 37°C throughout the experiment via an incubated microscope chamber and thermocouple. After the final timepoint of live imaging, media was aspirated, 1X PBS was added to wash the wells, and 0.05% Trypsin (Fisher Scientific) was added to dissociate cellmatrix attachments. Once cells were fully detached from the PA gels, a final zstack was acquired as a stressfree reference image for comparison to cellbased PA gel deformation and extraction of TFM measurements.
References
 1.
Mason, T. & Weitz, D. Optical measurements of frequencydependent linear viscoelastic moduli of complex fluids. Physical Review Letters 74, 1250–1253 (1995).
 2.
Gittes, F., Schnurr, B., Olmsted, P. D., MacKintosh, F. C. & Schmidt, C. F. Microscopic viscoelasticity: Shear moduli of soft materials determined from thermal fluctuations. Physical Review Letters 79, 3286–3289 (1997).
 3.
Crocker, J. C. et al. Twopoint microrheology of inhomogeneous soft materials. Physical Review Letters 85, 888–891 (2000).
 4.
Wong, I. Y. et al. Anomalous diffusion probes microstructure dynamics of entangled Factin networks. Physical Review Letters 92, 178101 (2004).
 5.
Hoffman, B. D., Massiera, G., Van Citters, K. M. & Crocker, J. C. The consensus mechanics of cultured mammalian cells. Proceedings of the National Academy of Sciences 103, 10259–10264 (2006).
 6.
Mizuno, D., Tardin, C., Schmidt, C. F. & MacKintosh, F. C. Nonequilibrium mechanics of active cytoskeletal networks. Science 315, 370–373 (2007).
 7.
Guo, M. et al. Probing the stochastic, motordriven properties of the cytoplasm using force spectrum microscopy. Cell 158, 822–832 (2014).
 8.
Dembo, M. & Wang, Y. L. Stresses at the celltosubstrate interface during locomotion of fibroblasts. Biophys J 76, 2307–2316 (1999).
 9.
Butler, J. P., Tolic′Nørrelykke, I. M., Fabry, B. & Fredberg, J. J. Traction fields, moments, and strain energy that cells exert on their surroundings. AJP: Cell Physiology 282, C595–C605 (2002).
 10.
Del Álamo, J. C. et al. Spatiotemporal analysis of eukaryotic cell motility by improved force cytometry. Proceedings of the National Academy of Sciences 104, 13343–13348, (2007).
 11.
Sabass, B., Gardel, M. L., Waterman, C. M. & Schwarz, U. S. High resolution traction force microscopy based on experimental and computational advances. Biophysical journal 94, 207–220 (2008).
 12.
Legant, W. R. et al. Measurement of mechanical tractions exerted by cells in threedimensional matrices. Nature Methods 7, 969–971 (2010).
 13.
Stout, D. A. et al. Mean deformation metrics for quantifying 3d cell–matrix interactions without requiring information about matrix material properties. Proceedings of the National Academy of Sciences 113, 2898–2903 (2016).
 14.
Plotnikov, S. V., Pasapera, A. M., Sabass, B. & Waterman, C. M. Force Fluctuations within Focal Adhesions Mediate ECMRigidity Sensing to Guide Directed Cell Migration. Cell 151, 1513–1527 (2012).
 15.
Legant, W. R. et al. Multidimensional traction force microscopy reveals outofplane rotational moments about focal adhesions. Proceedings of the National Academy of Sciences 110, 881–886 (2013).
 16.
Toyjanova, J. et al. High resolution, large deformation 3d traction force microscopy. PLOS ONE 9, e90976 (2014).
 17.
Toyjanova, J., FloresCortez, E., Reichner, J. S. & Franck, C. Matrix confinement plays a pivotal role in regulating neutrophilgenerated tractions, speed, and integrin utilization. Journal of Biological Chemistry 290, 3752–3763 (2015).
 18.
Hall, M. S. et al. Fibrous nonlinear elasticity enables positive mechanical feedback between cells and ecms. Proceedings of the National Academy of Sciences 113, 14043–14048 (2016).
 19.
Hubel, T. Y., Hristov, N. I., Swartz, S. M. & Breuer, K. S. Timeresolved wake structure and kinematics of bat flight. Experiments in Fluids 46, 933 (2009).
 20.
Nawroth, J. C. et al. A tissueengineered jellyfish with biomimetic propulsion. Nature Biotechnology 30, 792–797 (2012).
 21.
Ardekani, R. et al. Threedimensional tracking and behaviour monitoring of multiple fruit flies. Journal of The Royal Society Interface rsif20120547 (2012).
 22.
Manley, S. et al. Highdensity mapping of singlemolecule trajectories with photoactivated localization microscopy. Nature Methods 5, 155–157 (2008).
 23.
Saxton, M. J. & Jacobson, K. Singleparticle tracking: applications to membrane dynamics. Annual review of biophysics and biomolecular structure 26, 373–399 (1997).
 24.
Jaqaman, K. et al. Robust singleparticle tracking in livecell timelapse sequences. Nature Methods 5, 695–702 (2008).
 25.
van der Schaar, H. M. et al. Dissecting the cell entry pathway of dengue virus by singleparticle tracking in living cells. PLoS pathogens 4, e1000244 (2008).
 26.
Ewers, H. et al. Singleparticle tracking of murine polyoma viruslike particles on live cells and artificial membranes. Proceedings of the National Academy of Sciences 102, 15110–15115 (2005).
 27.
Brandenburg, B. & Zhuang, X. Virus trafficking–learning from singlevirus tracking. Nature Reviews Microbiology 5, 197 (2007).
 28.
Wu, M., Roberts, J. W., Kim, S., Koch, D. L. & DeLisa, M. P. Collective bacterial dynamics revealed using a threedimensional populationscale defocused particle tracking technique. Applied and environmental microbiology 72, 4987–4994 (2006).
 29.
Drescher, K., Dunkel, J., Cisneros, L. H., Ganguly, S. & Goldstein, R. E. Fluid dynamics and noise in bacterial cell–cell and cell–surface scattering. Proceedings of the National Academy of Sciences 108, 10940–10945 (2011).
 30.
Meijering, E. et al. Methods for cell and particle tracking. Methods in Enzymology 504, 183–200 (2012).
 31.
Ng, M. R., Besser, A., Danuser, G. & Brugge, J. S. Substrate stiffness regulates cadherindependent collective migration through myosinII contractility. The Journal of Cell Biology 199, 545–563 (2012).
 32.
Wong, I. Y. et al. Collective and individual migration following the epithelialmesenchymal transition. Nature Materials 13, 1063–1071 (2014).
 33.
Gamboa Castro, M., Leggett, S. E. & Wong, I. Y. Clustering and jamming in epithelialmesenchymal cocultures. Soft Matter 12, 8327–8337 (2016).
 34.
Feng, X., Hall, M. S., Wu, M. & Hui, C.Y. An adaptive algorithm for tracking 3d bead displacements: application in biological experiments. Measurement Science and Technology 25, 055701 (2014).
 35.
Boltyanskiy, R., Merrill, J. W. & Dufresne, E. R. Tracking particles with large displacements using energy minimization. Soft Matter 13, 2201–2206 (2017).
 36.
Small, A. & Stahlheber, S. Fluorophore localization algorithms for superresolution microscopy. Nature Methods 11, 267–279 (2014).
 37.
Abraham, A. V., Ram, S., Chao, J., Ward, E. & Ober, R. J. Quantitative study of single molecule location estimation techniques. Optics Express 17, 23352–23373 (2009).
 38.
Cheezum, M. K., Walker, W. F. & Guilford, W. H. Quantitative comparison of algorithms for tracking single fluorescent particles. Biophysical Journal 81, 2378–2388 (2001).
 39.
Parthasarathy, R. Rapid, accurate particle tracking by calculation of radial symmetry centers. Nature Methods 9, 724–726 (2012).
 40.
Liu, S.L. et al. Fast and highaccuracy localization for threedimensional singleparticle tracking. Scientific Reports 3 (2013).
 41.
Ohmi, K. & Li, H.Y. Particletracking velocimetry with new algorithms. Measurement Science and Technology 11, 603 (2000).
 42.
Pereira, F., Stüer, H., Graff, E. C. & Gharib, M. Twoframe 3d particle tracking. Measurement Science and Technology 17, 1680 (2006).
 43.
Sbalzarini, I. F. & Koumoutsakos, P. Feature point tracking and trajectory analysis for video imaging in cell biology. Journal of Structural Biology 151, 182–195 (2005).
 44.
Crocker, J. C. & Grier, D. G. Methods of digital video microscopy for colloidal studies. Journal of Colloid and Interface Science 179, 298–310 (1996).
 45.
Ouellette, N. T., Xu, H. & Bodenschatz, E. A quantitative study of threedimensional lagrangian particle tracking algorithms. Experiments in Fluids 40, 301–313 (2006).
 46.
Pan, B., Qian, K., Xie, H. & Asundi, A. Twodimensional digital image correlation for inplane displacement and strain measurement: a review. Measurement Science and Technology 20, 062001 (2009).
 47.
Sutton, M. A., Orteu, J. J. & Schreier, H. Image correlation for shape, motion and deformation measurements: basic concepts, theory and applications (Springer Science & Business Media, 2009).
 48.
Schrijer, F. F. & Scarano, F. On the stabilization and spatial resolution of iterative piv interrogation. In 13th International Symposium on Applications of Laser Techniques to Fluid Mechanics, Lisbon, Portugal (2006).
 49.
Nogueira, J., Lecuona, A. & Rodriguez, P. Local field correction piv: on the increase of accuracy of digital piv systems. Experiments in Fluids 27, 107–116 (1999).
 50.
Schanz, D., Gesemann, S. & Schröder, A. Shakethebox: Lagrangian particle tracking at high particle image densities. Experiments in Fluids 57, 70 (2016).
 51.
BarKochba, E., Toyjanova, J., Andrews, E., Kim, K.S. & Franck, C. A fast iterative digital volume correlation algorithm for large deformations. Experimental Mechanics 55, 261–274 (2015).
 52.
Gates, M., Lambros, J. & Heath, M. Towards high performance digital volume correlation. Experimental Mechanics 51, 491–507 (2011).
 53.
Westerweel, J. & Scarano, F. Universal outlier detection for piv data. Experiments in Fluids 39, 1096–1100 (2005).
 54.
Tinevez, J.Y. et al. Trackmate: An open and extensible platform for singleparticle tracking. Methods 115, 80–90 (2017).
 55.
Wen, Q., Basu, A., Janmey, P. A. & Yodh, A. G. Nonaffine deformations in polymer hydrogels. Soft Matter 8, 8039–8049 (2012).
 56.
Kähler, C. J., Scharnowski, S. & Cierpka, C. On the resolution limit of digital particle image velocimetry. Experiments in Fluids 52, 1629–1639 (2012).
 57.
Cierpka, C., Lütke, B. & Kähler, C. J. Higher order multiframe particle tracking velocimetry. Experiments in Fluids 54, 1533 (2013).
 58.
ColinYork, H. et al. Superresolved traction force microscopy (stfm). Nano Letters 16, 2633–2638 (2016).
 59.
Plotnikov, S. V., Sabass, B., Schwarz, U. S. & Waterman, C. M. Highresolution traction force microscopy. In Methods in cell biology, vol. 123, 367–394 (Elsevier, 2014).
 60.
Hall, M. S. et al. Toward single cell traction microscopy within 3d collagen matrices. Experimental Cell Research 319, 2396–2408 (2013).
 61.
Sarrió, D. et al. Epithelialmesenchymal transition in breast cancer relates to the basallike phenotype. Cancer Research 68, 989–997 (2008).
 62.
Chenouard, N. et al. Objective comparison of particle tracking methods. Nature Methods 11, 281 (2014).
Acknowledgements
We acknowledge funding from the National Institute of Environmental Health Sciences (T32ES007272), the National Institute of General Medical Sciences (P30GM110759), the National Cancer Institute (R21CA212932), the National Science Foundation (DGE 1058262), and the Office of Naval Research (Dr. Tim Bentley, N000141712644). We wish to thank S. Javaid and D. A. Haber (Massachusetts General Hospital) for the gift of MDAMB231 cell line stably transfected with cytoplasmic GFP, M. S. Hall for providing code for FVRM and W. R. Legant for providing his particle tracking code.
Author information
Affiliations
Contributions
M.P. and C.F. conceived the study. M.P. implemented particle tracking code and simulations with assistance from A.K.L. M.P. and S.E.L. performed experiments. M.P., I.Y.W. and C.F. wrote the paper with feedback from S.E.L. and A.K.L. All authors reviewed the results and commented on the manuscript.
Corresponding authors
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Patel, M., Leggett, S.E., Landauer, A.K. et al. Rapid, topologybased particle tracking for highresolution measurements of large complex 3D motion fields. Sci Rep 8, 5581 (2018). https://doi.org/10.1038/s4159801823488y
Received:
Accepted:
Published:
Further reading

Dynamic Subsurface Deformation and Strain of Soft Hydrogel Interfaces Using an Embedded Speckle Pattern With 2D Digital Image Correlation
Experimental Mechanics (2021)

Smart Digital Image Correlation Patterns via 3D Printing
Experimental Mechanics (2021)

Fast Adaptive Mesh Augmented Lagrangian Digital Image Correlation
Experimental Mechanics (2021)

Part2Track: A MATLAB package for double frame and time resolved Particle Tracking Velocimetry
SoftwareX (2020)

FMTrack: A fiducial marker tracking software for studying cell mechanics in a threedimensional environment
SoftwareX (2020)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.