Abstract
An active solution method of the homography, which is derived from four laser lines, is proposed to recover the pavement cracks captured by the camera to the real-dimension cracks in the pavement plane. The measurement system, including a camera and four laser projectors, captures the projection laser points on the 2D reference in different positions. The projection laser points are reconstructed in the camera coordinate system. Then, the laser lines are initialized and optimized by the projection laser points. Moreover, the plane-indicated Plücker matrices of the optimized laser lines are employed to model the laser projection points of the laser lines on the pavement. The image-pavement homography is actively determined by the solutions of the perpendicular feet of the projection laser points. The pavement cracks are recovered by the active solution of homography in the experiments. The recovery accuracy of the active solution method is verified by the 2D dimension-known reference. The test case with the measurement distance of 700 mm and the relative angle of 8° achieves the smallest recovery error of 0.78 mm in the experimental investigations, which indicates the application potentials in the vision-based pavement inspection.
Similar content being viewed by others
Introduction
Vision-based inspection1,2,3,4 is broadly applied in the fields of the mechanical part manufacture5,6, the dimension measurement7,8, the diagnostic equipment9,10,11 and Fourier profilometry12,13,14, etc. The crack on the pavement is one of the most important inspection objects in the vision-based inspection. Although the road surfaces with the extreme roughness do not evidently cause the serious traffic accidents due to the cautiousness of the drivers15, the previous studies indicate that a significant decrease in the road capacity of about 30% is attributable to the road pavement distress16. Moreover, the two-lane-road capacity is augmented by 10–15% according to a perfect driving surface17. Thus, the quantitive detection and evaluation of the crack are beneficial to extend the lifetime of the pavement18 and enhance the driving quality as well as the traffic safety19.
The inspections of the pavement cracks include three kinds of methods. The first kind of methods is the measurement on the basis of the linear array camera20. Mraz A.21 constructs a pavement imaging system with the line array camera at a preset height and a computer. According to different light conditions, an additional lighting system is designed for the inspection system. The accuracy of the pavement image system is evaluated on different lighting conditions. The detection system named the automated pavement distress survey (APDS) is designed by Yao M.22 to achieve the automatic inspection of pavement cracks. The developed system consists of two line-scan cameras. The exposure settings of the two cameras are different to deal with different lighting conditions. The calibration method for the line-scan cameras and the image fusion approach are introduced in the study. The linear array camera has only one line of photosensitive elements. Therefore, it takes the advantages of the high resolution and frequency. However, in the scanning applications, the linear array camera is fixed on the moving vehicle. As the speed of the vehicle and the lateral sliding is difficult to measure accurately, the information combination of the pavement cracks is the problem to solve. The second kind of methods is provided by the laser scanner23. Li Q.24 presents a pavement generation method with the triangulation of structured light. The method consists of filtering, edge detection, spline interpolation, and laser stripe location. The pavement surface is derived from the laser stripe on the pavement. The laser scanner reconstructs the pavement cracks by 3D information. Li L.25 proposes a bounding box-based technique in order to separate the captured cracks to appropriate types. The cracks are recognized by a seed fusion method and a pavement generation system. The bounding box is determined by road marks and wheel paths, by which the cracks are classified and measured. Li W.26 outlines a detection method for the pavement cracks, on the basis of the empirical mode decomposition (EMD). The region-grow method and morphology are performed on the binary crack images. A deep-learning network, instead of the convolutional neural network, is employed by Zhang A.27 for the pavement crack detection. The method eliminates the pooling layers to simple the outputs of former layers. The laser-scanner-based approaches reconstruct the pavement cracks by 3D information. Nevertheless, the laser scanner on the vehicle tends to be influenced by the weather and cannot contribute the color information of the measured object. In addition, the laser scanner is the much more expensive than the cameras for the normal applications. The third kind of methods refers to capture the image by the planar array camera28. Tsai Y.29 evaluates the image segmentation methods, including the statistical thresholding, the edge detection, the multiscale wavelets, the iterative clipping and the dynamic optimization, for the pavement crack sealing. The pavement images with diverse lighting conditions and cracks are provided to test the method performances. The planar array camera is the measurement technology that is widely used in the most vision-based cases. The planar array camera directly captures the 2D image in the test. Hence, it is an effective and economical way for the situations requiring the moderate solution. Nevertheless, in the pavement crack measurement, the images captured from the planar array camera are measured by image pixels. The pavement cracks are dimensioned by millimeters. Thus, the cracks in the image plane should be transformed to the real cracks on the pavement plane. The pavement plane can be generated from a 2D dimension-known reference on the pavement and the Zhang’s method. The bridge from the image plane to the pavement plane is represented by a 2D-2D homography. However, the homography is not a constant matrix due to the relative motion between the camera fixed on the vehicle and the pavement. Thus, an active solution approach is proposed to contribute the homography from the image to the pavement. There are 8 freedoms of the 2D-2D homography without regard to the global freedom. Moreover, a pair of corresponding points determines 2 freedoms in the homography. Therefore, 4 laser lines, which aim to achieve the minimum number of the laser projection points on the pavement, are chosen in the active solution method.
The rest paper consists of three parts. Section 2 constructs the geometrical model of the active solution of the homography. The laser points of the laser lines are derived from the projections on the 2D reference in different positions. Then, the 3D laser lines are initialized and optimized by the 3D laser points in the camera coordinate system. Finally, the laser lines are projected to the pavement. The homography is determined by the laser projections on the pavement and the related image points. Section 3 performs the experiments to recover the pavement cracks with the active solution of homography. The recovery accuracy is also estimated in the experiments. Section 4 provides the conclusion.
Geometrical Model of Homography
The measurement system, as illustrated in Fig. 1, consists of four laser projectors and a camera. The positions of the projectors are fixed relative to the camera. A planar target is employed as the reference of the calibrations for the camera and laser lines. The world coordinate system, the camera coordinate system and the image coordinate system are attached on the target, camera and image, respectively. Here, the camera coordinate system is considered as the global coordinate system.
The target is moved to different positions in the view field of the camera. Therefore, the laser lines intersect the target at the laser points on the target. The laser point in the world coordinate system is projected to the image and recovered by30
where \({\hat{{\bf{M}}}}_{i,j}^{{\rm{W}}}\) is the homogeneous coordinates of the x, y coordinates of the laser point in the world coordinate system. As the z coordinate is zero on the target plane, the laser point \({{\bf{M}}}_{i,j}^{{\rm{W}}}\) can be derived from \({\hat{{\bf{M}}}}_{i,j}^{{\rm{W}}}\). i = 1, 2, …, n is the number of the positions of the target. j = 1, 2, 3, 4 is the number of the laser lines. K is the intrinsic parameter matrix of the camera. R i = [ri,1, ri,2, ri,3] and t i are the rotation matrix and translation vector from the world coordinate system to the global coordinate system. Zhang’s method30 is chosen to calibrate K, R i t i . \({{\bf{m}}}_{i,j}^{{\rm{W}}}\) is the laser point in the image coordinate system.
In order to represent the laser points in the global coordinate system, the laser point is transformed to31
where \({{\bf{M}}}_{i,j}^{{\rm{C}}}={[{x}_{i,j}^{{\rm{C}}},{y}_{i,j}^{{\rm{C}}},{z}_{i,j}^{{\rm{C}}},1]}^{{\rm{T}}}\) is the laser point in the camera coordinate system.
In the set of the laser points in the camera coordinate system, two laser points \({{\bf{M}}}_{1,j}^{{\rm{C}}}\), \({{\bf{M}}}_{2,j}^{{\rm{C}}}\) far away from each other in the j-th laser line are chosen to initially define the laser line by
Then the parameterized displacements from the other laser points in the set to the laser line are adopted to refine the laser line. The optimization function derived from the sum of the displacements is given by
where \({x}_{1,j}^{{\rm{C}}},{y}_{1,j}^{{\rm{C}}},{z}_{1,j}^{{\rm{C}}},{x}_{2,j}^{{\rm{C}}},{y}_{2,j}^{{\rm{C}}},{z}_{2,j}^{{\rm{C}}}\) are the unknown parameters that define the laser line. The parameters are initialized by the results of Eq. (3) and identical to the arguments related to the minimization of the function.
Due to Eq. (4) and the Graßmann-Plücker relation32, the optimized laser line can be represented by the Plücker matrix
where \({{\rm{\Lambda }}}_{j}^{\ast }\) is the plane-indicated Plücker matrix of the optimized laser line. The generation process of the optimized laser line is described in Fig. 2.
The four laser lines are generated from Eq. (5). The laser projectors and camera are both attached on the vehicle in the pavement test. In Fig. 3, the laser lines are projected on the pavement. The laser points \({{\bf{M}}}_{q,j}^{{\rm{R}}}\) are derived from the intersections between the laser lines and the q-th pavement plane, q = 1, 2, …, m. All the pavement intersection points are represented in the global coordinate system.
The intersection point is on the laser line \({{\rm{\Lambda }}}_{j}^{\ast }\) and satisfies31
The laser point on the pavement also obeys the projection relationship of33
where \({{\bf{m}}}_{q,j}^{{\rm{R}}}\) is the image mapping of the laser point on the pavement, s q is the scale factor.
The laser point on the pavement is generated from Eqs (6) and (7). The laser point obeys the condition of the laser point on the pavement plane31. However, in view of the practical non-coplanarity of the four laser points on the pavement, the integrated pavement plane is determined by the four laser points on the pavement as
where Γ q is the q-th integrated pavement plane.
The pavement plane is derived from Eq. (8). Although the homography is determined by the relationship between the image plane and the pavement plane, there are no enough constraints to solve the homography from two planes above. Hence, we propose a method to generate the homography from the perpendicular feet \({{\bf{M}}}_{q,j}^{{\rm{V}}}\) of the four laser points.
Considering the condition of the perpendicular feet on the integrated pavement plane31, the perpendicular foot satisfies
We construct the vector consisting of the laser point and its perpendicular foot \(({{\bf{M}}}_{q,j}^{{\rm{R}}}-{{\bf{M}}}_{q,j}^{{\rm{V}}})\). \({{\bf{M}}}_{q,k}^{{\rm{V}}}\) and \({{\bf{M}}}_{q,k-1}^{{\rm{V}}}\) are two points different from \({{\bf{M}}}_{q,j}^{{\rm{V}}}\) on the pavement plane. The vector \(({{\bf{M}}}_{q,j}^{{\rm{R}}}-{{\bf{M}}}_{q,j}^{{\rm{V}}})\) is orthogonal to the vectors \(({{\bf{M}}}_{q,k}^{{\rm{V}}}-{{\bf{M}}}_{q,k-1}^{{\rm{V}}})\) in the pavement plane. Thus,
The perpendicular feet of the four laser points are solved by stacking Eqs (9) and (10). The homography H q is then solved by32
The homography H q is determined by the singular value decomposition (SVD) method34. The active solution process of the homography H q that is generated from the four laser points is shown in Fig. 4.
Results
The experiments are performed by an Industrial Vision HT-U300C camera, which has the 2048 × 1536 image resolution and 3.0 megapixels. It is an industrial camera with the focus scope of 4 mm-12 mm and an aperture of F1.6. The laser line is generated from a Class IIIa Product SYD1230 laser projector. The output power of the line-laser projectors is 20 mW and the peak wavelength is 650 nm. The 2D target is a 150 mm × 150 mm board that is covered by the 10 mm × 10 mm rectangles. First, the camera is calibrated by the target board to obtain the internal and external parameters of the camera. The laser projectors provide four laser lines on the target and generate four laser points. The positions of the four laser lines are solved by the intersection laser points on the target. Then, the laser lines are projected to the pavement. The camera captures the images of the cracks and the laser projections. The homography is generated from the laser projections on the pavement. Finally, the pavement cracks are extracted in the image and transformed to the pavement plane by the active solution of the homography. The recovery results of the pavement cracks are shown in Fig. 5. Figure 5(a)–(d) and (i)–(l) are the pavement crack images. Figure 5(e–h) and (m–p) are the reconstructed pavement cracks. According to the active solution of the homography, the image coordinates of the pavement cracks are transformed to the real-dimension coordinates on the pavement plane.
In order to evaluate the accuracy of the active solution method, the recovery errors of the homography are verified by experiments. The 225 corners of the checkerboard pattern on the target board are extracted as the feature points. The homography matrix is solved by the proposed method. The image coordinates of the 225 feature points are transformed to the real-dimension pavement coordinates by the homography. The recovery accuracy is evaluated by the differences between the reconstructed real-dimension coordinates and the real coordinates of feature points on the target. Two impact factors are considered in the experiments. One factor is the measurement distance between the target and the camera. The other factor is the relative angle between the optical axis of the camera and the normal vector of the target. In addition, the initialization method and the optimization method of the laser
line are used to calculate the recover errors to verify the accuracy of the homography. The experimental results are shown in Fig. 6. EinX and EinY denote the X, Y-direction errors between the coordinates of the recovery feature points and the coordinates of the true feature points in the initialization method. EopX and EopY denote the X, Y-direction errors between the coordinates of the recovery feature points and the coordinates of the true feature points in the optimization method. Ein and Eop represent the combined errors between the recovery feature points and the true feature points by the means of the initialization method and optimization method. Furthermore, Fig. 7 shows the statistical means and maximums of the errors between the recovery feature points and the real feature points under different experimental conditions. In Fig. 7(a), the golden balls and the green balls represent the means of the errors between the recovery feature points and the real feature points in the optimization method and initialization method, respectively. In Fig. 7(b), the golden balls and the green balls represent the maximums of the errors between the recovery feature points and the real feature points in the optimization method and initialization method, respectively.
In Fig. 7, when the relative angle between the normal vector of the target and the optical axis of the camera is 4° and the measurement distances between the target and the camera are 500 mm, 600 mm, 700 mm and 800 mm, the means of the recovery errors are 2.37 mm, 1.94 mm, 1.22 mm and 1.88 mm in the optimization method. The corresponding maximums of the errors are 5.41 mm, 3.41 mm, 2.34 mm and 4.00 mm. Moreover, for the initialization method, the means of the errors are 2.45 mm, 2.11 mm, 1.59 mm and 2.50 mm. the corresponding maximums are 6.39 mm, 4.09 mm, 3.48 mm and 5.16 mm. The recovery errors derived from the optimization method are smaller than the errors from the initialization method. It can be observed that the recovery errors decrease evidently when the measurement distance increases from 500 mm to 700 mm. However, when the measurement distance is up to 800 mm, the recovery errors become larger. Thus, in the test results under the relative angle of 4°, the recovery errors are smaller than others when the measurement distance is 700 mm. The test results correspond to Fig. 6(a–d). The recovery errors of Fig. 6(c) are more concentrative to zero than the errors of others.
The second group of tests is achieved by the relative angle of 8° and the measurement distances of 500 mm, 600 mm, 700 mm and 800 mm. The means of recovery errors are 2.03 mm, 1.86 mm, 0.79 mm and 1.51 mm in the optimization method in Fig. 7. The corresponding maximums are 5.18 mm, 2.94 mm, 1.52 mm and 2.87 mm in the optimization method. Furthermore, for the initialization method, the recovery errors are 2.29 mm, 2.00 mm, 1.47 mm and 2.25 mm. The related maximums are 6.37 mm, 4.07 mm, 3.98 mm and 4.00 mm. In this case the conclusion can be reached that when the measurement distance rises from 500 mm to 700 mm, the errors of recovery experiments decrease significantly. Then the recovery errors grow up on the condition that the measurement distance is 800 mm. Figure 6(e–h) relates to the group of experiments. The recovery errors of Fig. 6(g) are closer to zero than others. The tendencies of recovery errors of the optimization method and the initialization method are the same. In addition, the green balls are obviously higher than the golden balls in Fig. 7. So the recovery errors from the optimization method are smaller than the errors from the initialization method.
When the relative angle is 12° and the measurement distances are 500 mm, 600 mm, 700 mm and 800 mm, the means of recovery errors are 2.17 mm, 2.06 mm, 1.68 mm and 2.00 mm in the optimization method. The corresponding maximums are 4.98 mm, 3.07 mm, 2.72 mm and 3.02 mm. Besides, the means of the recovery errors are 2.77 mm, 2.72 mm, 1.98 mm and 2.83 mm in the initialization method. The corresponding maximums are 6.74 mm, 5.78 mm, 3.99 mm and 6.19 mm. The smallest errors in this test group are observed with respect to the measurement distance of 700 mm. The recovery errors in Fig. 6(k) are more approaching to zero than errors of others in Fig. 6(i–l). The green balls are higher than the golden balls. Therefore, the recovery errors derived from the optimization method are smaller than the errors from the initialization method.
The last group of experiments is performed by the relative angle of 16° and the measurement distances of 500 mm, 600 mm, 700 mm and 800 mm. The means of the recovery errors are 2.64 mm, 2.39 mm, 1.84 mm and 2.30 mm in the optimization method in Fig. 7. The corresponding maximums are 4.41 mm, 5.00 mm, 3.47 mm and 4.36 mm. Then, the means of the recovery errors are 3.00 mm, 3.08 mm, 2.44 mm and 3.08 mm and the corresponding maximums are 6.59 mm, 6.70 mm, 6.11 mm and 6.43 mm in the initialization method. The smaller errors are contributed when the relative angle is 12° and the measurement distance is 700 mm. The small errors from the optimization method are also observed in Fig. 7. The error reductions of the optimization method relative to the initialization method are described in Table 1, under the measurement distances of 500 mm, 600 mm, 700 mm, 800 mm, and the measurement angles of 4°, 8°, 12°, 16°. The average error reduction of the optimization method is 20.33%.
Discussion
In the test, the relative angle between the normal vector of the target and the optical axis of the camera increases from 4° to 16° with the interval of 4°. The means of the recovery errors are 1.85 mm, 1.55 mm, 1.98 mm and 2.29 mm in the optimization method and 2.16 mm, 2.00 mm, 2.57 mm and 2.90 mm in the initialization method. Hence, the recovery errors decrease when the relative angle increases from 4° to 8°. Recovery errors show a trend of steady growth when the relative angle increases from 8° to 16°. Moreover, when the angle is 12°, the errors are greater than 4° but less than 16°. Due to the virtual camera optical axis, it is impossible to obtain the true relative angle between the normal vector of the target and the optical axis of the camera. So the small relative angles generally contribute the better results than the large angles. Furthermore, the measurement distance between the camera and the measured object is also a factor that affects the errors of recovery experiments. The measurement distance increases from 500 mm to 800 mm, the means of the recovery errors are 2.31 mm, 2.06 mm, 1.38 mm and 1.92 mm in the optimization method and 2.62 mm, 2.48 mm, 1.87 mm and 2.66 mm in initialization method. So the errors of the recovery experiments are minimal when the distance is 700 mm. The errors of the recovery experiments obviously decrease when the distance increases from 500 mm to 700 mm. When the measurement distance is 800 mm, the recovery errors are larger than the errors at the distance of 700 mm, but slightly smaller than 600 mm. In summary, the experimental results show that the recovery values are closest to the real values when the measurement distance is 700 mm and the relative angle is 8°. The recovery errors of the optimization method are less than the errors of the initialization method in the verification experiments. Therefore, the optimization of the four laser lines reduces the experimental errors effectively. As the homography between the image plane of the camera and the base plane of the measured object plays an important role in various inspections, the active solution method of the homography for the pavement crack recovery with four laser lines can be widely popularized to the measurements of mechanical parts, electronic devices, architecture, etc.
Summary
An active solution method of the homography is presented to recover the pavement cracks. The homography is generated from the pavement projections of four laser lines. The measurement distance between the camera and the target as well as the relative angle between the normal vector of the target and the optical axis of the camera are considered as the two impact factors on the recovery errors in the experiments. The global mean of the recovery errors of the initialization method is 2.41 mm and the global mean of the recovery errors of the optimization method is 1.91 mm. The experimental results show that the active solution method of the homography is a valid and accurate approach in the research field of the vision-based pavement measurement. Furthermore, for other vision-based inspections, it is also important to generate the homography from the dimension of the image plane to the dimension of the base plane. Therefore, the active solution method of the homography for the pavement crack recovery with four laser lines have the potentials to the measurements of mechanical parts, electronic devices, architecture, etc. In future work, the enhancement method to reduce the sunlight influence should be investigated for further applications.
Data availability
The datasets generated during the current study are available from the corresponding author on reasonable request.
References
Frollo, I., Krafčík, A., Andris, P., Přibil, J. & Dermek, T. Circular samples as objects for magnetic resonance imaging - mathematical simulation, experimental results. Meas. Sci. Rev. 15, 313–318 (2015).
Phromsuwan, U., Sirisathitkul, Y., Sirisathitkul, C., Muneesawang, P. & Uyyanonvara, B. Quantitative analysis of X-ray lithographic pores by SEM image processing. Mapan-J. Metrol. Soc. I. 28, 327–333 (2013).
Glowacz, A. & Glowacz, Z. Diagnosis of the three-phase induction motor using thermal imaging. Infrared Phys. Techn. 81, 7–16 (2017).
Murawsk, K. New vision sensor to measure gas pressure. Meas. Sci. Rev. 15, 132–138 (2015).
Ren, Z., Liao, J. & Cai, L. Three-dimensional measurement of small mechanical parts under a complicated background based on stereo vision. Appl. Optics 49, 1789–1801 (2010).
Groot, P., Biegen, J., Clark, J., Lega, X. C. & Grigg, D. Optical interferometry for measurement of the geometric dimensions of industrial parts. Appl. Optics 41, 3853–3860 (2002).
Bell, T., Vlahov, B., Allebach, J. P. & Zhang, S. Three-dimensional range geometry compression via phase encoding. Appl. Optics 56, 9285–9292 (2017).
Chen, S., Wu, C., Tie, G. & Zhai, D. Stitching test of large flats by using two orthogonally arranged wavefront interferometers. Appl. Optics 56, 9193–9198 (2017).
Elhaddad, M. T. & Tao, Y. K. Automated stereo vision instrument tracking for intraoperative OCT guided anterior segment ophthalmic surgical maneuvers. Biomed. Opt. Express 6, 3014–3031 (2015).
Liu, X., Balicki, M. R., Taylor, H. & Kang, J. U. Towards automatic calibration of Fourier-domain OCT for robot-assisted vitreoretinal surgery. Opt. Express 18, 24331–24343 (2010).
Glowacz, A., Glowacz, W., Glowacz, Z. & Kozik, J. Early fault diagnosis of bearing and stator faults of the single-phase induction motor using acoustic signals. Measurement 113, 1–9 (2018).
Li, B., An, Y. & Zhang, S. Single-shot absolute 3D shape measurement with Fourier transform profilometry. Appl. Opt. 55, 5219–5225 (2016).
Yun, H., Li, B. & Zhang, S. Pixel-by-pixel absolute three-dimensional shape measurement with modified Fourier transform profilometry. Appl. Opt. 56, 1472–1480 (2017).
Tian, G. et al. Green decoration materials selection under interior environment characteristics: a grey-correlation based hybrid MCDM method. Renew. Sust. Energ. Rev. 81, 682–692 (2018).
Li, Y., Liu, C. & Ding, L. Impact of pavement conditions on crash severity. Accident Anal. Prev. 59, 399–406 (2013).
Chandra, S. Effect of road roughness on capacity of two-lane roads. J. Transp. Eng. 130, 360–364 (2004).
Ben-Edigbe, J. & Ferguson, N. Extent of capacity loss resulting from pavement distress. Transport 158, 27–32 (2005).
Vilaa, J. L., Fonseca, J. C., Pinho, A. C. M. & Freitas, E. 3D surface profile equipment for the characterization of the pavement texture-TexScan. Mechatronics 20, 674–685 (2010).
Ouyang, W. & Xu, B. Pavement cracking measurements using 3D laser-scan images. Meas. Sci. Technol. 24, 105204 (2013).
Huang, Y. & Xu, B. Automatic inspection of pavement cracking distress. J. Electron. Imaging 15, 013017 (2006).
Mraz, A., Gunaratne, M., Nazef, A. & Choubane, B. Experimental evaluation of a pavement imaging system: Florida department of transportation’s multipurpose survey vehicle. Transport. Res. Rec. 1974, 97–106 (2006).
Yao, M., Zhao, Z., Yao, X. & Xu, B. Fusing complementary images for pavement cracking measurements. Meas. Sci. Technol. 26, 025005 (2015).
Monti, M. Large-area laser scanner with holographic detector optics for real-time recognition of cracks in road surfaces. Opt. Eng. 34, 2017–2023 (1995).
Li, Q., Yao, M., Yao, X. & Xu, B. Real-time 3D scanning system for pavement distortion inspection. Meas. Sci. Technol. 21, 015702 (2010).
Li, L. & Wang, K. Bounding box-based technique for pavement crack classification and measurement using 1 mm 3D laser data. J. Comput. Civil Eng. 30, 04016011 (2016).
Li, W., Ju, H., Tighe, S. L., Ren, Q. Q. & Sun, Z. Y. Three-dimensional pavement crack detection algorithm based on two-dimensional empirical mode decomposition. J. Transp. Eng. 143, 04017005 (2017).
Zhang, A. et al. Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-learning network. Comput.-Aided Civ. Inf. 32, 805–819 (2017).
Shang, Y., Yu, Q. & Zhang, X. Analytical method for camera calibration from a single image with four coplanar control lines. Appl. Optics 43, 5364–5369 (2004).
Tsai, Y. C., Kaul, V. & Mersereau, R. M. Critical assessment of pavement distress segmentation methods. J. Transp. Eng. 136, 11–19 (2010).
Zhang, Z. A. flexible new technique for camera calibration. IEEE Trans. Pattern Anal. 22, 1330–1334 (2000).
Hartley, R. & Zisserman, A. Multiple view geometry in computer vision. (Cambridge University, 2003).
Faugeras, O. D., Luong, Q. T. & Papadopoulo, T. The geometry of multiple images: the laws that govern the formation of multiple images of a scene and some of their applications. (MIT, 2004).
Abdel-Aziz, Y. I. & Karara, H. M. Direct linear transformation into object space coordinates in close-range photogrammetry. Proceedings of the Symposium on Close-Range Photogrammetry Falls Church, USA, 1–18 (1971).
Nocedal, J. & Wright, S. Numerical optimization. (Springer, 2006).
Acknowledgements
This work was funded by National Natural Science Foundation of China under Grant Nos 51478204, 51205164, and Natural Science Foundation of Jilin Province under Grant Nos 20170101214JC, 20150101027JC.
Author information
Authors and Affiliations
Contributions
G.X. contributed the idea, G.X., F.C. and X.T.L. provided the data analysis, writing and editing of the manuscript, G.W.W. and F.C. contributed the program and experiments, G.X. and F.C. prepared the figures. All authors contributed to the discussions.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Xu, G., Chen, F., Wu, G. et al. Active solution of homography for pavement crack recovery with four laser lines. Sci Rep 8, 7198 (2018). https://doi.org/10.1038/s41598-018-25572-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-018-25572-9
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.