Abstract
The quantitative assessment of the image quality produced by atomic force microscopy (AFM) is an ongoing and challenging task. In our study, we demonstrate Shannon’s application of information theory for measuring image quality. Specifically, we propose quantifying the loss of image information due to the various distortion processes by exploring the relationship between image information based on the information channel capacity (ICC), spectral image representation, and visual quality. Since the ideal image is unavailable, the power and noise spectrum, the critical input information for the image quality evaluation, must be robustly estimated in the proposed method. The classical, most popular Welch method for spectral estimation uses an average of several windowed periodograms and can produce biased spectrum estimates. Therefore, in our work, we discuss an alternative technique based on the wavelet transform that can be applied to solve this challenging problem, specifically in the case of noisy, uncertain AFM measurements. Finally, we validate the performance of the enhanced ICC-wavelet-based algorithm with noisy measurement AFM data.
Similar content being viewed by others
Introduction
Scanning probe microscopy (SPM) based technologies, including atomic force microscopy (AFM), have been broadly applied for studying the electrical, mechanical, and other properties of metals, semiconductors, dielectrics, or organic structures. Appropriate signal acquisition can analyse the properties of a sample under consideration. Measurements of force are performed indirectly. The cantilever used in the process is the force-displacement transducer; therefore, measurement is vulnerable to the influence of any external forces. Consequently, uncertainties involved in a measurement process may have various origins. Temperature changes affect the sensor and the sample, changing the noise properties and dimensions. Acoustic noises generated by machines and human activity result in the displacement of the mechanical parts of the detector, influencing the measurement. Electromagnetic noise is constantly present in the background and interferes with the electronic part of the system in the broad spectrum of frequencies. Although several means are undertaken in the system’s design, noises can only partially be sorted out. Therefore, a need emerges to assess the level of noise affecting the measured information quantitatively.
In the past two decades, image quality assessment methods have gained increasing attention from academics and industry for their wide applications in many fields, including compression, fusion, registration, and reconstruction1. Concerning used measures, approaches for image quality evaluation can be classified as quantitative and qualitative techniques. These studies focus on the former method, which applies the information-based capacity criterion by Shannon2 for image quality assessment in the AFM3. More specifically, there are three inspired by information theory approaches to visual quality assessment (QA): (i) with a complete reference model, (ii) with a reduced reference model, (iii) and a no-reference image4,5. The availability of reference information has important practical implications in designing the algorithm for the QA of images. This paper deals exclusively with a no-reference quality assessment method for AFM images.
The AFM image quality is metrologically defined as the trueness of the created topographic map to the original surface. There are numerous possible discrepancies, which will be elaborated on in the following sections. More precisely, due to the measurement procedure in a noisy environment, AFM images can suffer numerous artifacts, such as a dust particle stuck to the tip, a drift, the proportional-integral-derivative (PID) loop going haywire, the sudden tip-sample interaction changes during scanning, to stay with a few. As a result, certain factors decrease the signal-to-noise ratio (SNR), while others can keep SNR-like measures unchanged or even enhance them. For instance, on the one hand, the drift might completely ruin measurements of the grating period, but on the other hand, it may be a minor problem for roughness measurement. The precisely opposite effect brings, for example, tip convolution. Besides, a roughness measurement may have significant lateral positioning errors that will not affect the desired measurement result. Moreover, image quality includes imperfections that influence spatial imaging, reducing spatial resolution. Thus, in our work, we focus predominantly on the influence of the Gaussian-like noise on the AFM procedure, mimicking certain aspects of a harsh environment with a Gaussian-like noise model.
The maximum capacity of the information channel (ICC) by Shannon2, furthermore generalized in6, is explored. According to information theory, the Shannon capacity of a communication channel refers to the maximum amount of error-free information that can theoretically be transferred over the channel without error. From a purely abstract viewpoint, the imaging procedure can be seen as an instance of a communication process. Therefore, assuming that image quality is proportional to the ICC measure, related to the modulation transfer function (MTF) and the level of a perturbed noise4,5,7,8, this technique can also be used for image quality evaluation. In particular, Shannon’s metric was also successfully used in3 to measure the quality of the AFM imaging process quantitatively. However, this measure might be biased due to the uncertainty of the power spectrum estimator. Thus, choosing the right spectrum analysis tool might be challenging. The state-of-the-art spectrum estimation methods are periodogram9, Blackman-Tukey10, Welch11 and Multi-taper approach12. Since the ICC measure might be prone to measurement noise, the wavelet method seems to be a superior tool for spectrum estimation13.
On the one hand, this paper’s main contribution is to enhance the assessment method for the quality of the AFM imaging process. On the other hand, an equally important objective is to provide robust spectral estimates from noisy, uncertain AFM measurements, enabling the extraction of a reliable AFM image spectrum. A spectrum estimation approach based on a wavelet transform is proposed for these reasons. The main challenge for wavelets in this application lies in their capability to deal with singularities and irregular structures apart from the trade-offs they offer in terms of varied metrics, including frequency resolution and variance of the estimated power spectrum14,15. According to the author’s best knowledge, applying the wavelet transform to quantitative AFM image assessment in the context of information theory has not been studied yet in the proposed framework.
AFM image quality assessment
In the case of the AFM technique, the signal-to-noise ratio (SNR) plays a crucial role in assessing image quality apart from the MTF. However, calculating those parameters requires measurements on a specially prepared so-called reference sample, which might seem complicated due to manufacturing uncertainties. Moreover, information on the potential improvements in image quality is often demanded in the early stage of the measurement process. For instance, it allows for calibrating the AFM setup. For this purpose, a single parameter methodology was proposed in3, which allows for quantitative image quality assessment. Another solution, developed in16, relies on estimating the normalized power spectrum’s variance, which requires recording images with relatively high SNR values.
Information channel capacity as image quality measure
The visual quality quantification process is crucial to various image and video processing applications, including AFM measurements. Within this context, we propose measuring the loss of image information due to the various distortion processes by exploring the relationship between image information based on the information theory by Shannon17, its spectral representation, and visual quality. In the following, likewise, as in4,5,7, we presume that Shannon’s information capacity could measure perceived image quality determined by the MTF and noise. As a result of this assumption, the imaging procedure is seen in our work as an instance of a communication process. Consequently, Shannon’s information channel capacity (ICC), which is a function of both bandwidth \(\mathscr {W}\) and the signal-to-noise ratio \(\left( {\frac{{\mathcal{S}}}{{\mathcal{N}}}} \right)\), can be treated as a suitable measure for image quality assessment3,4,5,7,16,18.
According to Theorem 2, from2, the complete one-dimensional equation for Shannon capacity, derived for the signal perturbed by the white thermal noise of power N in the band \(\mathscr {W}\), is given by
with resulting units of information expressed in bits per second, \([\mathrm b/ s]\), where \(\mathscr {S}\) denotes the mean power of a signal. The straightforward generalization of Eq. (1) to the case of the arbitrary Gaussian noise, reads as2,3
where \({\xi }\) denotes the frequency of the spectral component of \(\mathscr {S}({\xi })\) and \(\mathscr {N}({\xi })\), respectively. More specifically, in Eq. (2), the signal and noise power spectrum under the Gaussian assumption can theoretically be estimated by \(\mathscr {P}({\xi }) = \sigma ^2[\mathscr {S}_{\textrm{ideal}}({\xi })]\) and \(\mathscr {N}({\xi }) = \sigma ^2[\mathscr {N}({\xi })]\) with variance denoted by \(\sigma\), respectively. In particular, we suppose that the measured signal includes noise that results in \(\mathscr {P}({\xi })+\mathscr {N}({\xi })=:\sigma ^2[\mathscr {S}({\xi })]\). Finally, we conclude that, as in2,17, in our notation \(N({\xi })\) denotes the noise measured in the presence of signal \(S_{\textrm{ideal}}({\xi })\) (not narrow-band noise of frequency \(({\xi })\)). Furthermore, it is also worth noting that in Eq. (2), the predominant measure of ICC corresponds to the SNR values, while the bandwidth \(\mathscr {W}\) is a result of signal representation only. In addition, the uncertainty of the tested sample design results in uncertainty of its spectrum. Nevertheless, under the assumption that the white model noise is appropriate for the slow scan axis due to the relatively long measurement time, ICC is finally estimated by
where \({{\mathscr {S}}_{N}({\xi })}\) refers to the power spectrum of the noisy signal, and \(\mathscr {F}[\,\cdot \,]\) is the function filter responsible for the thresholding operation of values smaller than 1 to avoid integration of negative values of logarithms due to the uncertain power spectrum estimator.
Moreover, one-dimensional Eq. (3) can straightforwardly be adjusted to a 2D case
where u and v denote the spectral component frequency in x and y direction, respectively. Correspondingly, after using a polar coordinate system with the spectral radius denoted by
with unit (μ m−1) and considering the weak dependence \(\mathscr {S}\) and \(\mathscr {N}\) on \(\theta\), it can finally be transformed into an equation in one dimension as
with \(\kappa ={2\pi }\) and the constant level of white noise denoted by N. The transformation defined by Eq. (6) can also be justified by the fact that significant variation is predominantly concentrated at specific scales in the centre of the 2D power spectrum. Thus, the one-dimensional power spectrum is expressed as
where \(\mathscr {S}^{\textrm{2D}}_{\mathscr {N}}[\cdot]\) denotes the 2D centred power spectrum, approximated by Eq. (8). The unit of the estimated \(\mathscr {C}^{1D}_{r}\) is given in bits per μm (b/μm). It shows the maximum amount of bits of information that (b/μm) of the scanned distance can transmit3. The appropriate reduction of the dimensionality through equivalence classes was also recommended by2,7,17. There exist varied methods which allow for estimating the power spectrum \({{\mathscr {S}}_{N}}({\xi })\) for example, the periodogram technique9, the Blackman-Tukey method10, and the Welch approach11. Another group of algorithms for the power spectrum estimation is the multitaper spectrum estimator proposed by Thomson12 and its natural extension, the wavelet packet approach13.
Fourier transform-based method for power estimation
The common feature of the first group method9,10,11 to estimate the power spectrum is the usage of the two-dimensional (2D) Fourier transform. Denote by \(g(x, y) \in L^2(\textbf{R}^2)\) a square-integrable function whose domain is the spatial location within an image located at coordinates, (x, y), and whose gray level intensity range at this location is bounded by \(0 \le I_v \le 255\). Here, 0 is related to black, while 255 corresponds to white. The exemplary result of the AFM measurement is depicted in Fig. 1. It is treated in our research as the case study for it is not burdened with purposely generated noise. In the experimental part, samples were measured in three different configurations using various intensities of correlated noise. Only based on them the actual information channel capacities were calculated, contributing to the case study. Out of conducted measurements and calculations, several are presented as appendices to the manuscript.
In the classic approach, measurement data g(x, y) are transformed by a windowed 2D Fourier transform given in the continuous form by19,20
with \(j=\sqrt{-1}\), \(x_1 = nx_0, y_1 = my_0, u = lu_0,\) and \(v = pv_0\), \(n,m,l,p \in \textbf{N}\), where \(\circ\) represents an windowing operator with the window function denoted by h(x, y).
Furthermore, the application of Parseval’s theorem, which asserts that the Fourier transform preserves energy, yields the estimation of the power spectrum
with the standard \(\ell ^2\)-norm (the Euclidean norm) defined by \(|\cdot |\). It is a well-known fact that the result of the power estimation depends strongly on the window function to be used9. In the simplest form, the periodogram utilizes a rectangular window. However, its counterpart in the frequency domain is a \({\sin}c\) function, which results in a high sidelobe and significant leakages in the power estimates. For this reason, a window function with a taper that smoothly decays on both sides is used21, for example, Hamming, Blackman-Harris, Tukey and Blackman. The second serious issue with estimating power spectral density with the periodogram is that it results in significant variance and low precision, which cannot be alleviated using more data. The averaging operation of power spectral density is often used as a remedy. The so-called Blackman-Tukey method and the Welch periodogram originated from this idea. For instance, the 1D power spectrum was calculated using Eq. (7) for both presented methods and shown in Fig. 2a and b, respectively.
In addition, we also investigated the influence of wavelet denoising properties on the smoothness of the 1D power spectrogram calculated by either the standard 2DFFT periodogram or the Welch periodogram method (WPM). However, since the noise reduction procedure can also remove information while reducing N(f) at high spatial frequencies below its proper appriori unknown value, and therefore, potentially affecting the MTF (sharpness) of the image, information capacity measurements should be analyzed with caution. Results of filtering 2D AFM image of the case study sample when using the biorthogonal wave function (Specifically, in our computation, (bior4.4) has been used for filtering 2D AFM image which is implemented in MATLAB filter bank.)23 are depicted on Fig. 3a and b, respectively. Since a spike on a relatively smooth power spectrum curve can be easily identified, one can find the cutoff frequency and then estimate the noise level as the average value of the flat part of the spectrum24. This might, in turn, allow for designing a fully automated algorithm for the quality assessment of AFM images.
Wavelet-based approach for power estimation
The multitaper spectrum estimator is another solution that improves vorticity and reduces sidelobe and leakage by developing a set of orthogonal tapers or windows25. The wavelet-based approach for spectral estimation is the natural extension of that method, which also uses different orthogonal decompositions as prototype filters14,15. In the continuous form, a two-dimensional mother wavelet, \(\psi (x,y)\) with dilatation and translation controlled by \((a_1, a_2)\) and \((b_1, b_2)\), respectively, is defined as20
where \(a_i,b_i \in \textbf{R}\) and \(a_i \ne 0\). Analogously as in the case of the Fourier transform, Parseval’s theorem in the wavelet framework states as
with \(\overline{u}(x)\) corresponded to a complex conjugate of u(x), where the Fourier transform of the wavelet function is given as
Form Eq. (11) it can be concluded that the wavelet transforms also preserves energy conservation. However, the definition of the wavelet power spectrum as the squared amplitude of the wavelet transform26 might be troublesome from a physical perspective due to units. Besides, the power wavelet spectrum calculated this way might be distorted and biased in terms of large scales27. A few solutions to this problem are given in28,29. In the end, the two-dimensional wavelet transform of g(x, y) is given by20
In the case of the wavelet transform, calculating a wavelet radius requires only averaging the resulting matrix versus other parameters such as a or \(\theta\). Many distinct types of wavelets26 have found a broad application in the image and signal processing14,15,23. In particular, selecting an appropriate wavelet function, \(\psi\) is a crucial issue when comparing the radially averaged Fourier power spectrum against the global wavelet power spectrum30,31. It results from the fact that this function determines the distribution of the wavelet spectrum. A wide wavelet function provides a more smooth spectrum due to a similarity measure (a scalar product) between each frequency signal component and the windowed wavelet function, which is used for power spectrum estimation. Specifically, the well-known Morlet type wavelet,27,28, which employs more sinusoidal cycles than other wavelet transforms to form the analyzing wavelet, seems particularly attractive for this purpose29,32. Moreover, since the Morlet wavelet transform is defined in the complex domain, the Morlet power spectrum and the Fourier spectrum can be interpreted similarly. The 2D Morlet complex wavelet (or Gabor wavelet) consists of a complex exponential, which is multiplied by a Gaussian window with associated directional dependence as33
with \(\sigma \in \mathbb {R}\), \(\omega _0 \in \mathbb {R}\), \(\varepsilon \in \mathbb {R}\). To fulfill the admissibility condition \(\omega _0 = 5.336\)31.
Another type of wavelet used for a power spectrum analysis is a Fan wavelet function, which is, in essence, a summation of several directional 2D Morlet wavelets spaced along with different directions to have a direction insensitive amplitude response34. Thus, the superposition of the Morlet wavelet is average32
over a finite number of directions with \(\theta _i = \theta _0+i\delta \theta\), where \(\delta \theta =16.29^{\circ}\) for \(\omega _0 = \pi \sqrt{2/ \ln 2} \approx 5.336\). In work32 reported that the Fan and Morlet wavelets belong to the most successful in reproducing the Fourier power spectra. It can be explained by pointing out that these wavelets are, in the space domain, complex exponentials modulated by a Gaussian envelope, which are, in fact, very similar to the Fourier basis functions. For instance, the wavelet-based spectrum using varied mother wavelet function is compared to the classic 2DFFT periodogram technique in Fig. 4.
The following section uses Fourier and wavelet transform for 1D spectrum estimation of AFM images.
Numerical results and discussion
The proposed wavelet-based ICC method for AFM quality assessment was verified using three data series , which include an academic benchmark with generated noised synthetic data, and the analyzed referenced sample affected by two type of various noise sources.
Benchmark with synthetic white noise
To validate the procedure for assessing image quality based on ICC metrics compound with various spectral analyses, we generated artificially an image, shown in Fig. 5, which served as the academic test case. The artificial surface described with the sawtooth signal profile was generated because of a resemblance to the actual measured sample. It was further burdened with white noise generated by a pseudo-random numbers generator recalling the values from a tabularized Gaussian distribution. The matrix of resulting noise was normalized to values of signal-to-noise ratio in the range of 10, 1 and 0.1 dB and subsequently summed with corresponding values of the surface model.
Furthermore, we applied the formula (3) with the 2DFFT periodogram with \(i,j=0,\ldots , P\), \(P=255\), Welch periodogram, and wavelet-based method to estimate the ICC metric. As recommended in27,29,32, we have used the Morlet and Fan wavelets \(\psi _{\textrm{M}}(6,1,1)\) and \(\psi _{\textrm{F}}(6,1,1,8)\) to calculate the wavelet-based power spectrograms, defined by (13) with (14) or (15). For this reason, following26, we have specified the simulation setup: \(s = s_02^{j/J}= [1,\ldots ,180.76]\) with the smallest resolvable scale given by \(s_0=1.0144\) and an integer \(j=[0,\ldots ,J]\) corresponding to the level number with \(J=363\), and, finally, a uniform grid for \(\theta = l\pi /L = [0,\ldots ,3.115]\) with \(l=0,\ldots , L\), \(L = 63\).
Furthermore, to approximate the ICC measure (7), we used the classic trapezoidal method with \(N+1\) evenly spaced points22,35
with a posteriori error estimation given by
where for the last term of (17), an asymptotic error estimate for \(N\rightarrow 0\) is conducted with \(\eta =-\pi /6\) and the first and second derivative denoted by \(f', f''\), respectively. Please note that the approximation error is proportional to \(\xi _h^2\) and depends on the regularity of spectrum given by \(f(\xi )\).
However, if a (spectrum) function \(f(\xi )\) has no bounded a second derivative, i.e. is only a ’rough’ continuous function, the error bound given by (17) is not applicable any more. In such a case, the following sharp error bound for the trapezoidal rule has to be applied36
where \(\sup\) and \(\inf\) denotes suppremum and infimum over a set I, respectively.
In fact, since the spectral analysis has been applied to the sawtooth signal profile, we suppose that the sharp error bound given by (18) is the reliable error estimation. Finally, the results with error analysis provided by (18) estimate are listened in Table 1. In summary, we can conclude that based on the provided error analysis, the ICC measure wavelet approximation seems less biased than those estimations provided by Welch and 2FFT periodogram method, at least for a moderate, practically occurred noise levels. It is strictly related to the regularity of the integrand and the grid size used for the integration.
The artificially generated test case allows us to demonstrate the applicability of the proposed approach in the more challenging measurement setting.
AFM measurements
The first part of the measurement was performed with a white noise signal, in which the root mean square (RMS) value was changed from 0 to 20 V with 5 V step. In the second part, acoustic noise was delivered to the system. The varied music tracks were played during the measurement, acting as the known noise source.
All measurements were performed in contact mode with a sinusoidal speed profile. The speed was one line per second. The scanned area of samples was specified either as 2 by 2 (μm) or 1 by 1 (μm). The reason for the change in sample area was to alter the frequency of details in the topogram. Therefore, the results consisted of a series of AFM images with different noise levels.
Noise modelling
In our paper, two types of noise inputs were utilized to test the influence of types of external noise sources. A distinction is made between white noise and nondeterministic noise. Electronic processing of the signal burdens it with wideband noises. Those wide spectral signals are often referred to as noises of different colours due to similarities to the light spectrum. Among them is white noise, which characterizes the equal distribution of spectral density over all spectrums. This noise was used to elevate the background noise level in the spectrum homogeneously. Moreover, we applied a generator embedded in the function generator to generate white noise. The noise was generated with different RMS values: 5, 10, 15, and 20 V. The results are to be consulted in the appendix Fig. 1.
Music samples were used to simulate natural noise background in the environment with people. The main concern of this measurement was not necessarily a quantitative assessment of the noise level but the ability to differentiate topograms influenced by different types of music, representing different types of background noises. For that purpose, a few pieces of music were used. They were varied from classical music: “Étude Op. 10, No. 12” by F. Chopin, “Piano Concerto no. 4” by S. Rachmaninoff, “Symphony No.9 by A. Dvorak, “Ride of the Valkyries” by R. Wagner, to the modern rock and heavy metal: “You Can’t Teach An Old Dog New Tricks” by Seasick Steve, “Stargazers” by Nightwish, and “Chippin’ in by Samurai. Indeed, different music sounds should contribute differently to the overall noise spectrum. The effect of AFM measurement are to be acquainted with in the supplementary material.
The influence of narrowband noises, which come from mechanical sources, especially motor drives present in pumps, fans, and generators - devices characterized by constant engine speed - is not considered in our paper.
Quantitative assessment of AFM images’ quality
The AFM images of the reference sample were measured to demonstrate the performance of the proposed quality assessment method. These reference samples’ topographies look similar in various configurations of the noise excitation. However, differences in AFM images might be rather identified and assessed qualitatively. A power spectral analysis of images may support the rough observations. For this reason, the ICC-based measure, whose calculation procedure was described in Section "Information channel capacity as image quality measure", was used to assess the quality of the recorded AFM images. The methods for the power spectra estimation, including the 2DFFT periodogram, the WPM, and the wavelet-based periodogram technique, described in Section "AFM image quality assessment", were implemented in Matlab\(^{\circledR }\)22. The implementation of the ordinary periodogram method with the use of the 2DFFT routine and varied windows function has been straightforward.
The WPM provides the power spectral density estimate with the aid of overlapped segment averaging estimator, where each segment can be windowed with various types of windows, as stated in Section Fourier transform-based method for power estimation. In our simulations, we considered the maximal size of the segment of 256 by 256 with 50\(\%\) overlap. Furthermore, for mapping the resulting 2D power spectra into the 1D space, we used Eq. (7). In the end, the 1D power spectral density plots were prepared for all gathered AFM images with the various source of noise as described in Section Noise modelling. Furthermore, since the spectral analysis provided by the standard 2DFFT periodogram and the WPM look similar, specifically compared to the wavelet-based spectra, only the results for the 2DFFT power spectrum are presented in Fig. 6a and b, respectively.
As to the wavelet-based power spectrograms, we applied the Morlet and Fan wavelets as recommended in32. In our simulations, the fast Morlet and Fan wavelet transform27,29 was used for wavelets \(\psi _{\textrm{M}}(6,1,1)\) and \(\psi _{\textrm{F}}(6,1,1,8)\). For convenience, we defined scale s as base 2 exponentials26, that is, \(s = s_02^{j/J}= [1,\ldots ,180.76]\), \(s_0=1.0144\) denoted the smallest resolvable scale and an integer \(j=[0,\ldots ,J]\) representing the level number with \(J=363\). However, we used a uniform grid for \(\theta = l\pi /L = [0,\ldots ,3.115]\) with \(l=0,\ldots , L\), \(L = 63\). To demonstrate the improvements of the wavelet-based method, we compare the 1D wavelet power spectrum results shown in Fig. 7a and b with those provided with the 2DFFT method (cf. Fig. 6a and b) using noised AFM images. It should be noted that the resulting wavelet power spectra’ smoothness properties, on the one hand, allow for automatizing the ICC-based metric of AFM images. For example, a simple procedure for finding an inflection point can be used to identify the background noise. On the other hand, the wavelet-based ICC estimation quality can be significantly improved since the cutoff frequency can be precisely found. In our work, similarly to24, the noise level was estimated as the mean value of the flat part of the spectrum \(S_{\textrm{N}}(\xi )\). Finally, we explored the ICC metrics proposed in24, defined by Eq. (6) with \(\kappa =2\pi\) to assess the quality of the recorded AFM images quantitatively. The ICC-based metrics calculated for all gathered AFM images are listed in Tables 2 and 3, respectively.
Adopting the Shannon theorem from the telecommunication technologies2, the higher values of ICC will specify the higher quality image. This conclusion results from the fact that the amount of error-free information that may be transmitted through the channel is determined by the bandwidth of the communication channel and the signal-to-noise ratio. In our work, we mainly focused on studying the influence of the signal-to-noise ratio as the limitation for the amount of error-free information. In fact, even a cursory examination of Table 2 allows for verifying this theorem in the context of spectral analysis of AFM images: a higher level of noise limits the quality of images. Even though the ICC metrics computed based on three studied methods for power spectra estimation are consistent, the less biased ones seems to be those provided by the wavelet-based method. It results from the fact that background noise can be identified more precisely when considering a smooth continuous spectrum, which might improve the calculation reliability based on the formula (3).
Furthermore, the ICC measure can also be applied to a noise model, which is random but not equally distributed in the frequency spectrum noise model (cf. Fig. 7a and b). An example of such a noise is music, which was used to simulate a noise produced by a human. Undoubtedly, music, being not perfectly described ambient noise source (especially considering its spectrum), is more of a qualitative indicator and a means to provide noise-differentiated samples into exemplary calculations. Also, in this case, the resulting ICC values summarized in Table 3 produced by three different methods show convergence.
Experimental procedures and methods
Principles of AFM operation and sample characterization
SPM techniques, including electrostatic force microscopy (EFM) or AFM, have found broad application in analyzing the surface properties of varied materials3,19. AFM belongs to the SPM family, whose main principle of the measurement is detection of a singular interaction between the probe and the surface - so called atomic forces. Microcantilevers are most often used as probes. In contact mode, a change in sample height is detected by bending a probe by imposing a constant force. Typically, in non-contact mode, a change in the amplitude or frequency of the cantilever vibration is sought, which does not cause surface wear. Additionally, there is no lateral contact force between the probe and the surface, so it is possible to investigate more fragile surfaces (e.g., biofilms, proteins) in this mode37. Among the AFM modes, there is also a place for mixed techniques, which combine properties of both contact and non-contact, e.g., a tapping mode in which the probe touches the surface only at specific points, see, e.g., for details38,39,40,41,42.
Experimental set-up
In our studies, we applied the AFM system for contact measurements with an optical beam deflection (OBD) in the experiment. The purpose of conducting measurements was to register signals with different noise levels. A typical AFM system registers low-band signals - in this case, the upper band limit is 10 kHz, therefore the actuator should have a band broader than from 0.1 to 10 kHz and be applied to the cantilever as closely as possible. Both demands are satisfied by a piezoelectric chip actuator. In our research, we used the Thorlabs piezoelectric chip PA4HEW. A phosphor bronze spring held it together with the cantilever in the holder. Schematics of the setup are presented in Fig. 8. The signal to the piezoelectric chip was delivered from the signal generator Tektronix AFG3021B via the infinite impulse response (IIR) low-pass filter with a cutoff frequency 10 kHz. The filter was necessary to eliminate a resonance of the piezoelectric chip (165 kHz).
In the further phase of our research, we slightly modified the setup to assess the impact of typical acoustic noises on the measurement process. Even though, music usage may seem nonintuitive, we have found it a useful noise source for several reasons. Specifically, we considered music the least consistent noise source, being chaotic in some sense while remaining in a typical frequency range for human activity; concurrently, it is repeatable and of somehow controlled characteristics. The choice of different pieces from different music genres pushed randomization even further, excluding the domination of one set of frequencies. Therefore, it states the intermediate step between a deterministic noise source and an entirely stochastic model. In our case, during the measurements, a noise was emitted with speakers ZX-SPACE ZoltriXound connected to the PC shown in Fig. 9. Speakers were chosen to simulate a noise background typical for the presence of people in the surroundings. They were to emit noise in the acoustic subspectrum between 20 and 10 kHz.
We analysed the same surface in all measurements, SiC with 1.5 nm atomic steps calibration sample. The used cantilevers was a model PPP-CONTSCPt by NANOSENSORS™. They belong to the family of typical contact probes with resonant frequency in the range 1–57 kHz (typically 25 kHz), force constant between 0.01 and 1.87 N/m (typically 0.2 N/m) and full PtIr coating.
The measurement setup offers a sensitivity of 125 nm/V, derived from calibration sample measurements. However, the information capacity of a scanned surface is invariant concerning the transformation of measurements from the voltage to the height domain. In fact, we could even operate on unaltered values as given by the measurement setup.
Measurements performed with the AFM at lower resolutions are highly vulnerable to external noises, which can be present in different forms. In all electronic systems, electrical noises are always present2,3,24, yet, the progress in the field of integrated circuits decreases the influence of those noises. Another source is the construction of actuators for height compensation. In dedicated systems, noises are well-characterized and relatively low. The laser detector light is a typical noise source, apart from the mechanical construction (inert elements, material creep) or temperature (thermal expansion, parasitic thermal deflection). External mechanical noises of acoustic and sub-acoustic frequencies seem most influential. Despite active and passive methods of mechanical noise damping, those signals are frequently observed in measurements.
Acoustic noises consist of harmonic and impulse signals, whereby harmonious signals can be filtered out entirely with active and partly with passive damping. Active vibration cancelling relies on generating signals identical to noise in a reversed phase to cancel both signals in superposition. The passive damping is acoustic filtering, so the system’s physical properties limit the filtered band. Another purpose of passive filtering is, on the one hand, to shift the system’s resonant frequency as low as possible to eliminate the possibility of resonant excitation. On the other hand, impulses are easily damped by passive filtering and are impossible to eliminate with active filtration. Nevertheless, harmonious and impulse noises are finally present in the resulting picture.
In the frequency spectrum, noises are visible as peaks corresponding to specific frequencies (mainly harmonious noises), constant band elevation (thermal, electric, and mechanical noises, also impulses), and frequency-dependent band elevation (e.g., 1/f noise).
Conclusion
Our work has briefly explained the methodology of measurements conducted with the AFM setup to address the important problem of the QA process of AFM images, which must be quantitatively assessed to improve the measurement process or find measurements with the highest quality. However, the ideally conducted data series in the sense of the reference measurements do not exist in this case. Therefore, we have had to apply the ICC metric, adopted from telecommunication technologies and initially proposed by24. In fact, this metric has been widely used in various applications to assess image quality under the assumption to be correlated with MTF and noise4,5,7,8. As this measure is predominantly susceptible to signal-to-noise ratio and image resolution, the superior tool for estimating power spectra is the taper wavelet-based method. On the one hand, it allows for estimating background noise that is a source of bias in the ICC metric. On the other hand, it provides a smooth approximation of power spectra, limiting the spectrum distribution uncertainty. For these reasons, the fast Morlet and Fan wavelet methods have been used in our studies. We used data noised by white noise and a random but not equally distributed frequency spectrum noise model for numerical experiments. Thus, based on our numerical experimentation, we claim that the ICC metric, primarily based on the wavelet approach, could be a robust method enabling the metrological assessment of the recorded AFM images43. In addition, applying the wavelet-based method for the power spectrum estimation might result in a fully automatic procedure for AFM image assessment.
The wavelet transform can also be perceived as an intermediate step between filtration and spectral analysis, which allows for extracting essential features of AFM images. It is seen as a promising direction for future investigations.
Data availability
The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
References
Wang, Z. & Bovik, A. C. Modern Image Quality Assessment (Morgan & Claypool, 2006).
Shannon, C. E. Communication in the presence of noise. Proc. IEEE 86(2), 447–457 (1948).
Kopiec, D., Jóźwiak, G., Moczała, M., Sierakowski, A. & Gotszalk, T. Multifrequency Kelvin probe force microscopy on self assembled molecular layers and quantitative assessment of images’ quality. Ultramicroscopy 194, 100–107 (2018).
Sheikh, H. R. & Bovik, A. C. Image information and visual quality. IEEE Trans. Image Process. 15(2), 430–444 (2006).
Soundararajan, R. & Bovik, A. C. Survey of information theory in visual quality assessment signal. Image Video Process. 7(3), 391–401 (2013).
Verdú, S. & Han, T. S. A general formula for channel capacity. IEEE Trans. Inf. Theory 40, 1147–1157 (1994).
Shaw, R. Application of Fourier technique and information theory to the assessment of photographic image quality. Photogr. Sci. Eng. 6(5), 281–286 (1962).
Byrnes, N. & Foreman, M. R. Universal bounds for imaging in scattering media new. J. Phys. 22, 083023 (2020).
Auger, F. & Flandrin, P. Improving the readability of time-frequency and time-scale representations by the reassignment method. IEEE Trans. Signal Process. 43(5), 1068–1089 (1995).
Blackman, R. B. & Tukey, J. W. The Measurement of Power Spectra from the Point of View of Communications Engineering - Part I The. Bell Syst. Tech. J. 37(1), 185–282 (1958).
Welch, P. W. The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short. Modified Periodograms IEEE Trans. Audio Electroacoust. 15(2), 70–76 (1967).
Thomson, D. J. Spectrum estimation and harmonic analysis. Proc. IEEE 70(9), 1055–1096 (1982).
Vu, D. H. Wavelet-based spectral analysis. Trends Anal. Chem. 62, 144–153 (2014).
Lakshmanan, M. K., Ariananda, D. D., & Nikookar, H. A reconfigurable wavelet packet filter bank transceiver for spectral analysis and dynamic spectrum access. In 2011 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN) 564–575 (2011).
Starck, J.-L., Siebenmorgen, R. & Gredel, R. Spectral analysis using the wavelet transform. Astrophys. J. 482(2), 1011–1020 (1997).
Szeloch, R. F., Janus, P., Serafińczuk, J., Szecówka, P. M. & Jóźwiak, G. Characterization of fatigued Al lines by means of SThM and XRD: Analysis using fast Fourier transform microelectron. Reliab. 52, 711–717 (2012).
Shannon, C. E. A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948).
Levitin, L. B. & Toffoli, T. The capacity of a channel with an image as the information source. J. Quantum Inf. Sci. 4, 111–116 (2014).
Stern, J., Terris, B., Mamin, H. & Rugar, D. Deposition and imaging of localized charge on insulator surfaces using force microscopy. Appl. Phys. Lett. 53, 2717–2719 (1988).
Schmeelk, J. Wavelet transforms on two-dimensional images. Math. Comput. Model. 36, 939–948 (2002).
Lim, J. & Oppenheim, A. V. Advanced Topics in Signal Processing Englewood Cliffs (Prentice Hall, 1988).
MATLAB 9.10.0.1649659 (R2021a). Natick (The MathWorks Inc, 2022).
Daubechies, I. Ten lectures on wavelets. In CBMS-NSF Regional Conference Series in Applied Mathematics (Philadelphia Society for Industrial and Applied Mathematics, 1992)
Jóźwiak, G. et al. The spring constant calibration of the piezoresistive cantilever based biosensor. Sens. Actuators B 170, 201–206 (2012).
Candy, J. V. Multitaper spectral estimation: An Alternative to the Welch periodogram approach. Technical Report by Lawrence Livermore National Lab: LLNL-TR-788954, United States. https://www.osti.gov/biblio/1560107 (2019).
Torrence, Ch. & Compo, G. P. A practical guide to wavelet analysis. Bull. Am. Meteorol. 79(1), 61–78 (1998).
Shyu, H. C. & Sun, Y. S. Construction of a Morlet wavelet power spectrum. Multidimens. Syst. Signal Process. 13, 101–111 (2002).
Büssow, R. An algorithm for the continuous Morlet wavelet transform. Mech. Syst. Signal. Process. 21(8), 2970–2979 (2007).
Chen, C. & Chu, X. Two-dimensional Morlet Wavelet transform and its application to wave recognition methodology of automatically extracting two-dimensional wave packets from lidar observations in Antarctica. J. Atmos. Sol. Terr. Phys. 162, 28–47 (2017).
Perrier, V., Philipovitch, T. & Basdevant, C. Wavelet spectra compared to Fourier spectra. J. Math. Phys. 36, 1506–1519 (1995).
Kirby, J. F. Which wavelet best reproduces the Fourier power spectrum?. Comput. Geosci. 31(7), 846–864 (2005).
Kirby, J. F. & Swain, C. J. Power spectral estimates using two-dimensional Morlet-Fan wavelets with emphasis on the long wavelengths: Jackknife errors, bandwidth resolution and orthogonality properties. Geophys. J. Int. 194(1), 78–99 (2013).
Dallard, T. & Spedding, G. R. 2-D wavelet transforms: Generalisation of the Hardy space and application to experimental studies. Eur. J. Mech. B Fluids 12(1), 107–134 (1993).
Dehaeck, S., Tsoumpas, Y. & Colinet, P. Analyzing closed-fringe images using two-dimensional fan wavelets. Appl. Opt. 54(10), 2939–2952 (2015).
Babuška, I., Nobile, F. & Tempone, R. Worst case scenario analysis for elliptic problems with uncertainty. Numer. Math. 101, 185–219 (2005).
Cruz-Uribe, D. & Neugebauer, C. J. Sharp error bounds for the trapezoidal rule and Simpson’s rule. J. Inequal. Pure Appl. Math. 3(4), 1–22 (2002).
Sozański, K. et al. A depletion layer in polymer solutions at an interface oscillating at the subnano-to submicrometer scale. Soft Matter 10(39), 7762–7768 (2014).
Linnemann, R., Gotszalk, T., Rangelow, I. W., Dumania, P. & Oesterschulze, E. Atomic force microscopy and lateral force microscopy using piezoresistive cantilevers. J. Vac. Sci. Technol. B 14, 856–860 (1996).
Minne, S. C., Manalis, S. R. & Quate, C. F. Parallel atomic force microscopy using cantilevers with integrated piezoresistive sensors and integrated piezoelectric actuators. Appl. Phys. Lett. 67(26), 3918–3920 (1995).
Nieradka, K. et al. Fabrication and characterization of electromagnetically actuated microcantilevers for biochemical sensing, parallel AFM and nanomanipulation. Microelectron. Eng. 98, 676–679 (2012).
Kunicki, P., Angelov, T., Ivanov, T., Gotszalk, T. & Rangelow, I. W. Sensitivity improvement to active piezoresistive AFM probes using focused ion beam processing. Sensors 4429(19), 1–9 (2019).
Pruchnik, B. et al. Study of the efficiency of microcantilevers: Cases of electrothermal and electromagnetic actuation. J. Microelectromech. Syst. 31(5), 784–790 (2022).
Gackenheimer, C., Cayon, L. & Reifenberger, R. Analysis of scanning probe microscope images using wavelets. Ultramicroscopy 106(4–5), 389–397 (2006).
Acknowledgements
The National Science Centre has supported this work, Poland OPUS grant “Nanometrology of Nottingham cooling effect using operational microelectromechanical systems” under project contract no. 2020/37/B/ ST7/03792.
Author information
Authors and Affiliations
Contributions
T.P.G. introduced the methodology. B.C.P. performed experimental part. P.A.P. performed data analysis and prepared quantifical results. All authors wrote and reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Pruchnik, B.C., Putek, P.A. & Gotszalk, T.P. Wavelet-based information theory in quantitative assessment of AFM images’ quality. Sci Rep 14, 3996 (2024). https://doi.org/10.1038/s41598-024-53846-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-53846-y
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.