Abstract
A majority of experimental disciplines face the challenge of exploring large and highdimensional parameter spaces in search of new scientific discoveries. Materials science is no exception; the wide variety of synthesis, processing, and environmental conditions that influence material properties gives rise to particularly vast parameter spaces. Recent advances have led to an increase in the efficiency of materials discovery by increasingly automating the exploration processes. Methods for autonomous experimentation have become more sophisticated recently, allowing for multidimensional parameter spaces to be explored efficiently and with minimal human intervention, thereby liberating the scientists to focus on interpretations and bigpicture decisions. Gaussian process regression (GPR) techniques have emerged as the method of choice for steering many classes of experiments. We have recently demonstrated the positive impact of GPRdriven decisionmaking algorithms on autonomouslysteered experiments at a synchrotron beamline. However, due to the complexity of the experiments, GPR often cannot be used in its most basic form, but rather has to be tuned to account for the special requirements of the experiments. Two requirements seem to be of particular importance, namely inhomogeneous measurement noise (inputdependent or noni.i.d.) and anisotropic kernel functions, which are the two concepts that we tackle in this paper. Our synthetic and experimental tests demonstrate the importance of both concepts for experiments in materials science and the benefits that result from including them in the autonomous decisionmaking process.
Introduction
Artificial intelligence and machine learning are transforming many areas of experimental science. While most techniques focus on analyzing “big data” sets, which are comprised of redundant information, i.e. information that is not strictly needed to define the model confidently, collecting smaller but informationrich data sets has become equally important. Bruteforce data collection leads to tremendous inefficiencies in the utilization of experimental facilities and instruments, in data analysis and data storage; large experimental facilities around the globe are running at 10–20% utilization and are still spending millions of dollars each year to keep up with the increase in the amount of data storage needed^{1,2,3,4}. In addition, conventional experiments require scientists to prepare samples and directly control experiments, which leads to highlytrained researchers spending significant effort on micromanaging experimental tasks rather than thinking about scientific meaning. To avoid this problem, autonomously steered experiments are emerging in many disciplines. These techniques place measurements only where they can contribute optimally to the overall knowledge gain. Measurements that collect redundant information are avoided. These autonomous approaches minimize the number of needed measurements to reach a certain model confidence, thus optimizing the utilization of experimental, computing, and datastorage facilities. Autonomy, in the course of this paper, refers to the machine’s ability to selfdrive measurements of an experiment. Some initial parameters, such as the parameters to explore and their corresponding ranges, have to be defined by the user beforehand.
A universal goal in materials science is to explore the characteristics of a given material across the set of all conceivable combinations of experimental parameters, which can be thought of as a parameter space defining that class of materials. The experimental parameters can be the characteristics of material components, their composition, processing or synthesis parameters, and environmental conditions on which the experimental outcomes depend^{5,6}. Successful exploration of the parameter space amounts to being able to define a highconfidence map, i.e. a surrogate model function, of experimental outcomes across all elements of the set. For twodimensional parameter spaces, this is traditionally achieved by “scanning” the space, often on a simple Cartesian grid. Selecting a scanning strategy implies picking a scan resolution without knowing the model function, which will unequivocally lead to inaccuracies and inefficiencies. When the parameter space is highdimensional, an approach based on intuition is often used, i.e., manually selecting measurements, assessing trends and patterns in the data, and selecting followup measurements. With increasing dimensionality of the parameter space, this method quickly fails to efficiently explore the space and becomes prone to bias. Needless to say, the human brain is generally poorly equipped for highdimensional pattern recognition.
What is needed are methods that decouple the human from the measurement selection process. This fact served as a motivation to establish a research field called design of experiment (DOE)^{7}, which can be traced back as far as the late 1800s. These DOE methods are largely geometrical, independent of the measurement outcomes, and are concerned with efficiently exploring the entire parameter space. The latinhypercube method is the prime example of this class of methods^{8,9}. Most of the recent approaches to steer experiments are part of a field called active learning, which is based on machine learning techniques^{5,10,11,12}. Others have used deep neural networks to make data acquisition cheaper^{13}. Many techniques originated from image analysis^{11,14}, but, as images are traditionally two or three dimensional, these methods rarely scale efficiently to highdimensional spaces. A useful collection of methods can be found in^{15,16}.
Gaussian process regression (GPR) is a particularly successful technique to steer experiments autonomously^{17,18}. The success of GPR in steering experiments is due to its nonparametric nature; simply speaking, the more data that is gathered the more complicated the model function can become. The number of parameters of the function, and therefore its complexity, does not have to be defined a priori. This is in contrast to neural networks, which need a specification of an architecture (number of layers, layer width, activation function) beforehand. The nonparametric nature is not unique to Gaussian processes, but is characteristic to all kernel methods and, in an even broader scope, all methods that approximate a function by a sum of basis functions. The strength of Gaussian processes comes from the fact that kernels are used to define a similarity measure between points, which in turn is used to define a covariance matrix. Therefore, GPR also naturally includes uncertainty quantification, which is an absolute necessity in experimental sciences.
Traditional GPR has mostly been derived and applied under the assumption of independent and identically distributed noise (i.i.d. noise)^{18,19,20,21,22,23}, i.e., noise that follows the same probability density function at each measurement point. Since we are exclusively dealing with Gaussian statistics, this means that all measurements have the same variance. In Kriging, the geostatistical analog of GPR, this concept is called the nugget effect, named after gold nuggets in the subsurface. In early geostatistical computations, the gold nuggets lead to seemingly random errors. These were assumed to be constant across the domain. However, for materialsdiscovery experiments the assumption of i.i.d. noise is an unacceptable simplification. The variance of real experimental measurements vary greatly across the parameter space, and this has to be reflected in the steering process as well as in the final model creation. For instance, in xray scattering experiments, the variance of a raw measurement depends strongly on the exposure time; computed quantities can have wildly different variances depending on the raw data in that part of the space (e.g. fit quality will not be uniform), and material heterogeneity will depend strongly on location within the parameter space. These inhomogeneities in the measurement noise need to be actively included in the final model to avoid interpolation mistakes and consequently erroneous models. Fortunately, noni.i.d. noise can easily be included in the GPR framework^{24,25}. Large variances have to be countered with more measurements in the respective areas until the desired uncertainty threshold is reached. This is naturally taken care of by the noni.i.d Gaussian process since the overall posterior variance (or prediction variance) is a combination of the measurement variance and the variance due to distances from known data. When creating the final model, the algorithm has to incorporate that the final model function does not have to explain data points exactly if there is an associated variance. Therefore, the model function does not have to pass through every data point. After correct tuning, GPR is perfectly equipped for this situation since it keeps track of a probability distribution over all possible model functions; conditioning will then produce the most likely model function incorporating all measurement variances optimally.
Another effect that has a significant impact on autonomous experiments is anisotropy of the parameter space, which is either introduced by differing parameter ranges or different model variability in different parameterspace directions. In isotropic GPR one finds a single characteristic length scale for the data set. This was again motivated by early geostatistical surveys in which isotropy was a good assumption. However, when one of the parameters is of significantly different magnitude, for instance, spatial directions in \(\text {mm}~\in ~[0,1]\) versus temperature in \(^\circ \mathrm {C}~\in ~[5,500]\), we should find different length scales for different directions of the parameter space. Also, there might be different differentiability characteristics in different directions. It is therefore vitally important to give the model the flexibility to account for those varying features. This can either be done by using an altered Euclidean norm, or by employing different norms that provide more flexibility of distance measures in different directions. The general idea, including the concepts proposed in this paper, is visualized in Fig. 1.
The proposed method can be understood as a variant of Bayesian optimization (BO) in which only Gaussian priors and likelihoods are considered. While, as the name suggests, BO is mostly used to find a maximum or minimum, autonomous experimentation makes no such restriction. However, since there is a variety of different objective functions that can be optimized in BO, the proposed method can certainly be understood as a subset of BO. See^{26} for a good overview of Bayesian optimization.
This paper is organized as follows: First, we introduce the traditional theory of Gaussian process regression with i.i.d. noise and standard isotropic kernel functions. Second, we make formal changes to the theory to include noni.i.d. noise and anisotropy. Third, we demonstrate the impact of the two concepts on synthetic experiments. Fourth, we present a synchrotron beamline experiment that exploited both concepts for autonomous control.
Gaussian process regression with noni.i.d. noise and anisotropic kernels
Prerequisite
We define the parameter space \({\mathscr{X}} \subset {\mathbb{R}}^n\), which serves as the index set or input space in the scope of Gaussian process regression and elements \({\mathbf{x}}~\in {\mathscr{X}}\). We define four functions over \({\mathscr {X}}\). First, the latent function \(f=f({\mathbf{x}})\) can be interpreted as the inaccessible ground truth. Second, the often noisy measurements are described by \(y=y({\mathbf{x}}):\; {\mathscr {X}}\; \rightarrow \, {\mathbb {R}}^d\). To simplify the derivation, we assume \(d=1\); allowing for \(d>1\) is a straightforward extension. Third, the surrogate model function is then defined as \(\rho =\rho ({\mathbf{x}}):~{\mathscr {X}}~\rightarrow ~{\mathbb {R}}\). Fourth, the posterior mean function \(m({\mathbf{x}})\), which is often assumed to equal the surrogate model, i.e., \(m({\mathbf{x}})=\rho ({\mathbf{x}})\), but this is not necessarily the case. We also define a second space, a Hilbert space \({\mathscr {H}}~\subset ~{\mathbb {R}}^N~\times ~{\mathbb {R}}^N~\times ~{\mathbb {R}}^J\), with elements \([{\mathbf{f}}~{\mathbf{y}}~{\mathbf{f}}_0]^T\), where N is the number of data points, J is the number of points at which we want to predict the model function value, \({\mathbf{y}}\) are the measurement values, \({\mathbf{f}}\) is the vector of unknown latent function evaluations and \({\mathbf{f}}_0\) is the vector of predicted function values at a set of positions. Note that scalar functions over \({\mathscr {X}}\), e.g. \(f({\mathbf{x}})\), are vectors (bold typeface) in the Hilbert space \({\mathscr {H}}\), e.g. \({\mathbf{f}}\). We also define a function p over our Hilbert space which is just the function value of the Gaussian probability density functions involved. For more explanation on the distinction between the two spaces and the functions involved see Fig. 2.
Gaussian process regression with isotropic kernels and i.i.d. observation noise
Defining a GP regression model from data \(D=\{({\mathbf{x}}_1,y_1),\ldots ,({\mathbf{x}}_N,y_N)\}\), where \(y_i=f({\mathbf{x}}_i)+\epsilon ({\mathbf{x}}_i)\), is accomplished in a GP regression framework, by defining a Gaussian probability density function, called the prior, as
and a likelihood
where \(\varvec{\mu }=[\mu ({\mathbf{x}}_1),\ldots ,\mu ({\mathbf{x}}_N)]^T\) is the mean of the prior Gaussian probability density function (not to be confused with the posterior mean function \(m({\mathbf{x}})\)). Here dim is the dimensionality of the space over which the Gaussian probability density function is defined. The prior mean can be understood as the position of the Gaussian. \({\mathbf{f}}=[f({\mathbf{x}}_1),\ldots ,f({\mathbf{x}}_N)]^T\), \({\mathbf{K}}_{ij}~=~{\mathbf{k}}(\phi ,{\mathbf{x}}_i,{\mathbf{x}}_j);~{\mathbf{x}}\in {\mathscr {X}}\) is the covariance of the Gaussian process, with its covariance function, often referred to as the kernel, \(k(\phi ,{\mathbf{x}}_i,{\mathbf{x}}_j)\), where \(\phi\) is a set of hyper parameters, most often length scales and signal variance, and where \(\sigma ^2\) is the variance of the i.i.d. observation noise. The hyper parameters will be later often referred to as length scale l or signal variance \(\sigma _s^2\). We will omit the dependency on \(\phi\) in the kernel definition unless necessary for clarity. The problem here is that, in practice, the i.i.d. noise restriction rarely holds in experimental sciences, which is one of the issues to be addressed in this paper. The kernel k is a symmetric and positive semidefinite function, such that \(k:{\mathscr {X}} \times {\mathscr {X}}\rightarrow {\mathbb {R}}\). As a reminder, \({\mathscr {X}}\) is our parameter space and often referred to as index set or input space in the literature. A wellknown choice^{19} is the Matérn kernel class defined by
where \(B_\nu\) is the Bessel function of second kind, \(\Gamma\) is the gamma function, \(\sigma _s^2\) is the signal variance, l is the length scale, \(r~=~{\mathbf{x}}_i{\mathbf{x}}_j_{l_2}\) is the Euclidean distance between input points and \(\nu\) is a parameter that controls the differentiability characteristics of the kernel and therefore of the final model function. The wellknown exponential and squared exponential kernels are special cases of the Matérn kernels for \(\nu ~=~\frac{1}{2}\) and \(\nu ~\rightarrow ~\infty\) respectively. Unless otherwise stated, we used the Matérn kernel with \(\nu ~=~\frac{3}{2}\) for our tests and experiments, which translates to first order differentiability of the posterior mean function. The signal variance \(\sigma _s^2\) and the length scale l are hyper parameters (\(\phi\)) that are found by maximizing the loglikelihood, i.e., solving
where
where I is the identity matrix. In the isotropic case, we only have to optimize for one signal variance and one length scale (per kernel function). The mean function \(\mu ({\mathbf{x}})\), while formally being part of the optimization problem in (4) is often assumed to be constant and therefore neglected. The mean function assigns the location of the prior in \({\mathscr {H}}\) to any \({\mathbf{x}}~\in ~{\mathscr {X}}\); it can therefore be used to communicate prior knowledge (for instance physics knowledge) to the Gaussian process. For our tests and the experiment, we assume a constant mean function defined by the mean of the data. Choosing a particular kernel function and optimizing the hyper parameters can be a challenging task depending on the data and the function to be approximated. The kernel function has a dramatic impact on the approximation quality. It takes some practice and good knowledge of the characteristics of kernel functions and their effect on the Gaussian process to make the right decision. Provided some hyper parameters, the joint prior is given as
where
where \(\varvec{\kappa }_i~=~k(\phi ,{\mathbf{x}}_0,{\mathbf{x}}_i)\), \(\varvec{{\mathscr {K}}}~=~k(\phi ,{\mathbf{x}}_0,{\mathbf{x}}_0)\) and, as a reminder, \({\mathbf{K}}_{ij}~=~k(\phi ,{\mathbf{x}}_i,{\mathbf{x}}_j)\). dim in (5) and (6) is again the dimensionality of the space the Gaussian probability density function is defined over. Intuitively speaking, \(\varvec{\Sigma }\), \({\mathbf{K}}\) and k are all measures of similarity between measurement results \(y({\mathbf{x}})\) of the input space. While \(y({\mathbf{K}})\) stores this similarity between all data points, \(\varvec{\Sigma }\) stores the similarity between all data points and all unknown points of interest, and \(\varvec{{\mathscr {K}}}\) contains the similarity only between the unknown \(y({\mathbf{x}})\) of interest. k contains the instruction on how to calculate this similarity. The reader might wonder: “How do we find the similarity between unknown points of interest?” The answer lies in the formulation of the kernels that calculate the similarity just by knowing locations \({\mathbf{x}}~\in ~{\mathscr {X}}\) and not the function evaluations \(y({\mathbf{x}})\). \({\mathbf{x}}_0\) is the point where we want to estimate the mean and the variance. Note here that, with only slight adaption of the equation, we are able to compute the posterior mean and variance for several points of interest.
The predictive distribution is defined as
and the predictive mean and the predictive variance are therefore respectively defined as
which are the posterior mean and variance at \({\mathbf{x}}_0\), respectively. \({\mathscr{N}}(\cdot ,\cdot )\) stands for the normal (Gaussian) distribution with a given mean and covariance.
Gaussian processes with noni.i.d. observation noise
To incorporate noni.i.d. observation noise^{27,28} one can redefine the likelihood (2) as
where \({\mathbf{V}}\) is a diagonal matrix containing the respective measurement variances. In case the measurements happen to be correlated, the matrix \({\mathbf{V}}\) also has nondiagonal entries. However in our case this would have to be communicated by the instrument since we are not estimating the noise levels or their correlations^{29}. We will only discuss and use noncorrelated measurement noise in this paper.
From Eqs. (6) and (11), we can calculate Eq. (8), i.e., the predictive probability distribution for a measurement outcome at \({\mathbf{x}}_0\), given the data set. The mean and variance of this distribution are
respectively. Note here, that the matrix of the measurement errors \({\mathbf{V}}\) replaces the matrix \(\sigma ^2~{\mathbf{I}}\) in Eqs. (9) and (10). However, this does not follow from a simple substitution, but from a significantly different derivation. The loglikelihood (5) changes accordingly, yielding
This concludes the derivation of GPR with noni.i.d. observation noise. Figure 3 illustrates the effect of different kinds of noise on an onedimensional model function. As we can see, while some details of the derivation change when we account for inhomogeneous (also known as inputdependent or noni.i.d) noise, the resulting equation are very similar and the computation exhibits no extra costs.
Gaussian processes with anisotropy
For parameter spaces \({\mathscr {X}}\) that are anisotropic, i.e., where different directions have different characteristic correlation length, we can redefine the kernel function to incorporate different length scales in different directions. One way of doing this for axial anisotropy is by choosing the \(l^1\) norm as distance measure and redefine the kernel function as
where the superscripts m, n mean point labels, the subscript i means different directions in \({\mathscr {X}}\) and d is here the dimensionality of \({\mathscr {X}}\). This kernel definition originates from the fact that multiplying kernels will result in another valid kernel^{19}. Defining a kernel per direction gives us the flexibility to enforce different orders of differentiability in different directions of \({\mathscr {X}}\). The main benefit, however, is the possibility to define different length scales in different directions of \({\mathscr {X}}\) (see Fig. 4). Unfortunately, the choice of the \(l^1\) norm can lead to a very recognizable checkerboard pattern in the surrogate model, but the predictive power of the associated variance function is significantly improved compared to the isotropic case.
A second way, which avoids the checkerboard pattern in the model but does not allow different kernels in different direction, is to redefine the distances in \({\mathscr {X}}\) as
where \({\mathbf{M}}\) is any symmetric positive semidefinite matrix playing the role of a metric tensor^{30}. This is just the Euclidean distance in a transformed metric space. In the actual kernel functions, any r/l can then be replaced by the new equation for the metric. We will here only consider axisaligned anisotropy, which means the matrix \({\mathbf{M}}\) is a diagonal matrix with the inverse of the length scales on its diagonal. The extension to general forms of anisotropy is straightforward but needs a more costly likelihood optimization since more hyper parameters have to be found. The rest of the theoretical treatment, however, remains unchanged. The mean function \(\mu ({\mathbf{x}})\) and the hyper parameters \(\phi\) are again found by maximizing the marginal loglikelihood (14). The associated optimization tries to find a maximum of a function that is defined over \({\mathbb {R}}^{d + 1}\), if we ignore the mean function as it is commonly done. We therefore have to find \(d + 1\) parameters which adds a significant computational cost. If \({\mathbf{M}}\) is not diagonal we have to maximize the loglikelihood over \({\mathbb {R}}^{(d^2N)/2 + 1}\). However, the optimization can be performed in parallel to computing the posterior variance, which can hide the computational effort. It is important to note that accounting for anisotropy can make the training of the algorithm, i.e. the optimization of the loglikelihood, significantly more costly. The extent of this depends on the kind of anisotropy considered. As we shall see, taking anisotropy into account leads to more efficient steering and a higherquality final result, and is thus generally worth the additional computational cost.
Synthetic tests
Our synthetic tests are carefully chosen to demonstrate the benefits of the two concepts under discussion, namely: noni.i.d. observation noise and anisotropic kernels. To demonstrate the importance of including noni.i.d. observation noise into the analysis, we consider a synthetic test based on actual physics which we used in previous work to showcase the functionality of past algorithms^{17}. We are choosing an example given in a closed form because it provides a noisefree “ground truth” that we can compare to, whereas experimental data would inevitably include unknown errors. To showcase the importance of anisotropic kernels as part of the analysis, we provide a highdimensional example based on a simulation of a material that is subject to a varying thermal history.
The shown synthetic tests explore spaces of very different dimensionality. There is no theoretical limit to the dimensionality of the parameter space. Indeed the autonomous methods described herein are most advantageous when operating in highdimensional spaces since this is where simpler methods—and human intuition—typically fail to yield meaningful searches. However, while there is no theoretical limit, there are several practical issues that must be considered for highdimensional problems. The quality of the approximation suffers in highdimensional spaces since data density grows increasingly sparse with increasing dimensions. Therefore, in highdimensional spaces often more data has to be gathered, which correspondingly increases computational costs. See^{31,32,33,34,35} for an overview of work on methods to speed up Gaussian process computations.
Noni.i.d. observation noise
For this test, we define a physical “ground truth” model \(f({\mathbf{x}})\), whose correct function value at \({\mathbf{x}}\) would normally be inaccessible due to noni.i.d measurement noise, but can be probed by our simulated experiment through \(y({\mathbf{x}})\). In this case, we assume that the measurements are subject to Gaussian noise with a standard deviation of \(2\%\) of the function value at \({\mathbf{x}}\). The groundtruth model function is defined to be the diffusion coefficient \(D = D(r,T,C_m)\) for the Brownian motion of nanoparticles in a viscous liquid consisting of a binary mixture of water and glycerol:
where \(k_B\) is Bolzmann’s constant, \(r~\in ~[1~,100]~\mathrm {nm}\) is the nanoparticle radius, \(T~\in ~[0~,100]~^{\circ }\mathrm {C}\) is the temperature and \(\mu =\mu (T,C_m)\) is the viscosity as given by^{36}, where \(C_m~\in ~[0.0,100.0]~\%\) is the glycerol mass fraction. This model was used in^{17} to show the functionality of Kriging based autonomous experiments. The experiment device has no direct access to the ground truth model, but adds an unavoidable noise level, i.e.,
To demonstrate the importance of the noise model, we first ignore the noise \(\epsilon\), then approximate it assuming i.i.d. noise, and finally model it allowing for noni.i.d. noise. Figure 5 shows the results after 500 measurements, and a comparison to the (inaccessible) ground truth. Figure 6 compares the decrease in the error, in form of the Euclidean distance between the models and the ground truth, with increasing number of measurements N, for the three different types of noise.
The results show that treating noise as i.i.d. or even nonexistent can lead to artifacts in the surrogate model. Additionally, the discrepancy between the ground truth and the surrogate mode is reduced far more efficiently if noni.i.d. noise is accounted for.
Anisotropy
Allowing anisotropy can increase the efficiency of autonomous experiments significantly for any dimensionality of the underlying parameter space. However, as the dimensionality of the parameter space increases, the importance of anisotropy increases substantially, purely due to the number of directions in which anisotropy can occur. To demonstrate this link, we simulated an experiment where a material is subjected to a varying thermal history. That is, the experiment consists of repeatedly changing the temperature, and taking measurements along this timeseries of different temperatures. The temperature at each time step can be thought of as one of the dimensions of the parameter space. The full set of possible applied thermal histories thus become points in the highdimensional parameter space of temperatures.
In particular, we consider the ordering of a block copolymer, which is a selfassembling material that spontaneously organizes into a welldefined morphology when thermally annealed^{37}. The material organizes into a defined unit cell locally, with ordered grains subsequently growing in size as defects annihilate^{38}. We use a simple model to describe this grain coarsening process, where the grain size \(\xi\) increases with time according to a powerlaw
where \(\alpha\) is a scaling exponent (set to 0.2 for our simulations) and the prefactor k captures the temperaturedependent kinetics
Here, \(E_a\) is an activation energy for coarsening (we select a typical value of \(E_a = 100 \, \mathrm {kJ/mol}\)), and the prefactor A sets the overall scale of the kinetics (set to \(3 \times 10^{11} \, \mathrm {nm}/\mathrm {s}^{\alpha }\)). From these equations we construct an instantaneous growthrate of the form:
Block copolymers are known to have an orderdisorder transition temperature (\(T_{\mathrm {ODT}}\)) above which thermal energy overcomes the material’s segregation strength, and thus the nanoscale morphology disappears in favor of a homogeneous disordered phase. Heating beyond \(T_{\mathrm {ODT}}\) thus implies driving \(\xi\) to zero. We describe this ‘grain dissolution’ process using an adhoc form of:
where we set \(k_{\mathrm {diss}} = 1.0 \, \mathrm {nm\,s^{1}\,K^{1}}\) and \(T_{\mathrm {ODT}} = 350 \, ^{\circ }\mathrm {C}\). We also apply adhoc suppression of kinetics near \(T_{\mathrm {ODT}}\) and when grain sizes are very large to account for experimentallyobserved effects. Overall, this simple model describes a system wherein grains coarsen with time and temperature, but shrink in size if the temperature is raised too high. The parameter space defined by a sequence of temperatures will thus exhibit regions of high or low grain size depending on the thermal history described by that point; moreover, there is a nontrivial coupling between these parameters since the grain size obtained for a given step of the annealing (i.e. a given direction in the parameter space) sets the startingpoint for coarsening in the next step (i.e. the next direction of the parameter space).
We select thermal histories consisting of 11 temperature selections (temperature is updated every \(6 \, \mathrm {s}\)), which thus defines an 11dimensional parameter space for exploration. Each temperature history defines a point (\({\mathbf{x}}~\in ~{\mathscr {X}}\)) within the 11dimensional input space. As can be seen in Fig. 7a, the majority of thermal histories terminate in a relatively small grain size (blue lines in Fig. 7a). This can be easily understood since a randomlyselected annealing protocol will use temperatures that are either too low (slow coarsening) or too high (\(T>T_{\mathrm {ODT}}\) drives into disordered state). Only a subset of possible histories terminate with a large grain size (dark, less transparent lines in Fig. 7a), corresponding to the judicious choice of annealing history that uses large temperatures without crossing ODT. While this conclusion is obvious in retrospect, in the exploration of a new material system (e.g. for which the value of material properties like \(T_{\mathrm {ODT}}\) are not known), identifying such trends is nontrivial. Representative slices through the 11dimensional parameter space (Fig. 7b, c) further emphasize the complexity of the search problem, especially emphasizing the anisotropy of the problem. That is, different steps in the annealing protocol have different effects on coarsening; correspondingly the different directions in the parameter space have different characteristic length scales that must be correctly modeled (even though every direction is conceptually similar in that it describes a \(6 \, \mathrm {s}\) thermal annealing process).
Autonomous exploration of this parameter space enables the construction of a model for this coarsening process. Moreover, the inclusion of anisotropy markedly improves the search efficiency, reducing the model error more rapidly than when using a simpler isotropic kernel (Fig. 7d). As the dimensionality of the problem and the complexity of the physical model increase, the utility of including an anisotropic kernel increases further still.
Autonomous SAXS exploration of nanoscale ordering in a flowcoated polymergrafted nanorod film
The proposed GPdriven decisionmaking algorithm that takes into account noni.i.d. observation noise and anisotropy has been used successfully in autonomous synchrotron experiments. Here we present, as an illustrative example, the results of an autonomous xray scattering experiment on a polymergrafted gold nanorod thin film, where a combinatorial sample library was used to explore the effects of film fabrication parameters on a selfassembled nanoscale structure.
Unlike traditional short ligand coated particles, polymergrafted nanoparticles (PGNs) are stabilized by high molecular weight polymers at relatively low grafting densities. As a result, PGNs behave as soft colloids, possessing the favorable processing behavior of polymer systems while still retaining the ability to pack into ordered assemblies^{39}. Although this makes PGNs well suited to traditional approaches for thinfilm fabrication, the nanoscale assembly of these materials is inherently complex, depending on a number of variables including, but not limited to, particleparticle interactions, particlesubstrate interactions, and process methodology.
The combinatorial PGN film sample was fabricated at the Air Force Research Laboratory. A flowcoating method^{39} was used to deposit a thin PGN film on a surfacetreated substrate where gradients in coating velocity and substrate surface energy were imposed along two orthogonal directions over the film surface. A 250 nM toluene solution of 53 kDa polystyrenegrafted gold nanorods (94% polystyrene by volume), with nanorod dimensions of \(70 \pm 6\) nm in length and \(11.0 \pm 0.9\) nm in diameter (based on TEM analysis), was cast onto a functionalized glass coverslip using a motorized coating blade. The resulting film covered a rectangular area of dimensions 50 mm \(\times\) 60 mm. The surface energy gradient on the glass coverslip was generated through the vapor deposition of phenylsilane^{40}. The substrate surface energy varied linearly along the x direction from 30.5 mN/m (hydrophobic) at one edge of the film (\(x=0\)) to 70.2 mN/m (hydrophilic) at the other edge (\(x=50\) mm). Along the y direction, the filmcasting speed increased from 0 mm/s (at \(y=0\)) to 0.5 mm/s (\(y=60\) mm) at a constant acceleration of 0.002 mm/s\(^{2}\). The filmcasting condition corresponds to the evaporative regime where solvent evaporation occurs at similar timescales to that of solid film formation^{41}. In this regime, solvent evaporation at the meniscus induces a convective flow, driving the PGNs to concentrate and assemble at the contact line. The film thickness decreased with increasing coating speed, resulting in transitions from multilayers through a monolayer to a submonolayer with increasing y. This was verified by optical microscopy observations of the boundaries between multilayer, bilayer, monolayer and submonolayer regions, the last of which were identified by the presence of holes in the film, typically 1 \(\mu\)m or greater as seen in the optical images.
The objective of the autonomous synchrotron xray scattering experiment was twofold, corresponding to a combination of exploration and exploitation. The first aim was to explore the dependence of the nanoscale order of the PGN film on the two fabrication parameters, i.e., the substrate surface energy and the film coating speed, or equivalently on the surface coordinates (x, y), respectively. The second aim was to exploit the knowledge gained from the exploration to locate and home in on the regions in the twodimensional parameter space that resulted in the highest degrees of order.
The autonomous smallangle xray scattering (SAXS) experiment was performed at the Complex Materials Scattering (11BM CMS) beamline at the National Synchrotron Light Source II (NSLSII), Brookhaven National Laboratory. As described previously^{17,42}, experimental control was coordinated by combining three Python software processes: bluesky^{43} for automated sample translations and data collection, SciAnalysis^{44} for realtime analysis of newly collected SAXS images, and the above GPRbased optimization algorithms for decisionmaking. The incident xray beam was set to a wavelength of 0.918 Å (13.5 keV xray energy) and a size of 0.2 mm \(\times\) 0.2 mm. The PGN filmcoated substrate was mounted normal to the incident xray beam, on a set of motorized xy translation stages. Transmission SAXS patterns were collected on an area detector (DECTRIS Pilatus 2M) located at a distance of 5.1 m downstream of the sample, with an exposure time of 10 s/image. The SAXS results indicate that the polymer grafted nanorods tend to form ordered domains in which the nanorods lie flat and parallel to the surface and align with their neighbors. The fitting of SAXS intensity profiles via realtime analysis allowed for the extraction of quantities such as the scatteringvector position q for the diffraction peak corresponding to the inplane internanorod spacing \(d = 2\pi /q\); the degree of anisotropy \(\eta \in [0, 1]\) for the inplane internanorod alignment, where \(\eta = 0\) for random orientations and \(\eta = 1\) for perfect alignments^{45}; the azimuthal angle \(\chi\) or the factor \(\cos (2\chi )\) for the inplane orientation of the internanorod alignment; and the grain size \(\xi\) of the nanoscale ordered domains, which is inversely proportional to the diffraction peak width and provides a measure of the extent of inplane positional correlations between aligned nanorods. The analysisderived bestfit values and associated variances for these parameters were passed to the GPR decision algorithms.
In the autonomous experiment, three analysisderived quantities \(\xi\), \(\eta\), and \(\cos (2\chi )\) were used as the input signals utilized by the GPR algorithms to steer the SAXS measurements as a function of surface coordinates (x, y). For the GPR computations, the search space was restricted to \(1.0 \le x \le 48.0\) mm and \(1.0 \le y \le 49.0\) mm. The objective function used was described previously, given by Eq. (11) of Ref.^{42}. The objective function is therefore of the upperconfidence kind as described in^{46}, with varying tradeoff coefficient throughout the experiment. For this experiment, we used the firstorderdifferentiability Matérn kernel. Setting up the parameter space, or search space, has to be done initially by the user; afterward the experiment runs autonomously without human interference. For the initial part of the experiment, \(N < 464\) (first 4 h), where N is the number of measurements completed up to a given point in the experiment, the autonomous steering utilized the exploration mode based on model uncertainty maxima^{42} for \(\xi\), \(\eta\), and \(\cos (2\chi )\). For the later part of the experiment (\(464 \le N \le 1520\) or next 11 h), the feature maximization mode^{42} was used for \(\eta\), while keeping \(\xi\) and \(\cos (2\chi )\) in the exploration mode. We found that the nanorods in the ordered domains tended to orient such that their long axes were aligned along the x direction [\(\cos (2\chi ) \approx 1\)], i.e., perpendicular to the coating direction, and that \(\xi\) and \(\eta\) are strongly coupled. Figure 8A (top panels) show the Ndependent evolution of the model for the grain size distribution \(\xi\) over the film surface. It should be noted that the entire experiment took 15 h, and that the GPRbased autonomous algorithms identified the highly ordered regions in the band \(5< y < 15\) mm (between red lines in Fig. 8A), corresponding to the uniform monolayer region, within the first few hours. By contrast, gridbased scanningprobe transmission SAXS measurements would not be able to identify large regions of interest at these resolutions in such a short amount of time^{17}.
The collected data is corrupted by noni.i.d. measurement noise. While all signals are corrupted by noise, we draw attention to the peak position q because it shows the most obvious correlation of noni.i.d. measurement noise and model certainty. The green circles in Fig. 8B (middle panel) and C (right panel) highlight the areas where the measurement noise affects the Gaussianprocess predictive variance significantly. Note that we have not used q for steering in this case, but the general principle we want to show remains unchanged across all experiment results. Figure 8A shows the time evolution of the exploration of the model and the impact of noni.i.d. noise on the model but also on the uncertainty. If q had been used for steering without taking into account noni.i.d.noise into the analysis, the autonomous experiment would have been misled because predictive uncertainty due to high noise levels would not have been taken into account. Figure 8 shows that the next suggested measurement strongly depends on the noise. We want to remind the reader at this point that the next optimal measurement happens at the maximum of the GP predictive variance. The locations of the optima (Fig. 8C) are clearly different when noni.i.d. noise is taken into account. The objective function without measurement noise (Fig. 8C, left panel) shows no preference for regions of high noise (green circles in Fig. 8B, middle panel), where preference means higher function values of the GP predictive variance. In contrast, the variance function that takes measurement noise into account (Fig. 8C, right panel) gives preference to regions (green circles) where measurement noise of the data is high. This is a significant advantage and can only be accomplished by taking into account noni.i.d. measurement noise. In conclusion, the model that assumes no noise looks better resolved, which communicates a wrong level of confidence and misguides the steering. The model that takes into account noni.i.d. noise finds the correct, most likely model, and the corresponding uncertainty. The algorithm also took advantage of anisotropy by learning a slightly longer length scale in the xdirection which increased the overall model certainty. Note that the algorithm used an objective function formulation that put emphasis on highamplitude regions of the parameter space. This led to a higher resolution in those areas of interest.
The above autonomous SAXS experiment revealed interesting features from the material fabrication perspective as well. First, a somewhat surprising result is that the grain size is not observed to change significantly with surface energy (Fig. 8A). Previous work on the assembly of polystyrenegrafted spherical gold nanoparticles^{39} demonstrated a significant decrease in nanoparticle ordering when fabricating films on lower surface energy substrates (greater polymersubstrate interactions). Although the surface energies used in this study are similar, a different silane was used to modify the glass surface (phenylsilane vs octyltrichlorosilane) which may differ in its interaction with polystyrene. We also note that PGNsubstrate interactions will be sensitive to the molecular orientation of the functional groups, which is known to be highly dependent on the functionalization procedure^{40}. Second, an unexpected wellordered band was identified at \(20< x < 35\) mm and \(y > 15\) mm (between blue lines in Fig. 8A), corresponding to the submonolayer region with an intermediate surfaceenergy range. We believe that this effect arises from instabilities associated with the solution meniscus near the middle of the coating blade (\(x \sim 25\) mm). Rapid solvent evaporation often leads to undesirable effects including the generation of surface tension gradients, Marangoni flows, and subsequent contact line instabilities. This can result in the formation of nonuniform morphologies as demonstrated by the irregular region of larger grain size centered in the middle of the film and spanning the entire velocity range. Further investigations into these issues are currently in progress.
Discussion and conclusion
In this paper, we have demonstrated the importance of including inhomogeneous (i.e. noni.i.d.) observation noise and anisotropy into Gaussianprocessdriven autonomous materialsdiscovery experiments.
It is very common in the scientific community to rely on Gaussian processes that ignore measurement noise or only include homogeneous noise, i.e. noise that is constant across measurements. In experimental sciences, and especially in experimental material sciences, strong inhomogeneity in measurement noise can be present and only accounting for homogeneous (i.i.d) measurement noise is therefore insufficient and leads to inaccurate models and, in the worst case, wrong interpretations and missed scientific discoveries. We have shown that it is straightforward to include noni.i.d noise into the steering and modeling process. Figure 5 undoubtedly shows the benefit of including noni.i.d measurement noise into the Gaussian process analysis. Figure 6 supports the conclusion we drew from Fig. 5 visually, by showing a faster error decline.
The case for allowing anisotropy in the input space can be made when there is a reason to believe that data varies much more strongly in certain directions than in others. This is often the case when the directions have different physical meanings. For instance, one direction can mean temperature, while another one can define a physical distance. In this case, accounting for anisotropy can be vastly beneficial, since the Gaussian process will learn the different length scales and use them to lower the overall uncertainty. Figure 7 shows how common anisotropy is, even in cases where it would normally not be expected, and how including it decreases the approximated error of the Gaussian process posterior mean. In our example, all axes carry the unit of temperature; even so, anisotropy is present, and accounting for it has a significant impact on the approximation error.
In our autonomous synchrotron xray experiment, we have seen how misleading the nomeasurementnoise assumption can be. While the Gaussian process posterior mean, assuming no noise, is much more detailed in Fig. 8, it is not supported by the data which is subject to noni.i.d. noise. In addition, we have seen that the steering actually accounts for the measurement noise if included, which leads to much a smarter decision algorithm that knows where data is of poor quality and has to be substantiated. We showed that without accounting for noni.i.d. noise this phenomenon would not arise. We would therefore place measurements suboptimally, wasting device access, staff time, and other resources.
It is important to discuss the computational costs that come with accounting for noni.i.d. noise and anisotropy. While noni.i.d. noise can be included at no additional computational costs, anisotropy potentially comes at a price. The more complex the anisotropy, the more hyper parameters have to be found. The number of hyper parameters translates directly into the dimensionality of the space over which the likelihood is defined. The training process to find the hyper parameters will therefore take longer when more hyper parameters have to be found. However, the cost per function evaluation will not change significantly. Therefore, instead of avoiding the valuable anisotropy, we should make use of modern, efficient optimization methods.
During the experiment process, the GPbased autonomous experiment keeps track of the posterior variance function. This function serves as validation for the scientists and can be used to confidently terminate the process when an uncertainty threshold is reached. Another quantity that is available to the scientist for verification and validation, is the change in differential entropy as data is collected.
While our results have shown that accounting for noni.i.d. noise and anisotropy is highly valuable for the efficiency of an autonomously steered experiment, we have only scratched the surface of possibilities. Both proposed improvements can be seen as part of a larger theme commonly referred to as kernel design. The possibilities for improvements and tailoring of Gaussianprocessdriven steering of experiments are vast. Welldesigned kernels have the power to extract subspaces of the Hilbert space of functions, which means that constraints can be placed on the functions we consider as our model. We will look into the impact of advanced kernel designs on autonomous data acquisition in the near future.
References
Habib, S. et al. Ascr/hep exascale requirements review report. arXiv preprintarXiv:1603.09303 (2016).
Gerber, R. et al. Crosscut report: exascale requirements reviews, march 9–10, 2017–tysons corner, virginia. an office of science review sponsored by: advanced scientific computing research, basic energy sciences, biological and environmental research, fusion energy sciences, high energy physics, nuclear physics. Technical report, Oak Ridge National Lab.(ORNL), Oak Ridge, TN (United States); Argonne (2018).
Almgren, A. et al. Advanced scientific computing research exascale requirements review. an office of science review sponsored by advanced scientific computing research, september 2729, 2016, Rockville, Maryland. Technical report, Argonne National Lab.(ANL), Argonne, IL (United States). Argonne Leadership (2017).
Thayer, J. et al. Data processing at the linac coherent light source. In 2019 IEEE/ACM 1st Annual Workshop on Largescale ExperimentintheLoop Computing (XLOOP), 32–37 (IEEE, 2019).
Pilania, G., Wang, C., Jiang, X., Rajasekaran, S. & Ramprasad, R. Accelerating materials property predictions using machine learning. Sci. Rep. 3, 2810 (2013).
Jain, A. et al. Commentary: The materials project: a materials genome approach to accelerating materials innovation. APL Mater. 1, 011002 (2013).
Dean, E. B. Design of experiments (2000).
McKay, M. D., Beckman, R. J. & Conover, W. J. Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21, 239–245 (1979).
Fisher, R. A. The arrangement of field experiments. In Breakthroughs in Statistics, 82–91 (Springer, 1992).
Scarborough, N. M. et al. Dynamic xray diffraction sampling for protein crystal positioning. J. Synchrotron Radiat. 24, 188–195 (2017).
Godaliyadda, G. et al. A supervised learning approach for dynamic sampling. Electron. Imaging 2016, 1–8 (2016).
Balachandran, P. V., Xue, D., Theiler, J., Hogden, J. & Lookman, T. Adaptive strategies for materials design using uncertainties. Sci. Rep. 6, 19660 (2016).
Cang, R., Li, H., Yao, H., Jiao, Y. & Ren, Y. Improving direct physical properties prediction of heterogeneous materials from imaging data via convolutional neural network and a morphologyaware generative model. Comput. Mater. Sci. 150, 212–221 (2018).
Martínez, A., Martínez, J., PérezRosés, H. & Quirós, R. Image processing using voronoi diagrams. In IPCV, 485–491 (2007).
Santner, T. J., Williams, B. J., Notz, W. & Williams, B. J. The Design and Analysis of Computer Experiments Vol. 1 (Springer, Berlin, 2003).
Forrester, A., Sobester, A. & Keane, A. Engineering Design via Surrogate Modelling: A Practical Guide (Wiley, New York, 2008).
Noack, M. M. et al. A krigingbased approach to autonomous experimentation with applications to xray scattering. Sci. Rep. 9, 11809 (2019).
Hanuka, A. et al. Online tuning and light source control using a physicsinformed Gaussian process adi. arXiv preprintarXiv:1911.01538 (2019).
Williams, C. K. & Rasmussen, C. E. Gaussian Processes for Machine Learning Vol. 2 (MIT Press, Cambridge, MA, 2006).
Schulz, E., Speekenbrink, M. & Krause, A. A tutorial on Gaussian process regression with a focus on explorationexploitation scenarios. bioRxiv 095190 (2017).
McHutchon, A. & Rasmussen, C. E. Gaussian process training with input noise. In Advances in Neural Information Processing Systems, 1341–1349 (2011).
Stegle, O., Lippert, C., Mooij, J. M., Lawrence, N. D. & Borgwardt, K. Efficient inference in matrixvariate Gaussian models with\(\backslash\)iid observation noise. In Advances in Neural Information Processing Systems, 630–638 (2011).
Ballabio, C. et al. Mapping Lucas topsoil chemical properties at European scale using Gaussian process regression. Geoderma 355, 113912 (2019).
Bijl, H. Gaussian process regression techniques with applications to wind turbines. Delft University of Technology, Doctoral degree (2016).
Kuss, M. Gaussian process models for robust regression, classification, and reinforcement learning. Ph.D. thesis, Technische Universität (2006).
Frazier, P. I. A tutorial on Bayesian optimization. arXiv preprintarXiv:1807.02811 (2018).
Goldberg, P. W., Williams, C. K. & Bishop, C. M. Regression with inputdependent noise: a Gaussian process treatment. In Advances in Neural Information Processing Systems, 493–499 (1998).
Kersting, K., Plagemann, C., Pfaff, P. & Burgard, W. Most likely heteroscedastic Gaussian process regression. In Proceedings of the 24th International Conference on Machine Learning, 393–400 (2007).
Wang, W., Chen, N., Chen, X. & Yang, L. A variational inferencebased heteroscedastic Gaussian process approach for simulation metamodeling. ACM Trans. Model. Comput. Simul. (TOMACS) 29, 1–22 (2019).
Vivarelli, F. & Williams, C. K. Discovering hidden features with Gaussian processes regression. In Advances in Neural Information Processing Systems, 613–619 (1999).
Noack, M. & Zwart, P. Computational strategies to increase efficiency of Gaussianprocessdriven autonomous experiments. In 2019 IEEE/ACM 1st Annual Workshop on Largescale ExperimentintheLoop Computing (XLOOP), 1–7 (IEEE, 2019).
Dutordoir, V., Durrande, N. & Hensman, J. Sparse Gaussian processes with spherical harmonic features. arXiv preprintarXiv:2006.16649 (2020).
Cohen, S., Mbuvha, R., Marwala, T. & Deisenroth, M. P. Healing products of Gaussian process experts. In Proceedings of the 37th International Conference on Machine Learning (2020).
Wang, K. et al. Exact Gaussian processes on a million data points. In Advances in Neural Information Processing Systems, 14648–14659 (2019).
Meanti, G., Carratino, L., Rosasco, L. & Rudi, A. Kernel methods through the roof: handling billions of points efficiently. arXiv preprintarXiv:2006.10350 (2020).
Cheng, N.S. Formula for the viscosity of a glycerol–water mixture. Ind. Eng. Chem. Res. 47, 3285–3288 (2008).
Doerk, G. S. & Yager, K. G. Beyond native block copolymer morphologies. Mol. Syst. Des. Eng. 2, 518–538 (2017).
Majewski, P. W. & Yager, K. G. Rapid ordering of block copolymer thin films. J. Phys. Condens. Matter 28, 403002 (2016).
Che, J. et al. Preparation of ordered monolayers of polymer grated nanoparticles: impact of architecture, concentration, and substrate surface energy. Macromolecules 49, 1834–1847 (2016).
Genzer, J., Efimenko, K. & Fischer, D. A. Molecular orientation and grafting density in semifluorinated selfassembled monolayers of mono, di, and trichloro silanes on silica substrates. Langmuir 18, 9307–9311 (2002).
Bao, X., Shaw, L., Gu, K., Toney, M. F. & Bao, Z. The meniscusguided deposition of semiconducting polymers. Nat. Commun. 9, 534 (2018).
Noack, M. M., Doerk, G. S., Li, R., Fukuto, M. & Yager, K. G. Advances in krigingbased autonomous xray scattering experiments. Sci. Rep. 10, 1325 (2020).
Laboratory, B. N. Bluesky. https://github.com/NSLSII/bluesky (2015).
Laboratory, B. N. Scianalysis. https://github.com/CFNsoftbio/SciAnalysis (2015).
Ruland, W. & Smarsly, B. Saxs of selfassembled oriented lamellar nano composite films: an advanced method of evaluation. J. Appl. Crystallogr. 37, 575–584 (2004).
Snoek, J., Larochelle, H. & Adams, R. P. Practical Bayesian optimization of machine learning algorithms. In Advances in Neural Information Processing Systems, 2951–2959 (2012).
Acknowledgements
The work was partially funded through the Center for Advanced Mathematics for Energy Research Applications (CAMERA), which is jointly funded by the Advanced Scientific Computing Research (ASCR) and Basic Energy Sciences (BES) within the Department of Energy’s Office of Science, under Contract No. DEAC0205CH11231. This work was conducted at Lawrence Berkeley National Laboratory and Brookhaven National Laboratory. This research used resources of the Center for Functional Nanomaterials and the National Synchrotron Light Source II, which are U.S. DOE Office of Science Facilities, at Brookhaven National Laboratory under Contract No. DESC0012704. Partial funding was supplied by the Air Force Research Laboratory Materials and Manufacturing Directorate and the Air Force Office of Scientific Research.
Author information
Authors and Affiliations
Contributions
M.M.N., K.G.Y., and M.F. developed the key ideas. M.M.N. devised the necessary algorithm, formulated the required mathematics, and implemented the computer codes. M.F. and K.G.Y. designed the xray scattering experiment. R.A.V. conceived the material and process design. J.K.S. prepared the samples and performed preliminary characterizations. M.M.N., K.G.Y., M.F., G.D., and R.L. performed the autonomous experiments. K.G.Y. analyzed the experimental data. M.M.N. analyzed the algorithm performance and wrote the first draft of the manuscript. M.F. and K.G.Y. supervised the work. All authors discussed the results and commented on the manuscript.
Corresponding authors
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Noack, M.M., Doerk, G.S., Li, R. et al. Autonomous materials discovery driven by Gaussian process regression with inhomogeneous measurement noise and anisotropic kernels. Sci Rep 10, 17663 (2020). https://doi.org/10.1038/s41598020743941
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598020743941
This article is cited by

Autonomous scanning probe microscopy investigations over WS2 and Au{111}
npj Computational Materials (2022)

Machinelearning for designing nanoarchitectured materials by dealloying
Communications Materials (2022)

Machine learningbased analysis of overall stability constants of metal–ligand complexes
Scientific Reports (2022)

Gaussian processes for autonomous data acquisition at largescale synchrotron and neutron facilities
Nature Reviews Physics (2021)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.