Introduction

Enhancing materials research via integration with artificial intelligence (AI) comprises a recent transformation in the evolution of materials science1,2,3,4,5,6. Such efforts span the research lifecycle from experiment planning7 to data analysis8, with early demonstrations of AI-assisted data processing naturally occurring in image analysis since many machine learning (ML) algorithms were initially developed to automate pattern recognition in images9,10,11. Complementary examples of AI-assisted data analysis include automated identification of composition-structure–property relationships where the existence of a relationship is automatically identified, but often the labeling of the relationships and their scientific interpretation are relegated to human experts12,13.

To further automate mapping of structure-dependent properties, the community has made a concerted effort in crystal structure phase mapping, wherein a collection of XRD patterns is used to identify the identity and distribution of each crystalline phase, typically within a 2 to 4-element composition space14,15,16,17,18,19. We recently reported Deep Reasoning Networks (DRNets)20,21 to automate phase mapping for complex datasets where prior algorithms and extensive human analyses fail to fully solve the underlying phase behavior. While phase mapping is a route to accelerate generation of phase diagrams in high-order composition spaces, most immediately the results are needed to interpret variations in measured materials properties, i.e. the underlying composition–structure–property relationships. Herein we present materials structure–property factorization (MSPF) as an approach to automate modeling of the properties as a function of composition and phase distribution, enabling identification of synergistic phase interactions. While the MSPF model of the present work can in principle be coupled to any phase mapping algorithm, MSPF is most necessary when the number of phase combinations and the associated variations in materials properties exceed the capabilities of traditional analysis, and such complex datasets are precisely where DRNets excel at phase mapping.

Phase mapping can seed a variety of further investigations, as recently demonstrated for experiment planning to discover optimal phase-change materials in a ternary composition library22. In that work, the CAMEO framework was introduced wherein phase mapping results are used to partition the composition library into phase field regions. Each region receives an independent active learning model so that the desired materials property is optimized within each phase field. In that case, the maximal performance was observed in a phase-pure material, whereas the present work focuses on the identification of phase mixtures that exhibit synergistic interactions. While CAMEO may be extended to compare active learners from different phase fields, the training of machine learning models in each phase field is impractical for increased phase diagram complexity where some phase fields may contain only several composition samples.

In the present work, we use comprehensive high throughput experimentation to provide the performance data that is interpreted in the context of the phase map. In the example dataset of the present work, the Bi-Cu-V oxide composition library contains 25 unique combinations of phases with an average of about 13 samples per phase field. As a result, there is little opportunity to lower the required number of samples via training of 25 independent active learners, highlighting that for complex materials systems, the most direct route to accelerating the generation of scientific knowledge is to extract knowledge via the application of data science to large datasets from combinatorial experimentation. Toward this goal, we introduce MSPF to model the average performance contribution of each phase as well as the interactions among phases, especially when the composition-structure–property relationships are too complex to be readily interpreted by manual analysis. MSPF is demonstrated herein for the identification of optimal solar fuels photoanodes via measurement of photoelectrochemical (PEC) performance. Metal oxide photoanodes comprise a class of complex, multi-functional materials whose properties are often optimized in high-order compositions, including mixed-phase compositions23,24,25,26,27,28. High throughput photoelectrochemistry experiments have been effective at discovering complex photoanodes23,29,30, and a goal of the present work is to provide a framework for automating interpretation of the resulting complex datasets.

In MSPF for metal oxide photoanodes, phase concentration maps provided by phase mapping are used to identify representative PEC behavior of each phase and subsequently analyze the phase combinations that provide better or worse performance compared to the underlying assumption that the performance contribution from each phase is proportional to phase concentration. In the broader effort to automate data analysis and interpretation, the contributions of the present work include the first deployment of DRNets for analyzing structure–property relationships, the integration of phase mapping and property factorization to provide a compact and interpretable analysis of complex data, and illustration of the materials design principle of exploiting synergistic interactions among multiple phases to amplify materials performance. This identification of emergent properties in complex, multi-phase materials is critical to accelerated exploration and understanding of high-performance materials in high-order composition spaces29,30,31.

Results and discussion

The data-driven search for synergies in multi-phase photoanodes commences with the deposition of four composition libraries, the Bi-Cu-V oxide library along with each of the 2-cation subspaces as shown in Fig. 1a. XRD measurements on 353 unique compositions produce diffraction patterns (see Fig. 1b) that collectively contain information about the phase behavior in this composition system but individually are not readily interpretable due to the presence of 2 or 3-phase mixtures from a set of 99 candidate phases. This set of phases is described in Supplementary Table 1 and was determined by searching the International Crystallography Diffraction Database (ICDD) for entries containing oxygen and any combination of Bi, Cu, and V. This set of phases contains many diffraction patterns with overlapping signal, especially when considering experimental measurement of grains with sub-100 nm crystallites due to the resulting broadening of diffraction peaks. The consequence is that a single XRD pattern may be well explained by dozens of unique combinations of phases from the 99 candidates. Even if each XRD pattern has only 2 alternate interpretations, the corresponding number of phase map solutions would be 2353, which is larger than 10106. Consequently, individually analyzing each XRD pattern and subsequently stitching together a solution from all the possible combinations of phases is intractable. Finding the best global solution to the collection of XRD patterns requires collectively demixing the phases in each XRD pattern while applying constraints that guide the demixing process to an optimal solution. The constraints are based on the thermodynamics of phase diagrams and include a maximum number of co-existing phases per Gibbs’ phase rule, which is taken to be 2 for the 2-cation compositions and 3 for the 3-cation compositions under the approximation that the thin films reach equilibrium with the O2 in the annealing atmosphere at the anneal temperature of 550 °C. Additional rules include the generation of phase fields that are connected within the composition graph, and the algorithm models the presence of alloying by identifying composition-dependent shifting of the XRD patterns indicative of lattice constant modulation. Since alloying comprises at least 1 thermodynamic degree of freedom, its presence results in a reduction in the maximum number of phases to 1 for 2-cation and 2 for 3-cation compositions.

Fig. 1: Phase mapping in the Bi-Cu-V oxide system.
figure 1

a Photographs of 4 sputter-deposited composition libraries in Bi–Cu–V oxide system. b Representative x-ray diffraction patterns collected on the composition libraries, where each XRD pattern is plotted at the location of the composition in the Bi–Cu–V composition graph. c The DRNets solution for one composition, showing that the XRD pattern of the Bi0.11Cu0.39V0.50 oxide sample is composed of 42% BiVO4 and 58% Cu2V2O7. d The resulting phase map of the primary 14 of the 21 phases identified by DRNets, where each phase has a unique symbol whose point size indicates phase concentration in the composition graph. Multi-phase samples have multiple overlapping symbols.

While several phase mapping algorithms have been developed to incorporate these rules15,16,18, they have not been fully integrated into the pattern demixing to date since the enforcement of rules inherently involves computational reasoning, whereas the pattern demixing inherently involves computational learning. Deep Reasoning Networks20,21 are a framework for seamlessly integrating reasoning and learning, enabling phase mapping of XRD datasets whose complexity cannot be harnessed by manual analysis or prior phase mapping algorithms. The resulting DRNets phase map solution reveals the challenges in interpreting the measured XRD patterns, as the 353 XRD patterns collectively contain 21 different phases (see Supplementary Fig. 1 and Supplementary Table 2) in 33 unique combinations when considering phase concentrations above 1%, which is the approximate detectability limit. The distribution of phase concentrations for the primary 14 phases is shown in Fig. 1c.

Some of the 21 phases appear only as dilute phases and/or only appear in a few compositions, making the presence of the phase in the library insufficient for learning its properties. Considering phases that appear in at least 10 compositions, the composition libraries contain 11 phases, and the samples with these phases include 25 of the 33 phase combinations. Some Cu–V and Bi–V oxide phases are omitted by this criterion, which results in several compositions in these 2-cation spaces being removed from the below analysis, although since these phases are not prominent in the 3-cation composition region (as indicated by their lack of appearance in at least 10 compositions), they are relatively unimportant for the present focus on identifying multi-phase synergies. The resulting dataset contains 335 different compositions (data samples).

PEC characterization of the composition library reveals a range of shapes of the photocurrent vs. electrochemical potential (IE) curves as well as overall photoactivity. Understanding the composition-photoactivity trends in the context of the 11 phases and 25 phase combinations requires assistance from machine learning, motivating our development of MSPF. We commence with an approximation for the expected behavior of a photoelectrode containing a simple mixture of phases. If the photoelectrode contained a combination of non-interacting phases, e.g. by piecing together a set of phase-pure electrodes, then the photocurrent of the mixed-phase electrode will be the sum of the photocurrent of each phase scaled by the respective fraction of the electrode occupied by that phase. While some mixed-phase photoelectrodes may behave according to this weighted-sum model, heterogeneous grain boundaries can have deleterious (e.g. recombination sites) or beneficial (e.g. junction that facilitates charge separation) effects. While discovering the deleterious effects is important for guiding future synthesis efforts by establishing the phase mixtures that should be avoided when scaling up photoelectrodes, the opportunities for photoanode optimization lie in the discovery of phase mixtures whose photoactivity exceeds that of the weighted-sum approximation. The strategy of the present work is to analyze deviations from the weighted-sum model and reserve analysis of the underlying causes of the deviations to future work. We note that alternatively the weighted-sum model could be replaced by a model for the specific type of physics under investigation, e.g. elasticity, ionic transport, or scattering processes, to directly learn parameters of interest from the phase map and performance data. Such an approach may be suitable when the physics of interacting phases is well understood, which is not the case for the mixed-phase photoelectrodes of the present work. Understanding this physics will require detailed investigation of exemplar systems, and the methods of the present work automate the identification of those exemplars.

MSPF applies the weighted-sum model to the entire dataset via matrix factorization wherein the set of measured IE data is compiled in a matrix A. The weighted-sum approximation can be conceptualized as modeling the measured PEC data using a single IE curve for each phase, multiplying these curves by the phase concentrations, and summing over the phases. This process is captured by MSPF as illustrated in Fig. 2. A contains the photocurrent at 15 electrochemical potentials for the 335 compositions, resulting in a 15 × 335 matrix. This matrix is then approximated as the product of the basis pattern matrix and the phase concentration matrix. The matrix of basis patterns is a 15 × 11 matrix that contains the representative IE data for each of the 11 phases. Note that many of the phases are not observed as phase-pure materials, and even phase-pure materials may appear at different compositions due to alloying, so the data does not directly tell us the representative IE basis pattern for any of the phases, motivating the learning of basis patterns from the data. The concentration of the 11 phases is provided for each of the 335 compositions by the DRNets phase mapping solution, resulting in a matrix of size 11 × 335.

Fig. 2: Illustration of materials structure–property factorization.
figure 2

Representative measured IE patterns in the Bi–Cu–V oxide composition space are shown with red and green fill color indicating negative and positive photocurrent, respectively. This set of photocurrent data is modeled as the sum of contributions for each phase, where the composition map of the contribution of each phase is determined by the product of a representative IE pattern and the respective phase concentration map from DRNets.

We solve the matrix factorization problem piecewise by first considering the 2-cation compositions with the assertion that the basis pattern for 2-cation phases are best learned from the corresponding 2-cation data provided that the phase exists in sufficient phase purity in the 2-cation data. Using a minimum phase concentration threshold of 80%, the following 6 of the 11 phases have their basis components learned via matrix factorization with 33 compositions from the 2-cation data: BiVO4, CuBi2O4, Cu2V2O7, Cu5V2O10, CuV2O6, and V2O5. These patterns are then frozen while using all 335 compositions to learn the basis patterns from the remaining 5 phases: Bi2Cu2VO7, Bi4Cu3V2O14, Bi4.1Cu0.2V1.7O10.6, Cu11V6O26, and Bi8V2O17. This latter matrix factorization step was evaluated for robustness against random removal of 20% of the 3-cation data, resulting in a positive assessment as detailed in Supplementary Fig. 2.

The results of this calculation are the MSPF model AMSPF of the PEC data as well as the basis I-E patterns of each phase, which are shown for some phases in Fig. 2 and for all phases in Supplementary Fig. 3. These latter results indicate that CuBi2O4 has cathodic photocurrent with a turn on potential near 1 V vs RHE, in agreement with recent reports32. BiCu2VO6 shows appreciable photoanodic activity, which is also in agreement with prior work26,27,28. The other 3-cation phases show small negative values in their basis patterns, which is due to a combination of small cathodic photocurrents and the general decrease in photocurrent when these phases are mixed with more photoactive phases. The 4 phases with highest photoactivity are BiVO4, Cu2V2O7, Cu5V2O10, and CuV2O6. In Supplementary Fig. 4, the MSPF model for the photoactivity of each phase is compared to the measured photoactivity for the 2 samples closest in composition to the respective formula unit and with high-phase purity of the respective phase. This analysis shows that the MSPF model successfully captures the representative photoactivity of each phase.

The photocurrent residual matrix, R = A − AMSPF, is representative of measured photocurrent beyond that explained by the weighted-sum MSPF model. The residuals can be analyzed as a function of phase concentrations, composition, and/or electrochemical potential, and we commence analysis by calculating the average residuals for 3 different ranges of electrochemical potential and plotting them as a function of composition in Fig. 3. This analysis reveals 3 distinct composition regions with respect to the MSPF residuals. The region with substantially negative residuals is the 3-cation region with V concentration between 30 and 50% and Cu concentration less than 25%. The primary phase field in this region is a 2-phase combination of BiVO4 and Bi4Cu3V2O14. Given that BiVO4 has the highest demonstrated photoanode performance out of all observed phases33, adding a small amount of Cu to the Bi0.5V0.5 composition would be an intuitive strategy for optimizing photoactivity in the Bi-Cu-V system. The results of Fig. 3 reveal that this is an ineffective strategy. The MSPF analysis as well as inspection of the compositions with highest phase concentration of Bi4Cu3V2O14 indicate that this phase exhibits little photoactivity. The dilution of the photoactive BiVO4 phase in the phase mixture with this 3-cation phase is expected to lower the photoactivity compared to the 2-cation BiVO4 samples, yet the considerably negative values of R demonstrate that the decrease in photoactivity is even more drastic due to deleterious interactions of the 2 phases. While this analysis clearly identifies the deleterious phase interaction, it does not address the underlying physical mechanism.

Fig. 3: Phase interaction detection.
figure 3

The residual from the factorization model of Fig. 2 is averaged over three different ranges of photoelectrochemical potential to ascertain whether a given composition outperforms (positive residual) or underperforms (negative residual) the expectation from materials structure–property factorization model at (a) 0.74–0.79 V vs RHE; (b) 0.94–0.99 V vs RHE; and (c) 1.14–1.19 V vs RHE.

The two composition regions with large positive values of R are (i) compositions with V concentration in excess of 70% and (ii) a smaller composition region with Cu concentration between 45 and 55% and Bi concentration below 20%. Figure 4 shows the measured photoactivity and its corresponding MSPF model for the maximum-residual composition in each of these regions. In Supplementary Fig. 5, the same measured photoactivity for the 2 select compositions are shown alongside the highest photoactivity observed with high-phase-purity photoelectrodes from the 2-cation composition space, revealing that in the respective potential regions, the select 3-cation composition outperforms not only the expectation from the MSPF model but also the best 2-cation compositions.

Fig. 4: The measured photoactivity and its corresponding property factorization model for the maximum-residual compositions in two composition regions shown in Fig. 3.
figure 4

a The Bi0.07Cu0.17V0.76 photoanode composed of 33% BiVO4 and 67% CuV2O6; b The Bi0.11Cu0.39V0.50 photoanode composed of 42% BiVO4 and 58% Cu2V2O7. Note that these phase concentrations are labeled by prototype formula unit, although the composition within each phase may be different due to alloying.

In the first composition region of interest, represented by Bi0.07Cu0.17V0.76, the primary phase is CuV2O6, which is a known photoanode phase (in the Cu–V 2-cation composition space) but with limited photoactivity, especially at low electrochemical potential34,35. Figure 4a shows that this low electrochemical potential region is precisely where the phase mixture excels compared to the MSPF model, with measured photocurrents well above those of the MSPF model for potentials below 0.9 V vs RHE. Even though the sample of Fig. 4a is only 33% BiVO4 in the DRNets phase map, the photocurrent in the low electrochemical potential region exceeds that of the best high-phase-purity BiVO4 samples on the Bi-V line.

The second composition region of interest, represented by Bi0.11Cu0.39V0.50, exhibits large positive values of R and contains the primary phase Cu2V2O7, another known photoanode that has recently received considerable attention34,36,37,38. Here, the photoactivity is also enhanced compared to the MSPF model at all potentials, with the most substantial increase observed above 0.9 V vs. RHE, where the photocurrent far exceeds the maximum values observed on the Bi–V and Cu–V2-cation composition lines.

The results of the MSPF residual analysis strongly suggest beneficial interactions of the respective pairs of phases in the complex 3-cation photoelectrodes of Fig. 4. While the intention of the present work is to identify these exemplars of synergistic phase interactions to set the stage for future inquiry, we additionally seek to confirm that the composition map of photoactivity residuals (Fig. 3) is not governed by changes in morphology. Using cross-section transmission electron microscopy (TEM) and plan-view scanning electron microscopy (SEM) imaging, the morphology of the 2 primary compositions of interest is characterized and compared to a range of other compositions in Figs. S6S9. For the Bi0.07Cu0.17V0.76 oxide sample, the film thickness varies between 300 and 500 nm with ~200 nm wide BiVO4 domains embedded in a CuV2O6-like matrix with small domains of Cu-rich precipitates that were not detected in the XRD-based phase map. For the Bi0.11Cu0.39V0.50 oxide sample, the film thickness also varies between 300 and 500 nm with a broader size range of BiVO4 domains (10–200 nm) embedded in a Cu2V2O7-like matrix that exhibits variability in both microstructure and Cu:V composition. The substantial difference in morphology between these 2 compositions is representative of the substantial range of morphology observed over the broader range of compositions, including the substantial variations observed among high-phase-purity BiVO4 samples. These results indicate that morphology alone does not account for the substantial residuals from the MSPF analysis. The MSPF analysis demonstrates that for this photoanode synthesis method, specific mixtures of phases perform well, for which the underlying mechanism of photoactivity improvement may involve a combination of electronic, catalytic, and morphological effects. These may be driven by a combination of modulations of the composition within each phase, alterations to the crystallization during synthesis, and/or electronic junctions formed between 2 phases. MSPF identifies the specific phase synergies whose mechanistic underpinnings must be elucidated via further study. In the present case of studying photocurrent as a function of applied potential, we observe that the 2-phase mixtures of interest exhibit distinct potential-dependence variations in the photocurrent residuals, which suggests that the underlying mechanism of the synergy differs in each case and motivates further study of synergistic interactions of BiVO4 with both Cu2V2O7-like and CuV2O6-like phases.

Materials structure–property factorization provides a framework for identifying synergistic and deleterious phase interactions with respect to desired material properties. This framework is particularly needed when a given dataset includes many combinations of phases that exhibit properties of interest. Consequently, MSPF commences with phase mapping, in the present work using the recently developed Deep Reasoning Networks. Our approach leverages the intuitive interpretability of matrix factorization, which aggregates the properties of each phase in a multi-phase sample under an assumption of non-interacting phases. The analysis of the data deviations from the matrix factorization model is insightful, revealing compositions and phase mixtures of greatest scientific interest since the associated properties cannot be explained by the “non-interacting” model. We also note that other non-linear methods could easily overfit the data, especially given the limited number of data samples (335), in addition to potentially being less interpretable. Applying this methodology to solar fuels photoanodes in the Bi–Cu–V oxide system reveals specific phase combinations with synergistic interactions that elevate the photoactivity and provide avenues for further photoelectrode development. These results demonstrate that the intuitive approach of adding small amounts of copper vanadates to the best known photoanode phase (BiVO4) is far less effective than the strategy discovered in the present work, wherein the relatively low-performance copper vanadate photoanodes are dramatically improved upon the addition of a small amount of BiVO4. MSPF identifies the phase combinations that merit further investigation to reveal the underlying mechanism of performance enhancement.

Methods

Physical vapor deposition (PVD) library synthesis

The four continuous composition libraries of Bi–Cu–V oxide system were synthesized by radio-frequency (RF) magnetron co-sputtering from elemental sources (Bi, Cu, and V) arranged symmetrically with respect to the 100-mm-diameter glass substrate with SnO2:F conducting layer in a custom-designed combinatorial sputtering system39, and post-deposition annealed in a conventional box oven at 550 °C in air for 3 h, followed by natural cooling to room temperature. The reactive working atmosphere composed of 4.8 mTorr of inert Ar gas and 1.2 mTorr of reactive O2 gas, and the substrate was kept without intended heating. The RF powers on the elemental sources were adjusted for the relative deposition rates to obtain the designed composition in the substrate center, and the non-confocal geometry of sputter sources provided a continuous composition gradient on the order of 1 at.% mm−1. These methods have been validated in prior work to produce metal oxide films—in particular oxides based on Bi, Cu, and V—that are suitable for photoelectrochemical evaluation31,40,41.

Composition and structure measurements

The library compositions were obtained by x-ray fluorescence (XRF) measurements using an EDAX Orbis Micro-XRF system with an x-ray beam approximately 2 mm in diameter. The Bi L, V K, and Cu K XRF peak intensities (counts per second) were exacted from the Orbis software, then converted to the metal loadings (nmol cm−2) and normalized compositions using the sensitivity factor for each element calibrated by commercial XRF standards (MicromatterTM).

The crystal structures of composition libraries were analyzed by x-ray diffraction (XRD) with a Bruker DISCOVER D8 diffractometer with Cu Kα radiation from a Bruker IµS source. The x-ray spot size was limited to a 2 mm length scale, over which the composition is constant to within approximately 1–2 at.%. Diffraction images were collected using a two-dimensional VÅNTEC-500 detector and integrated into one-dimensional patterns using DIFFRAC.SUITE™ EVA software.

Scanning Droplet Cell (SDC) photoelectrochemistry (PEC)

Scanning droplet cell experiments42 were performed on Bi-Cu-V oxide thin films from 4 composition libraries in the O2-bubbled pH 9 sulfite-containing electrolyte. A 0.4 mm diameter optical fiber coupled to the SDC provided 388 nm wavelength LED illumination (3.2 ± 0.05 eV) combined with a white light (W 3500 K, Doric LEDC2-385/W35) such that toggling provided a large 388 nm peak and broad white light centered at 600 nm with a smaller peak at 450 nm. Current driver settings were 0.4 A for both sources, with white light irradiance at approximately 80 mW cm−2. Illumination area was 1.13 mm2 with sampling done on the same 4.5 mm grid as XRF and XRD measurements across the composition gradient.

The photocurrent measurements resulted from a linear potential sweep from 1.246 to 0.27 V vs RHE at 0.02 V s−1 with illumination turned on for 1.344 s and turned off for 0.672 s, creating a series of illumination cycles from which the photocurrent was modeled as described previously31.

Electronic microscopy

Scanning electron microscopy (SEM) were obtained with a FEI Nova NanoSEM 450 microscope at 5 kV acceleration voltage and an Everhart-Thornley secondary electron detector.

A FEI DualBeam Focused Ion Beam/scanning electron microscope (FIB/SEM) was used to prepare transmission electron microscopy (TEM) sample, which was capped carbon/I-C prior to milling. TEM experiments were carried out in a FEI Tecnai Osiris FEG/TEM operated at 200 kV in bright-field (BF) and high-resolution (HR) TEM mode. The energy-dispersive X-ray spectroscopy (EDX) elemental mapping was acquired using Bruker Quantax. This characterization was performed by Eurofins EAG Precision TEM in Santa Clara, California.

Crystal structure phase mapping (DRNets)

DRNets for phase mapping were described previously20 and used here on the union of XRD patterns from the 4 composition libraries. The 99 ICDD entries in Supplementary Table 1, curated using the quality rating to choose the entry to represent a respective formula unit and space group, were used to determine the presence of the 21 phases in Supplementary Table 2 in the dataset. Additionally, SnO2 (ICDD 04-003-0649) was used to model the crystalline underlayer whose diffraction signal is present in each diffraction pattern but with variable intensity based on the attenuation of the photoanode sample. DRNets used candidate phase patterns normalized to a maximum intensity of 1. Supplementary Table 2 also provides the relative intensities of the 21 phases calculated from Eq. 5 of ref. 43, which were used to renormalize the DRNets pattern concentrations to molar phase concentrations using Eq. (6) of ref. 43.

Matrix factorization

Assuming a linear weighting of phase-specific properties in a mixed-phase signal, a signal Ai for sample i is modeled as the inner product of the vector of phase concentrations for sample i (Hi) and the matrix of representative signals or “basis patterns” for each phase (W). Given the set of samples with different phase mixtures, this becomes a matrix factorization problem where the phase concentration matrix H is fixed at the values obtained from phase mapping: AW · H. Given the PEC measurements A, the matrix W is solved by gradient descent using Tensorflow Keras with random initialization, RMSE loss, and RMSprop optimizer (learning rate 1e-4, momentum 0.9). The optimal solution was found after 1000 iterations.