Article | Open | Published:

# A new mathematical approach to finding global solutions of the magnetic structure determination problem

## Abstract

Determination of magnetic structure is an important analytical procedure utilized in various fields ranging from fundamental condensed-matter physics and chemistry to advanced manufacturing. It is typically performed using a neutron diffraction technique; however, finding global solutions of the magnetic structure optimization problem represents a significant challenge. Generally, it is not possible to mathematically prove that the obtained magnetic structure is a truly global solution and that no solution exists when no acceptable structure is found. In this study, the global optimization technique called semidefinite relaxation of quadratic optimization, which has attracted much interest in the field of applied mathematics, is proposed to use as a new analytical method for the determination of magnetic structure, followed by the application of polarized neutron diffraction data. This mathematical approach allows avoiding spurious local solutions, decreasing the amount of time required to find a tentative solution and finding multiple solutions when they exist.

## Introduction

Development of method for determining crystal and magnetic structure is an important issue1,2,3. The magnetic structure of a compound is directly related to the microscopic origins of various intriguing magnetic phenomena observed in physics, chemistry, biology and geology4,5,6,7,8,9,10,11. Accurate information on the experimentally determined magnetic structures can be potentially used to effectively design functional materials and opens multiple opportunities for utilizing advanced first-principle calculations and informatics approaches. Furthermore, the responses of the analysed magnetic structure to external factors such as temperature, pressure, electromagnetic field, light and environment are usually related to the corresponding changes in the macroscopic properties of minerals and biomolecules.

Since the pioneering work of Shull et al. published in 19511, many studies on the determination of the magnetic structures of various materials by neutron diffraction have been performed. Thus, Izymov, Kovalev and Bertaut developed the irreducible representation (IR) theory, which successfully classified magnetic structures by their magnetic point symmetries obtained through the analysis of neutron diffraction data12,13,14. Moreover, the modern neutron diffractometers exhibit relatively high statistical accuracy and resolution15,16. However, analysing neutron diffraction data to determine the correct magnetic structure represents a challenging task. The major issue here is the existence of so-called local solutions to the optimization problem (Fig. 1A). The analysis procedure is mathematically categorized as the nonlinear optimization, in which the obtained diffraction data points are fitted with the function of neutron scattering cross-section characterized by high-dimensional nonlinear parameters such as magnetic moment vectors17. After performing nonlinear optimization, it is very difficult to prove that the best solution obtained via various numerical models is the global one. Furthermore, multiple or many solutions are hidden in some cases, and no solutions exist in other cases. To mitigate these issues, global optimization techniques including a simulated annealing method, the Monte Carlo method and genetic algorithms can be used18,19,20,21,22,23. However, none of these approaches can determine the global solution(s) with 100% probability.

In this study, a new analytical method for the determination of magnetic structure is proposed, which allows (i) judging whether the obtained solution is a truly global one; (ii) evaluating the uniqueness of the solution obtained for a given set of experimental data; and (iii) completing the global optimization procedure in a very short time (typically, less than several seconds). Furthermore, the applicability of the proposed method is demonstrated using polarized-neutron powder diffraction data.

## Mathematical Formulation for Applications of Semidefinite Relaxation Method

Relaxation techniques have been previously developed in the field of mathematical programming. In particular, semidefinite relaxation (SDR) combined with semidefinite programming (SDP) has found many applications in applied mathematics and engineering (for example, see Chapter 2.2 in ref.24). SDR is an efficient technique for solving nonlinear optimization problems, such as quadratic programs (QPs), namely the minimization of multivariate quadratic polynomials under constraints. It should be noted that SDR could provide both fast convergence and a numerical proof of the global optimality of the obtained solutions using the global convergence property and duality theorem of the convex programming methods, as schematically shown in Fig. 1(B,C).

In the field of optical imaging, Candès et al. published a pioneering work (called the PhaseLift method), in which a sparse modelling approach was adopted for general phase retrieval25. Furthermore, one of the authors (ROT) developed an SDR-based mathematical approach to investigate whether a crystal structure could be uniquely identified using only diffraction data and independent atomic model26.

In this study, this method was applied to magnetic structure analysis by replacing the optimized parameters with magnetic moments. The problem of magnetic structure determination can be mathematically described by the following set of N quadratic equations:

$${I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})\approx {I}_{{\rm{mag}},{\rm{cal}}}({Q}_{k})={{\boldsymbol{x}}}^{{\rm{T}}}{S}_{k}{\boldsymbol{x}}=\sum _{1\le i,j\le n}{S}_{k}(i,j){x}_{i}{x}_{j}\,(1\,\le \,k\,\le N),$$
(1)

where $${I}_{\mathrm{mag},\mathrm{obs}}({Q}_{k})\,$$and $${I}_{\mathrm{mag},\mathrm{cal}}({Q}_{k})$$ denote the observed and calculated integrated magnetic diffraction intensities at the magnetic reflection $${Q}_{k}={h}_{{\rm{mag}}}\,{k}_{{\rm{mag}}}\,{l}_{{\rm{mag}}}$$, respectively; x = (x1, …, xn)T and $${S}_{k}$$ represents the coefficient matrix numerically obtained using the scattering cross-section formula for each $${Q}_{k}$$, which consists of the absolute intensity scale factor, magnetic form factor, Lorentz factor, multiplicity and structural weight factor (the details of this formula are summarized in Supplementary Information).

The symbol $$\approx$$ indicates that each $${I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})$$ value includes an experimental error. In order to incorporate all errors, the following optimization problem is solved:

$$\{\begin{array}{c}{\rm{Minimize}}\sum _{k=1}^{N}\frac{|{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})-{{\boldsymbol{x}}}^{{\rm{T}}}S{\boldsymbol{x}}|}{{\rm{Err}}[{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})]},\\ {\rm{subject}}\,{\rm{to}}:|{x}_{i}|\le {R}_{i}(1\le i\le n).\end{array}$$
(2)

The inequality $$|{x}_{i}|\le {R}_{i}$$ can be also removed if the permitted range of $$|{x}_{i}|$$ ($${R}_{i}$$, for example, the upper limit of magnetic moment) is uncertain while maintaining the validity of the subsequent discussion of the SDR and SDP techniques.

Equation (2) is classified as a so-called l1-norm minimization problem, which is equivalent to the following form of the quadratic programming problem:

$$\{\begin{array}{c}{\rm{Minimize}}\,\sum _{k=1}^{N}\,\frac{{\eta }_{k}^{+}+{\eta }_{k}^{-}}{2}\\ {\rm{subject}}\,{\rm{to}}:\frac{{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})-{{\boldsymbol{x}}}^{{\rm{T}}}{S}_{k}{\boldsymbol{x}}}{{\rm{Err}}[{I}_{\mathrm{mag},\mathrm{obs}}({Q}_{k})]}=\frac{{\eta }_{k}^{+}-{\eta }_{k}^{-}}{2}(1\le k\le N),\\ {{x}_{i}}^{2}+{y}_{i}={{R}_{i}}^{2},\,{y}_{k}\ge 0\,(1\le i\le n),\\ {\eta }_{k}^{+}\ge 0,{\eta }_{k}^{-}\ge 0\,(1\le k\le N).\end{array}$$
(3)

The problems described by equations (2) and (3) are equivalent since they have the same set of solutions x and the minimized values of the objective functions (more details are provided in Supplementary Information). The basic strategy utilized in this work is to apply SDR to equation (3) in order to solve equation (2) and then provide a computational proof on the global convergence property of the solution. The least-squares minimization of the $$\,\sum _{k=1}^{N}{|({I}_{\mathrm{mag},\mathrm{obs}}({Q}_{k})-{{\boldsymbol{x}}}^{T}S{\boldsymbol{x}})/{\rm{Err}}[{I}_{\mathrm{mag},\mathrm{obs}}({Q}_{k})]|}^{2}$$ function is avoided because a small increase in the polynomial degree considerably magnifies the size of the SDR problem (it increases proportionally to the power of N). Thus, it is possible to locate the global optimum by performing l1-norm minimization, which can be subsequently used as the initial parameter of the normal least-squares method to calculate the refined parameters and then compare them with literature data.

## Application to Experimental Data Analysis

### Experimental results

The developed SDR method was verified by applying it to the experimental data obtained for pyrochlore Nd2Ir2O7, which served as a proximate material for a three-dimensional Weyl semimetal and a component of spintronic devices on the basis of its geometrically frustrated magnetism and 5d-electron configuration27,28,29,30,31,32. This state theoretically corresponds to the all-in all-out type of magnetic structure described by the magnetic propagation vector kmag = (0, 0, 0), in which all the magnetic moments are oriented either towards the centre of the participating tetrahedron or in the opposite direction30,32. This prediction was experimentally confirmed in previous unpolarized neutron diffraction studies33,34. However, the superposition of the nuclear and magnetic reflections observed for the magnetic structures with kmag = (0, 0, 0) produces ambiguous results during their separation. Furthermore, it is not possible to mathematically prove with 100% certainty the absence of other acceptable solutions to the problem of magnetic structure determination. Thus, in this work, polarized neutron diffraction studies were performed for this material, and the obtained magnetic structure was verified mathematically.

Figure 2 shows the representative neutron diffraction data obtained for Nd2Ir2O7 at the minimum temperature T = 1.4 K. The non-spin-flip and spin-flip parameters IOFF and ION roughly correspond to the nuclear and magnetic reflection components Inuc and Imag, respectively. The magnitude of IOFF is systematically larger than ION at all temperatures, thus confirming the necessity of conducting polarized neutron diffraction experiments. For ION, the intensity of the 113 reflection increases with decreasing temperature, indicating the existence of strong temperature dependence for this reflection, which is not observed for the 222 reflection. Moreover, as the flipping ratio of the neutron beam in the actual experiments is finite, the magnitudes of ION and IOFF can be expressed by the following formulas:

$$\{\begin{array}{c}{I}_{{\rm{OFF}}}=(1-{r}_{{\rm{mix}}}){I}_{{\rm{nuc}}}+\,{r}_{{\rm{mix}}}{I}_{{\rm{mag}}},\,\\ {I}_{{\rm{ON}}}={r}_{{\rm{mix}}}{I}_{{\rm{nuc}}}+\,(1-{r}_{{\rm{mix}}}){I}_{{\rm{mag}}},\,\end{array}$$

where rmix = N/(N+ + N) is the mixing rate, and N+ (N) denotes the number of majority-spin (minority-spin) neutrons. The value of rmix is selected to satisfy the condition Imag = 0; hence, ION = rmix·Inuc at the paramagnetic T = 40 K. As a result, the pure magnetic intensity Imag can be determined by combining IOFF and ION. A more detailed explanation and data obtained for other reflections are presented in Supplementary Information, while the calculated Imag,obs values are listed in Table 1.

### Magnetic structure analysis results

The arbitrary magnetic structure with kmag = (0, 0, 0) in the space group $$Fd\bar{3}m$$ is described as the function of xarb = (m(Nd)1, , m(Nd)12, m(Ir)1, , m(Ir)12) containing narb = 24 variables generated by the eight magnetic atoms of the unit cell and three Cartesian coordinates. Here, the magnetic symmetry was classified by performing IR analysis (this procedure is generally not required for the proposed method; however, it may be potentially useful because of the reduction of the number of variables if the number of observed reflection points is limited). The possible magnetic structures are described by the representations ΓNd = Γ3 + 2Γ5 + 3Γ7 + 6Γ9 and ΓIr = Γ3 + 2Γ5 + 3Γ7 + 6Γ9, where Γ3 corresponds to the all-in all-out type of the magnetic structure, and the coefficients denote the numbers of basis vectors summarized in Table 218,35. Hence, the total numbers of variables are reduced to nΓ3 = 2, nΓ5 = 4, nΓ7 = 6 and nΓ9 = 12. Furthermore, representation Γ9 includes six ferromagnetic basis vectors. However, the Nd2Ir2O7 structure exhibits only extremely weak spontaneous magnetization (around 10−4μB/formula unit)29, which is significantly below the detection limit of the neutron diffraction technique. Therefore, the ferromagnetic basis vectors are precluded and the value of nΓ9 is further reduced from 12 to 6 during the analysis of the neutron diffraction data.

Thus, the variables used for the magnetic structure analysis in this work are defined as follows: xΓ3 = (m(Γ3,Nd)1, m(Γ3,Ir)1), xΓ5 = (m(Γ5,Nd)1, m(Γ5,Nd)2, m(Γ5,Ir)1, m(Γ5,Ir)2), xΓ7 = (m(Γ7,Nd)1, m(Γ7,Nd)2, m(Γ7,Nd)3, m(Γ7,Ir)1, m(Γ7,Ir)2, m(Γ7,Ir)3) and xΓ9 = (m(Γ9,Nd)1, m(Γ9,Nd)2, m(Γ9,Nd)3, m(Γ9,Ir)1, m(Γ9,Ir)2, m(Γ9,Ir)3). The goal is to determine the globally optimal solutions x for representations Γ3, Γ5, Γ7 and Γ9 using the Imag,obs magnitudes listed in Table 1. After that, the solution characterized by the best fit can be selected.

The output values produced by the SDP solver are as follows.

1. (1)

The convergence procedure results in the following coefficients:

$$\begin{array}{c}{{X}_{{\rm{\Gamma }}3}}^{({\rm{opt}})}\approx {{{\boldsymbol{x}}}_{{\rm{\Gamma }}3}}^{({\rm{opt}}1)}{{{\boldsymbol{x}}}_{{\rm{\Gamma }}3}}^{({\rm{opt}}1)T};\\ {{X}_{{\rm{\Gamma }}5}}^{({\rm{opt}})}\approx ({{{\boldsymbol{x}}}_{{\rm{\Gamma }}5}}^{({\rm{opt}}1)}{{x}_{{\rm{\Gamma }}5}}^{({\rm{opt}}1)T}+{{{\boldsymbol{x}}}_{{\rm{\Gamma }}5}}^{({\rm{opt}}2)}{{{\boldsymbol{x}}}_{{\rm{\Gamma }}5}}^{({\rm{opt}}2)T})/2;\\ {{X}_{{\rm{\Gamma }}7}}^{({\rm{opt}})}\approx 0;\\ {{X}_{{\rm{\Gamma }}9}}^{({\rm{opt}})}\approx ({{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}1)}{{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}1)T}+{{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}2)}{{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}2)T}+{{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}3)}{{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}3)T})/3;\end{array}$$

and

$$\begin{array}{c}{{{\boldsymbol{x}}}_{{\rm{\Gamma }}3}}^{({\rm{opt}})}=(-\,1.20,\,0.19);\\ {{{\boldsymbol{x}}}_{{\rm{\Gamma }}5}}^{({\rm{opt}}1)}=(0.55,\,0.,\,0.48,\,0.),\,{{{\boldsymbol{x}}}_{{\rm{\Gamma }}5}}^{({\rm{opt}}2)}=(0.,\,0.55,\,0.,\,0.48);\\ {{{\boldsymbol{x}}}_{{\rm{\Gamma }}7}}^{(opt)}=(0.,\,0.,\,0.,\,0.,\,0.,\,0.);\\ {{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}1)}=(0.55,\,0.,\,0.,\,-\,0.52,\,0.,\,0.),\,{{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}2)}=(0.,\,0.55,\,0.,\,0.,\,-\,0.52,\,0.),\\ {{{\boldsymbol{x}}}_{{\rm{\Gamma }}9}}^{({\rm{opt}}3)}=(0.,\,0.,\,0.55,\,0.,\,0.,\,-\,0.52);\end{array}$$

where the values of x are expressed the μB units, and the negative sign indicates the nearest ferromagnetic Nd–Ir correlation. While a single optimum solution is determined for representation Γ3, multiple solutions are obtained for Γ5 and Γ9, respectively, in accordance with the rank values of XΓ5(opt) and XΓ9(opt), which indicate the existence of an infinite number of solutions with the same objective functions $${{\boldsymbol{x}}}_{{\rm{\Gamma }}5}^{({\rm{opt}})}=\,\cos \,\theta {{\boldsymbol{x}}}_{{\rm{\Gamma }}5}^{({\rm{opt}}1)}+\,\sin \,\theta {{\boldsymbol{x}}}_{{\rm{\Gamma }}5}^{({\rm{opt}}2)}$$ and $${{\boldsymbol{x}}}_{{\rm{\Gamma }}9}^{({\rm{opt}})}=\,\cos \,\theta {{\boldsymbol{x}}}_{{\rm{\Gamma }}9}^{({\rm{opt}}1)}+\,\sin \,\theta \,\cos \,\varphi {{\boldsymbol{x}}}_{{\rm{\Gamma }}9}^{({\rm{opt}}2)}+\,\sin \,\theta \,\sin \,\varphi {{\boldsymbol{x}}}_{{\rm{\Gamma }}9}^{({\rm{opt}}3)}$$, where $$\theta$$ and $$\varphi$$ are arbitrary. Without SDR, it is difficult to find the optimum solutions for this type of problems and prove that better solutions do not exist. Furthermore, the zero magnitude of xΓ7(opt) is obtained for representation Γ7. Indeed, when xΓ7 values are finite (non-zero), the $${I}_{{\rm{mag}},{\rm{cal}}}$$ values for $${I}_{{\rm{mag}},{\rm{obs}}}=0$$ indices increase more rapidly than those for $${I}_{{\rm{mag}},{\rm{obs}}}\ne 0$$ indices. Thus, the SDR method automatically overcomes these issues.

2. (2)

The obtained indicator values for representations Γ3, Γ5, Γ7 and Γ9 are as follows.

1. a)

The corresponding duality gaps determined by the SDP solver are equal to $${\rm{\Delta }}f=2.1\times {10}^{-7}$$, $$1.4\times {10}^{-6}$$, $$3.1\times {10}^{-6}$$ and $$8.0\times {10}^{-7}$$, respectively. Their magnitudes are close to zero, indicating that the convergence to the global optimums is achieved.

2. b)

The minimized objective function $${f}^{({\rm{gl}})}\underline{\underline{{\rm{def}}}}\,\sum _{k=1}^{N}\,|{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})-{I}_{{\rm{mag}},{\rm{cal}}}({Q}_{k})|/{\rm{Err}}[{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})]$$ = 4.5, 19, 32 and 27, and the more familiar R-factor, $${R}_{{\rm{Bragg}}}\underline{\underline{{\rm{def}}}}\,(\sum _{k=1}^{N}|{I}_{\mathrm{mag},\mathrm{obs}}({Q}_{k})-{I}_{\mathrm{mag},\mathrm{cal}}({Q}_{k})|)/(\sum _{k=1}^{N}\,{I}_{\mathrm{mag},\mathrm{obs}}({Q}_{k}))$$ = 0.13, 0.63, 1.0 and 0.81, respectively. These results show that the smallest values are obtained for representation Γ3.

3. c)

The goodness of the fit $${\chi }^{2}\underline{\underline{{\rm{def}}}}\,(\sum _{k=1}^{N}{|{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})-{I}_{{\rm{mag}},{\rm{cal}}}({Q}_{k})|}^{2}\,/\,\,{\rm{Err}}{[{I}_{{\rm{mag}},{\rm{obs}}}({Q}_{k})]}^{2})/(N-{n}_{{\rm{\Gamma }}})$$ = 2.6, 14, 25 and 20, and the related statistical parameter $${f}^{({\rm{gl}})}/(N-{n}_{{\rm{\Gamma }}})=0.75$$, 4.8, 16 and 14, respectively. The value closest to the expected value (1 for $${\chi }^{2}$$; $$\sqrt{2/\pi }\approx 0.798$$ for the latter parameter) is obtained for Γ3.

All these facts suggest that Γ3 represents the best solution, whereas representations Γ5, Γ7 and Γ9 are excluded for the first time. For clarity, the values of Imag,cal are listed in Table 2 and also shown in Fig. 3. The magnitude of Imag,cal-Γ3 matches Imag,obs very well, whereas the globally optimal Imag,cal-Γ5, Imag,cal-Γ7 and Imag,cal-Γ9 parameters substantially differ from the corresponding Imag,obs values.

After proving mathematically the uniqueness of representation Γ3, the refined values mNd = −1.22(5)μB and mIr = 0.14(5)μB are obtained using the xΓ3(opt) values as the initial parameters in the normal least-squares method. These results are comparable with the reported values of mNd = −1.27(1)μB and mIr = 0.34(1)μB34.

## Discussion

Representation Γ9 (the only IR containing ferromagnetic basis vectors35) is rejected as the optimal solution despite the existence of weak ferromagnetism29. The observed inconsistency suggests that this ferromagnetism is symmetrically decoupled from the bulk magnetic structure (for example, as a surface or interface-protected property). In fact, by performing careful measurements of the macroscopic magnetization and electrical resistivity of isomorphic Cd2Os2O7, it was found that the surface ferromagnetism coupled with novel spin-polarized conductivity emerged on the walls between the all-in all-out and all-out all-in antiferromagnetic domains36. The macroscopic observation is consistent with the findings of this study verified both microscopically and mathematically, indicating their potential applicability in domain wall spin electronics.

We discuss the expected application scope of the SDR method. After determining the list of (hmag, kmag, lmag, Imag,obs) values, the described SDR method can be used to find the corresponding magnetic structures as the global solutions. First, the configurations with kmag = (0, 0, 0) are considered, indicating their high potential applicability in various fields (including magnet materials). Second, this method is not restricted to polarized neutron diffraction experiments, but can be also used in studies involving unpolarized neutrons when the magnetic structure is characterized by kmag ≠ (0, 0, 0) or kmag = (0, 0, 0) with detectable magnetic moment. Both the magnetic and crystallographic structures can be simultaneously refined by the normal least-squares method, in which the obtained SDR solutions are utilized as the initial values of the magnetic structural parameters. Third, the SDR technique is able to easily process thousands of independent variables. Therefore, magnetic structures of arbitrary types can be theoretically determined using the advanced diffractometers that provide a relatively large number of reflection points (even for the target materials with complex compositions).

The diffraction intensities are not represented by quadratic functions of the atomic positions rj; hence, the SDR technique seems to be inapplicable for determining the values of rj (crystal structure). However, the neutron and X-ray diffraction intensities are represented by those of the nuclear and electron densities (generalized crystal structure), respectively. Likewise, a magnetic structure is also generalized to the magnetic moment density. Thus, the SDR technique is expected to enable analysing the global solutions of the generalized structures together with the aforementioned high-volume processing ability, such as protonic/ionic distributions in the conductors and electronic spin-orbital distributions.

## Materials and Methods

### Calculations

The system of quadratic equations was solved using the SDP solver SDPA37. To find the global optima of SDP problems, interior point methods were efficiently used38.

### Experiments

The polarized neutron elastic scattering experiments were performed using the HB1 thermal neutron three-axis spectrometer located at the High Flux Isotope Reactor (HFIR) of the Oak Ridge National Laboratory (ORNL). Heusler alloy 111 reflection crystals were utilized as the monochromator and analyser. The flipping ratio R = 10 was obtained using the nuclear 222 reflection at a paramagnetic temperature of 40 K corresponding to the beam polarization P = 0.82. The polarization vector was set parallel to the scattering vector (P//Q). The incident energy of neutrons was Ei = 13.5 meV. The horizontal collimator sequence was 48′(open)–80′–80′–240′. A pyrolytic graphite Bragg-reflection filter was used to efficiently eliminate the contamination caused by higher-order wavelengths.

A powder Nd2Ir2O7 sample was synthesized by a solid-state reaction method inside a quartz tube. About 4.8 g of the sample was wrapped in thin aluminium foil and shaped to a hollow cylinder with a thickness of 0.8 mm and diameter of 20 mm to mitigate the effect of the strong neutron absorption of Ir nuclei. The cylinder was stored in an aluminium container filled with He gas and placed under the cold heads of a He-closed-cycle (Displex) or liquid-He-type (Orange) cryostat.

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## References

1. 1.

Shull, C. G., Strauser, W. A. & Wollan, E. O. Neutron diffraction by paramagnetic and antiferromagnetic substances. Phys. Rev. 83, 333 (1951).

2. 2.

Booth, A. D. Application of the method of steepest descents to X-Ray structure analysis. Nature 160, 196 (1947).

3. 3.

Cochran, W. The Fourier method of crystal structure analysis. Nature 161, 765 (1948).

4. 4.

Kimura, T. et al. Magnetic control of ferroelectric polarization. Nature 426, 55 (2003).

5. 5.

Vaknin, D. et al. Antiferromagnetism in La2CuO4-y. Phys. Rev. Lett. 58, 2802–2805 (1987).

6. 6.

Tranquada, J. M. et al. Neutron-diffraction determination of antiferromagnetic structure of Cu ions in YBa2Cu3O6+x with x = 0.0 and 0.15. Phys. Rev. Lett. 60, 156 (1988).

7. 7.

de la Cruz, C. et al. Magnetic order close to superconductivity in the iron-based layered LaO1-xFxFeAs systems. Nature 453, 899 (2008).

8. 8.

Tokura, Y., Kawasaki, M. & Nagaosa, N. Emergent functions of quantum materials. Nat. Phys. 13, 1056 (2017).

9. 9.

Tsujimoto, Y. et al. Infinite-layer iron oxide with a square-planar coordination. Nature 450, 1062 (2007).

10. 10.

Ovsyannikov, S. V. et al. Charge-ordering transition in iron oxide Fe4O5 involving competing dimer and trimer formation. Nat. Chem. 8, 501 (2016).

11. 11.

Michel, F. M. et al. Ordered ferrimagnetic form of ferrihydrite reveals links among structure, composition, and magnetism. PNAS 107, 2787 (2010).

12. 12.

Izymov, Y. A., Naish, V. E. & Ozerov, R. R. Neutron Diffraction of Magnetic Materials (Consultants Bureau, New York, 1991).

13. 13.

Kovalev, O. Representations of the Crystallographic Space Groups (Gordon and Breach, Switzerland, 1993).

14. 14.

Bertaut, E. F. Representation Analysis of Magnetic Structures. Acta Cryst. A24, 217 (1968).

15. 15.

For example, Torii, S., Yonemura, M., Ishikawa, Y., Miao, P., Tomiyasu, R., Satoh, S., Noda, Y. & Kamiyama, T. Improvement of Instrument Devices for Super High Resolution Powder Diffractometer at J-PARC. J. Phys.: Conf. Ser. 502, 12052 (2014).

16. 16.

Willis, B. T. M. & Carlile, C. J. Experimental Neutron Scattering (Oxford University Press, 2017).

17. 17.

Lovesey, S. W. Theory of Neutron Scattering from Condensed Matter (Oxford University Press, 1984).

18. 18.

Wills, A. S. A new protocol for the determination of magnetic structures using simulated annealing and representational analysis (SARAh). Physica B (Amsterdam, Neth.) 276–278, 680 (2000).

19. 19.

Rodríguez-Carvajal, J. Recent advances in magnetic structure determination neutron powder diffraction. Physica B (Amsterdam, Neth.) 192, 55 (1993).

20. 20.

McGreevy, R. L. & Pusztai, L. Reverse Monte Carlo Simulation: A New Technique for the Determination of Disordered Structures. Journal Molecular Simulation 1, 359 (1988).

21. 21.

Harris, K. D. M., Tremayne, M., Lightfoot, P. & Bruce, P. G. Crystal Structure Determination from Powder Diffraction Data by Monte Carlo Methods. J. Am. Chem. Soc. 116, 3543 (1994).

22. 22.

Shankland, K., David, W. I. F. & Csoka, T. Crystal structure determination from powder diffraction data by the application of a genetic algorithm. Zeitschrift fur Kristallographie 212, 550 (1997).

23. 23.

Harris, K. D. M., Johnston, R. L. & Kariuki, B. M. The Genetic Algorithm: Foundations and Applications in Structure Solution from Powder Diffraction Data. Acta Crystallographica A54, 632 (1998).

24. 24.

Blekherman, G. & Parrilo, P. A., Ed. Thomas, R. R. Semidefinite Optimization and Convex Algebraic Geometry in MOS-SIAM Series on Optimization. (Society for Industrial and Applied Mathematics and Mathematical Optimization Society, Philadelphia, 2013).

25. 25.

Candès, E. J., Strohmer, T. & Voroninski, V. PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming. Commun. Pure and Appl. Math. 66, 1241 (2013).

26. 26.

Oishi-Tomiyasu, R. Application of convex optimization to identification of atomic species from diffraction patterns. Powder Diffraction J. 32(S1), S179 (2017).

27. 27.

Pesin, D. & Balents, L. Mott physics and band topology in materials with strong spin–orbit interaction. Nat. Phys. 6, 376 (2010).

28. 28.

Matsuhira, K. et al. Metal–Insulator Transition in Pyrochlore Iridates Ln 2Ir2O7 (Ln = Nd, Sm, and Eu). J. Phys. Soc. Jpn. 76, 043706 (2007).

29. 29.

Matsuhira, K., Wakeshima, M., Hinatsu, Y. & Takagi, S. Metal–Insulator Transitions in Pyrochlore Oxides Ln 2Ir2O7. J. Phys. Soc. Jpn. 80, 094701 (2011).

30. 30.

Yamaji, Y. & Imada, M. Metallic Interface Emerging at Magnetic Domain Wall of Antiferromagnetic Insulator: Fate of Extinct Weyl Electrons. Phys. Rev. X 4, 021035 (2014).

31. 31.

Tian, Z. et al. Field-induced quantum metal–insulator transition in the pyrochlore iridate Nd2Ir2O7. Nat. Phys. 12, 134 (2015).

32. 32.

Wan, X., Turner, A. M. & Vishwanath, A. & Savrasov, S. Y. Topological Semimetal and Fermi-Arc Surface States in the Electronic Structure of Pyrochlore Iridates. Phys. Rev. B 83, 205101 (2011).

33. 33.

Tomiyasu, K. et al. Emergence of Magnetic Long-range Order in Frustrated Pyrochlore Nd2Ir2O7 with Metal–Insulator Transition. J. Phys. Soc. Jpn. 81, 034709 (2012).

34. 34.

Guo, H., Ritter, C. & Komarek, A. C. Direct determination of the spin structure of Nd2Ir2O7 by means of neutron diffraction. Phys. Rev. B 94, 161102(R) (2016).

35. 35.

Wills, A. S. et al. Magnetic ordering in Gd2Sn2O7: the archetypal Heisenberg pyrochlore antiferromagnet. J. Phys. Condens. Matter Lett. 18, L37 (2006).

36. 36.

Hirose, H. T., Yamaura, J. & Hiroi, Z. Robust ferromagnetism carried by antiferromagnetic domain walls. Sci. Rep. 7, 42440.

37. 37.

Yamashita, M. et al. A high-performance software package for semidefinite programs: SDPA 7. Research Report B-460 (Dept. of Mathematical and Computing Science, Tokyo Institute of Technology, Tokyo, Japan) (2010).

38. 38.

Vandenberghe, L. & Boyd, S. Semidefinite Programming. SIAM Review 38, 49 (1996).

## Acknowledgements

Neutron diffraction experiments were conducted using the High Flux Isotope Reactor, a user facility of the DOE Office of Science operated by the Oak Ridge National Laboratory (USA). This study was partially supported by the U.S.-Japan Cooperative Program on Neutron Scattering. This study was financially supported by the MEXT/JSPS KAKENHI (grant Nos JP18K03503, JP17H06137 and JP15H03692), JST PRESTO (grant No. JPMJPR14E6), Japan-US program administrated by ISSP at the University of Tokyo and FRIS program for the creation of interdisciplinary research at the Tohoku University.

## Author information

### Affiliations

1. #### Department of Physics, Tohoku University, Aoba, Sendai, 980-8578, Japan

• K. Tomiyasu
2. #### Faculty of Science, Yamagata University, Yamagata, 990-8560, Japan

• R. Oishi-Tomiyasu
3. #### JST, PRESTO, Saitama, 332-0012, Japan

• R. Oishi-Tomiyasu

• M. Matsuda
5. #### Faculty of Engineering, Kyusyu Institute of Technology, Kitakyusyu, 804-8550, Japan

• K. Matsuhira

### Contributions

K.T. conceived and conducted this study. R.O.-T. performed the mathematical optimization. K.M. synthesized the sample. K.T. and M.M. performed the neutron diffraction experiments. K.T. and R.O.-T. analysed the data. K.T. and R.O.-T. wrote the manuscript based on the feedback provided by all authors.

### Competing Interests

The authors declare no competing interests.

### Corresponding authors

Correspondence to K. Tomiyasu or R. Oishi-Tomiyasu.