## Abstract

Bose–Einstein condensation (BEC) in quantum magnets, where bosonic spin excitations condense into ordered ground states, is a realization of BEC in a thermodynamic limit. Although previous magnetic BEC studies have focused on magnets with small spins of *S* ≤ 1, larger spin systems potentially possess richer physics because of the multiple excitations on a single site level. Here, we show the evolution of the magnetic phase diagram of *S* = 3/2 quantum magnet Ba_{2}CoGe_{2}O_{7} when the averaged interaction *J* is controlled by a dilution of magnetic sites. By partial substitution of Co with nonmagnetic Zn, the magnetic order dome transforms into a double dome structure, which can be explained by three kinds of magnetic BECs with distinct excitations. Furthermore, we show the importance of the randomness effects induced by the quenched disorder: we discuss the relevance of geometrical percolation and Bose/Mott glass physics near the BEC quantum critical point.

## Introduction

Bose–Einstein condensation (BEC), in which a macroscopic number of bosons occupy the same state, has been studied broadly in areas ranging from condensed matter physics and particle physics to astrophysics. In condensed matter physics, a variety of systems such as photons^{1}, composite bosons (e.g., bosonic atoms^{2} and pairs of fermionic atoms^{3}), and quasi-particles (e.g., excitons^{4,5}, phonons^{6}, polaritons^{7}, and magnons^{8}) have been studied using a common bosonic quantum field theory. The understanding of BEC forms the foundation for exploring advanced quantum condensate states such as superfluidity and superconductivity. In particular, the behavior of bosonic particles in a periodic potential is of recent interest. Experimental, theoretical, and computational studies on both crystal lattice and optical lattice have been intensively performed^{9,10,11}.

Magnetic field-induced phase transitions in quantum magnets which approximately possess *U*(1) global rotational symmetry are one of the experimental realizations of BEC^{12,13,14}. The energy gap *E*_{g} between the ground state and the bottom of the magnon band, which is nonzero in the quantum paramagnetic phase, is translated into chemical potential *μ* for the bosonic language (see inset in Fig. 1a). By tuning the applied magnetic field, *μ* can be tuned to be zero, resulting in a long-range ordered magnetic BEC. Unlike a cold-atom system in an optical lattice, which is another experimental realization of BEC, quantum magnets can host a much larger number of bosons, and are thus suited for the test of theoretical prediction for BEC physics in the thermodynamic limit^{15}.

Historically, experimental studies of BEC in quantum magnets have been mainly performed on low-spin systems such as quantum dimer systems^{16,17,18,19,20} and *S* = 1 systems with strong easy-plane single-ion (SI) anisotropy^{21}. Higher spin systems are usually considered to be disadvantageous observing quantum phenomena like BEC, while they can provide a playground for much richer physics due to the multiple excitations on a single site level.

To see the effect of the multiple excitations, let us introduce an *S* = 3/2 antiferromagnetic (AFM) Heisenberg model, given by:

where \({\hat{S}}_{i}^{\alpha }(\alpha=x,\,y,\,z),\,J( > 0)\), *D*( > 0), *H*_{z}, \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{DM}}}}}}}}}\) and \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{me}}}}}}}}}\) are *S* = 3/2 spin operators at site *i*, AFM exchange interaction between neighboring sites *i* and *j*, easy-plane SI anisotropy, magnetic field along the *z*-axis, Dzyalosinskii–Moriya (DM) interaction term and magnetoelectric coupling term, respectively. The existence of \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{DM}}}}}}}}}\), and \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{me}}}}}}}}}\) in Ba_{2}CoGe_{2}O_{7} (BCGO), the material studied in this paper, allows sensitive detection of a magnetic order through electric measurements^{22}. Still, as far as these two terms are small compared with the first three terms, which is the case in BCGO^{23}, the BEC physics would remain qualitatively unchanged from the case of the no-magnetoelectric coupling. Therefore, hereafter, we will continue the discussion without considering \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{DM}}}}}}}}}\) and \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{me}}}}}}}}}\). See Methods for the explicit form of the magnetoelectric coupling in BCGO.

The single-site energy diagram is depicted in Fig. 1a. In a low-field range, the system can be well described in the subspace spanned by the lower doublet \(\left|{S}_{z}=\pm 1/2\right\rangle\), which yields an effective *S* = 1/2 XXZ model expressed as:

where *J*_{XXZ} = 4*J*, Δ = 1/4, and *h*_{z} = *H*_{z}^{23,24}. Here, we considered the case that the ground state at a zero field is the XY-AFM order (AFM I). The application of the magnetic field splits the lower doublet into \(\left |+1/2\right\rangle\) and \(\left|-1/2\right\rangle\), which finally destroys the long-range order and the system enters a polarized state \({\prod }_{i}{\left |+1/2\right\rangle }_{i}\) (polarized lower doublet: PLD) at the first critical field *H*_{c1}. This magnetic-field induced phase transition in the XXZ model belongs to the universality class of BEC type^{25}; in the bosonic language, *μ* of magnons in the PLD phase, which is proportional to *H* − *H*_{c1}, is positive, and magnons can no longer condensate into a magnetically ordered state. With further increasing the field, the energy levels of the \(\left |+3/2\right\rangle\) and \(\left |+1/2\right\rangle\) meet at *H* = *H*_{cross}. In the vicinity of *H*_{cross}, the system can be described in the subspace spanned by \(\left |+3/2\right\rangle\) and \(\left |+1/2\right\rangle\), yielding an effective *S* = 1/2 Hamiltonian Eq. (2) with *J*_{XXZ} = 3*J*, Δ = 1/3 and *h*_{z} = *H*_{z} − (2*D* + *n**J*), where *n* is the coordination number^{26}. For example, *n* = 4 for the square lattice. As a result, another antiferromagnetically ordered phase (AFM II) centered at *H*_{cross}( = 2*D* + *n**J*) emerges between the second and third critical fields *H*_{c2} and *H*_{c3}, which are governed by the BEC universality. At *H*_{c3}, the system eventually undergoes a phase transition to a fully polarized state (FP) \({\prod }_{i}{\left |+3/2\right\rangle }_{i}\).

The expected temperature-magnetic field phase diagram is presented in dark-blue color in Fig. 1b. Both the AFM I and AFM II phase shape dome structures called “BEC dome", and their peaks appear around *H* = 0 and *H*_{cross}, respectively. The peak temperature is proportional to *J*_{XXZ} of the effective XXZ model in Eq. (2), i.e., 4*J* and 3*J*, respectively.

Notably, the scenario mentioned above is valid only if *J* is weak enough. As the width of each magnon band is proportional to *J*, stronger *J* leads to an increase in *H*_{c1} and decrease in *H*_{c2}, so the two BEC domes merge into a single phase, as shown by the light-blue region in Fig. 1b. Accordingly, an exquisite energy balance between *J* and *D* is required to realize this type of BEC phenomenon, which has challenged the experimental realization. In order to establish a design principle for the higher spin BEC physics, we need to investigate how the featureless single AFM phase in the strongly interacting regime evolves into two AFM domes in the weakly interacting regime as a function of *J*/*D*.

Here, we show the emergence of a double BEC dome in well-known multiferroic material Ba_{2}CoGe_{2}O_{7} (BCGO)^{22}, where *J* is effectively tuned by diluting the magnetic Co sites with Zn. We observed a systematic reduction of the transition temperature as a function of Zn concentration and confirmed the phase diagram with the double BEC dome structure by measurements using a pulsed high magnetic field and low-temperature experiments. Mean-field calculations excellently reproduced the observations except for the quantum critical point between the first BEC dome and PLD, which can be explained by a theory for the dirty bosons.

## Results

### Magnetic properties of non-doped BCGO

BCGO is a quasi-two-dimensional magnet comprised of a simple square lattice of magnetic Co^{2+}(3*d*^{7}) ions surrounded by four O^{2−} ions [Fig. 2a, b]. Each CoO_{4} tetrahedron is strongly compressed along the *c*-axis, which reduces the local symmetry at the Co^{2+} site from *T*_{d} to *S*_{4} [Fig. 2a]. The *S*_{4} crystal-field and spin-orbit coupling induce strong easy-plane SI anisotropy *D* ≈ 1.03 meV compared with the AFM exchange interaction *J* ≈ 0.21 meV^{23,27,28}. AFM long-range order appears below *T*_{N} = 6.7 K at zero field, and the magnetic phase diagram of BCGO consists of one broad AFM phase, indicating that this material is in the strongly-interacting regime [Fig. 1b]. Therefore, BCGO is ideal for observing the transition from the strongly interacting regime to the weakly interacting regime. BCGO is known to host the multiferroic property^{29,30,31}, which is well explained by the spin-dependent *p*-*d* hybridization mechanism^{32}. Due to the strong magnetoelectric coupling in the ordered phase, the dielectric measurement enables us to sensitively detect magnetic phase transition as well as to explore the critical phenomena^{22}.

### Reduction in the effective magnetic interaction

First, we demonstrate a systematic reduction in the effective magnetic interaction *J*_{eff} from the original *J* ≈ 0.21 meV by the partial substitution of non-magnetic Zn^{2+} ions. Figure 2c shows the temperature dependence of relative electric permittivity *ε*_{a} along the *a*-axis in Ba_{2}Co_{1−x}Zn_{x}Ge_{2}O_{7} (BCZGO, *x* = 0.125, 0.25, 0.375, and 0.5). The electric permittivity exhibits a peak at the transition temperature, except for *x* = 0.5, where no obvious sign of long-range order is observed down to 0.4 K. As *x* increases, the ordering temperature decreases linearly, as observed in other two-dimensional magnets with rotational symmetry^{33}. The extrapolation of *T*_{N} reaches the axis of abscissas at *x* = 0.45 [inset of Fig. 2c], which is close to the percolation threshold of the square lattice: *x*_{c} = 0.41^{34}. Beyond *x*_{c}, the system is composed of finite-size magnetic clusters, and long-range magnetic order cannot arise in definition, which is consistent with the absence of the peak in *ε* down to 0.4 K for *x* = 0.5.

### Magnetic field dependences of physical properties

Next, Fig. 3 (a) presents the magnetization curves of BCZGO (*x* = 0.25, *T*_{N} = 2.8 K) for *H*∥*c* measured in pulsed high magnetic fields of up to 50 T at 1.4 and 4.2 K. At 1.4 K, the magnetization *M* monotonically increases until the saturated value of *M*_{sat} ≈ 3.3 *μ*_{B}/Co^{2+} is reached at ~ 35 T, except for the plateau-like anomaly around 12 T approximately at one-third of *M*_{sat}, indicating the emergence of the PLD phase. The anomaly broadens but remains visible at 4.2 K. These features were well reproduced by the mean-field calculation, for which the same Hamiltonian with Ref. ^{24} was adopted, and the dilution effects were effectively incorporated by tuning the exchange interaction *J*_{eff} [Fig. 3b] (see “Methods”). Figure 3c shows the magnetostriction [(Δ*L*/*L*)_{∥} and (Δ*L*/*L*)_{⊥}] parallel and perpendicular to the *c*-axis in *H*∥*c* at 1.5 K. No obvious magnetostrictive anomaly can be seen at the onset of the magnetization plateau, suggesting that the exchange striction in BCZGO is weak partly due to the long exchange path between Co^{2+} sites [Fig. 2b]. Meanwhile, a rapid increase in (Δ*L*/*L*)_{∥} and a decrease in (Δ*L*/*L*)_{⊥} with magnitudes of ~10^{−4} were observed in response to the further increase in *M* between 15 and 35 T. This should be attributed to the crystal-field striction; the contribution of \(\left |+3/2\right\rangle\) to the ground state should elongate the CoO_{4} octahedra along the *c*-axis. This type of magnetostriction is distinct from that previously reported in BEC materials such as NiCl_{2} ⋅ 4SC(NH_{2})_{2}^{35}, where Δ*L*/*L* changes nonmonotonically during passage through the BEC dome due to the exchange striction mechanism. Note that the saturation field observed in *M* and Δ*L*/*L* measurements is expected to be close to the critical field to the FP phase at absolute zero^{17,36}, but does not agree quantitatively due to the finite temperature phase boundary, as indicated by the calculation of staggered magnetization \({M}_{a}^{{{{{{{{\rm{st}}}}}}}}}\) [Fig. 3d], which is the order parameter of the XY-AFM order.

Established the magnetic properties of BCZGO, we examine magnetic phase transitions by dielectric constant measurement. Figure 3e shows a magnetic-field dependence of *ε*_{a} at various temperatures, simultaneously measured with *M* shown in Fig. 3a. At 1.4 K, three peaks are observed at *H*_{c1} = 11 T, *H*_{c2} = 16 T, and *H*_{c3} = 26 T, excellently agreeing with the prediction for phase transitions across AFMI → PLD → AFM II → FP phase transitions. As the temperature increases from 1.4 K, *H*_{c1} and *H*_{c3} shift to the lower field; whereas, *H*_{c2} shifts to the higher field. These dielectric responses were reproduced by the mean-field calculation [Fig. 3f]. Moreover, calculated \({M}_{a}^{{{{{{{{\rm{st}}}}}}}}}\) value [Fig. 3d] also supports that the three peaks in *ε*_{a}–*H* corresponds to the phase boundaries.

### Magnetic phase diagram of BCZGO

Based on the *ε*_{a} measurements, we construct the magnetic phase diagram for BCZGO with *x* = 0.25, as shown in Fig. 4. In contrast to undoped BCGO, the magnetic phase diagram is characterized by a double-dome structure. The peak temperature of the second BEC dome is estimated to be 2.1 K, which is consistent with the prediction (3/4)*T*_{N} [Fig. 1b], and the two domes merge below 1 K. The blue crosses at around 22 T in Fig. 4, which is observed as a broad peak in *ε*–*H* [Fig. 3e], are not phase boundary. They instead correspond to the enhancement of the spin fluctuation due to the level-crossing at the *H*_{cross} in Fig. 1a. Indeed, considering the effective *S* = 1/2 XXZ model Eq. (2), the second BEC dome is expected to take its maximum around *H*_{cross} = 2*D* + *n**J*. We obtain a consistent estimation of *H*_{cross} to be 22.4(4) T for BCZGO (*x* = 0.25), where we use the reported values of *J*_{z}, *D*, *g*_{zz}, where *g*_{zz} is the *z*-component of *g*-factor, for BCGO^{23,28} and assuming a reduction from *n* = 4 to *n* = 4(1 − *x*) due to the dilution.

In *x* = 0.25, the PLD phase only exists at finite-temperature. Further reduction of effective magnetic interaction by the dilution would be required to separate two BEC domes completely. In this case, however, we need to carefully consider the effect of randomness, which brings another possibily that the site dilution may lead to the trivial percolation disorder instead of the proposed three distinct BEC phase transitions in Fig. 1.

To confirm the relevance of the randomness effect, we measured *ε*_{a} for higher doped sample *x* = 0.375 at the lower temperatures down to 0.4 K in static magnetic fields. Figure 5a, b summarize a magnetic-field dependence of the ordering temperature *T*_{N}(*H*) for *x* = 0.25 and 0.375, respectively, which are extracted from the peak positions of the *ε*–*T* curves [insets of the figures]. By fitting *T*_{N}(*H*) using a power-law scaling *T*_{N}(*H*) ∝ ∣*H* − *H*_{c}∣^{φ}, the critical exponent *φ* estimated to be *φ* = 1.07(1) for *x* = 0.375 [red line in Fig. 5 (b)]. The phase diagram for *x* = 0.25 also has a region where the fitting yields *φ* = 0.93(2), close to 1 [red line in Fig. 5a]. We cannot reconcile these results with the theoretical predictions for conventional systems such as *φ* = 2/3 for three-dimensional BEC systems or *φ* = 1/2 for three-dimensional Ising systems^{37}. We note, however, *φ* ≈ 1 was reported for the systems with quenched disorder both in experiments and a numerical simulation^{36,38,39}. The phase transition characterized by *φ* ≈ 1 was attributed to a transition from inhomogeneous BEC to Bose glass (BG), i.e., local ordering (BEC) clusters weakly connect to show a long-range ordered phase at the first state; they are eventually disconnected, leaving only locally ordered clusters. Therefore, *φ* ≈ 1 in BCZGO implies that the field-induced disordred phase is the BG phase [Fig. 5b]. These results show that the randomness effect plays a central role in this system. We discuss a model on this line to capture the phase transition features in BCZGO as follows.

## Discussion

Here, we theoretically discuss the possibility of complete separation of two BEC domes by explicitly considering the randomness effect induced by the site dilution. First, in the vicinity of *H*_{z} ≈ (1/2)*H*_{cross}, the system can be described in a subspace spanned by {\(\left|3/2\right\rangle\), \(\left|1/2\right\rangle\), and \(\left|-1/2\right\rangle\)} [Fig. 1a], which we can translate into the Hilbert space expressed by the operators for *S* = 1. *S* = 3/2 spin operators effectively take the form,

where *I* is an identity operator and quadrupole operators are defined as \({\hat{Q}}_{zx}\equiv {\hat{S}}_{z}{\hat{S}}_{x}+{\hat{S}}_{x}{\hat{S}}_{z}\) and \({\hat{Q}}_{yz}\equiv {\hat{S}}_{y}{\hat{S}}_{z}+{\hat{S}}_{z}{\hat{S}}_{y}\). Omitting the quadrupole terms, as its coefficients are more than ten times smaller than usual spin operators, the effective Hamiltonian becomes equivalent to the *S* = 1 XXZ model with SI anisotropy

where *J*_{XXZ} ≈ 1.74*J*, Δ ≈ 0.57, and *h*_{z} = *H*_{z} − (*D* + *n**J*/2) [see Fig. 5c]. The effective magnetic field *h*_{z} stabilizes the XY magnetic order. Therefore, the ordering temperature, if exists, should take a minimum around *h*_{z} = 0, i.e., *H*_{z} = *D* + *n**J*/2 = (1/2)*H*_{cross}. Note that an actual *H*_{z} at which the system would have the lowest ordering temperature is (1/2)*H*_{cross} < *H*_{z} < (4/7)*H*_{cross} due to the quadrupole terms. See Supplementary Note 3 for the detail.

Site-dilution effect in the model Eq. (4) has been, in fact, investigated theoretically in ref. ^{40}, where the exchange anisotropy Δ was fixed to 1. Note that Δ does not have a significant effect in the present context because the possible ordered phase does not have any *z*-component even at zero field due to the SI anisotropy *D*^{41}. The resultant simplified phase diagrams as a function of *x* for representative *D*/*J*_{XXZ} are shown in Fig. 5d. The ground state at a zero field (*h*_{z} = 0) in a clean limit (*x* = 0) is the XY ordered state for *D*/*J*_{XXZ} < 5.5 and the quantum paramagnetic state for *D*/*J*_{XXZ} > 5.5. For 2.3 ≲ *D*/*J*_{XXZ} ≲ 5.5, the theory predicts the emergence of a disordered phase so-called Mott glass (MG) phase in a region *x*^{*} < *x* < *x*_{c}. This phase is a dilution-induced non-geometrically percolating quantum disordered phase, and corresponds to the PLD phase in the current context. Using the reported parameters, we ensure that BCGO is in this parameter regime as *D*/*J*_{XXZ} ≈ 3.0^{23,28}, which theoretically corroborates that the complete separation of two BEC domes would be possible in BCZGO.

Experimental results also support the above discussion. The effective zero-field point (*h*_{z} = 0) of the *S* = 1 model is estimated to be *H*_{z} = 11.2 T and 11.0 T for *x* = 0.25 and 0.375, respectively (see Supplementary Note 4). For *x* = 0.25, we observe magnetic order at the estimated *h*_{z} = 0 (*H*_{z} = 11.2 T), consistent with the XY ordered ground state in the phase diagram for *D*/*J*_{XXZ} ≈ 3.0 in ref. ^{40}. It is hence expected that 0.25 < *x*^{*}. However, for *x* = 0.375, the experimentally obtained *H*_{c1} is 11.3(3) T, close to the predicted *h*_{z} = 0 (*H*_{z} = 11.0 T). This is consistent with the theoretical prediction that *x*^{*} is slightly smaller than 0.375. The possible quantum disordered phase around 11 T would correspond to the MG phase [Fig. 5b]. Therefore, we may provide BCZGO, unlike other diluted systems^{42,43}, as a candidate stage for the dilution-induced quantum phase transition in an insulator spin system without crossing the percolation threshold.

To summarize, we have investigated the evolution of the magnetic phase diagram of BCZGO and confirmed that the effective magnetic interaction is tunable via the dilution approach. In *x* = 0.25, due to the effective reduction of the interaction, the magnetic field dependence of electric permittivity shows a three-peak structure, which suggests the emergence of a double BEC-dome. The randomness effect, which is beyond the mean-field treatment of dilution, is also observed in a comprehensible way. In *x* = 0.375, the ordering temperatures of the first BEC dome obey the scaling law with *φ* ≈ 1, which belongs to the universality of the BEC-Bose glass phase transition. Thus, the resulting paramagnetic phase can be regarded as a Bose glass phase. Effective Hamiltonians at the different field regions well explain the experimentally obtained magnetic phase diagram of BCZGO.

Owing to the simpleness of each effective model, BCZGO would be an excellent playground for theoretical and numerical studies of the bosonic particle systems with quenched disorder. We note that the discussion used here can be straightforwardly generalized to higher spin (*S* > 1) systems with strong easy-plane anisotropy. For example, an *S* = 2 system can be well described in a subspace spanned by \(\left|{S}_{z}=0\right\rangle\) and \(\left|{S}_{z}=\pm 1\right\rangle\) at a zero field. This is actually confirmed in Ba_{2}FeSi_{2}O_{7}(*S* = 2)^{44,45,46,47}. Particularly in ref. ^{44}, they also derived effective *S* = 1 Hamiltonian in a zero field and yield *D*/*J*_{XXZ} ≈ 5.4, which is close to the critical point of *D*/*J*_{XXZ} ≈ 5.5. Therefore, a small amount of dilution could induce non-geometrically percolating quantum phase transition. This general criterion may give rise to the further discovery of BEC materials and, consequently, advanced understanding of magnetic BEC phenomena.

## Methods

### Samples

Single crystals of Ba_{2}Co_{1−x}Zn_{x}Ge_{2}O_{7} (*x* = 0, 0.125, 0.25, 0.375, 0.5) were grown by floating zone method in 3 atm of O_{2} atmosphere. BaCO_{3}, CoO, ZnO, and GeO_{2} powders were mixed in the stoichiometric ratio and calcined at 980 ^{∘}C for 60 h with multiple intermediate grinds. The resultant powder was reground, pressed into a rod, and sintered at 950 ^{∘}C for 24 h in air to form seed and feed rods. Crystal axes were determined by back-reflection Laue X-ray photographs.

### Measurements of electric permittivity, magnetization, and magnetostriction

Electric permittivity *ε* up to 9 T above 1.8 K was measured using an LCR meter (E4980A/B, Agilent) in a commercial cryostat equipped with a superconducting magnet (PPMS, Quantum Design). Two electrodes were attached to the large (100) surfaces of the polished thin plate crystals. To achieve low temperature down to 0.4 K in static fields, ^{3}He refrigerator (Heliox, Oxford Instruments) was used, which was inserted into the cryostat equipped with a 12 T/14 T superconducting magnet. Magnetization *M* below 7 T was measured using a SQUID magnetometer (MPMS-XL, Quantum Design). The higher-field *M* and *ε* up to 50 T were simultaneously measured using a non-destructive pulsed magnet (36 ms duration) at the Institute for Solid State Physics (ISSP). *M* was measured by the conventional induction method using coaxial pickup coils. Capacitance was measured along the electric field direction (*E*∥*a*) by using a capacitance bridge (General Radio 1615-A) and converted to *ε*^{48}. Magnetostriction Δ*L*/*L* up to 44 T was measured by the optical fiber-Bragg-grating technique using the optical filter method in a non-destructive pulsed magnet (36 ms duration) at ISSP^{49}.

### Mean field calculations

Numerical simulation used in this study is based on the Hamiltonian proposed in^{24}. Using *S* = 3/2 operators, the Hamiltonian of BCGO can be written as:

where *J*_{DM}, *K*_{z}, and **E** are Dzyalosinskii-Moriya interaction and spin nematic interaction, and electric field, respectively. DM term corresponds to \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{DM}}}}}}}}}\) in Eq. (1), and the fifth and seventh terms correspond to \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{{{{{{{{\rm{me}}}}}}}}}\) in Eq. (1). The cartesian cordinate *x*, *y,* and *z* correspond to the crystallographic [110], [\(\bar{1}\)10], [001] directions, respectively. \({\hat{P}}_{i}^{\alpha }(\alpha=x,\, y,\, z)\) is the spin-induced electric polarization at site *i*, calculated using:

where *κ*_{i} is a rotation angle of CoO_{4} tetrahedron around the site around the *c*-axis; *κ*_{i∈A} = *κ*, *κ*_{i∈B} = − *κ* [see Fig. 2b]. The mean field Hamiltonian is given by:

where \({\hat{{{{{{{{\mathcal{H}}}}}}}}}}_{A}\) is

The mean values of \(\langle {\hat{{{{{{{{\bf{S}}}}}}}}}}_{B}\rangle\) and \(\langle {\hat{{{{{{{{\bf{P}}}}}}}}}}_{B}\rangle\) are calculated as functions of \(\langle {\hat{{{{{{{{\bf{S}}}}}}}}}}_{A}\rangle\) and \(\langle {\hat{{{{{{{{\bf{P}}}}}}}}}}_{A}\rangle\) as:

where \({\langle \hat{O}\rangle }_{B}\) is a general operator representing either \({\langle \hat{S}\rangle }_{B}\) or \({\langle \hat{P}\rangle }_{B}\). \({\hat{H}}_{B}\) is obtained by exchanging the sublattice *A* and *B*. Here, we assume *J* = *J*_{z}. Using a scale factor *γ* (0 < *γ* < 1), reduced effective interactions can be expressed as *γ**J*, *γ**J*_{DM}, *γ**K*, respectively. To lift the degeneracy, small electric field was applied in the *a*-axis. Electric permittivity can be calculated using:

with small applied electric field *E*_{1} and *E*_{2} in the *a*-axis.

## Data availability

All data that support the findings of this study are included in this published article and supplementary information files. Source data are provided as a Source Data file. Source data are provided with this paper.

## Code availability

The code used for this study is provided as a Supplementary Software.

## References

Klaers, J., Schmitt, J., Vewinger, F. & Weitz, M. Bose–Einstein condensation of photons in an optical microcavity.

*Nature***468**, 545–548 (2010).Anderson, M. H., Ensher, J. R., Matthews, M. R., Wieman, C. E. & Cornell, E. A. Observation of Bose–Einstein condensation in a dilute atomic vapor.

*Science***269**, 198–201 (1995).Regal, C. A., Greiner, M. & Jin, D. S. Observation of resonance condensation of fermionic atom pairs.

*Phys. Rev. Lett.***92**, 040403 (2004).Blatt, J. M., Böer, K. W. & Brandt, W. Bose-einstein condensation of excitons.

*Phys. Rev.***126**, 1691–1692 (1962).Snoke, D. W., Wolfe, J. P. & Mysyrowicz, A. Evidence for Bose–Einstein condensation of excitons in Cu

_{2}O.*Phys. Rev. B***41**, 11171–11184 (1990).Misochko, O. V., Hase, M., Ishioka, K. & Kitajima, M. Transient Bose–Einstein condensation of phonons.

*Phys. Lett. A***321**, 381–387 (2004).Kasprzak, J. et al. Bose–Einstein condensation of exciton polaritons.

*Nature***443**, 409–414 (2006).Demokritov, S. O. et al. Bose–Einstein condensation of quasi-equilibrium magnons at room temperature under pumping.

*Nature***443**, 430–433 (2006).Fisher, M. P., Weichman, P. B., Grinstein, G. & Fisher, D. S. Boson localization and the superfluid-insulator transition.

*Phys. Rev. B***40**, 546–570 (1989).Greiner, M. et al. Quantum phase transition from a superfluid to a Mott insulator in an ultracold gas of atoms.

*Nature***415**, 39 (2002).Bloch, I. Ultracold quantum gases in optical lattices.

*Nat. Phys.***1**, 23 (2005).Matsubara, T. & Matsuda, H. A lattice model of liquid metal. I.

*Prog. Theor. Phys.***16**, 569 (1956).Kaganov, M. I. & Chubukov, A. V. Interacting magnons.

*Sov. Phys. Uspekhi***30**, 1015–1040 (1987).Giamarchi, T., Rüegg, C. & Tchernyshyov, O. Bose–Einstein condensation in magnetic insulators.

*Nat. Phys.***4**, 198–204 (2008).Zapf, V., Jaime, M. & Batista, C. D. Bose–Einstein condensation in quantum magnets.

*Rev. Mod. Phys.***86**, 563–614 (2014).Nikuni, T., Oshikawa, M., Oosawa, A. & Tanaka, H. Bose–Einstein condensation of Dilute Magnons in TlCuCl

_{3}.*Phys. Rev. Lett.***84**, 5868 (2000).Samulon, E. C. et al. Asymmetric quintuplet condensation in the frustrated

*S*= 1 spin dimer compound Ba_{3}Mn_{2}O_{8}.*Phys. Rev. Lett.***103**, 047202 (2009).Jaime, M. et al. Magnetic-field-induced condensation of triplons in Han purple pigment BaCuSi

_{2}O_{6}.*Phys. Rev. Lett.***93**, 087203 (2004).Kimura, S. et al. Ferroelectricity by Bose–Einstein condensation in a quantum magnet.

*Nat. Commun.***7**, 12822 (2016).Hester, G. et al. Novel strongly spin-orbit coupled quantum dimer magnet: Yb

_{2}Si_{2}O_{7}.*Phys. Rev. Lett.***123**, 027201 (2019).Zapf, V. S. et al. Bose–Einstein condensation of

*S*= 1 nickel spin degrees of freedom in NiCl_{2}-4SC(NH_{2})_{2}.*Phys. Rev. Lett.***96**, 077204 (2006).Kim, J. W. et al. Manifestation of magnetic quantum fluctuations in the dielectric properties of a multiferroic.

*Nat. Commun.***5**, 4419 (2014).Soda, M. et al. Spin-nematic interaction in the multiferroic compound Ba

_{2}CoGe_{2}O_{7}.*Phys. Rev. Lett.***112**, 127205 (2013).Kenzelmann, M. et al. Order-to-disorder transition in the XY-like quantum magnet Cs

_{2}CoCl_{4}induced by noncommuting applied fields.*Phys. Rev. B***65**, 144432 (2002).Radu, T. et al. Bose–Einstein condensation of magnons in Cs

_{2}CuCl_{4}.*Phys. Rev. Lett.***95**, 127202 (2005).Romhányi, J., Pollmann, F. & Penc, K. Supersolid phase and magnetization plateaus observed in the anisotropic spin-3/2 Heisenberg model on bipartite lattices.

*Phys. Rev. B***84**, 184427 (2011).Romhányi, J., Lajkó, M. & Penc, K. Zero- and finite-temperature mean field study of magnetic field induced electric polarization in Ba

_{2}CoGe_{2}O_{7}: effect of the antiferroelectric coupling.*Phys. Rev. B***84**, 224419 (2011).Penc, K. et al. Spin-stretching modes in anisotropic magnets: spin-wave excitations in the multiferroic Ba

_{2}CoGe_{2}O_{7}.*Phys. Rev. Lett.***108**, 257203 (2012).Yi, H. T., Choi, Y. J., Lee, S. & Cheong, S. W. Multiferroicity in the square-lattice antiferromagnet of Ba

_{2}CoGe_{2}O_{7}.*Appl. Phys. Lett.***92**, 212904 (2008).Murakawa, H., Onose, Y., Miyahara, S., Furukawa, N. & Tokura, Y. Ferroelectricity induced by spin-dependent metal-ligand hybridization in Ba

_{2}CoGe_{2}O_{7}.*Phys. Rev. Lett.***105**, 137202 (2010).Kézsmárki, I. et al. Enhanced directional dichroism of terahertz light in resonance with magnetic excitations of the multiferroic Ba

_{2}CoGe_{2}O_{7}oxide compound.*Phys. Rev. Lett.***106**, 057403 (2011).Arima, T. Ferroelectricity induced by proper-screw type magnetic order.

*J. Phys. Soc. Jpn.***76**, 073702 (2007).Birgeneau, R. J., Cowley, R. A., Shirane, G., Tarvin, J. A. & Guggenheim, H. J. Spin fluctuations in random magnetic-nonmagnetic two-dimensional antiferromagnets. Heisenberg percolation.

*Phys. Rev. B***21**, 317 (1980).Newman, M. E. J. & Ziff, R. M. Efficient Monte Carlo algorithm and high-precision results for percolation.

*Phys. Rev. Lett.***85**, 4104–4107 (2000).Zapf, V. S. et al. Direct measurement of spin correlations using magnetostriction.

*Phys. Rev. B***77**, 020404 (2008).Yu, R. et al. Bose glass and Mott glass of quasiparticles in a doped quantum magnet.

*Nature***489**, 379–384 (2012).Kawashima, N. Quantum critical point of the XY model and condensation of field-induced quasiparticles in dimer compounds.

*J. Phys. Soc. Jpn.***73**, 3219–3222 (2004).Shindo, Y. & Tanaka, H. Localization of spin triplets in Tl

_{1−x}K_{x}CuCl_{3}.*J. Phys. Soc. Jpn.***73**, 2642–2645 (2004).Yu, R., Haas, S. & Roscilde, T. Universal phase diagram of disordered bosons from a doped quantum magnet.

*Europhys. Lett.***89**, 10009 (2010).Roscilde, T. & Haas, S. Mott glass in site-diluted

*S*= 1 antiferromagnets with single-ion anisotropy.*Phys. Rev. Lett.***99**, 047205 (2007).Wang, H. T. & Wang, Y. Long-range order in gapped magnetic systems induced by Bose–Einstein condensation.

*Phys. Rev. B***71**, 104429 (2005).Vajk, O. P., Mang, P. K., Greven, M., Gehring, P. M. & Lynn, J. W. Quantum impurities in the two-dimensional spin one-half Heisenberg antiferromagnet.

*Science***295**, 1691–1695 (2002).Rowley, S. E. et al. Quantum percolation phase transition and magnetoelectric dipole glass in hexagonal ferrites.

*Phys. Rev. B***96**, 020407 (2017).Do, S. H. et al. Decay and renormalization of a longitudinal mode in a quasi-two-dimensional antiferromagnet.

*Nat. Commun.***12**, 5331 (2021).Jang, T.-H. et al. Physical properties of the quasi-two-dimensional square lattice antiferromagnet Ba

_{2}FeSi_{2}O_{7}.*Phys. Rev. B***104**, 214434 (2021).Do, S.-H. et al. Understanding temperature-dependent SU(3) spin dynamics in the

*S*= 1 antiferromagnet Ba_{2}FeSi_{2}O_{7}.*npj Quantum Mater.***8**, 5 (2023).Watanabe, Y., Gen, M., Kurumaji, T., Tokunaga, Y. & Arima, T.-h Magnetic-field-induced antiferromagnetic–antiferromagnetic phase transition in quasi-two-dimensional multiferroic material Ba

_{2}FeSi_{2}O_{7}.*J. Phys. Soc. Jpn.***92**, 014701 (2023).Miyake, A. et al. Capacitive detection of magnetostriction, dielectric constant, and magneto-caloric effects in pulsed magnetic fields.

*Rev. Sci. Instrum.***91**, 105103 (2020).Ikeda, A., Matsuda, Y. H. & Tsuda, H. Note: Optical filter method for high-resolution magnetostriction measurement using fiber Bragg grating under millisecond-pulsed high magnetic fields at cryogenic temperatures.

*Rev. Sci. Instrum.***89**, 096103 (2018).

## Acknowledgements

This work was partly supported by JSPS Grants No. 19H01835, No. JP19H05824, and No. JP19H05826, and by CREST (No. JPMJCR19T5) from Japan Science and Technology (JST). Y.W. are supported by JSPS through Program for Leading Graduate Schools (MERIT). Measurements of electric permittivity above 1.8 K, X-ray Laue photograph, high-field magnetostriction, high-field magnetization, and high-field electric permittivity were performed at the Institute for Solid State Physics (ISSP), the University of Tokyo, Japan.

## Author information

### Authors and Affiliations

### Contributions

Y.W., Y.T., and T.A. conceived the project. Y.W. grew single crystals. Electric permittivity measurements above 1.8 K in static magnetic fields were performed by Y.W. High-field magnetostriction measurements were performed by M.G. and Y.W. under the supervision of A.I. High-field magnetization and electric permittivity measurements were performed by A.M. and Y.W. under the supervision of M.T. Y.W. constructed the theoretical model and performed numerical calculations. Y.W., Y.M., and K.H. designed the electric permittivity measurement setup and performed the low-temperature measurements using ^{3}He refrigerator under the supervision of T.S. All authors discussed the results. Y.W. and M.G. wrote the manuscript with the inputs from all authors. T.K., Y.T., and T.A. supervised the projects.

### Corresponding authors

## Ethics declarations

### Competing interests

The authors declare no competing interests.

## Peer review

### Peer review information

*Nature Communications* thanks the anonymous reviewers for their contribution to the peer review of this work. Peer reviewer reports are available.

## Additional information

**Publisher’s note** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Source data

## Rights and permissions

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

## About this article

### Cite this article

Watanabe, Y., Miyake, A., Gen, M. *et al.* Double dome structure of the Bose–Einstein condensation in diluted *S* = 3/2 quantum magnets.
*Nat Commun* **14**, 1260 (2023). https://doi.org/10.1038/s41467-023-36725-4

Received:

Accepted:

Published:

DOI: https://doi.org/10.1038/s41467-023-36725-4

## Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.