Introduction

Large intrinsic anomalous Hall effect (AHE) in topological semimetals has been a subject of intensive studies. Unlike the conventional Hall effect, which is caused by the Lorentz force under an external magnetic field, the intrinsic AHE stems from the net Berry curvature Ω (k) associated with the electronic bands1,2,3. Ω (k), which describes the geometry of the Bloch wavefunctions, is determined by the topology of the band structure. When a longitudinal electric field is applied, Ω (k) imparts transverse velocity [ E × Ω (k)] to Bloch electrons and thus results in the AHE. Presence of an intrinsic AHE requires time-reversal symmetry (TRS) to be broken. Therefore, large intrinsic AHE is usually expected in magnetic materials with Berry curvature hot-spots near the Fermi level. Prior studies have found that several types of magnetic topological materials can exhibit large intrinsic AHE. These include ferromagnetic (FM) Weyl semimetals such as Co3Sn2S24,5 and Co2MnGa6,7, which host Weyl nodal crossings that lie close to the Fermi level and carry a diverging Berry curvature. With the TRS broken by ferromagnetism, the Berry curvature contribution from the Weyl nodes with opposite chirality will not cancel out, resulting in a large AHE. Strength of the AHE is usually characterized by the intrinsic anomalous Hall angle (AHA) ΘH, where ΘH = tan−1(\({\sigma }_{{yx}}^{{{{{{\rm{AH}}}}}}}\)/\({\sigma }_{{xx}}\)), and \({\sigma }_{{yx}}^{{{{{{\rm{AH}}}}}}}\) and \({\sigma }_{{xx}}\) are the anomalous Hall conductivity and longitudinal conductivity, respectively. Co3Sn2S2 and Co2MnGa both exhibit large AHA with tanΘH = 0.2 (Co3Sn2S2)4 and 0.12 (Co2MnGa)8. Antiferromagnetic (AFM) half-Heusler materials such as GdPtBi9 and TbPtBi10 also display a large intrinsic AHE with tanΘH values as large as 0.16–0.769,10,11,12. Although these materials harbor Weyl nodes induced by magnetic fields, their large AHE does not originate from Weyl nodes but arises from the large net Berry curvature produced by the anticrossing of spin-split bands near the Fermi level9,12. Besides the large AHE caused by the presence of anticrossing Weyl nodes or bands, recent studies show that gapped nodal rings can also generate extremely large AHE13,14. This was experimentally demonstrated in FM Heusler Co2MnAl14, whose AHA reaches a record value with tanΘH = 0.21 at room temperature. In addition, the non-collinear AFM structure can lead to a large Berry curvature, resulting in a large intrinsic AHE15,16; this has been seen in a range of AFM topological materials with broken TRS, such as Mn3Sn17 and Mn3Ge18.

In this paper, we report a large AHE in the Pd-based half-Heusler compound TbPdBi. Its tanΘH value reaches ~2, which is the largest among all known magnetic topological materials. Our in-depth theoretical analysis suggests that such an extremely large AHE originates from a half-topological semimetal (HTS) state. HTS is a long-sought topological state in materials and it can be viewed as a topological version of the half-metallic state in which electrons conduct in only one spin channel, while the other spin channel is insulating19,20,21. Since such a state could generate low-power-consuming spin current, it holds great promise for applications in topological quantum spintronic devices22. Moreover, it has been theoretically shown that a gap opening at the non-trivial band crossing points transforms the HTS into a quantum anomalous Hall insulator23,24. These exotic properties have inspired extensive interest and a variety of material systems have been predicted to be HTSs, such as two-dimensional(2D) MnN25, PrOBr26, and PtCl324; quasi-1D X2RhF6 (X = K, Rb, Cs)27 and XYZ3 (X=Cs, Rb, Y=Cr, Cu, Z=Cl, I)28; 3D MF3 (M=Pd, Mn)29, LiV2F630, among others. The Dirac/Weyl points or nodal rings in all these materials are comprised of spin-polarized bands21,30,31. However, these theoretical predictions are still awaiting experimental verification. Our work here demonstrates that TbPdBi hosts a unique HTS in proximity to a topological critical point. Such a peculiar HTS in TbPdBi results in not only an unusually large AHE but also leads to a large negative magnetoresistance. Additionally, we find that the Hall resistivity of TbPdBi exhibits a distinct anomalous peak in the low-field range, where its isothermal magnetization depends nearly linearly on field. This behavior can be understood in terms of the Berry curvature enhancement induced by spin canting.

Results

Single crystals of TbPdBi were grown using the Bi-flux method (Methods). Their temperature dependence of resistivity ρxx(T) is found to exhibit a broad peak ~50 K (supplementary Fig. S1a), indicating their semi-metallic nature. This can be understood as follows: In a semimetal with a small Fermi pocket, high-temperature transport is primarily governed by excited carriers, which results in a semiconducting behavior. In contrast, at low temperatures, excited charge carriers are substantially suppressed, and transport is dominated by the electrons/holes hosted by the small Fermi pocket, resulting in a metallic behavior with a broad peak in ρxx(T). Magnetic susceptibility (χ) measurements (supplementary Fig. S1a) show the AFM state with TN = 5.2 K. ρxx exhibits a steeper drop below TN, indicating the presence of electronic transport coupled with magnetism. We performed a Curie–Weiss (CW) fit for the temperature dependence of susceptibility χ(T): the best fit was obtained in the temperature range of 100–300 K (supplementary Fig. S1b), which yields the effective magnetic moment (μeff) of 9.4 μB/Tb, consistent with a prior report32.

Anomalous Hall effect

From Hall resistivity (ρxy) measurements under high magnetic fields, we observed strong AHE in TbPdBi. Figure 1a shows the ρxy data up to 31 T at various temperatures over 1.7–20 K. The most significant feature of this data is that it exhibits a prominent peak. This peak occurs below TN (= 5.2 K) and extends to temperatures above TN but diminishes above 50 K (supplementary Note 1 and Fig. S2c, d). The peak field is ~5 T below TN, and slightly shifts to higher fields with increasing temperature. ρxy(B) gradually evolves into a linear field dependence after exhibiting a peak. This occurs above 15 T for T < TN; at higher temperatures (e.g., 15 K and 20 K), due to the shift of the peak to higher field, the linear trend develops at higher fields, with the linear slope remaining similar to its value at low temperatures. Such a distinct peak in ρxy has never been observed before in any other half-Heusler compound, or a full-Heusler antiferromagnet, or a conventional ferromagnet. As noted above, prior work has shown that the isostructural half-Heusler compound (Gd/Tb)PtBi also exhibits a large AHE9,10,11,12, where the ρxy data also display anomalous peaks near 4.5 T with AHAs maxima reaching values of tanΘH = 0.16–0.769,10,11,12. However, the ρxy anomalous peak of (Tb/Dy)PtBi is far weaker than that of TbPdBi. For comparison, we have added the ρxy data of TbPtBi at 1.7 K to Fig. 1a. While its weak ρxy peak near 4.5 T can be clearly resolved when the data is zoomed into the field range of 0–9 T (Fig. 1c in ref. 12), it is hardly discernible when this data is plotted together with the data of TbPdBi in the field range up to 31 T (Fig. 1a), suggesting that the replacement of Pt by Pd leads to essential changes in the band structure, a point to which we will return below. In the field regime where ρxy exhibits an anomalous peak, the longitudinal resistivity ρxx displays a drastic decrease, followed by a saturation trend in the high-field range where ρxy evolves into a linear field dependence, as shown in Fig. 2b, which presents representative ρxx and ρxy data at 4 K. Note that the anomalous ρxy peak near 5 T is not caused by the ρxx component which might not be removed from the ρxy data anti-symmetrizing process; this can be seen clearly from the raw data of ρxy and ρxx shown in supplementary Fig. S3 which shows that the ρxx component in ρxy is negligibly small. To find whether the unusual field dependences of ρxy and ρxy arise from a magnetic transition, we measured the magnetization of TbPdBi up to 35 T at various temperatures (Methods). This data (Fig. 1b) indicates the presence of a spin-flop transition near 15 T. The saturated magnetic moment of Tb3+ in the FM phase is ~8.5μB/f.u. at 0.57 K, comparable to the effective magnetic moment extracted from the CW fit (μeff ~ 9.4 μB/Tb). This unusual field dependences of ρxx and ρxy are indeed coupled with such a magnetic spin-flop transition. The ρxy peak as well as the sharp drop of ρxx are present in the canted AFM state (CAFM), while the linear field dependence of ρxy and the ρxx saturation behavior occur in the polarized FM phase. These observations imply that the spin-flop transition leads to an electronic structure transition. We will show below that our theoretical calculations demonstrate that the spin-flop transition in TbPdBi drives an electronic phase transition and gives rise to the HTS state.

Fig. 1: Anomalous Hall effect of TbPdBi.
figure 1

a Hall resistivity of TbPdBi as a function of the magnetic field B up to 31 T at various temperatures (solid lines). The Hall data have been anti-symmetrized to remove the minor component of \({\rho }_{{xx}}\). The black dashed line represents the normal Hall component. Inset: a schematic of the experimental setup for Hall measurements. b Left axis: longitudinal resistivity \({\rho }_{{xx}}\) and Hall resistivity \({\rho }_{{xy}}\) at 4 K for TbPdBi (marked as hollow circles). Right axis: magnetization measured at various temperatures (marked as solid lines). c tan\({\Theta }^{{{{{{\rm{H}}}}}}}\) of TbPdBi as a function of magnetic field B at 4 K (below Neel temperature). d Comparison of \({\sigma }_{{yx}}^{{{{{{\rm{AH}}}}}}}\) and tan\({\Theta }^{{{{{{\rm{H}}}}}}}\) between TbPdBi and other magnetic conductors4,6,8,9,12,14,17,18,39,45,55,56,57. The star represents the data of current work.

Fig. 2: Magnetoresistivity (MR) of TbPdBi.
figure 2

ab Transverse (a) and longitudinal (b) MR = Δρ /ρ0 = [ρ(B)–ρ(B = 0)]/ρ(B = 0) at 4 K (below Neel temperature), and at 10 K and 20 K (above Neel temperature). MR at 4 K(red solid lines) and 10 K (blue solid lines)were measured up to 31 T, while the MR at 20 K (green hollow circles)was measured up to 18 T. Insets show the schematic of the experimental setup for transverse and longitudinal MR measurements. c Longitudinal MR versus magnetic field measured in Physical Property Measurement System (PPMS) at various temperatures (solid lines).

Given that the prominent \({\rho }_{{xy}}\) peak is present in the CAFM state, its origin is most likely associated with the Berry curvature induced by the noncolinear spin structure. In general, \({\rho }_{{xy}}\) of magnetic systems can be described by

$${\rho }_{{xy}}={\rho }_{{xy}}^{{{{{\rm{N}}}}}}+R{{{{{\rm{s}}}}}}{{{{{\bf{M}}}}}}+{\rho }_{{xy}}^{{{{{\rm{T}}}}}},$$
(1)

where the first term is the normal Hall contribution, the second term represents the anomalous Hall resistivity linearly coupled with magnetization M (RS is the anomalous Hall coefficient), and the last term \({\rho }_{{xy}}^{{{{{\rm{T}}}}}}\) is the anomalous Hall resistivity arising from the non-collinear spin structure. The \({\rho }_{{xy}}\) peak of TbPdBi in the CAFM state suggests that it involves a significant component of anomalous Hall resistivity \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\)(=\({\rho }_{{xy}}\)- \({\rho }_{{xy}}^{{{{{\rm{N}}}}}}\)). At low temperatures with TTN, \({\rho }_{{xy}}^{{{{{\rm{N}}}}}}\) can be expressed as R0B (R0 is the normal Hall coefficient), shown as the dashed line in Fig. 1a. If we assume that the spin-flop transition does not lead to a prominent change in carrier density, we can extract the approximate \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) by subtracting \({\rho }_{{xy}}^{{{{{\rm{N}}}}}}\) (= R0B) from \({\rho }_{{xy}}\) (supplementary Note 2 and Fig. S2a). However, when the temperature is above TN, \({\rho }_{{xy}}^{{{{{\rm{N}}}}}}\) deviates from R0B and displays noticeable characteristics of multiple-band normal Hall effect for T > 50 K due to thermal excitations (supplementary Note 1). Although the \({\rho }_{{xy}}\) peak appears to increase in the temperature range TN < T < 20 K, it should not be due to the increase of \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) but arise from the multiple-band effect in the normal Hall resistivity, which is superimposed on the AHE peak. The AHE peak should become weak above TN and diminish above 50 K where the \({\rho }_{{xy}}\) data can be fitted with a two-band model (supplementary Note 1 and Fig. S2c, d).

In order to understand how the magnetization contributes to \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\), we have plotted \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) as a function of magnetization in supplementary Fig. S4. [Note that \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) is obtained by subtracting the normal Hall contribution, i.e., the dashed line in Fig. 1a, which is inferred from the high-field linear field dependence of \({\rho }_{{xy}}\)(B)]. We find that \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) strongly deviates from linear dependence on magnetization and exhibits a prominent peak, indicating that the anomalous Hall resistivity of TbPdBi involves a significant contribution of \({\rho }_{{xy}}^{{{{{\rm{T}}}}}}\). The maximal \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) near 5 T is ~0.6 mΩ-cm for T < TN (supplementary Fig. S2a), almost 5–15 times larger than that in (Gd/Tb)PtBi9,12. From \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\), we derive anomalous Hall conductivity \({\sigma }_{{yx}}^{{{{{\rm{AH}}}}}}\) using \({\sigma }_{{yx}}^{{{{{\rm{AH}}}}}}\) = \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\)/(ρxy2 xx2) and AHA as shown in supplementary Fig. S2b and Fig. 1c. The maximal value of tanΘH is ~2 at about 15 T and 4 K (Fig.1c), which is unexpectedly large compared to other magnetic topological materials, as shown in Fig. 1d, which plots tanΘH versus \({\sigma }_{{yx}}^{{{{{\rm{AH}}}}}}\) for TbPdBi and other magnetic topological materials. Such an extremely large AHE in TbPdBi is likely not induced by extrinsic mechanisms such as skew scattering or side jump since the associated Hall angle is usually quite small (tanΘH < 0.01)33,34. Further, the dependence of \({\sigma }_{{yx}}^{{{{{\rm{AH}}}}}}\) on the longitudinal conductivity \({{\sigma }}_{{xx}}\) in TbPdBi is consistent with an intrinsic AHE (see Supplementary Note 3). These results suggest that intrinsic mechanisms due to Berry curvature are at play in generating the unusually large AHE in TbPdBi, a point to which we return below. Notably, previous studies have shown that Skyrmion magnetic lattices could also give rise to an anomalous peak in \({\rho }_{{xy}}\) (i.e., a topological Hall effect35). Compared to the topological Hall effect of a prototype Skyrmion system MnSi, where anomalous Hall resistivity jump (i.e., \({\rho }_{{xy}}^{{{{{\rm{T}}}}}}\)) induced by the spin-texture is <0.04 µΩ-cm36, our observed maximal \({\varDelta \rho }_{{xy}}^{{{{{\rm{AH}}}}}}\) value of ~0.6 mΩ-cm in TbPdBi is four orders of magnitude larger. This implies that the extremely large AHE in TbPdBi involves a unique mechanism. We will show below that it is associated with a peculiar HTS state.

Large negative magnetoresistance

The steep decrease in ρxx in field regions where ρxy exhibits an anomalous peak (Fig. 1b) suggests that TbPdBi host a large negative magnetoresistance. Although we observed large negative magnetoresistance in our earlier low-field (≤9 T) measurements on TbPdBi37, its origin remained mysterious; it was also unclear whether its magnetoresistance saturates at high fields. With access to high-field measurements and theoretical analyses, we are in a position to address this issue here. Figure 2a, b present the transverse and longitudinal magnetoresistivities [MR = \(\frac{{{\rho }}_{{xx}}\left({{{{{\bf{B}}}}}}\right)-{{\rho }}_{{xx}}(0)}{{{\rho }}_{{xx}}(0)}\)] of TbPdBi measured with the current applied perpendicular and parallel to the magnetic field, respectively, at various temperatures (insets to Fig. 2a, b). [Note that these data were measured on the same sample which was used for the Hall resistivity measurements shown in Fig. 1a.] Both transverse and longitudinal MRs decrease steeply with increasing magnetic field, and tend to saturate above 15 T; magnitude of the negative MR reaches ~98% as the field rises to 15 T. This large negative MR is observed at both T ≤ TN and T > TN, where the magnitude of the MR remains nearly temperature independent below 20 K, but gradually decreases with increasing temperature above 20 K (Fig. 2c). Even as the temperature rises to 200 K, the negative MR remains significant, with its magnitude being ~20% at 9 T (Fig. 2c). The MR changes from negative to positive only at room temperature, with the magnitude of the positive MR being much smaller than that of the negative MR at lower temperatures. Since TbPdBi is a superconductor with Tc = 1.7 K, its MR measured at 1.7 K (base temperature of our measurement system) first shows a steep increase as the superconducting state is suppressed by magnetic field, followed by a steep decrease as discussed above (supplementary Fig. S5; this data is not included in Fig. 2a, b for simplicity). Note that large negative MR observed in TbPdBi does not occur in the isostructural compounds (Gd/Tb/Dy)PtBi10,11,12,38,39, which again suggests that TbPdBi hosts an electronic state that is distinct from (Gd/Tb/Dy)PtBi.

Negative MR that has been observed in various materials originates from several different mechanisms. In topological Weyl semimetals, the topological current induced by the chiral anomaly can lead to a large negative MR when the magnetic field is parallel to the current, as observed in GdPtBi11,38 and TbPtBi10,12. When the magnetic field is rotated away from the current, the chiral anomaly is gradually suppressed so that the sign of MR can change from negative to positive above a certain value of the rotation angle. Prior studies have also shown that materials with macroscopic disorders may display negative longitudinal MR, as for example in polycrystalline Ag2+δSe40, gallium arsenide quantum wells41, and disordered topological insulator TlBi0.15Sb0.85Te242. Another mechanism involves spin-scattering suppression driven by spin flip/flop transition; an example is the colossal MR in Ca3Ru2O743. None of the aforementioned mechanisms, however, is relevant to our observation of the large negative MR in TbPdBi. This is because (i) our observed negative MR is nearly independent of field orientation and tends to saturate in the high-field regime, which excludes the chiral anomaly effect, (ii) our samples are high-quality single crystals and do not involve macroscopic disorders, and (iii) the large negative MR of TbPdBi occurs at both T ≤ TN and T > TN. If this large negative MR were due to the spin-scattering suppression in the spin-flop transition, we would expect the value of the MR to significantly drop as the spin-flop transition is suppressed at T > TN, which is inconsistent with the observation of the temperature independence of MR between TN and 20 K and the survival of large negative MR in a wide temperature region above 20 K (Fig. 2c). Notably, a large negative transverse/longitudinal MR was recently reported in EuMnSb244 and EuB645. The large negative MR in EuMnSb2 is ascribed to the field-induced metal-insulator transition, while the large negative MR of EuB6 is suggested to arise from the high spin-polarization of charge carriers in a half-Weyl semimetal45. As discussed below, our band structure calculations for TbPdBi also reveal a high spin-polarization state, which is caused by a unique FM HTS state close to the topological critical point. Our observed large negative MR in TbPdBi provides strong support for such a HTS state.

Electronic structure and Hall conductivity calculations

To understand the unusual transport properties of TbPdBi, we now present our detailed theoretical analysis. Figure 3a–c show the arrangement of atoms in the nonmagnetic, FM with ordering vector [100], and the A-type AFM state with propagation vector [111]46. The high-symmetry nonmagnetic state of TbPdBi is described by the inversion asymmetric space group \({T}_{d}^{2}(F\bar{4}3m, \, {{{{{\rm{No}}}}}}. \, {216})\). In the [100] FM state, the symmetry of the lattice reduces to fourfold rotary reflection \({\bar{S}}_{4}\), which combines the fourfold rotational and mirror symmetries. The associated band structure is semi-metallic as shown in Fig. 3d (without spin-orbit coupling). Importantly, the band structure exhibits a band inversion between \({\Gamma }_{8}\) (p-type) and \({\Gamma }_{6}\) (s-type) states reminiscent of half-Heulser materials only in the spin-down channel, whereas the spin-up channel is not inverted. Such a unique band structure with a single-spin-channel band inversion can be closely associated with the half-metallic state of magnets, and for this reason, we call it a HTS. This HTS state can host multiband anticrossing points comprised of opposite spin-channels. In the presence of SOC, the band anticrossing points are gapped, inducing a non-zero Berry curvature field that leads to a large AHE (Fig. 3e). Figure 3f shows the band structure of the A-type AFM state of TbPtBi (ground state). The associated crystalline symmetries are threefold rotational symmetry (C3) around the [111] direction and spacetime symmetry \(\widetilde{T}=\left\{T | \frac{1}{2}\frac{1}{2}\frac{1}{2}\right\}\), which combines time-reversal symmetry with half-translation along [111]. The band structure is semi-metallic with various band crossings along the \(\Gamma -Z\) line and contains band inversions in both spin-channels. This non-trivial band inversion in the AFM state evolves to an HTS state with a single-spin channel band inversion in the presence of the magnetic field, which drives the AFM-to-FM transition. This band structure evolution with the magnetic field can lead to an intermediate spin-canted state with various band anticrossing points and enhance the Berry curvature field and the associated AHE.

Fig. 3: Electronic structure of TbPdBi with magnetic ordering.
figure 3

a Crystal structure of half-Heusler TbPdBi. [111] and [100] vectors denote the principal magnetic axes for antiferromagnetic (AFM) and ferromagnetic (FM) states, respectively. Spin structures of b [100] FM and c [111] AFM state. Spins are aligned ferromagnetically in a (111) plane and antiferromagnetically between the (111) planes in the AFM state shown in c. d Calculated spin-resolved bulk band structure of FM TbPdBi without spin-orbit coupling (SOC). e Spin-polarized band structure with SOC in e FM and f AFM states. Insets in de show the first Brillouin zones associated with the unit cells employed in the calculations.

We emphasize that the distinct anomalous Hall resistivity peak in TbPdBi occurs near 5 T (Fig. 1a), where the system is in a spin-canted AFM state. We can expect an additional contribution to the AHE stemming from the canted AFM state. As noted in the introduction, the non-collinear spin-texture can induce a large non-vanishing Berry curvature. Since TbPdBi possesses the same magnetic structure as GdPtBi/TbPtBi46, i.e., the magnetic moments of Tb order ferromagnetically on the (111) planes, but are antiferromagnetically coupled along the [111] direction. When the magnetic field is applied long [100], the magnetic moments will gradually tilt toward [100], resulting in a spin-canted state. A recent theoretical study indicates that, in AFM nodal-line materials AMnBi2 (A = Ca, and Yb), a strong AHE could be induced by weak spin canting, so that the anomalous Hall conductivity keeps growing as the canting angle increases47. This suggests that the anomalous Hall resistivity peak near 5 T in TbPdBi likely has its origin in the canted spin state formed by Tb+ ions. Such an interpretation is supported by our Berry curvature calculation for the spin-canted state, see below.

To calculate the band structure and anomalous Hall conductivity (AHC) in the spin-canted states of TbPdBi under an external magnetic field, we employ the virtual crystal approximation (VCA) where the AFM and FM states are taken as the end members. The VCA Hamiltonian Hvca of the spin-canted state is thus defined as follows:

$${H}_{{{{{\rm{vca}}}}}}=\left(1-x\,\right){H}_{{{{{\rm{AFM}}}}}}+{{xH}}_{{{{{{\rm{FM}}}}}}},$$
(2)

where \({H}_{{{{{\rm{AFM}}}}}}\) (\({H}_{{{{{\rm{FM}}}}}}\)) is the Hamiltonian for AFM (FM) phase and x is a tuning parameter that varies from 0 to 1. x = 0 (1) denotes the pure AFM (FM) phase, while 0 < x < 1 describes the spin-canted states. In the x = 0 ground state, the dominant Berry curvature Ωyz resides on the anticrossing points in the ΓZ direction (Fig. 4a). For x = 0.1 (low external magnetic field), although the strong Berry curvature Ωyz remains on the ΓZ path, finite FM coupling splits the oppositely spin-polarized bands, shifting the Berry curvature hot-spots to distinct energies [Fig. 4b]. In the fully polarized FM phase, the Berry curvature Ωyz around Γ becomes quite small [Fig. 4c]. Calculated AHC for x varying from 0 to 1 as a function of energy is shown in Fig. 4d. The AHC is nearly zero at x = 0 due to Berry curvature cancellation induced by effective \(\widetilde{T}\) symmetry. A dramatic peak emerges near 0.1 eV above the Fermi level at x = 0.1 because the band splitting caused by breaking both C3 and \(\widetilde{T}\) reduces the Berry curvature cancellation. The AHC peak gradually flattens and shifts to a higher energy with increasing x. The negative AHC at the Fermi level grows monotonically from x = 0 to 1, which implies that there are non-zero Berry curvatures away from the Γ point in the spin-canted AFM states.

Fig. 4: Berry curvature and anomalous Hall conductivity.
figure 4

Berry curvature (Ωyz) distribution of TbPdBi band structures for a x = 0 (antiferromagnetic (AFM) state), b x = 0.1 (spin-canted state) and c x = 1 (ferromagnetic (FM) state) along high-symmetry directions. d Calculated anomalous Hall conductivity (σyz) as a function of energy for varying x = 0 (dark blue curve) to x = 1 (red curve). e Anomalous Hall conductivity as a function of x with Δn = 0.0085/f.u. See ‘Electronic structure and Hall conductivity calculations’ section for details.

We consider the doping effect on the AHC across the magnetic transition. For each doping concentration, the chemical potential is determined by fixing the number of occupied states. Positive (negative) doping concentration Δn indicates the number of occupied states above (below) the original occupied particle number, i.e., Δn = n-n0, where n (n0) is the doped (original) occupied particle number per formula unit cell. When Δn = 0.0085/f.u., σyz reaches a maximum near x = 0.1, as shown in Fig. 4e, in qualitative agreement with our experimental observations (Fig. 1a). Note that σyz grows dramatically, while σxy and σzx remain close to zero, which can be attributed to the anisotropy of the calculated anomalous Hall conductivity (see Supplementary Note 4). Note also that the simplistic VCA model we used here cannot be expected to quantitatively capture the evolution of magnetic states under an external magnetic field. Indeed, our calculated AHC is seen to be smaller than the experimental value (supplementary Fig. S2b), indicating that effects other than those captured by our VCA calculations are at play.

Discussion

We first discuss the origin of the large Berry curvature in TbPdBi. Figure 3d, e show the band structure without and with SOC when the magnetic field is applied along [100]. Band degeneracy lifted by exchange interaction are common in Heusler compounds, such as GdPtBi/TbPtBi9,11,12. However, the weaker exchange interaction of Tb ions and the nearly zero band inversion strength in TbPdBi lead to smaller band splittings compared to (Gd/Tb)PtBi. As a result, the spin-split bands create a larger number of crossing points near the Fermi level. A small gap opens at the anticrossing points with SOC, and a large non-vanishing Berry curvature accumulates at these points.

Note that in REPtBi (RE = Gd, Nd), the non-vanishing Berry curvature is induced by the field-induced Weyl state. The number of Weyl nodes and their locations depend on the direction of the applied magnetic field (B). In TbPdBi, our calculations find two pairs of Weyl nodes around \(\varGamma\) in the FM phase for magnetic field applied along the [100] direction; positions of these Weyl nodes are summarized in supplementary table I. Since these Weyl nodes are far away from the Fermi level, they cannot induce a large AHE. Furthermore, the absence of a chiral anomaly in our magnetotransport measurements indicates that the Weyl nodes do not contribute to the transport properties of TbPdBi. Hence, we conclude that the large AHC in TbPdBi cannot be attributed to the Weyl state.

A large Berry curvature can also arise from the spin-canted state. Our calculations show that increasing the canting angle widens the band splitting and enlarges the gap at the anticrossing points, which results in the enhancement of the Berry curvature along the yz direction (Ωyz). The spin-canted state is of course not unique to TbPdBi, and it has also been observed in other half-Heusler compounds such as GdPtBi9,11, TbPtBi12, and DyPtBi39 where the anomalous Hall conductivity and Hall angle are much smaller than in TbPdBi. One may wonder what makes TbPdBi unique. Our band structure calculations give insight by revealing that TbPdBi hosts a distinct topological state: TbPdBi lies at a critical point of the AFM ground state since its band inversion strength is nearly zero. At the field-driven FM state, it evolves into a HTS state, in which its spin-down bands maintain band inversion, while its spin-up bands lose band inversion and become topologically trivial. Notably, a similar state has been predicted in EuB648, where a large AHE and large negative MR have been recently reported45. These results suggest that the HTS state likely plays a crucial role in enhancing the AHE in topological materials. Since the net Berry curvature involves a summation over all the occupied states, the number of bands crossing the Fermi level could affect the Berry curvature cancellation. In general, compounds showing good-metal behavior usually also exhibit a large Berry curvature cancellation, resulting in a small net Berry curvature. However, in some compounds with bad-metal or semimetal behavior, only a few bands cross the Fermi level, which could reduce the possibility of Berry curvature cancellation. In TbPdBi, the spin-up and spin-down bands are pushed in opposite directions, with a bandgap opening in the spin-up bands, which substantially reduces the number of bands which cross the Fermi level, thus reducing cancellation effects in the Berry curvature.

The exotic HTS state in TbPdBi leads to not only a large AHE but also a large isotropic negative MR. As spins are polarized near the Fermi level (spin-polarization reaches 40%) under external magnetic field, the spin-down carriers dominate transport in TbPdBi. The spin-scattering is thus significantly suppressed across the spin-flop transition, which leads to a steep resistivity drop with increasing magnetic field. For fields above 15 T, spins are fully polarized (Fig. 1b) and the MR saturates. Since we attribute the large negative MR to an exotic 3D band structure, we expect the MR to be insensitive to field orientation, which is what we observe in TbPdBi (Fig. 2a, b). The temperature independence of MR(B) between TN( = 5.2 K) and 20 K (Fig. 2a, b) can also be rationalized in terms of the field-induced FM HTS. Although there is not a long-range spin-flop transition above TN, short-range AFM order should exist above TN at zero field, so that a crossover-like transition from PM to FM should occur under high magnetic fields, which is indeed seen in the magnetization data at 20 K (Fig. 2b). This indicates that the FM HTS can extend to temperatures above TN under high magnetic fields. However, for temperature above 50 K, thermal effects will excite electrons out of spin-up bands, increasing spin-scattering and reduction of the negative MR, much like the results shown in Fig. 2c.

In summary, we have observed an unusual AHE effect with a large anomalous Hall angle (tanΘH ≈ 2) and a large negative MR in TbPdBi. Our analysis indicates that these exotic transport properties originate from the unique HTS state of TbPdBi, dominated by the contribution of spin-down bands. The greatly enhanced AHE results from a significantly reduced Berry curvature cancellation between the spin-down and spin-up bands. Spin canting of the AFM state under magnetic field increases the number of band anticrossing points and widens the gaps, which in turn increase Berry curvature hot-spots near the Fermi level and account for the distinct anomalous Hall resistivity peak at low fields. We also find that the HTS state enhances the spin-polarization for the spin-down band in the FM phase, which explains the large negative MR. Our study unveils an alternative pathway for generating an extremely large AHE by tuning the electronic structure and the magnetic state in half-Heusler materials. It thus advances the understanding of the interplay between topological state and magnetism and provides strategies for materials design for spintronic and other applications.

Methods

Single-crystal growth

Single crystals of TbPdBi were synthesized using the Bi-flux method49. The starting materials (Tb, Pd, and Bi powders) were mixed with a molar ratio of Tb: Pd: Bi=1:1:20, loaded into Al2O3 crucibles, and sealed in quartz tubes under high vacuum. The mixtures of source materials were heated to 1050°C in a crucible furnace and held at this temperature for 48 hours for homogeneous melting, followed by slow cooling down to 700°C at a rate of 3° C/h. Cubic-shaped single crystals of TbPdBi were obtained by removing the excess Bi-flux by centrifuging. The inset of the supplementary Fig. S1c shows an image of a typical TbPdBi crystal. The cubic structure and composition of the grown crystals were confirmed by X-ray diffraction (XRD) measurements (supplementary Fig. S1c) and Energy-dispersive X-ray spectroscopy (EDS). The lattice parameter a extracted from the XRD pattern from the (001) plane is ~6.6360 Å, consistent with the previously reported value (a ~ 6.65310 Å)37.

Magnetotransport and magnetization measurements

Magnetoresistivity and Hall resistivity measurements were performed using a standard six-probe method in a Physical Property Measurement System (PPMS, Quantum Design). The high-field transport measurements were carried out at the National High Magnetic Field Laboratory (NHMFL) in Tallahassee. The magnetoresistivity and Hall resistivity data presented in this paper are obtained after symmetrizing and anti-symmetrizing the longitudinal and transverse Hall resistivity data measured at positive and negative magnetic fields, respectively. All the samples used for transport measurements were polished to rectangular shapes with dimensions of ~0.8 mm × 0.7 mm × 0.2 mm, where the polished surfaces were parallel to the (001) plane. The current was applied along the [100] or [001] directions for both the longitudinal resistivity and the Hall resistivity measurements. Magnetization measurements used the National High Magnetic Field Pulsed Field Facility at Los Alamos National Laboratory and a SQUID magnetometer (Quantum Design).

Electronic structure calculations

Electronic structure calculations were performed within the density functional theory framework using the Vienna ab-initio simulation package (VASP) based on the projector-augmented wave method50,51,52.The generalized gradient approximation (GGA) was employed to include exchange-correlation effects53. An on-site Coulomb interaction was added on Tb f-electrons within the GGA + U scheme with Ueff = 10 eV. A plane wave cut-off energy of 500 eV was used, along with a \(11\times 11\times 11\Gamma\)-centered k-point mesh to sample the first Brillouin zones of the cubic and trigonal unit cells associated with various magnetic orderings (see Supplementary Data 1). Spin-orbit coupling effects were included self-consistently. Transport properties were calculated using a first-principles material-specific, effective tight-binding model Hamiltonian generated using the VASP2WANNIER90 interface54. Tb d and f orbitals, Pd s, p, and d orbitals, and Bi p orbitals were included in constructing the Wannier functions.