Introduction

The confluence of spin–orbit coupling (SOC) and strong electron correlation provides a new paradigm of solid-state quantum phenomena1,2,3,4,5,6. In particular, the new type of superconductivity that are expected to arise in spin–orbit coupled Mott insulators has drawn great attentions. The representative candidate materials are transition metal dicalchogenides TaS26 and Sr2IrO41,2,7,8,9,10,11. Despite of the promising examples, the microscopic superconducting mechanism itself, as well as its pairing symmetry remain, elusive. The key step forward is to have a concrete material platform for which the unambiguous theoretical description can be provided and tested. In addition, reliable prediction of pairing symmetry and the detailed suggestions for its experimental verification are demanded.

Lacunar spinel compounds, GaM4X8 (M = transition metals; X = chalcogens), are a fascinating class of materials for the demonstration of rich correlated electronic structure and potential applications in technologies12,13,14,15,16,17,18,19,20,21. Among the known lacunar spinels, GaTa4Se8 is a Mott insulator with a charge gap of 0.1–0.3 eV22,23,24. Its widely tunable conductivity is expected to be useful for nonvolatile memory devices24,25,26,27. More recent first-principles calculation points out that the SOC of Ta ion induces a novel electronic band structure described by molecular state with so-called jeff = 3/2 nature28. Subsequently, resonant inelastic X-ray scattering (RIXS) experiment has directly verified this jeff = 3/2 electronic structure29, establishing GaTa4Se8 as a notable example of spin–orbit coupled Mott insulator where both electron correlation and SOC play the crucial role.

Strikingly, applying pressure induces the phase transition from a spin–orbit coupled Mott insulator to a metal and eventually to a superconductor22,30,31,32. The characteristics of this superconductivity are quite intriguing in many regards. First, GaTa4Se8 does not show any long-range magnetic order down to low temperature22,30. Second, there is no experimental signature for structural transition as a function of pressure and no drastic phonon mode change. Third, nevertheless, the anomalies in specific heat as well as magnetic susceptibility are repeatedly identified at around 50 K, which is an order of magnitude higher than superconducting Tc22,33,34,35,36. Most importantly, it is also noted that superconductivity is only observed in the case of M = Nb and Ta; namely, only when the low energy band structure is of jeff = 3/2 character28. This observation heavily prompts a speculation that jeff = 3/2 nature of the electronic band structure pervades the origin of the superconductivity, being different from the conventional BCS type. However, there has been no firm investigation on its character both theoretically and experimentally.

In this paper, we show that the superconductivity in GaTa4Se8 is attributed to the new type of electronic pairing. Due to the intriguing interplay of multi-band jeff = 3/2 character and inter-band correlation, novel d-wave quintet superconductivity with spin-2 Cooper pairs is stabilized. Such high angular momentum Cooper pair state has been also referred to as the quintet pairing states37,38,39,40,41,42,43. Utilizing both density functional theory and random phase approximation (RPA), we first show that the system well retains the characteristic of jeff = 3/2 under high pressure. Our first-principles calculations also show how intra-, inter-orbital electron interactions and Hund coupling change by pressure. Starting from the constructed many-body Hamiltonian, we analytically show that applying pressure activates many-body inter-band tunnelings and opens attractive quintet pairing channels assisted by strong Hund coupling. Among the possible quintet pairings, it turns out the system favors a particular d-wave superconductivity with t2g symmetries. This novel superconductivity is characterized by nodal lines of Bogoliubov quasiparticles and by topologically protected Majorana modes at the surface. Thereby, our work theoretically establishes GaTa4Se8 as a strong candidate of topological d-wave superconductor. In order to facilitate its confirmation, we also propose the concrete experimental setups and the signatures to be identified in Josephson junction transport and scanning tunneling microscopy (STM).

Results

Electronic structure and many-body Hamiltonian

GaTa4Se8 consists of GaSe4 and Ta4Se4 clusters arranged in NaCl structure (see Fig. 1a)22 that belong to the space group F\(\bar{4}3\)m, which forms non-centrosymmetric structure. Due to the short intra-cluster bondings, its electronic band structure is well understood by molecular orbital states, and the states near Fermi level are dominated by triply degenerate molecular t2 orbitals denoted by (Dxy, Dyz, Dzx)22. Just as the atomic t2g orbitals, molecular t2 can also be represented by effective angular momentum leff = 1 = − L(1) where L(1) is the angular momentum operator with orbital quantum number l = 144. The spin–orbit interaction, HSOC = − λl S, gives rise to the molecular quartet jeff = 3/2 and the doublet jeff = 1/2. In particular, molecular quartet jeff = 3/2 in the basis of j, jz > is being represented as \(| 3/2,\pm 3/2>=\mp \frac{1}{\sqrt{2}}(\left|{D}_{yz,\uparrow \downarrow }\right\rangle \ \pm \ i\left|{D}_{zx,\uparrow \downarrow }\right\rangle )\) and \(| 3/2,\pm 1/2>=\sqrt{\frac{2}{3}}(\left|{D}_{xy,\uparrow \downarrow }\right\rangle \mp \frac{\left|{D}_{yz,\downarrow \uparrow }\right\rangle \ \pm \ i\left|{D}_{zx,\downarrow \uparrow }\right\rangle }{2})\) where ↑, ↓ refer to spin directions28.

Fig. 1: Crystal and band structure of GaTa4Se8.
figure 1

a Crystal structure of GaTa4Se8. GaSe4, and Ta4Se4 clusters consist of NaCl-like structure. b Schematic electronic structure near Fermi level. Molecular bonding orbitals e and a1 are fully-filled and one electron is in t2 orbitals. By SOC, t2 orbitals split into jeff = 1/2 doublet and jeff = 3/2 quartet with one electron in jeff = 3/2 bands. c Fat bands and PDOS of GaTa4Se8 for various pressures (ambient, 5 GPa, 10 GPa, and 14.5 GPa). Even under high pressure, jeff = 3/2 bands are well separated from other bands.

The calculated band dispersions and the projected density of states (PDOS) are shown in Fig. 1c as a function of pressure (for more details, see Supplementary Information 1 and ref. 22 for the crystal structure data under the pressures). Note that, not only at the ambient pressure but at the high pressure up to 14.5 GPa, jeff = 3/2 band characters are well maintained and still dominating the near Fermi energy region. It justifies our low energy model containing jeff = 3/2 states.

In order to take into account electronic correlations, we construct many-body Hamiltonian including intra-orbital (U > 0), inter-orbital interaction (\(U^{\prime} >0\)) and Hund coupling (JH > 0):

$$\begin{array}{l}{H}_{I}=U\mathop {\sum}\limits_{u}{n}_{u\uparrow }{n}_{u\downarrow }+U^{\prime} \mathop {\sum}\limits_{u,v\,{<}\,u}{n}_{u\sigma }{n}_{v\sigma ^{\prime} }\\ +\ \frac{{J}_{{\rm{H}}}}{2}\ \ \mathop {\sum}\limits_{u\ne v,\sigma ,\sigma ^{\prime} }{d}_{u\sigma }^{\dagger }{d}_{v\sigma ^{\prime} }^{\dagger }{d}_{u\sigma ^{\prime} }{d}_{v\sigma }\ +\ \frac{{J}_{{\rm{H}}}}{2}\ \ \mathop {\sum}\limits_{u\ne v,\sigma \ne \sigma ^{\prime} }{d}_{u\sigma }^{\dagger }{d}_{u\sigma ^{\prime} }^{\dagger }{d}_{v\sigma ^{\prime} }{d}_{v\sigma }\end{array}$$
(1)

where \({d}_{iu\sigma }\,({d}_{iu\sigma }^{\dagger })\) is the annihilation (creation) operator of electrons with orbital u (Dxy, Dyz, Dzx) and spin σ. The third and fourth terms are the Hund exchange and Hund’s pair hopping interaction, respectively.

d-wave quintet pairing

Projecting this many-body interactions onto jeff = 3/2 basis (namely, \(\Psi =(\left|3/2\right\rangle ,\left|1/2\right\rangle ,\left|-1/2\right\rangle ,\left|-3/2\right\rangle )\)) and using Fierz transformation, Eq. (1) is exactly decoupled into the singlet and the five distinct quintet pairing channels as follow:

$$\begin{array}{ll}{H}_{I,{J}_{{\rm{eff}}} = 3/2}={g}_{0}({\Psi }^{\dagger }{T}^{\dagger }{\Psi }^{* })({\Psi }^{T}T\Psi )\\ +{g}_{1}\mathop{\sum }\limits_{a = 1}^{3}({\Psi }^{\dagger }{(T{\gamma }_{a})}^{\dagger }{\Psi }^{* })({\Psi }^{T}T{\gamma }_{a}\Psi )\\ +{g}_{2}\mathop{\sum }\limits_{a = 4}^{5}({\Psi }^{\dagger }{(T{\gamma }_{a})}^{\dagger }{\Psi }^{* })({\Psi }^{T}T{\gamma }_{a}\Psi ).\end{array}$$
(2)

Here, γa is the four-dimensional gamma matrices representing quintet-spin operator and T is the unitary component of the time-reversal operator (for more details, see Supplementary Information 3). g1 and g2 represent the quintet pairing strength with t2g and eg symmetry, respectively, while g0 is the singlet pairing strength. Assuming that jeff = 3/2 states are well separated from 1/2 bands, one can have the exact expression of each coupling constant: \({g}_{0}=(2U+U^{\prime} +3{J}_{{\rm{H}}})/24\), \({g}_{1}=(3U^{\prime} -{J}_{{\rm{H}}})/24\) and \({g}_{2}=(U+2U^{\prime} -3{J}_{{\rm{H}}})/24\)45.

It is remarkable that no matter how large is the intra-orbital interaction U, g1 coupling can be attractive and therefore induce superconducting instability if the Hund coupling is comparable to inter-orbital interaction, \({J}_{H}\,>\,3U^{\prime}\). In contrast, the singlet pairing channel cannot be attractive (g0 < 0) since the Hund’s coupling and the Hubbard interactions are both positive. This result is irrespective of the interaction parameters, which single out the possibility of the trivial singlet superconductivity.

Importantly, this t2g symmetry d-wave pairing is robust even when the inter-band mixings between jeff = 3/2 and 1/2 are considered. Figure 1c shows the band separation between jeff = 3/2 and 1/2 gradually decreases as the pressure increases the bandwidth. At high enough pressure, the sizable many-body interband tunneling is expected. In this regime, jeff = 1/2 can make an additional contribution to the effective pairing interaction, g, through the virtual tunneling process. This effect can formally be calculated using many-body Schrieffer–Wolff transformation46. Interestingly, we find, the leading order contribution of the interband tunneling is always attractive pairing interactions irrespective of the specific values of \((U,U^{\prime} ,{J}_{H})\) (See Supplementary Information 3B for the estimation of the interaction parameters derived using the RPA calculation.) As a result, the tunneling effect, assisted by strong JH, opens up the attractive superconducting channel characterized by g1 < 0, and results in quintet-spin Cooper pairs with t2gd-wave symmetry.

Topological superconductivity

The intriguing nature of this d-wave quintet Cooper pair can be found in its non-trivial spin texture originating from the unique topological property of Bogliubov-de Gennes (BdG) energy spectrum. Among the possible superconducting order parameter configurations with t2g symmetry, we find that the energetically most favorable state, \(\langle {\psi }^{T}T\overrightarrow{\gamma }\psi \rangle =(1,0,0)\)-state where \(\overrightarrow{\gamma }=({\gamma }_{1},{\gamma }_{2},{\gamma }_{3})\) represents quintet pairing with t2g symmetry, is characterized by gapless nodal lines as shown in Fig. 2a; see Supplementary Information 4 for more details of our calculation. Due to the jeff = 3/2 orbital character, the nodal lines in Fig. 2a exhibit robust dxy symmetry even in the presence of small inversion symmetry breaking terms. This nodal lines have a topological origin and are protected by the non-trivial winding number.

Fig. 2: Gap structure and topological surface states.
figure 2

a The BdG gap structure of dxy pairing. We find two-fold degenerate nodal line gap structure shown as the red line. The red columns indicate the nodal lines. b The non-trivial winding of phase Φ(k) around the nodal lines. The blue streamline represents the winding of the phase Φ(k). We find that the non-trivial winding number protects the nodal line. cd The normalized zero-energy spectral density of the surface (c) and bulk (d). Open surface possesses the topological Majorana flat band covering the interior of the nodal line. The open boundary condition is taken along [010]-direction.

It is first noted that the particle-hole and the time-reversal symmetry allow us to define the following non-hermitian matrix and its singular value decomposition, \({h}_{0}({\bf{k}})+iT| \Delta | {\gamma }_{1}\equiv {U}_{{\bf{k}}}^{\dagger }{D}_{{\bf{k}}}{V}_{{\bf{k}}}\), where h0(k) is the normal Hamiltonian. Dk is now a diagonal matrix containing all the positive energy eigenvalues. Second, we can consider the adiabatic band flattening process by smoothly deforming Dk to \({{\mathbb{I}}}_{4}\) without any gap closing. This procedure defines the new unitary matrix, \({q}_{{\bf{k}}}\equiv {U}_{{\bf{k}}}^{\dagger }{V}_{{\bf{k}}}={\sum }_{n}{e}^{i{\lambda }_{n}({\bf{k}})}\left|n({\bf{k}})\right\rangle \left\langle n({\bf{k}})\right|\), and the corresponding phase λn(k). These phases are well-defined as long as the system is fully gapped. Therefore, one can assign \({{\mathbb{Z}}}_{2}\) topological winding number along a line that encircles the nodal line as follow: \(w=\frac{i}{2\pi }\oint d{\bf{k}}\cdot tr({q}_{{\bf{k}}}^{\dagger }{\nabla }_{{\bf{k}}}{q}_{{\bf{k}}})\) according to DIII class in the Altland-Zirnbauer classifications47.

Figure 2b shows the configuration of the phase Φ(k) ≡ ∑nλn(k). Blue streamlines clearly show that the phases have vortex–antivortex configurations where the core of the vortex defines the nodal line. From the explicit calculation of the winding number, we conclude that each nodal line and the vortex configuration are topologically characterized by the non-trivial winding number, w = ±1. These vortical configurations cannot be removed unless the vortex–antivortex pair annihilates each other. Thus, the nodal lines are topologically protected.

Experimental verifications

We now suggest the experimental signatures to verify d-wave quintet pairing. First of all, the non-trivial winding number encircling the nodal line manifests itself as the Majorana zero modes on the open surface. Figure 2c shows the simulated Majorana flat band, which can be directly observed by STM48 and superconducting tunneling spectroscopy49,50. The Majorana zero-modes depicted in Fig. 2c exist in every momentum point in the interior of the surface projected nodal line. Thus the Majorana flat band contributes to the zero-energy density of state at the surface.

Another experiment we suggest is Josephson junction transport. Figure 3a–c show the current-phase relation (CPR) for the planar junction of rotating orientations. The CPR can be expressed as a series of sinusoidal harmonics of the phase difference, ϕ: \({I}_{J}(\phi )={\sum }_{n}{I}_{n}\sin (n\phi )\) where In gives the 2πn periodic Josephson current component. Due to the dxy pairing symmetry, Josephson coupling gains π phase under 90 rotation of the junction orientation, and therefore the sign of I1 is inverted as shown in Fig. 3a, c. In between the two angles (i.e., when the junction is formed along the [100]-direction), the first harmonics vanishes, I1 = 0; see Fig. 3b. The next dominant CPR has π periodicity and the resulting Josephson frequency, 4eV/h, is the twice of the conventional Josephson frequency51. This frequency doubling can be directly observed from the measurement of the Shapiro step in the I–V characteristics.

Fig. 3: Josephson junction experiment and Fraunhofer diffraction pattern.
figure 3

ac The CPR of the planar Josephson junction at different orientations. Due to the dxy pairing symmetry, the first harmonics of the CPR is inverted under 90 rotation. d Schematic figure of the Josephson corner junction. e The unconventional Fraunhofer pattern of the lacunar spinel. Unlike the conventional Fraunhofer pattern, the location of the peaks and the dips are reversed.

One can also make use of the pairing symmetry in this material which results in the unconventional magnetic oscillation pattern52,53,54,55,56. Figure 3d shows the schematic setup of the Josephson corner junction which is constructed on the corner of the lacunar spinel crystal. Due to the π-phase difference in CPR with different orientations, Josephson currents at each face destructively interfere with each other. However, because of small inversion symmetry breaking in the system, the critical current does not completely cancel but makes the dips in the Fraunhofer diffraction pattern as shown in Fig. 3e. As a consequence, we find that the overall locations of the peaks and the dips in the Fraunhofer pattern should be reversed compared to the case of conventional superconductors. This unusual magnetic oscillation pattern can be regarded as the signature of the quintet pairing in GaTa4Se8.

Discussion

We discuss the relevance to another lacunar spinel material GaNb4Se8 which shares many similar features with GaTa4Se8. At ambient pressure, GaNb4Se8 is known to have a Mott gap of 0.19 eV22, and the previous calculation shows that its low energy band character is also well-identified by jeff = 3/2 states due to the sizable SOC in Nb atoms28. The pressure-induced superconductivity is also found with Tc = 2.9 K at 13 GPa30. Such similarity with GaTa4Se8 may indicate GaNb4Se8 as another strong candidate of topological superconductors. Nevertheless, in contrast to GaTa4Se8, GaNb4Se8 has a sizable band overlap between jeff = 3/2 and jeff = 1/2 bands28, which indicates the stronger inter-band tunneling effect that goes beyond the analysis of Schrieffer–Wolff transformation method. While stronger virtual tunneling effect on the superconductivity is expected, detailed correlation effect may be different under pressure, depending on molecular states occupied with either Nb or Ta.

In addition, Guiot et al. have performed Te doping in GaTa4Se8 by substitution of Se atoms24. The empirical effect of the Te doping is the reduction of the effective bandwidth followed by the increase of the Mott gap. Similarly, we may expect the increase of superconducting critical temperature. This would solidify our prediction that the superconducting pairing mediated by the electron-electron interaction than the phonon coupling.

Furthermore, the pressure control can be another interesting path to control the superconducting phase transition. Near the superconducting critical point, the transition to the time-reversal broken states is expected (See supplementary information 4). The time-reversal broken states is signatured by the Bogoliubov Fermi surfaces, and it can be measured by the anomalous thermal Hall effect similar to that of the p + ip chiral superconductor. In general, the time-reversal broken phase cannot occur in conventional singlet pairing. Therefore, the thermal Hall effect near the superconducting phase transition would be another smoking gun signature of the quintet superconductivity.

In summary, we have suggested a new superconducting pairing mechanism for which spin–orbit entangled multiband nature plays an essential role together with electron correlation. Our theory is developed for and finds its relevance to GaTa4Se8 and other lacunar spinels, where the origin of pressure-induced superconductivity has not been understood for a long time. Starting from the realistic band structure and considering the correlation strengths calculated by first-principles DFT calculations, we have developed the detailed microscopic theory. Superconducting gap is found to have d-wave symmetry and its gapless nodal lines emerge with the non-trivial topological character. Furthermore, we have proposed concrete experiments that can confirm our theoretical suggestion. The unusual IV characteristics and the magnetic oscillation patterns are expected from Josephson transport and can be regarded as the smoking gun signatures for this quintet paring. STM image can also be compared with our results. Our findings will pave a new way to search for exotic superconductivity in lacunar spinel compounds.

Methods

First-principles calculation

Electronic structures calculations were performed with OPENMX software package based on linear combination of pseudo-atomic-orbital basis57 and within local density approximation (LDA)58,59. The SOC was treated within the fully relativistic j-dependent pseudo-potential scheme60. We used the 12 × 12 × 12 k-grids for momentum-space integration and the experimental crystal structures at different pressures22. For the estimation of tight-binding hopping and interaction parameters, we used maximally localized Wannier function (MLWF) method61,62 and constrained RPA (cRPA) technique63,64,65 as implemented in ECALJ code66.