Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# Visualizing heavy fermion confinement and Pauli-limited superconductivity in layered CeCoIn5

## Abstract

Layered material structures play a key role in enhancing electron–electron interactions to create correlated metallic phases that can transform into unconventional superconducting states. The quasi-two-dimensional electronic properties of such compounds are often inferred indirectly through examination of bulk properties. Here we use scanning tunneling microscopy to directly probe in cross-section the quasi-two-dimensional electronic states of the heavy fermion superconductor CeCoIn5. Our measurements reveal the strong confined nature of quasiparticles, anisotropy of tunneling characteristics, and layer-by-layer modulated behavior of the precursor pseudogap gap phase. In the interlayer coupled superconducting state, the orientation of line defects relative to the d-wave order parameter determines whether in-gap states form due to scattering. Spectroscopic imaging of the anisotropic magnetic vortex cores directly characterizes the short interlayer superconducting coherence length and shows an electronic phase separation near the upper critical in-plane magnetic field, consistent with a Pauli-limited first-order phase transition into a pseudogap phase.

## Introduction

A central theme of the research on unconventional superconductivity has been its strong relationship to reduced dimensionality1,2,3,4. For example, the layered crystal structure of high-Tc superconductors gives rise to strongly two-dimensional (2D) electronic behavior, which increases the many-body correlation effects that are an essential ingredient for unconventional superconductivity. The heavy fermion superconductor CeCoIn5, which has many similarities to the high-Tc cuprates5,6,7,8,9,10, also has a layered crystal structure built up from the heavy fermion antiferromagnet CeIn311 separated by CoIn2 stacks. Bulk measurements of CeCoIn5 show signatures of an anisotropic, quasi-2D electronic structure12,13,14,15,16,17, but in contrast to the cuprates, there are also contributions from 3D bands that result in a smaller electronic anisotropy18. Among the Ce-based heavy fermion compounds, CeCoIn5 has the highest transition temperature at ambient pressure, which correlates with its electronic dimensionality as illustrated by isovalent substitutions19,20,21 and layer engineering22,23. Like the cuprates, superconductivity in CeCoIn5 has a $${\boldsymbol{d}}_{{\boldsymbol{x}}^2 - {\boldsymbol{y}}^2}$$ symmetry24,25,26,27,28,29,30,31 and there are indications of a pseudogap phase24,30,32,33,34,35 as well as other ordered phases that compete or coexist with superconductivity, such as the spin-density wave order identified as the Q-phase36,37,38. This phase appears at high magnetic fields, just before the upper critical field associated with a Pauli-limited transition into the pseudogap phase30,39,40.

Here we introduce an experimental approach to investigate the electronic structure of CeCoIn5: we use a scanning tunneling microscope (STM) to study its properties in cross-section. Our measurements directly probe the layer dependence of the electronic states, and represent the first cross-sectional study of a layered superconducting system. Our approach reveals important features of the correlated quasi-2D electronic structure in CeCoIn5, including confinement of heavy quasiparticles on the atomic scale and the layer dependence of its pseudogap. Furthermore, in the superconducting state, the cross-sectional geometry enables us to probe the direction-dependent response of the $${\boldsymbol{d}}_{{\boldsymbol{x}}^2 - {\boldsymbol{y}}^2}$$ order parameter to scattering from defects as well as spatially resolve the nature of the vortex phase and its first-order Pauli-limited phase transition into the pseudogap state.

## Results

### Layered crystal structure of CeCoIn5

To probe the quasi-2D nature of electronic behavior in the normal and superconducting phases of CeCoIn5, we cleave samples along the [100] orientation (parallel to the b–c surface) in situ in an ultra-high vacuum STM. Based on the crystal structure, we expect that the resulting surfaces expose a cross-sectional cut of the quasi-2D layers of this compound (Fig. 1a). The crystal structure also suggests that the surface termination in the [100] orientation will be either a Ce-Co-In2 layer or an In3 layer, and STM topographical images indeed show two different surfaces for the cleaved samples in the bc plane (Fig. 1b). One is atomically ordered and smooth, and we label it surface S; the other appears more disordered, and we refer to it as surface R. We identify surface R as the In3 layer and attribute the quasi-ordered bumps in the STM images to surface reconstruction (see the details in Supplementary Note 1 and Supplementary Fig. 1). We assign the atomically ordered surface S to the Ce-Co-In2 layer (Fig. 1c), which is expected to be offset from surface R with a step height of half of the lattice constant in the a–b plane, as found experimentally (Fig. 1d). The morphology of the surfaces allows us to identify the position of the quasi-2D layers (in previous studies30,41,42 referred as layer A and B) based on topographic images (Supplementary Note 2 and Supplementary Fig. 2). Our measurements of surface S reveal an anisotropic atomic lattice consistent with the crystal structure of CeCoIn5, and we focus on high-resolution measurements of this surface in the remainder of this work.

### Signatures of quasiparticle confinement in the normal state

Our ability to access CeCoIn5 layers in cross-section provides a unique opportunity to address the role of the layered structure of this compound on its electronic properties. Previous STM studies30,41,42 of CeCoIn5 on samples cleaved along the [001] orientation had been used to examine the layer dependence of the electronic properties by studying multiple surfaces perpendicular to the c-axis that were terminated with different layers. In those experiments, it was found that the STM tip couples differently to the heavy or light quasiparticles depending on the surface atomic termination, resulting in changes in the tunneling spectra. When tunneling is sensitive to the light spd electrons (on layer A), the spectra show a hybridization gap for such quasiparticles, whereas on layer B a stronger coupling to the f-electrons yields an asymmetric double peak in the spectra associated with the formation of the dispersing heavy f-band. In the current work, spectroscopic measurements on the exposed b–c plane enable us to investigate the composite nature of electronic states and their variation in the different quasi-2D layers while studying a single atomic surface (Fig. 1a). Measurements on surface S at T = 10 K show two types of spectra depending on the atomic positioning of the tip (Fig. 2): one corresponding to layer A (Fig. 2a, e), in which a hybridization gap is observed and the other to layer B (Fig. 2b, f), where a double peak feature is resolved. One type of spectrum evolves smoothly into the other as the STM tip examines the layers of CeCoIn5 in cross-section (Fig. 2c, g). This smooth progression illustrates the remarkable property that the observed electron mass varies significantly on the atomic scale within a single [100] unit cell and that it is strictly associated with the 2D layers. The transition between light and heavy nature of the excitations can be captured by a simple model (Fig. 2d, h) that considers the spatial dependence of the tunneling sensitivity (see Methods section).

One intriguing observation is that the spectroscopic signatures of the spd electron hybridization depends on whether the tunneling occurs perpendicular or parallel to the 2D layers. Previous measurements performed on the a–b plane30,31,41 indicate the presence of two gap-like features in the tunneling spectra (with energy scales of around 40 meV and 15 meV). These can be associated with a direction-dependent hybridization gap (or gaps43,44) based on quasiparticle interference (QPI) measurements41. In contrast, in our current cross-sectional experiments, we only observe one feature that matches the smaller hybridization gap when tunneling perpendicular to the same layer (Fig. 2e). Our data show that in addition to the previously observed in-plane anisotropy of the measured hybridization gap, the geometry of the STM measurement strongly influences the sensitivity of such measurements.

Mapping variations of the local density of states (LDOS) in the tunneling spectra on the b–c surface provides evidence for strong confinement of quasiparticles within the quasi-2D layers of CeCoIn5. Figure 3a shows a region where several islands of surface R act as scattering potentials, giving rise to modulations in the LDOS from QPI45 (Fig. 3b). Far from the defects (for example, at the bottom left corner of Fig. 3a, b) the QPI signal is absent and the LDOS exhibits a periodic modulation along the c-axis. This is the same behavior as observed in Fig. 2, and it further demonstrates that the stacked quasi-2D layers have different electronic characters. Near the islands, our cross-sectional imaging geometry reveals a preferential direction for quasiparticle scattering: the interference waves are oriented along the b-axis, whereas the modulation is almost absent in the direction of the c-axis. This strongly confined scattering behavior can be further demonstrated by taking a Fourier transform of the conductance map (Fig. 3d), which reveals three significant scattering vectors. The Q1 vector with the strongest intensity and the weaker Q2 are in the [010] direction and correspond to scattering along the quasi-2D layers (along the b-axis). The presence of 3D bands in CeCoIn5 leads to a scattering vector Q3, which has both [010] and [001] components (with $$Q_3 \approx \left( {0,0.37,0.69} \right)$$ relative lattice units), although this scattering signal is substantially weaker than the in-plane signal at Q1. We note that no scattering vector can be detected purely in the [001] direction, which indicates the low probability of electrons moving perpendicular to the quasi-2D layers (in the direction of the c-axis).

High-resolution conductance mapping (Fig. 3c) illustrates an additional aspect of the confinement of the quasiparticles: the strength of the QPI signal is strongly suppressed on lines on top of layer B. This is also visible in Fig. 3e, which displays the QPI modulation as a function of distance from the island on two neighboring atomic planes (one is on top of layer A and the other one is on top of layer B). On layer A, the interference signal exhibits a decaying, periodic, long-wavelength modulation of about 30 Å, whereas it is almost absent on layer B, showing that the dominant scattering vector is mainly detectable on layer A. Energy-resolved QPI measurements along the [010] direction (Supplementary Note 3 and Supplementary Fig. 3) reveal two major bands (a heavy and a light band) and shows that the long-wavelength signal (Q1) at this energy arises from scattering involving light bands, and hence its prominence on layer A is consistent with our discussion above and previous STM measurements 30,31,41,42.

### Unconventional superconductivity in cross-section

Next, we study the superconducting state of CeCoIn5, where our cross-sectional geometry allows us to map the antinodal direction of the $${\boldsymbol{d}}_{{\boldsymbol{x}}^2 - {\boldsymbol{y}}^2}$$ order parameter, which points out of plane from the exposed surface (Fig. 4a, inset). When the sample is cooled to $$T \approx 400$$ mK, well below its transition temperature, the spectrum exhibits a sharp, superconducting gap at the Fermi energy (Fig. 4a), which is unchanged as the STM tip crosses the quasi-2D layers (Fig. 4c), reflecting the fact that the coherence length is much longer than the interlayer spacing. The gap size $$\Delta _{{\mathrm{SC}}} \approx$$ 550 µeV is similar to previously measured values25,28,30,31. Tunneling into a layered d-wave superconductor in cross-section has not been previously demonstrated; our measurements offer a new approach for studying its response to impurities. Examining the spatial variation of the gap in the b–c surface, we find no variation in $$\Delta _{{\mathrm{SC}}}$$ across atomic step edges (Fig. 4e–g), in stark contrast to a previous measurement of scattering events in the a–b plane30. In that experiment, suppression of the superconducting gap was observed due to the sign change of the order parameter for electrons and holes with different in-plane momenta. In our geometry, we find that the gap is insensitive to such defects, which is consistent with the b–c surface of CeCoIn5 having a d-wave order parameter with a uniform phase (see schematic in Fig. 4g).

Application of a magnetic field induces vortices and eventually quenches superconductivity through a first-order phase transition to create a pseudogap state in CeCoIn524,30,32,33,34,35. We first discuss our STM spectroscopic measurements which reveal signatures of superconductivity up to a magnetic field H*, which is higher than the upper critical field Hc2 obtained from bulk thermodynamic studies36. The evolution of the spectra with magnetic field (measured between vortices, see below) is shown in Fig. 4b. There is a jump in the zero-bias conductance between 12.3 T and 12.5 T, which is associated with a first-order transition, in this case out of the superconducting state into a pseudogap state. Similar jumps in the spectra were reported in a previous study for the field applied along the c-axis30. However, this H* = 12.3 T transition field is above the bulk Hc2 = 11.8 T measured with thermodynamic techniques in CeCoIn5 samples from the same batch. Differences between measurements of Hc2 from transport and thermodynamic studies have been previously reported in related heavy fermion systems (see Methods section and refs.46,47,48). While we currently do not have a full explanation for this apparent difference between the STM-measured H* and the bulk Hc2 values, our STM data suggest that superconductivity survives locally to fields larger than the bulk Hc2.

Unlike the superconducting state, the pseudogap phase of CeCoIn5 shows a layer-dependent behavior similar to the confined electronic nature of the normal state discussed above. The LDOS exhibits pronounced variations on the atomic scale, as shown in Fig. 4d for H = 13 T (which is above the bulk Hc2 and surface measured H*). In layer A, the spectrum resembles the normal state at zero field and displays only the hybridization gap; in contrast, layer B exhibits an additional suppression of conductance over a smaller energy range around the Fermi level, indicative of a pseudogap. These results are consistent with previous observations that the pseudogap in CeCoIn5 is observed only when tunneling into the layer B, where there is strong coupling to f-electrons30. By imaging in cross-section, we not only confirm that the pseudogap feature is associated with the layers exhibiting heavy electronic behavior but also demonstrate that this phase varies on the atomic scale on a single cleaved surface, in sharp contrast to the superconducting phase. Observation of a spectroscopic signature of a pseudogap is consistent with transport studies of CeCoIn524,32,34,35, although there has been effort to explain this observation based on a heavy quasiparticle band structure effect49.

### Vortex lattice transition of a Pauli-limited superconductor

In the presence of a magnetic field, the superconducting state develops vortices, and our cross-sectional technique allows us to visualize the anisotropy of the electronic behavior in the resulting vortex state of CeCoIn5. By probing vortices in the b–c plane, we extract a direction-dependent characteristic coherence length, map the unusual vortex lattice structure, and directly image the transition of a Pauli-limited superconductor. A series of maps obtained in the same area between 9 T and 12.3 T are shown on Fig. 5a–e (also see Supplementary Fig. 5), where the lighter elongated regions of high conductance correspond to vortex cores, and the red dots represent the fitted center of mass of each vortex. We present background subtracted conductance maps to suppress the effect of conductance variations due to different surface terminations and defects in the field of view (Supplementary Note 4, Supplementary Fig. 4 and ref.50). Although the shape of individual vortices is disordered due to surface inhomogeneity and impurities, they exhibit an overall ellipsoid shape. To suppress the effects of inhomogeneity, we overlay all (~90) vortices measured at various fields through their center of mass. The resulting average vortex displays an azimuthally asymmetric core (Fig. 5f), which is a manifestation of the anisotropic coherence length in the b–c plane. Although a detailed model calculation of the local density of states that includes the multiband nature of CeCoIn5 is needed to fully characterize the vortex core shape, we extract characteristic lengths from our data by fitting the decay of the vortex conductance as function of distance r from the center at different angles $$\phi$$ with respect to the c-axis according to $$G( {r,\phi } )\!\sim\! e^{ - r/\xi ( \phi )}$$51. From this fit, we find characteristic lengths of $$\xi ^c =$$ 30 Å along the c-axis to $$\xi ^b =$$ 65 Å along the b-axis (Fig. 5g), which are consistent with values estimated for the in- and out-of-plane coherence lengths from measurements of the angle dependence of H c2 14. Conductance maps taken at various energies confirm the presence of the zero bias peak inside the vortex core (Fig. 5h and Supplementary Fig. 6).

Our high magnetic field measurements in the b–c plane demonstrate an unusual structural transition in the vortex lattice which is different from the ones found when the magnetic field was applied in the [001] or [110] direction52,53,54. As illustrated in Fig. 5, for H < 11 T, the vortices are arranged in a distorted hexagonal Abrikosov lattice with a field-independent β = 41 ± 2° opening angle, in excellent agreement with small angle neutron scattering studies54. However, when the magnetic field is increased above 11 T, a previously unreported vortex lattice transition occurs. In this phase, the vortices are arranged in rows along the c-direction, with larger spacing along the a-axis. One possible cause of such a change of the vortex lattice could be the onset of the Q-phase. However, such transition in the vortex lattice could also result from various effects such as the strong local anisotropy of the vortices, nonlocal electrodynamic effects between them, or superconducting gap symmetry effects55.

Finally, by mapping the electronic structure in close proximity of H* we directly image the transition of a Pauli-limited superconductor to its normal state39,40,53. Generally, two effects of the applied magnetic field govern the physics of a superconducting condensate: the kinetic energy of the supercurrent around the vortices and the Pauli energy of the electron spins coupled to the external field. In an orbital limited superconductor, the superconductivity is suppressed by the overlap of vortices, while in a Pauli-limited case, the Cooper pairs are destroyed by breaking the spin-singlet state, as is the case in CeCoIn5. Imaging the vortex state near the critical field at H* = 12.3 T (Fig. 5e) shows the coexistence of a normal region and vortices in the same field of view, while above H* only normal regions are present (Supplementary Fig. 5). Due to the short anisotropic coherence length, the distance between the cores and the orbiting supercurrents is large, which allows the Pauli-paramagnetic effects to dominate the orbital effects in CeCoIn5. Moreover, the emergence of domains is expected to occur for first-order phase transitions; the coexistence of both normal and superconducting regions therefore provides a direct visualization of the first-order superconducting phase transition in CeCoIn5.

## Discussion

In conclusion, we have explored the influence of the layered material structure and reduced effective dimensionality of CeCoIn5 on its confined electronic properties by utilizing the STM as a cross-sectional probe for samples cleaved along the [100] direction. Spectroscopic measurements performed in the normal and superconducting states demonstrate the effects of quasi-two-dimensionality, from varying effective electron mass on the atomic scale and confined quasiparticle scattering to layer-dependent pseudogap behavior and anisotropic vortex structure in the superconducting state. Imaging these dramatic effects in cross-section offers a direct illustration of quasi-2D electronic behavior in this archetypal correlated electron system.

## Methods

### Sample growth and preparation

The single-crystal samples used for the measurements were grown from excess indium at Los Alamos National Laboratory. Crystals with large thickness in the c-direction were chosen for the measurements, cut into suitable sizes (with dimensions in all directions of ~0.5–2 mm), oriented, and glued to the sample holder with the [100] surface facing up. An aluminum post with the same horizontal dimension was glued to the top of the sample and used to cleave the sample along the c-axis in ultra-high vacuum at room temperature. Immediately after cleaving the samples, they were inserted into our home-built STMs. We used a variable temperature STM for the T = 10–20 K temperature measurements and a dilution fridge STM for the low temperature ($$T \approx 400$$ mK) and high magnetic field experiments. A large number of samples (around 30) were cleaved in both setups, and each cleaved sample was approached multiple times (using long range piezoelectric motion). On the cleaved samples, we found atomically flat surfaces suitable for STM measurements with a success rate around 10% of the approaches. Differential conductance measurements were performed using standard lock-in techniques, with voltage bias applied to the sample.

### Theoretical model of the tunneling density of states

To capture the spectroscopic features (Fig. 2), we use a theoretical model56,57, which was previously successfully applied to data acquired on the a–b surface of CeCoIn530,41. In this model, the differential conductance dI/dV can be obtained from the interference of tunneling paths into two channels: the light and heavy electronic excitations.

The dispersion of the conduction band is

$${\it{\epsilon }}_{\boldsymbol{k}} = 2t(\cos k_x + \cos k_y) - \mu$$

whereas for the heavy band it is

$$\chi _k = - 2\chi _0(\cos k_x + \cos k_y) - 4\chi _1\cos k_x\cos k_y + {\it{\epsilon }}_f$$

where k x and k y are the wavevectors, t is the nearest neighbor hopping, $$\mu$$ is the chemical potential, $$\chi _0$$ and $$\chi _1$$ correspond to the antiferromagnetic correlation between the f moments, and $${\it{\epsilon }}_f$$ can be associated with the chemical potential for the f-electrons.

The components of the full Green’s function are

$$G_{ff}({\mathbf{k}},\omega ) = \left\{ {\left[ {G_{ff}^0\left( {{\mathbf{k}},\omega } \right)} \right]^{ - 1} - s^2G_{cc}^0\left( {{\mathbf{k}},\omega } \right)} \right\}$$
$$G_{cc}\left( {{\mathbf{k}},\omega } \right) = \left\{ {\left[ {G_{cc}^0\left( {{\mathbf{k}},\omega } \right)} \right]^{ - 1} - s^2G_{ff}^0\left( {{\mathbf{k}},\omega } \right)} \right\}^{ - 1}$$
$$G_{cf}\left( {{\mathbf{k}},\omega } \right)= - G_{cc}^0\left( {{\mathbf{k}},\omega } \right)sG_{ff}\left( {{\mathbf{k}},\omega } \right),$$

where s describes the coupling between the magnetic moments and the conduction electrons and $$G_{ff}^0\left( {{\mathbf{k}},\omega } \right) = \left( {\omega - \chi _{\boldsymbol{k}} + i\Gamma _f} \right)^{ - 1}$$, $$G_{cc}^0\left( {{\mathbf{k}},\omega } \right) = \left( {\omega - \varepsilon _{\boldsymbol{k}} + i\Gamma _c} \right)^{ - 1}$$ with the corresponding inverse lifetimes of $$\Gamma _f$$ and $$\Gamma _c$$.

The dI/dV spectrum can be approximated as

$$\frac{{{\mathrm{d}}{I}\left( {{\mathbf{r}},\omega } \right)}}{{{\mathrm{d}}{V}}} \propto - {\mathrm{Im}}\mathop {\sum }\limits_{i,j = 1}^2 \left[ {\hat t\hat G\left( {{\mathbf{r}},\omega } \right)\hat t} \right]_{ij}$$

where $$\hat t = \left[ {\begin{array}{*{20}{c}} {t_c} & 0 \\ 0 & {t_f} \end{array}} \right]$$ describes the sensitivity to tunnel into heavy or light part of the electrons.

In our calculation, we use $$t = 200$$ meV, $$\mu = 2t$$, $$\chi _0 = 0.01t$$, $$\chi _1 = 0.06\chi _0$$, $${\it{\epsilon }}_f = 0.035t$$, $$s = 0.15t$$, and $$\Gamma _c = \Gamma _f = 0.015t$$, and vary the $$t_f/t_c$$ ratio as a function of position with respect to the two-dimensional layers (Fig. 2d, h).

### The upper critical field identified by different techniques

Our STM measurements carried out in magnetic fields applied in the [100] direction show the absence of the signatures of superconductivity at the field of H* = 12.3 T, which is higher than the previously reported upper critical field Hc2 values36. Our samples are of high quality and show bulk thermodynamic Hc2 = 11.8 T, consistent with many other previous studies. Here, we discuss possible reasons for the experimental observation that superconductivity locally survives above the bulk Hc2.

We first emphasize that our STM measurements clearly show that there is a superconducting gap (measured outside of the vortices), which evolves smoothly from lower fields, and survives up to 12.3 T (Fig. 4b). The difference between the superconducting gap and the pseudogap is clear in our measurements, as there is a jump in the zero energy conductance between 12.3 T and 12.5 T. Spectroscopic imaging as a function of field (Fig. 5) also clearly shows the vortex lattice surviving through the bulk Hc2, and the lack of overlap between the vortices is consistent with the Pauli-limited nature of superconductivity in this compound. Furthermore, the observation of coexisting normal regions and superconducting areas with vortices at 12.3 T is consistent with a first-order superconducting phase transition.

A second important point is that in the CeMIn5 (M = Co, Rh, Ir) superconductors, one often finds a significant difference between the upper critical field determined from bulk measurements (e.g., specific heat, nuclear magnetic resonance) compared to Hc2 determined from transport measurements (see, for example refs.46,47,48). Usually, this difference between Hc2transport and Hc2bulk occurs when antiferromagnetism is present above the superconducting transition. CeIrIn5 is a notable exception, with no obvious antiferromagnetic transition observed above the bulk superconducting transition at Tcbulk = 0.4 K, while Tctransport = 1.3 K with a corresponding difference in Hc2bulk = 0.9 T < Hc2transport = 7 T for fields applied in the ab plane48. Based on the similarities of CeCoIn5 to CeIrIn5 (i.e., no antiferromagnetism present above Tc in zero magnetic field) and on our experimental findings (presence of the vortex lattice and evidence of the superconducting gap from dI/dV measurements) we conclude that superconductivity in CeCoIn5 is observed up to H* = 12.3 T (H||a).

Our STM measurements, which are uniquely sensitive to the electronic structure on the surface, are the first local measurements to provide insight into the superconducting properties of CeCoIn5 near Hc2 for fields applied in the [100] direction. We hope that this result will stimulate further work to understand the origin of the discrepancy in measured upper critical field from different techniques.

### Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

## References

1. Norman, M. R. The challenge of unconventional superconductivity. Science 332, 196–200 (2011).

2. Monthoux, P., Pines, D. & Lonzarich, G. G. Superconductivity without phonons. Nature 450, 1177–1183 (2007).

3. Scalapino, D. J. A common thread: the pairing interaction for unconventional superconductors. Rev. Mod. Phys. 84, 1383–1417 (2012).

4. Monthoux, P. & Lonzarich, G. p-wave and d-wave superconductivity in quasi-two-dimensional metals. Phys. Rev. B 59, 14598–14605 (1999).

5. Petrovic, C. et al. Heavy-fermion superconductivity in CeCoIn5 at 2.3 K. J. Phys. Condens. Matter 13, L337–L342 (2001).

6. Bianchi, A., Movshovich, R., Vekhter, I., Pagliuso, P. G. & Sarrao, J. L. Avoided antiferromagnetic order and quantum critical point in CeCoIn5. Phys. Rev. Lett. 91, 257001 (2003).

7. Paglione, J. et al. Field-induced quantum critical point in CeCoIn5. Phys. Rev. Lett. 91, 246405 (2003).

8. Sarrao, J. L. & Thompson, J. D. Superconductivity in cerium- and plutonium-based ‘115’ materials. J. Phys. Soc. Jpn. 76, 051013 (2007).

9. Pfleiderer, C. Superconducting phases of f-electron compounds. Rev. Mod. Phys. 81, 1551–1624 (2009).

10. Thompson, J. D. & Fisk, Z. Progress in heavy-fermion superconductivity: Ce115 and related materials. J. Phys. Soc. Jpn. 81, 011002 (2012).

11. Mathur, N. D. et al. Magnetically mediated superconductivity in heavy fermion compounds. Nature 394, 39–43 (1998).

12. Hall, D. et al. Electronic structure of CeRhIn5: de Haas–van Alphen and energy band calculations. Phys. Rev. B 64, 064506 (2001).

13. Hall, D. et al. Fermi surface of the heavy-fermion superconductor CeCoIn5: the de Haas–van Alphen effect in the normal state. Phys. Rev. B 64, 212508 (2001).

14. Settai, R. et al. Quasi-two-dimensional Fermi surfaces and the de Haas-van Alphen oscillation in both the normal and superconducting mixed states of CeCoIn5. J. Phys. Condens. Matter 13, L627–L634 (2001).

15. Oppeneer, P. M. et al. Fermi surface changes due to localized–delocalized f-state transitions in Ce-115 and Pu-115 compounds. J. Magn. Magn. Mater. 310, 1684–1690 (2007).

16. Malinowski, A. et al. c-axis magnetotransport in CeCoIn5. Phys. Rev. B 72, 184506 (2005).

17. Howald, L. et al. Strong pressure dependence of the magnetic penetration depth in single crystals of the heavy-fermion superconductor CeCoIn5 studied by muon spin rotation. Phys. Rev. Lett. 110, 017005 (2013).

18. Ma, Y. C., Liu, J. W., Lu, H. W. & Zheng, H. L. Out-of-plane temperature-dependent resistivity studies on Tl-based superconductors. J. Phys. Condens. Matter 19, 186203 (2007).

19. Movshovich, R. et al. Unconventional superconductivity in CeIrIn5 and CeCoIn5: specific heat and thermal conductivity studies. Phys. Rev. Lett. 86, 5152–5155 (2001).

20. Bauer, E. D. et al. Structural tuning of unconventional superconductivity in PuMGa5 (M=Co; Rh). Phys. Rev. Lett. 93, 147005 (2004).

21. Pagliuso, P. G. et al. Coexistence of magnetism and superconductivity in CeRh1−xIrxIn5. Phys. Rev. B 64, 100503(R) (2001).

22. Shishido, H. et al. Tuning the dimensionality of the heavy fermion compound CeIn3. Science 327, 980–983 (2010).

23. Mizukami, Y. et al. Extremely strong-coupling superconductivity in artificial two-dimensional Kondo lattices. Nat. Phys. 7, 849–853 (2011).

24. Izawa, K. et al. Angular position of nodes in the superconducting gap of quasi-2D heavy-fermion superconductor CeCoIn5. Phys. Rev. Lett. 87, 057002 (2001).

25. Park, W. K., Sarrao, J. L., Thompson, J. D. & Greene, L. H. Andreev reflection in heavy-fermion superconductors and order parameter symmetry in CeCoIn5. Phys. Rev. Lett. 100, 177001 (2008).

26. Xiao, H. et al. Pairing symmetry of CeCoIn5 detected by in-plane torque measurements. Phys. Rev. B 78, 014510 (2008).

27. Stock, C. et al. Spin resonance in the d-wave superconductor CeCoIn5. Phys. Rev. Lett. 100, 087001 (2008).

28. Sumiyama, A. et al. Point-contact study of the heavy-fermion superconductor CeCoIn5. J. Phys. Chem. Solids 69, 3018–3021 (2008).

29. An, K. et al. Sign reversal of field-angle resolved heat capacity oscillations in a heavy fermion superconductor CeCoIn5 and pairing symmetry. Phys. Rev. Lett. 104, 037002 (2010).

30. Zhou, B. B. et al. Visualizing nodal heavy fermion superconductivity in CeCoIn5. Nat. Phys. 9, 474–479 (2013).

31. Allan, M. P. et al. Imaging Cooper pairing of heavy fermions in CeCoIn5. Nat. Phys. 9, 468–473 (2013).

32. Sidorov, V. A. et al. Superconductivity and quantum criticality in CeCoIn5. Phys. Rev. Lett. 89, 157004 (2002).

33. Ernst, S. et al. Scanning tunneling microscopy studies on CeCoIn5 and CeIrIn5. Phys. Stat. Sol. B 247, 624–627 (2010).

34. Onose, Y., Li, L., Petrovic, C. & Ong, N. P. Anomalous thermopower and Nernst effect in CeCoIn5: loss of entropy current in precursor state. Europhys. Lett. 79, 17006 (2007).

35. Urbano, R. R. et al. Interacting antiferromagnetic droplets in quantum critical CeCoIn5. Phys. Rev. Lett. 99, 146402 (2007).

36. Bianchi, A., Movshovich, R., Capan, C., Pagliuso, P. G. & Sarrao, J. L. Possible Fulde-Ferrell-Larkin-Ovchinnikov superconducting state in CeCoIn5. Phys. Rev. Lett. 91, 187004 (2003).

37. Kenzelmann, M. et al. Coupled superconducting and magnetic order in CeCoIn5. Science 321, 1652–1654 (2008).

38. Aperis, A., Varelogiannis, G. & Littlewood, P. B. Magnetic-field-induced pattern of coexisting condensates in the superconducting state of CeCoIn5. Phys. Rev. Lett. 104, 216403 (2010).

39. Bianchi, A. et al. First-order superconducting phase transition in CeCoIn5. Phys. Rev. Lett. 89, 137002 (2002).

40. Tayama, T. et al. Unconventional heavy-fermion superconductor CeCoIn5: dc magnetization study at temperatures down to 50 mK. Phys. Rev. B 65, 180504(R) (2002).

41. Aynajian, P. et al. Visualizing heavy fermions emerging in a quantum critical Kondo lattice. Nature 486, 201–206 (2012).

42. Gyenis, A. et al. Quasi-particle interference of heavy fermions in resonant x-ray scattering. Sci. Adv. 2, e1601086 (2016).

43. Shim, J. H., Haule, K. & Kotliar, G. Modeling the localized-to-itinerant electronic transition in the heavy fermion system CeIrIn5. Science 318, 1615–1617 (2007).

44. Haule, K., Yee, C.-H. & Kim, K. Dynamical mean-field theory within the full-potential methods: electronic structure of CeIrIn5, CeCoIn5, and CeRhIn5. Phys. Rev. B 81, 195107 (2010).

45. Crommie, M. F., Lutz, C. P. & Eigler, D. M. Imaging standing waves in a two-dimensional electron gas. Nature 363, 524–527 (1993).

46. Park, T. et al. Textured superconducting phase in the heavy fermion CeRhIn5. Phys. Rev. Lett. 108, 077003 (2012).

47. Petrovic, C. et al. A new heavy-fermion superconductor CeIrIn5: a relative of the cuprates? Europhys. Lett. 53, 354–359 (2001).

48. Bianchi, A. et al. Origin of the zero-resistance anomaly in heavy fermion superconducting CeIrIn5: a clue from magnetic-field and Rh-doping studies. Phys. Rev. B 64, 220504(R) (2001).

49. Van Dyke, J. S., Séamus, J. C. D. & Morr, D. K. Differential conductance and defect states in the heavy-fermion superconductor CeCoIn5. Phys. Rev. B 93, 041107(R) (2016).

50. Hoffman, J. E. et al. A four unit cell periodic pattern of quasi-particle states surrounding vortex cores in Bi2Sr2CaCu2O8+δ. Science 295, 466–469 (2002).

51. Pan, S. H. et al. STM studies of the electronic structure of vortex cores in Bi2Sr2CaCu2O8+δ. Phys. Rev. Lett. 85, 1536–1539 (2000).

52. Eskildsen, M. R., Dewhurst, C. D., Hoogenboom, B. W., Petrovic, C. & Canfield, P. C. Hexagonal and square flux line lattices in CeCoIn5. Phys. Rev. Lett. 90, 187001 (2003).

53. Bianchi, A. D. et al. Superconducting vortices in CeCoIn5: toward the Pauli-limiting field. Science 319, 177–180 (2008).

54. Das, P. et al. Vortex lattice studies in CeCoIn5 with Hc. Phys. Rev. Lett. 108, 087002 (2012).

55. Maggio-Aprile, I., Renner, Ch, Erb, A., Walker, E. & Fischer, O. Direct vortex lattice imaging and tunneling spectroscopy of flux lines on YBa2Cu3O7−δ. Phys. Rev. Lett. 75, 2754–2757 (1995).

56. Yuan, T., Figgins, J. & Morr, D. K. Hidden order transition in URu2Si2 and the emergence of a coherent Kondo lattice. Phys. Rev. B 86, 035129 (2012).

57. Figgins, J. & Morr, D. K. Differential conductance and quantum interference in Kondo systems. Phys. Rev. Lett. 104, 187202 (2010).

## Acknowledgements

We thank Brian B. Zhou, Eduardo H. da Silva Neto, and Shashank Misra for the fruitful discussions. Work at Princeton was primarily supported by DOE-BES (DE-FG02-07ER46419) and Gordon and Betty Moore Foundation as part of EPiQS initiative (GBMF4530). This project was also made possible using the facilities at Princeton Nanoscale Microscopy Laboratory supported by grants through NSF-MRSEC programs through the Princeton Center for Complex Materials DMR-1420541, NSF-DMR-1608848, ONR-N00014-14-1-0330, ONR-N00014-13-10661, and Eric and Wendy Schmidt Transformative Technology Fund at Princeton. Work at Los Alamos National Laboratory was performed under the auspices of the US Department of Energy, Office of Basic Energy Sciences, Division of Materials Sciences and Engineering. B.E.F. acknowledges support from the Dicke Fellowship. M.T.R. acknowledges support from the NSF Graduate Research Fellowship. P.A. acknowledges funding from the U.S. National Science Foundation CAREER under award No. NSF-DMR 1654482.

## Author information

Authors

### Contributions

A.G., B.E.F., M.T.R., and G.A.P. performed the STM measurements. A.G., B.E.F., M.T.R., and P.A. analyzed the data. E.D.B. synthesized and characterized the materials. A.G., B.E.F., M.T.R., P.A., and A.Y. wrote the manuscript. All authors commented on the manuscript.

### Corresponding author

Correspondence to Ali Yazdani.

## Ethics declarations

### Competing interests

The authors declare no competing financial interests.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Gyenis, A., Feldman, B.E., Randeria, M.T. et al. Visualizing heavy fermion confinement and Pauli-limited superconductivity in layered CeCoIn5. Nat Commun 9, 549 (2018). https://doi.org/10.1038/s41467-018-02841-9

• Accepted:

• Published:

• DOI: https://doi.org/10.1038/s41467-018-02841-9

• ### Chiral superconductivity in heavy-fermion metal UTe2

• Lin Jiao
• Sean Howard

Nature (2020)