## Abstract

The optical theorem, which is a consequence of the energy conservation in scattering processes, directly relates the forward scattering amplitude to the extinction cross-section of the object. Originally derived for planar scalar waves, it neglects the complex structure of the focused beams and the vectorial nature of the electromagnetic field. On the other hand, radially or azimuthally polarized fields and various vortex beams, essential in modern photonic technologies, possess a prominent vectorial field structure. Here, we experimentally demonstrate a complete violation of the commonly used form of the optical theorem for radially polarized beams at both visible and microwave frequencies. We show that a plasmonic particle illuminated by such a beam exhibits strong extinction, while the scattering in the forward direction is zero. The generalized formulation of the optical theorem provides agreement with the observed results. The reported effect is vital for the understanding and design of the interaction of complex vector beams carrying longitudinal field components with subwavelength objects important in imaging, communications, nanoparticle manipulation, and detection, as well as metrology.

## Introduction

The optical theorem is a fundamental relation that emerges in both classical and quantum wave scattering phenomena^{1}. It relates the amplitude of a wave scattered from an object in the forward direction to its extinction cross-section. However, the rigorous proof of the commonly used form of the theorem strongly relies on the scalar nature of the considered waves^{1} and can be easily extended only to a simple vectorial case of transverse plane waves^{2,3,4}. While the former is usually true for acoustic or electron scattering (though even in the latter case, only for plane waves^{5}), for electromagnetic waves both the spatial distribution of the incident field and its polarization structure can be important. It has been shown that tightly focused Gaussian beams scattered by a small spherical particle partially violate the optical theorem^{6,7}. This violation is a direct consequence of the appearance of the longitudinal field components at the focal spot where the scattering object is located. The interaction of other beams of vectorial nature, such as radially or azimuthally polarized beams or complex vortex beams carrying optical angular momentum, with various nanostructures was studied both theoretically and experimentally^{8,9,10,11}, but the dynamics of the scattering of such beams and its relationship to the fundamental properties of the optical theorem have not been considered. Meanwhile, electromagnetic beams with complex vectorial fields are currently used in many important applications, including high-resolution imaging, radar detection, communication technology, nanoparticle trapping and manipulation, surface metrology and many others for which the optical theorem is widely used in system design and performance evaluation.

Many versions of the optical theorem have been formulated for scenarios involving different geometries of illumination for which the textbook form of the theorem cannot be applied. For example, the application of the optical theorem to the scattering in transmission lines has been studied^{12}, and generalizations for (i) nonlinear, time-varying and lossy materials^{13}, (ii) anisotropic embedding media^{14}, (iii) general inhomogeneous media^{15}, (iv) surface waves and layered media^{16}, and (v) evanescent fields^{17} have been theoretically derived. Nevertheless, in the majority of experimental studies where partial information regarding the scattering can be acquired, the optical theorem still tends to be applied in its conventional form.

In the present work, we experimentally demonstrate a complete violation of the conventional formulation of the optical theorem for vectorial beams and provide an experimental proof of its appropriate generalized version. Exploiting the vectorial structure of radially polarized beams in both optical and microwave spectral ranges, we study angular spectra of the scattering from subwavelength particles and show that scattering in the forward direction, which is favorable for the linearly polarized light illumination, vanishes under the radially polarized excitation even though the particle has a significant non-zero extinction cross-section. Therefore, the use of the conventional form of the optical theorem that establishes a direct relation between these two quantities is inappropriate. The violation of this connection was further confirmed in experiments for microwave radiation scattering through the mapping of the amplitude and phase of the forward scattering with a sub-diffraction resolution. As in the optical regime, the experimental results confirmed by numerical simulations, reveal strong overall scattering of the radially polarized beam with no forward scattering detected, in violation of the textbook optical theorem. Finally, the experimental and numerical results confirm the predictions based on the recent generalization of the optical theorem formulation.

## Materials and methods

### Finite element numerical modeling

Numerical analysis was performed using finite element software (COMSOL Multiphysics). The scattering from a 100 nm spherical gold nanoparticle (for which the permittivity data were taken from ref.^{18} was studied in the scattering-field formulation, with the simulation domain surrounded by a perfectly matched layer in order to guarantee the absence of back-reflection from the outer domain boundaries. The symmetry of the simulation setup (both the incident field and the object) was used to decrease the computational complexity. The simulation domain, which initially had a spherical form, was cut by two perpendicular planes intersecting along the beam axis. In the case of the plane wave illumination, these planes were the plane of the linear polarization and the wave vector plane perpendicular to it. For radial polarization, the azimuthal orientation of the planes is invariant due to the symmetry of the beam/object system. Only one quadrant of the space between these planes was used for numerical evaluation with the appropriate boundary conditions set on its flat edges (perfect magnetic conductor (PMC) for the polarization plane and perfect electric conductor (PEC) for the perpendicular plane in the case of linear polarization and PMC for both planes in the case of the radially polarized beam). The linearly polarized wave illumination was implemented in a straightforward manner, while the focused radially polarized beam field distribution obtained in the paraxial approximation^{19,20}, was corrected numerically. The latter approach allowed the implementation of highly focused beams with a numerical aperture of 0.4 in air, corresponding to the ~3500 nm beam waist in the studied 300–1000 nm wavelength range, and with a numerical aperture of 1.42 in immersion oil, corresponding to the 550–900 nm waist, which is wavelength-dependent due to tight focusing. The validity of the model was checked by benchmarking it against the results for scattering of a linearly polarized plane wave on a metallic nanoparticle from the literature^{21}. For all illumination scenarios (linear, radial, and azimuthal polarizations), the near field in the vicinity of the particle was numerically evaluated, while the far field was determined from the near field using the Stratton–Chu approach^{22}.

### Optical Fourier microscopy

Single-particle scattering experiments were performed in reflection using 100 nm gold colloidal nanoparticles. Dispersed nanoparticles were placed in oil between two microscope coverglasses in order to minimize the index mismatch. Single nanoparticle spectroscopy was performed using an inverted microscope in which the back focal plane of the objective is imaged onto a CCD camera, allowing direct imaging of the scattering pattern of a single nanoparticle. For illumination, incoherent white light from a tungsten-halogen lamp was filtered spatially with a 5 μm diameter aperture and spectrally with a bandpass filter (532 nm, Chroma), collimated and polarized linearly using a grid polarizer (Thorlabs). The polarization can be transformed into radial polarization using a polarization converter (Arcoptix, Switzerland). Linearly or radially polarized light was focused on the particle with a 1.49NA, ×100 objective (Nikon). A nanoparticle was collocated with the center of the beam using a piezostage. For detection, the back-scattered signal was collected by the same objective lens, and its back aperture was imaged on a CCD using a four-lens system. The final images were obtained by subtracting the background signal measured from the coverglass alone from the signal detected in the presence of the nanoparticle. The back-scattering geometry provides a much weaker background, allowing a better signal-to-noise ratio than that for the forward direction while still allowing the connection to the forward scattering behavior via numerical simulations.

### Microwave scanning microscopy

The microwave experiments emulate the optical setup and additionally provide direct measurement of amplitude and phase distributions of the forward scattered waves^{23}. The experiments were performed at the frequency of 9.5 GHz (corresponding to the wavelength *λ*=3.2 cm). A 3.5 mm sphere made from stainless steel was used as a scatterer. Both linearly and radially polarized beams were generated by a widely used conical horn antenna with an aperture diameter of 50 mm attached to a cylindrical waveguide fed by a coaxial cable^{24}. The polarization of the beam (either linear or radial) was achieved by exciting different modes of the waveguide. To obtain linear polarization, the antenna was fed by a standard coaxial waveguide connected to a vector network analyzer (VNA, Agilent PNA-L-N5230C), yielding the fundamental *H*_{11} mode excited in a cylindrical waveguide. The working frequency (9.5 GHz) was chosen such that no other linearly polarized mode can propagate in the waveguide of this size (WC94, inner diameter of 24 mm). To obtain radial polarization, the excitation of the first radial mode of the cylindrical waveguide, namely, the *E*_{01} mode, was used. Here, as well, the waveguide size restricts any other non-polarized cylindrical waveguide modes in the given frequency band. Since zero-order Bessel functions, which describe the radial field distributions of *H*_{11} and *E*_{01} modes, mimic a Gaussian distribution with at least 97% overlap in amplitude, the field distributions at the antenna aperture imitate linearly or radially polarized Gaussian beams (at least near the center of the aperture), which are radiated in the free space. The amplitude, phase and polarization profiles of the radiated beams were confirmed by amplitude-resolved and phase-resolved measurements at the distance of approximately 1.5 wavelengths from the antenna aperture. A 3.5 mm sphere made from stainless steel was placed at the distance of one wavelength from the antenna aperture along the beam axis. The measurements of the scattered field were performed in the near-field, recording both phase and amplitude information with a sub-diffraction resolution using a probe mounted on a planar near-field scanner (NSI Inc.) and connected to a VNA, which allows signal acquisition in the spectral range up to 100 GHz. Mechanical movement of the probe was controlled by the scanner. A calibrated NSI probe (open end of the rectangular waveguide), specifically designed to work in the X-band (8–12 GHz), was used for the measurements of the transverse linearly polarized field. On the other hand, a custom-made coaxial probe was used to measure the longitudinal *z*-component of the field. First, the amplitude and phase *x–y* maps of the total (incident and scattered) field were measured at the distance of *λ*/2 from the scatterer. Then, the amplitude and phase maps of the incident field (with the scatterer removed) were measured exactly at the same detection plane, again for both polarizations. Using these data, the amplitude and phase of the scattered field were determined via phase-resolved field subtraction.

## Results and discussion

### Conventional optical theorem and complex vectorial beams

The main contribution to the electromagnetic scattering from a subwavelength obstacle usually originates from a dipolar term in the multipolar decomposition. In other words, under linearly polarized plane wave illumination, the particle becomes predominantly polarized along the direction of the incident electrical field (if the magnetic response can be neglected) and re-radiates the energy according to the dipolar emission pattern. The highest intensity of the dipolar radiation propagates in the directions perpendicular to the dipole and, as the result, along the wave vector of the incident linearly polarized wave. Consequently, scattering in the forward direction (along the incident wave vector) is significant. The common formulation of the optical theorem postulates a direct proportionality between the scattering amplitude in the forward direction and the extinction cross-section^{1,2,3,4}. However, the situation can be drastically different for vectorial beams that may carry longitudinal field components, optical angular momentum or transverse spin^{25}. For example, radially polarized beams have a doughnut-like intensity profile for the transverse polarization directions and, most prominently, a strong longitudinal polarization component along the propagation direction at the beam axis^{26}. The intensity map and the electric field structure of a focused radially polarized beam, the scattering of which will be studied below, are presented in Fig. 1.

The optical theorem in its textbook formulation provides a straightforward way to calculate the nanoparticle extinction cross-section (\(C_{{\rm{ext}}}^{{\rm{OT}}}\)) by relating its magnitude to the value of the far-field component of the normalized scattered electric field amplitude evaluated in the forward direction (along the incident wave vector) \({\mathbf{e}}_{{\rm{scat}}}^{{\rm{far}}}\left( {{\mathbf{k}} = {\mathbf{k}}_{{\rm{inc}}}} \right)\) ^{2,3,4}:

where **p** is the unit vector signifying the polarization of the incident wave, **k**_{inc} and **k** are the wave vectors of the incident and scattered waves, respectively,\(\left| {\mathbf{k}} \right| = \left| {{\mathbf{k}}_{{\rm{inc}}}} \right| = 2\pi \varepsilon _{\mathrm{d}}^{1/2}/\lambda \,\epsilon_{d}\), is the permittivity of the surrounding dielectric, and \({\mathbf{e}}_{{\rm{scat}}}^{{\rm{far}}}\left( {{\mathbf{k}} = {\mathbf{k}}_{{\rm{inc}}}} \right)\) is related to the scattered electric field \({\mathbf{E}}_{{\rm{scat}}}^{{\rm{far}}}\left( {\mathbf{r}} \right)\) as follows:

where \(\left| {{\mathbf{E}}_0} \right|\) is the amplitude of the incident wave.

Alternatively, the extinction cross-section can be evaluated directly,

as the sum of the absorption \(C_{{\rm{abs}}}^{{\rm{dir}}}\) and scattering \(C_{{\rm{scat}}}^{{\rm{dir}}}\) cross-sections. The absorption cross-section can be calculated as an integral of the absorption losses over the nanoparticle volume *V*, normalized to the incident power flow:

where **E**_{0} and **E** are the incident and total electric fields, respectively, and **D** is the electric displacement. The scattering cross-section can be calculated as an integral of the intensity of the scattered fields over a surface *S* enclosing the particle, normalized to the same incident field intensity:

where \({\mathbf{P}}_{{\rm{scat}}}^{{\rm{far}}}\) is the power flow of the scattered waves. We note that other semi-analytical approaches, such as multipole expansion, can also be applied for calculations of extinction cross-sections for linearly or radially polarized beams^{19}.

For the plane wave illumination of a gold nanoparticle, the direct method for the calculation of the extinction cross-section (\(C_{{\rm{ext}}}^{{\rm{dir}}}\)) and the method based on the optical theorem (\(C_{{\rm{ext}}}^{{\rm{OT}}}\)) show excellent agreement (Fig. 2a). The extinction in the spectral range *λ* = 480–550 nm corresponds to the plasmonic dipolar resonance of the particle. The angular distribution of the far-field scattering has the characteristic shape corresponding to a dipolar radiation pattern, namely, cos^{2}*φ*, where *φ* is the scattering angle (Fig. 2c). As expected, the scattering dipole is induced along the *y*-direction along the polarization of the incident plane wave.

The situation is drastically different for the radially polarized incident beam. The wavelength dependence of the extinction cross-section calculated using the direct integration method shows a distinctive peak at the localized surface plasmon resonance of the particle (Fig. 2b, black line), which is in good agreement with the case of the plane wave excitation (Fig. 2a). At the same time, the extinction cross-section evaluated using the optical theorem given by Eq. (1) is practically zero (Fig. 2b, red line), within a numerical noise defined by the accuracy of the simulations. This means that the optical theorem in its common form cannot be applied for such beams. Here, we note that for the case of optical beams focused to dimensions comparable to the size of the scattering object, reconsideration of the usual notion of the cross-section is required due to the variation of the beam intensity across the object. For example, in the case of scattering of localized electron wave packets, this was done via the definition of the cross-section through the number of the scattering events, normalized to the introduced effective luminosity of the wave packet^{5}. In our case, in analogy to this approach, we used the power extinguished from the beam (equivalent to the number of photons removed from the beam), normalizing it for simplicity to the maximum intensity in the focal plane (Fig. 1).

The apparent contradiction created by the optical theorem described by Eq. (1) can be understood from the angular scattering diagram (Fig. 2d). For the radially polarized beam, the entire nanoparticle is located in the region of space where the longitudinal component of the incident field dominates (Fig. 1) and the transverse polarization is vanishingly small. Furthermore, it has an axisymmetric structure with the transverse fields directed out of the beam axis at the location of the scatterer, prohibiting the excitation of a transverse dipolar mode (Fig. 1). Consequently, the dipole moment in the particle is excited only by the longitudinal components along the beam axis, giving rise to pronounced energy re-radiation directed perpendicular to the latter. The dipolar excitation also causes the related absorption losses in the metal particle. This leads to significant non-zero values of scattering and absorption cross-sections, resulting in a considerable value of the extinction cross-section. However, the optical theorem given by Eq. (1) fails to reflect this: due to the symmetry, the re-radiation of the longitudinal dipole in the forward direction (along the dipole axis) is zero, and therefore, the optical theorem returns a zero extinction cross-section (Fig. 2d). The visual comparison between Fig. 2c and d suggests that they are almost perfect replicas of each other if a 90° rotational transformation is applied to either one of them. This observation enables us to draw an intuitive conclusion regarding the source of the violation of the optical theorem in this formulation. Instead of traveling along the optical axis, the scattering is deflected by 90°, which is the optimal angle for minimizing the forward scattering. Moreover, as seen in Fig. 2e, f, the violation also occurs in the case of a nonresonant excitation at *λ* = 520 nm for the nanoparticle in oil (the resonance is moved in this case to *λ* = 600 nm), which was experimentally examined in further studies described in the next section. In the case of the focused Gaussian beam, both transverse (dominant) and longitudinal (which are the consequence of focusing) components are present at the particle position. As was shown above, for the latter components, there is a complete violation of the optical theorem, while for the former components, the optical theorem holds, overall leading to a partial theorem violation. Generally, stronger beam focusing corresponds to a higher ratio between the longitudinal and transverse components and a more significant violation of the optical theorem. As was found in ref.^{5} for the axisymmetric scattering of vortex electron wave packets, zero forward scattering and yet a non-zero overall scattering cross-section can be observed even for scalar localized incident fields of a complex structure with a vortex phase change around the wave packet axis. However, the vectorial nature of the electromagnetic field essentially amplifies the effect: the zero divergence of the electromagnetic field at the node of the fields at the beam axis leads to the presence of the longitudinal field components, resulting in efficient excitation of the dipolar mode in the nanoparticle along the beam axis and thus efficient scattering, resulting in essential extinction simultaneously with zero forward scattering.

### Experimental investigation of scattering in the optical domain using Fourier microscopy

To verify the predictions of the numerical modeling, single-particle spectroscopy was performed, allowing the direct imaging of the scattering pattern (Materials and methods section) (Figure 3a). First, linearly polarized excitation was studied with a flat linearly polarized wavefront at the center of the focal spot. These excitation conditions can be directly compared to a plane wave excitation implemented in the simulations. Figure 3b, c show excellent agreement of the experimental and theoretical angular distribution in the back-scattering zone, clearly demonstrating a wave vector distribution that is symmetric with respect to the *k*_{y} = 0 plane with gradually decreasing magnitude toward higher *k*_{y}. They directly demonstrate the excitation of a dipole along the excitation polarization direction, as seen from the field map cross-sections of the full scattering diagram (Fig. 2e). Due to the nature of the Fourier plane detection, the number of the wave vectors per (*dk*_{x}, *dk*_{y}) interval is recorded. Hence, for a uniform angular distribution, the wave vectors scattered at higher angles have higher density than those close to the optical axis. This explains the higher intensities at the sides of the Fourier images in Fig. 3b, c for higher *k*_{x}.

For radial polarization, the experimental and numerical observations are again in excellent agreement (cf. Fig. 3d, e). It can be seen that the Fourier intensity in the entire central region of the map around *k*_{x} = *k*_{y} = 0 is virtually zero, gradually increasing toward higher *k*_{x} and *k*_{y} and clearly possessing a polar angular symmetry. Since the subwavelength size of the sphere only allows the dipolar plasmonic resonance, this provides clear evidence that the direction of the excited dipole is along the *z*-axis, which can be easily seen by the comparison of wave vector distributions in the Fourier images with the full scattering diagram in Fig. 2f. Such an orientation of the excited dipole inevitably leads to the absolute zero value of the scattering field (and consequently its imaginary part) in the forward direction along the *z*-axis. Hence, we demonstrated a complete violation of the optical theorem in its conventional form for radially polarized beams both experimentally and numerically: while the optical theorem predicts an extinction cross-section to be zero \(C_{{\rm{ext}}}^{{\rm{OT}}} = 0\) (Eq. (1)) on the basis of the zero scattering along the incident wave vector, a considerable extinction cross-section of the particle is observed with strong scattering of the incident radially polarized beam in the direction of large *k*_{x} and *k*_{y} wave vectors.

### Scanning microscopy of a scattered field in the microwave domain

The microwave scattering experiments emulate the optical setup and provide direct measurements of the amplitude and phase distributions of the scattered waves^{23}. The distributions of the scattered field amplitude in the forward direction demonstrate very good agreement with the modeling results (cf. Fig. 4b–e). For the linearly polarized illumination, the radiation profile corresponds to the dipolar moment excited along the direction of the incident polarization (Fig. 4b). On the other hand, the radiation profile in the case of the radially polarized illumination provides unambiguous evidence for the dipole moment excitation in the *z*-direction, along the beam axis (Fig. 4d). Again, the conventional formulation of the optical theorem is violated in this case: an essential scattering signal (and, therefore, considerable extinction cross-section) is evident, while Eq. (1) predicts zero extinction on the basis of the zero field measured in the forward direction (along the *z*-axis).

The fact that the facet of the probe rectangular waveguide lies in the measurement plane and, therefore, has a lower acceptance of the incident wave at higher angles leads to the smaller measured signal in this region, explaining the related difference between the experimental and theoretical field maps (cf. Fig. 4b with d and Fig. 4c with e). Also, the metallic sphere was held in the setup by a sample holder made of a plastic foam sheet. The sheet is nearly transparent for microwaves (*ε*~1.1) and, thus, did not essentially influence the results, although its presence can explain minor radial interference fringes observed in the experimental field maps (Fig. 4b, d).

### Generalization of the optical theorem

These numerical and experimental observations provide strong motivation for the development and application of generalized formulations of the optical theorem^{27}. This can be achieved by considering a relation linking extinction to incident (**E**_{0}(**r**), **H**_{0}(**r**)) and total (**E**(**r**), **H**(**r**)) fields valid for any vectorial structure of the field^{27}:

where *η*(**r**) and *χ*(**r**) are the electric and magnetic susceptibilities of the scatterer and the integration is taken over the scatterer volume *V*. The incident beam in free space is then represented by an arbitrary complex vectorial structure allowed by Maxwell’s equations and treated as a superposition of plane waves (generally also allowing the evanescent components) with amplitudes **e**(**k**). The extinction cross-section can then be expressed by projecting the amplitudes of the scattered components \({\mathbf{e}}\left( {{\mathbf{k}}_1} \right){\mathbf{A}}\left( {{\mathbf{k}}_1,{\mathbf{k}}_2^ \ast } \right)\) from each of the partial incident waves **e**(**k**_{1}) on all other incident components **e**(**k**_{2}) and integrating over all possible directional combinations of **k**_{1} and **k**_{2}:

Here, \(A_{\alpha \beta }\left( {{\mathbf{k}}_1,{\mathbf{k}}_2^ \ast } \right)\) are the components of the scattering amplitude tensor \({\mathbf{A}}\left( {{\mathbf{k}}_1,{\mathbf{k}}_2^ \ast } \right)\), double indices imply summation and || denotes the projection on the *z*-axis. Applying this approach to the scattering of both linearly and radially polarized light, it was found that the generalized optical theorem (Eqs. (6) and (7)) provides results in excellent agreement with the direct evaluation of the extinction cross-section using Eqs. (3–5) (Fig. 5a, b), revealing its validity even for the vectorial case. We note that in the derivation of the generalized optical theorem, no assumptions regarding the shape of the incident beam and the scattering object were made, e.g., complex fields including evanescent components and objects with an optical response dominated by magnetic dipoles or electric quadrupoles can be considered. The form of the optical theorem given by Eq. (6) is very convenient for approaching the problem with numerical simulations, allowing straightforward integration of the resulting electromagnetic fields. On the other hand, the form given by Eq. (7) is more suitable for analytical and semi-analytical calculations. Finding \({\mathbf{A}}\left( {{\mathbf{k}}_1,{\mathbf{k}}_2^ \ast } \right)\) and evaluating the scattering of a plane wave by an object of a given shape are generally within the capabilities of analytical calculations^{28}. Then, the double integration over the wave vectors for simple scatterers can be done analytically; otherwise, numerical evaluation can be performed using standard software.

The optical theorem was further tested in the case of the scattering of a focused azimuthally polarized beam (with the same parameters as for the radially polarized beam in Fig. 2) on a 100 nm spherical gold nanoparticle. Numerical modeling shows that the generalized version of the optical theorem (Eqs. (6) and (7), dashed green line in Fig. 5c) provides the correct prediction of the value of the extinction cross-section, while the conventional formulation (Eq. (1), solid red line in Fig. 5c) proves to be inadequate. Due to the vectorial structure of the beam signified by the absence of the electric terms in its multipole decomposition^{29}, the electric resonances that play a leading role in the optical response of a spherical plasmonic particle are not excited. This leads to much lower extinction cross-section values compared to linearly and radially polarized excitations (cf. Fig. 5c and Fig. 5a, b). In particular, the peak at the wavelength of 520 nm corresponding to the dipole resonance is no longer present for the azimuthal polarization. The observed small increase in the extinction cross-section toward the shorter wavelengths is related to the increase of the absorption in the metal.

## Conclusions

A violation of the standard formulation of the optical theorem was demonstrated both experimentally and numerically for illumination with radially polarized electromagnetic beams featuring strong longitudinal field components. Optical measurements were complemented by experiments in the microwave domain. The experiments together with comprehensive numerical modeling show clear evidence of the breakdown of the textbook version of the optical theorem. The origin of the breakdown has been identified to be mainly due to the presence of longitudinal field components in the complex vector beams. Rather than creating a paradox, this violation provides the evidence of the need for the reconsideration of the conditions required for satisfying this theorem, which was originally formulated for scalar and transverse vectorial waves. The generalized formulation of the optical theorem^{27} was shown to be in agreement with our numerical and experimental results. Longitudinal field components and related transverse optical spin of the surface and guided modes also lead to an inverse photonic spin-Hall effect, which is impossible for transverse waves^{30}, and the emergence of lateral optical forces^{31}. Finally, we would like to note that a similar violation should be expected for another important type of complex beams – vortex beams (with a non-zero orbital angular momentum). In analogy to radially and azimuthally polarized beams, vortex beams have vortex phase changes around their axes. Due to the symmetry of the problem, the forward scattering for vortex beams is zero, and so is the extinction cross-section given by the standard expression for the optical theorem, while, in fact, the extinction cross-section is non-zero at least due the high-order (e.g., quadrupolar) scattering effects and, if present, due to the absorption.

To underline the importance of the generalization of the well-established physical rules to novel phenomena for which the original form of the rule is no longer applicable, it is interesting to draw the attention to an example having very close parallels to the effects studied in the manuscript, yet from a completely different area of physics. Specifically, this is the generalization of the Born approximation for the scattering of electrons on energy potentials in the case of localized electron wave packets instead of plane waves^{5}^{.}^{32}, Apart from reconsidering the definition of the cross-section when the incident field localization is comparable to the scatterer size, it was found that for twisted (vortex) incident electron wave packets, if the impact parameter of the incident wave packet is zero (the beam axis goes through the center of the axisymmetric scattering potential), the forward scattering is zero as well, while the overall cross-section is not, which is in complete analogy to the violation of the optical theorem for the radial and azimuthal optical beams considered here.

Since the optical theorem in different forms is frequently used in a broad range of applications, such as imaging, nanoparticle manipulation, communications, and radar detection, as well as in other areas of physics, e.g., for quantum scattering^{33}, these findings demonstrate that a careful reconsideration of the required conditions and the introduction of additional degrees of freedom are of key importance. The understanding and generalization of the optical theorem applicability can broaden the span of its applications. For example, consideration of the spin-flip in an electron scattering process could introduce another (vectorial) degree of freedom, which could have remarkable implications for the relationships between the total extinction and forward scattering.

## Data availability

All data supporting this research are provided in full in the results section.

## Additional information

Accepted article preview online: 26 April 2018

## References

- 1.
Born, M. & Wolf, E.

*Principles of Optics*7th edn. (Cambridge University Press, New York, 1999). - 2.
Jackson, J. D.

*Classical Electrodynamics*3rd edn. (Wiley, New York, 1999). - 3.
Bohren, C. F. & Huffman, D. R.

*Absorption and Scattering of Light by Small Particles*(Wiley, New York, 1998). - 4.
Mishchenko, M. I., Travis, L. D. & Lacis, A. A.

*Scattering, Absorption, and Emission of Light by Small Particles*(Cambridge University Press, Cambridge, 2002). - 5.
Karlovets, D. V., Kotkin, G. L., Serbo, V. G. & Surzhykov, A. Scattering of twisted electron wave packets by atoms in the Born approximation.

*Phys. Rev. A***95**, 032703 (2017). - 6.
Newton, R. G. Optical theorem and beyond.

*Am. J. Phys.***44**, 639–642 (1976). - 7.
Lock, J. A., Hodges, J. T. & Gouesbet, G. Failure of the optical theorem for Gaussian-beam scattering by a spherical particle.

*J. Opt. Soc. Am. A***12**, 2708–2715 (1995). - 8.
Şendur, K. & Şahinöz, A. Interaction of radially polarized focused light with a prolate spheroidal nanoparticle.

*Opt. Express***17**, 10910–10925 (2009). - 9.
Normatov, A. et al. Efficient coupling and field enhancement for the nano-scale: plasmonic needle.

*Opt. Express***18**, 14079–14086 (2010). - 10.
Lerman, G. M., Yanai, A. & Levy, U. Demonstration of nanofocusing by the use of plasmonic lens illuminated with radially polarized light.

*Nano. Lett.***9**, 2139–2143 (2009). - 11.
Chen, W. B., Abeysinghe, D. C., Nelson, R. L. & Zhan, Q. W. Plasmonic lens made of multiple concentric metallic rings under radially polarized illumination.

*Nano. Lett.***9**, 4320–4325 (2009). - 12.
Marengo, E. A. & Tu, J. Optical theorem for transmission lines.

*Prog. Electromagn. Res. B***61**, 253–268 (2014). - 13.
Marengo, E. A. & Tu, J. Generalized optical theorem in the time domain.

*Prog. Electromagn. Res. B***65**, 1–18 (2016). - 14.
Marengo, E. A. A new theory of the generalized optical theorem in anisotropic media.

*IEEE Trans. Antennas Propagat***61**, 2164–2179 (2013). - 15.
Dacol, D. K. & Roy, D. G. Generalized optical theorem for scattering in inhomogeneous media.

*Phys. Rev. E***72**, 036609 (2005). - 16.
Halliday, D. & Curtis, A. Generalized optical theorem for surface waves and layered media.

*Phys. Rev. E***79**, 056603 (2008). - 17.
Carney, P. S. The optical cross-section theorem with incident fields containing evanescent components.

*J. Mod. Opt.***46**, 891–899 (1999). - 18.
Johnson, P. B. & Christy, R. W. Optical constants of the noble metals.

*Phys. Rev. B***6**, 4370–4379 (1972). - 19.
Mojarad, N. M. & Agio, M. Tailoring the excitation of localized surface plasmon-polariton resonances by focusing radially-polarized beams.

*Opt. Express***17**, 117–122 (2009). - 20.
Gouesbet, G., Lock, J. A. & Gréhan, G. Generalized Lorenz–Mie theories and description of electromagnetic arbitrary shaped beams: Localized approximations and localized beam models, a review.

*J. Quant. Spectrosc. Radiat. Transf.***112**, 1–27 (2011). - 21.
Parsons, J., Burrows, C. P., Sambles, J. R. & Barnes, W. L. A comparison of techniques used to simulate the scattering of electromagnetic radiation by metallic nanostructures.

*J. Mod. Opt.***57**, 356–365 (2010). - 22.
Stratton, J. A. & Chu, L. J. Diffraction theory of electromagnetic waves.

*Phys. Rev.***56**, 99–107 (1939). - 23.
Kapitanova, P. V. et al. Photonic spin Hall effect in hyperbolic metamaterials for polarization-controlled routing of subwavelength modes.

*Nat. Commun.***5**, 3226 (2014). - 24.
Balanis, C. A.

*Antenna Theory: Analysis and Design*3rd edn (Wiley-Interscience, New York, 2005). - 25.
Bliokh, K. Y., Rodríguez-Fortuño, F. J., Nori, F. & Zayats, A. V. Spin–orbit interactions of light.

*Nat. Photonics***9**, 796–808 (2015). - 26.
Martínez-Herrero, R., Mejías, P. M., Juvells, I. & Carnicer, A. Transverse and longitudinal components of the propagating and evanescent waves associated to radially polarized nonparaxial fields.

*Appl. Phys. B***106**, 151–159 (2012). - 27.
Lytle, D. R. II, Carney, P. S., Schotland, J. C. & Wolf, E. Generalized optical theorem for reflection, transmission, and extinction of power for electromagnetic fields.

*Phys. Rev. E***71**, 056610 (2005). - 28.
Liou, K. N., Cai, Q., Pollack, J. B. & Cuzzi, J. N. Light scattering by randomly oriented cubes and parallelepipeds.

*Appl. Opt.***22**, 3001–3008 (1983). - 29.
Orlov, S., Peschel, U., Bauer, T. & Banzer, P. Analytical expansion of highly focused vector beams into vector spherical harmonics and its application to Mie scattering.

*Phys. Rev. A***85**, 063825 (2012). - 30.
O’Connor, D., Ginzburg, P., Rodríguez-Fortuño, F. J., Wurtz, G. A. & Zayats, A. V. Spin–orbit coupling in surface plasmon scattering by nanostructures.

*Nat. Commun.***5**, 5327 (2014). - 31.
Rodríguez-Fortuño, F. J., Engheta, N., Martínez, A. & Zayats, A. V. Lateral forces on circularly polarizable particles near a surface.

*Nat. Commun.***6**, 8799 (2015). - 32.
Karlovets, D. V., Kotkin, G. L. & Serbo, V. G. Scattering of wave packets on atoms in the Born approximation.

*Phys. Rev. A***92**, 052703 (2015). - 33.
Taylor, J. R.

*Scattering Theory: The Quantum Theory of Nonrelativistic Collisions*(Dover Publications Inc., New York, 2006).

## Acknowledgements

This work was supported in part by EPSRC (UK) and ERC (project 789340). P.G. acknowledges the support by a TAU Rector Grant and the German-Israeli Foundation (GIF, grant number 2399). A.Z. acknowledges support from the Royal Society and the Wolfson Foundation. A.K. and R.D. thank Mr. Alexander E. Ageyskiy for help with the microwave experiments.

## Author information

### Author notes

- Paulina Segovia

Present address: Departamento de Optica, CICESE, Carretera Ensenada-Tijuana, 3918, 22860, Ensenada, Mexico

- Nicolas Olivier

Present address: Laboratory for Optics & Biosciences, Ecole Polytechnique, CNRS, UMR 7645, F-91128, Palaiseau, France

- Gregory A. Wurtz

Present address: Department of Physics, University of North Florida, Jacksonville, FL 32224, USA

### Affiliations

#### Department of Physics, King’s College London, Strand, London, WC2R 2LS, UK

- Alexey V. Krasavin
- , Paulina Segovia
- , Nicolas Olivier
- , Gregory A. Wurtz
- , Pavel Ginzburg
- & Anatoly V. Zayats

#### Department of Electronic Engineering, Queen Mary University of London, London, UK

- Rostyslav Dubrovka

#### School of Electrical Engineering, Tel Aviv University, Ramat Aviv, Tel Aviv, 69978, Israel

- Pavel Ginzburg

#### ITMO University, St. Petersburg, 197101, Russia

- Pavel Ginzburg

### Authors

### Search for Alexey V. Krasavin in:

### Search for Paulina Segovia in:

### Search for Rostyslav Dubrovka in:

### Search for Nicolas Olivier in:

### Search for Gregory A. Wurtz in:

### Search for Pavel Ginzburg in:

### Search for Anatoly V. Zayats in:

### Conflict of interest

The authors declare that they have no conflict of interest.

### Corresponding author

Correspondence to Alexey V. Krasavin.

## Rights and permissions

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.