Abstract
The lunar permanently shadowed regions (PSRs) are expected to host large quantities of water-ice, which are key for sustainable exploration of the Moon and beyond. In the near future, NASA and other entities plan to send rovers and humans to characterize water-ice within PSRs. However, there exists only limited information about the small-scale geomorphology and distribution of ice within PSRs because the orbital imagery captured to date lacks sufficient resolution and/or signal. In this paper, we develop and validate a new method of post-processing LRO NAC images of PSRs. We show that our method is able to reveal previously unseen geomorphological features such as boulders and craters down to 3 meters in size, whilst not finding evidence for surface frost or near-surface ice. Our post-processed images significantly facilitate the exploration of PSRs by reducing the uncertainty of target selection and traverse/mission planning.
Similar content being viewed by others
Introduction
Understanding the character and origin of lunar water-ice, and more generally of lunar polar volatiles, is one of seven broad science objectives identified by NASA’s Artemis Science Definition Team1,2 and is of high priority for both science and exploration. Lunar polar cold traps—located within permanently and transiently shadowed regions (PSRs/TSRs)—can trap volatiles delivered from comets, asteroids, solar wind interactions, interior outgassing, and other sources over an extended period of time and are therefore key to understanding the behavior history of volatiles on the Moon as well as other airless bodies in the solar system3,4,5,6. Evidence for volatiles on or underneath the surface of lunar cold traps, involving varying kinds of modeling and associated assumptions, has been found by the LCROSS impactor mission7,8, the Lunar Orbiter Laser Altimeter (LOLA9,10,11), the Diviner Lunar Radiometer Experiment (DLRE12,13,14), the Lyman Alpha Mapping Project (LAMP15), and the Moon Mineralogy Mapper (M316). However, the scientific instruments used by these studies are limited by their signal-to-noise ratio (SNR) and/or resolution over PSRs, and are only able to provide data and imagery within large PSRs (on a kilometer to sub-kilometer scale). The individual characterization of micro-PSRs, small PSRs/TSRs, and the edges of large PSRs has not yet been possible.
Optical sensors currently provide images of the sunlit lunar surface with the highest spatial resolution, however, the lack of direct illumination makes imaging of PSRs very challenging. Still, PSRs receive small amounts of secondary illumination, i.e., sunlight backscattered from surrounding topography and Earth, as well as faint illumination from stars (e.g., refs. 17,18), which could potentially be used to image them with optical sensors. NASA’s Lunar Reconnaissance Orbiter (LRO) Narrow Angle Camera (NAC) is acquiring regular- and summed-mode optical images of PSRs with spatial resolutions between ~1 and 2 m/pixel, but its short exposure times and low levels of secondary illumination means that CCD and photon noise dominate these images, making any meaningful observations difficult. Over the past decade, LRO’s NAC, as well as JAXA’s Kaguya Terrain Camera (TC), have used longer CCD exposure times to acquire optical images of PSRs with acceptable SNRs19,20,21,22, however, the spatial resolution of these images (long exposure NAC: ~20–40 m/pixel20,21 long exposure TC: ~10 m/pixel22) is strongly limited by the movement of the satellite and is not able to close the strategic gap posed by the lack of optical, high-resolution images (<10 m/pixel) that are required to study and understand the rover-/astronaut-scale geomorphology and trafficability of PSRs.
The current lack of knowledge of PSRs poses a risk to future ground exploration missions. Small lunar PSRs are top-priority sites targeted by a number of future robotic and crewed missions, for example, by NASA’s Artemis program, including the VIPER (Volatiles Investigating Polar Exploration Rover) and Artemis III missions (e.g., ref. 23). Without high-resolution data and imagery (<5 m/pixel), the meter-scale geomorphology of PSRs remains unknown, and this complicates mission planning and generates questions such as: Where can a given PSR be entered safely? Does it contain hazards to avoid? Where can we take samples or drill? Which PSRs offer the best compromise between risk and science output? Being forced to alter plans during the execution of a mission is inefficient and increases risk, and many problems could be foreseen if the terrain inside the shadows was visible ahead of time.
Here, we address the strategic need for low-noise, high-resolution optical images of PSRs by focusing on improving the quality of the short exposure, full-resolution regular- and summed-mode NAC images. We develop a state-of-the-art low-light denoising tool which we call HORUS—Hyper-effective nOise Removal U-net Software—that is capable of removing the high levels of noise in these images, unlocking the entire LRO NAC image archive for PSR-related science and exploration. The technical details of the algorithm are described in detail in our companion paper24 and here we focus on demonstrating its value by studying the small-scale geomorphology and trafficability of lunar PSRs for the first time.
Results
HORUS—unprecedented views into lunar shadowed regions
HORUS is a two-stage deep learning-based algorithm that uses environmental information (such as CCD temperature and orbit number) and a physical noise model of the NAC (modified from refs. 25,26) to remove CCD-related and photon noise from low-light full-resolution LRO NAC regular- and summed-mode images of shadowed regions. We find that HORUS is able to significantly improve the SNR of these images, allowing us to create high-resolution (~1.5 m/pixel) images of lunar PSRs for the first time. HORUS is able to recover features within PSRs as small as 3 to 5 m across; Fig. 1 showcases one HORUS image of a small PSR in the direct vicinity of the lunar south pole. This represents a factor >5–10 spatial resolution improvement over existing long-exposure optical images of lunar PSRs19,20,21,22,27. Furthermore, as HORUS does not rely on long exposure images that suffer from motion blur and pixel bleed, we are able to produce images of small PSRs \( < \) 100 m in diameter (≪0.03 km2), which have not been covered by long-exposure imaging campaigns. In addition to that, HORUS is able to resolve the particularly important sunlight–shadow transition zone (see Fig. 1). Given that small PSRs are significantly more abundant than large PSRs, HORUS represents an unprecedented and rich resource for science and exploration. We refer to the method section, the supplementary material (Fig. S1) and24 for a detailed description and characterization of the HORUS workflow.
In this study, we focus on demonstrating HORUS’ scientific value by denoising and analyzing a series of NAC images of 17 PSRs distributed over five areas of interest (AoIs) across the south pole of the Moon, with shadowed areas ranging from ~0.18 to ~54 km2. The selection of AoIs is based on NASA’s current array of potential Artemis program landing sites taken from2. Specifically, we selected A001 (Shackleton terrace, four PSRs), A004 (Shackleton rim, four PSRs), A011 (de Gerlache terrace, two PSRs), and A102 (Leibnitz plateau, six PSRs)(A = Artemis). We further include one Constellation program AoI, the pyroclastic vent in Schrödinger basin (C′), which hosts a PSR (C = Constellation) (e.g., ref. 28). The maximum and mean annual surface temperatures across all AoIs range from 96 to 232 K and 64 to 106 K, respectively. Across all AoIs we collect a total of 62 HORUS images, with an average of five and a minimum of three images per PSR. The geographic distribution of all AoIs and PSRs considered is visualized in Fig. 2.
Validating the unknown
Examples of noisy raw NAC images of shadowed regions are shown in Fig. 3. Because of the extremely low levels of secondary illumination, CCD and photon noise dominates these images, which manifests itself as stripes and graininess in the image, making any meaningful observations difficult. The images after HORUS denoising are shown alongside the raw images. Whilst HORUS appears to remove this noise effectively, a key challenge for images of PSRs is that there exists no direct ground truth imagery to verify the HORUS-denoised images. To address this we employ multiple strategies to validate the HORUS images and to maximize our confidence when using them for subsequent analysis. These strategies are described below.
Firstly (1), in our companion paper24, we quantitatively assessed the denoising performance of HORUS on a synthetic test dataset with varying levels of noise. The dataset consists of rescaled sunlit NAC images with synthetic noise added and attempts to closely match the noise conditions expected in shadowed images. Noise is generated by combining real noise samples from dark NAC frames with a physical noise model of the NAC CCD. In24, we then compared the HORUS denoising performance on this dataset to the default Isis3 lronaccal routine and a standard frequency domain-based filter, using L1 error, PSNR (peak signal-to-noise ratio), and SSIM (structural similarity index measure) as metrics. We observed that HORUS significantly outperforms all other routines on all metrics across all noise levels, reliably improving SNR. A key observation from this study is that the denoising performance of HORUS strongly depends on the level of secondary illumination, i.e., the number of photons received. In particular, the minimum feature size HORUS can recover strongly depends on the photon count (Fig. S2). For the synthetic dataset and photon counts around 10–15 digital numbers (DN), the minimum feature size resolvable is ~3 to 5 m. In24, we observed that this feature size increases significantly for lower counts (i.e., only larger features are resolvable) and decreases slowly for higher counts (i.e., smaller features become resolvable). We observed that HORUS tends to remove features below the minimum feature size (i.e., introduces false negatives), but does not introduce any false features (i.e., does not introduce false positives).
Secondly (2), we qualitatively and quantitatively assess HORUS’ performance using TSRs. In these regions, we take sunlit images as ground truth and compare them to HORUS denoised shadowed images. An example comparison is shown in Fig. 3. This comparison indicates that HORUS is able to preserve physical features, such as boulders and craters, in these images as small as ~3 m in diameter. Furthermore, similar to the synthetic observations above, HORUS does not introduce false features (i.e., does not introduce false positives). We are also able to use TSRs to carry out application-specific validation, for example when carrying out crater counting within a PSR we also carry out crater counting within a neighboring TSR as a control test. Our application-specific TSR validation methods are described in more detail below.
Thirdly (3), when analyzing each PSR, we qualitatively assess performance by comparing multiple HORUS frames over the PSR. Here we assume features which appear in more than 2 HORUS frames, i.e., features which are spatially and morphologically consistent, are in fact physically present (Fig. 4). We sometimes observe that faint residual noise is left by HORUS (as seen in Figs. 3 and S4 through S20), and the cross-comparison of HORUS PSR frames allows us to discard this noise which could otherwise have been misinterpreted as surface albedo variations or very small (<~3 m in diameter) physical features.
Fourthly (4), we generate SNR maps for specific PSRs by dividing the mean photon signal (in DN) estimated by HORUS by the standard deviation of the noise removed by HORUS, averaged over a 100 m radius. These maps are useful for quantifying our confidence in the HORUS denoising (Fig. S3) alongside the validation approaches above, as they give us a direct measure of how difficult the image is to denoise. Similar to the DN counts, lower SNR values indicate that the minimum size of resolved features increases. The smallest observed features (3 to 5 m in diameter) are typically observed in HORUS images with SNRs larger than five.
Validation steps (2) and (3) have been applied for all images used in this paper. More detailed discussions on the validation results specific to the scientific findings of this work are presented below. All of the validated HORUS images of PSRs used in this study are displayed in the supplementary information (Fig. S4 through S20).
The boulder population of small lunar shadowed regions
We first use the HORUS images to map boulders across all the target AoIs and PSRs. Examples of identified boulders are shown in Figs. 1, 3, and 4. Across the PSRs we identify a total of 20 intra-PSR boulders with average, minimum, and maximum diameters of 10, 3, and 19 m respectively. Not all PSRs host boulders and the spatial density of boulders is generally very low, around ~4 boulders/km2, on average; we only find boulders in C′, A004 PSR 1, and A004 PSR 3. Boulders are located close to the edge of PSRs as well as towards their centers.
We perform a validation test within a TSR that is located right next to A004 PSR 3, mapping boulders (n = 5) in sunlit (regular NAC image) and shadowed conditions (HORUS image). The used HORUS image is the same as used for the intra-PSR boulder count of A004 PSR 3. The small number of boulders is governed by the overall scarcity of boulders in the studied TSRs. We observe that boulders that are observable in sunlit and shadowed conditions appear slightly larger in the considered HORUS image (shadowed conditions), roughly ~0.9 m larger on average (~11% larger relative to boulders observed in sunlit conditions), which is less than one pixel, meaning that HORUS might potentially introduce a subtle observational bias, at least for small, high intensity features such as boulders, depending on the DN and SNR of the respective HORUS image.
It is unclear how these boulders have been deposited in their host PSRs, i.e., if they have a local or distal (e.g., rockfall/impact) origin. Despite the size of the observed boulders, we do not observe any boulder tracks and/or imprints to prove their distal origin. The lack of tracks could indicate that boulders never moved or were deposited more than ~1.5 to 35 Ma ago, i.e., that tracks have been eroded through processes such as micrometeoroid bombardment (e.g., refs. 29,30). In contrast, we do not observe any signs of boulder degradation, such as fragments or fillets, suggesting that the observed boulders are not particularly old. We note that the surrounding terrain of the respective PSRs generally favors the occurrence of mass wasting, with slope angles ranging from ~20 to more than ~30° (see Fig. 2 and S21). Previous studies have reported rockfalls, recent impact events, and potential boulder source regions in the direct vicinity of these sites that could have produced and/or transported boulders31,32,33. Assuming the observed intra-PSR boulders have a distal origin, their presence could be an indication for the mechanical properties of the shallow subsurface of the respective PSRs. However, it is important to note that boulders with diameters greater than 3 m usually carve tracks more than ~0.75 m deep33,34, meaning that the mapped boulder population (with a mean boulder diameter of ~10 m) would not allow for the study of the mechanical properties of the near surface of PSRs, but of their subsurface, between an estimated ~1.5 and ~2.5 m depth.
While mapping boulders in the PSR of Schrödinger basin’s pyroclastic vent (C′), we discovered two clusters of boulder-like, high-reflectance features high up on the northern wall of the vent. Those features are located on the exact same topographic elevation as the high-albedo rock outcrops on the vent’s sunlit eastern and western wall, and thus could be outcrops of the same lithological unit. We note that these potential outcrops are candidate source regions for some of the boulders and scree within the PSR. An overview map of the mapped features in the vent is presented in Fig. S21.
Crater counting and cumulative crater size-frequency distributions
Next, we map the locations and diameters of all observable intra-PSR craters across all AOIs. The diameters of craters range from ~4 to ~320 m, with an average of ~18 m. The spatial density of craters across our AoI PSRs ranges from ~0.1 to ~68 craters/km2, with an average of ~15 craters/km2. The observable craters in the studied PSRs cover between ~0.03 and ~12% of their host PSRs surface, with a mean of ~4.6%. We recognize that varying levels of secondary illumination across the different PSRs (and hence the minimum feature size resolvable by HORUS) could potentially influence the observed crater density variations. The majority of the observable craters in our AoI PSRs do not appear to overlap, potentially allowing for a traverse around them. We further note qualitative differences in crater appearance, regarding feature albedo, sharpness, and texture, which might represent differences in crater formation age. Figure 5 showcases one such potentially fresh impact crater; Table S1 lists all derived numerical values per AoI and PSR.
Next, we derive the crater size-frequency distributions (CSFDs) of five of our larger and/or well-secondary-lit PSR AoIs (A001 PSR 10, A004 PSR 1, A004 PSR 2, A004 PSR 3, and A102 PSR 6) and compare them to the CSFDs of five equally sized, sunlit regions in the direct vicinity of their respective PSR. Despite the fact that we are able to recognize very small craters (down to ~4 m in diameter) in the selected PSRs, the derived CSFD curves indicate that the investigated PSRs generally feature fewer craters with diameters smaller than ~8.5 to 11 m than their immediate sunlit surroundings (Fig. S22).
This could indicate that either: (A) there is a physical process—absent in sunlit regions—that is erasing small craters in lunar PSRs, for example, volatile/dust migration or volatile sequestration as discussed in the literature (e.g., refs. 35,36,37,38,39). (B) the upper layers of regolith in TSRs/PSRs feature anomalous geomechanical behavior e.g., caused by an increased porosity—as predicted by a number of remote sensing studies (e.g., refs. 15,40,41,42) as well as the LCROSS impactor8—leading to increased impact crater diameters, as has been reported for e.g., pyroclastic deposits43. Alternatively, (C) there is an observational bias in the used HORUS images, i.e., even if very small craters can be recognized locally, not all physically present small craters across the PSR are visible, e.g., due to spatial and subtle variations of the secondary illumination and SNR. We perform an additional validation test within a TSR that is located within A004, in between PSRs 1, 2, and 3 (89.82°S and 44.01°W). We map all craters in a predefined area in sunlit (regular NAC CDR image) and shadowed conditions (the same HORUS image used for the intra-PSR CSFD curve) and compute various CSFDs (shown in Fig. 6). We draw two conclusions from this test: the first is that for craters which are observable in both images, the crater diameter measurements performed in HORUS images do not suffer from any observation bias; in other words, HORUS does not appear to increase the diameter of craters compared to the sunlit image (Fig. 6 left). The second is that HORUS does not reliably resolve a substantial fraction of the crater population with diameters smaller than ~8.5 m; in other words, HORUS contains some, but not all craters < ~8.5 m in diameter (Fig. 6 right); we note that the observed threshold diameter could be subject to change, depending on the DN and SNR of the used images. This leads us to discard hypotheses (A) and (B), although we acknowledge the large statistical uncertainties associated with crater counting in such small AoIs, which is a physical limitation of the study of small PSRs, however. The analysis of additional, small PSRs will help to gather more confident statistics.
We observe that the AoI PSR C′ in Schrödinger’s pyroclastic vent features an anomalously low spatial concentration of craters (~0.07 crater/km2, compared to the overall AoI mean of ~15 craters/km2), meaning that only ~0.03% of the PSR area are cratered (in contrast to the overall AoI mean of ~4.6%). The analysis of the DN count and SNR distributions (DN ranges between ~5.8 and ~12.1, while SNR ranges between ~1.4 and ~2.4) of the used HORUS images indicates that (1) a spatial bias as discussed above is likely and (2) there is a substantial chance that not all physically present features are resolved. However, it is unclear if the limited SNR alone is responsible for the nearly complete lack of craters, especially as multiple boulders and a few craters can be observed across the PSR (see Figs. S20 and S21).
HORUS-enabled traverse planning
Besides studies of geomorphology, HORUS can also be used to inform traverse planning. We enhanced our HORUS images by adding topographical information from LOLA and used both datasets to lay out a hypothetical rover traverse that targets AoI A102 PSR 6, a ~450 m diameter PSR on the Leibnitz plateau, close to the rim of the Nobile crater (Fig. 5). The analysis of HORUS images revealed a high-albedo and potentially fresh impact crater within this PSR, which could represent a promising science target. HORUS images and slope information indicate that an access from the west might be safest in terms of topography and obstacles: the traverse would not feature slope angles steeper than ~10°, and the traverse could be planned in a way that helps the rover to avoid all visible physical obstacles. After examination of the potentially fresh crater and its ejecta blanket, the notional traverse continues to lead the rover deeper into the core of the PSR, following the gentle, local topographic gradient while avoiding a series of impact craters scattered across the PSR. We note that HORUS products could be applied—in a similar way as presented here—to inform and guide traverse planning in any other lunar PSR.
Potential indications for (near-) subsurface ice abundance
Finally, we closely examined HORUS images of all AoI PSRs for evidence of surface frost or ice, such as e.g., bright patches or lenses, although we could not find any such evidence. The absence of surface frost might be expected as the majority of AoI PSRs feature maximum annual surface temperatures slightly above 100 to 112 K where water-ice would be stable for an extended period of time13,44,45,46,47, but evidence for surface frost or ice is also absent in the two PSRs with lower temperatures (A001 PSR 3 and A011 PSR 2). Impact craters across our AoIs do not appear to expose any subsurface ice, although any exposed ice might have sublimated before it was observed by LRO. Our observations are in agreement with earlier studies of long-exposure optical images of PSRs that did not find any evidence of large-scale surface frost either20,22,27,48. The apparent absence of surface frost and ice patches could indicate that ice may only exist in the shallow subsurface of the studied PSRs, may be intermixed with regolith as fines, or might be present as a (dis)continuous matrix (e.g., refs. 37,49), which would explain why some (nonoptical) instruments register the footprint of water-ice on the surfaces of PSRs13,16 despite the lack of evidence in optical images. Due to that mixing and the limited spatial resolution of NAC/HORUS, the scarce secondary illumination might not be sufficient to make ice/frost-caused albedo differences visually apparent in optical images, as observed in the case of long-exposure images (e.g., ref. 19).
Even if visually absent, the general presence of ice on or underneath the surface might be revealed by larger-scale, geomorphic features that are characteristic for ice-bearing soils, such as ice wedges, patterned ground, and lobate features, as observed on Earth (e.g., ref. 50) and Mars (e.g., ref. 51), for example. We observe slope-orthogonal lobate features, which bear visual resemblance to terrestrial and martian solifluction features—sometimes referred to as elephant-hide terrain, creep, or textured ground52,53,54,55, that extend from predominantly sunlit regions into TSRs (predominantly shadowed) (Fig. 7), but appear to be absent in PSRs. We do not observe obvious changes in the morphology of these features, such as width and spacing, as a function of their location within a TSR or their proximity to a PSR. Within TSRs, lobate features appear to be exclusively located on slope angles ranging from ~10 to ~20° (as observed in AoIs A001 PSR 1, A001 PSR 2, A004 PSR 3, A011 PSR 1, A011 PSR 2, A102 PSR 3, A102 PSR 4, A102 PSR 5, and A102 PSR 6).
The transiently/seasonal illumination of potentially ice-bearing regions could lead to sublimation of (sub)surface ice (see e.g., ref. 38). Vertically constrained by a potential underlying, impermeable ice layer or ice-cemented breccia or regolith, the sublimation process could lead to a local, short-lived modification of the geomechanical properties of the regolith, which could ultimately result in a lateral displacement of material, potentially facilitated by local slopes. Assuming that the presence and sublimation of (sub)surface ice would affect the mechanical properties of the regolith, the apparent lack of morphological differences between sunlit- and TSR lobate features could indicate that (1) the predominantly sunlit polar regolith contains a similar amount of (shallow) subsurface ice as the predominantly shadowed polar regolith (TSRs); or (2) both regions are similarly depleted of shallow (sub)surface ice. Further, the apparent lack of lobate features within PSRs might on the one hand indicate that (3) lobate features indeed are only related to gravitational creep without the involvement of ice, given that small PSRs are usually located in relatively flat, topographic depressions (resulting in a lack of slopes); or on the other hand that (4) the lack of seasonal illumination in PSRs is the reason for the absence of sublimation and thus surface displacement/ lobate feature formation.
We do not expect HORUS to remove or hallucinate lobate-type features, as elongated lobes and ridges are common geomorphic features across the Moon and, thus, should be well represented in HORUS’ training dataset. We perform a qualitative validation test within a TSR that is located close to A001 PSR 10 (89.59°S, 118.73°W), comparing the visual appearance of surface texture and lobate-type features in sunlit (regular NAC image) and shadowed conditions (HORUS image). We observe that—overall—the analyzed HORUS images appropriately display the surface texture and relevant features as observed in sunlit conditions (Fig. S23). However, we note that varying illumination conditions might highlight different aspects of the surface texture present in a PSR, as is the case for sunlit regions as well. In this study, we also use multi-frame image validation, which allows further verification by requiring features are consistent across the frames, which typically have varying illumination conditions (see Figs. 3 and 4). The fact that similar lobate-type features have not been observed in low-resolution, long-exposure images of TSRs and PSRs might be explained by their small size—we note that there may be other ice-related geomorphic features smaller than the spatial resolution as currently offered by HORUS. We note that additional, systematic observations are required to better understand the potential role of ice and ice sublimation in the formation of lobate-type features and other small-scale geomorphology, in shadow as well as in sunlit polar regions. We point out that, if the potential role of ice in landform generation can be confirmed, the presence of ice-related landforms, as well as the potentially sublimation-modified geomechanical properties of the affected regions, might make access to PSRs more challenging. In turn, the presence of such features would imply that in those regions ice is—or has been—relatively close to the surface and might be easier to access by exploration and ISRU missions.
Discussion
By denoising regular- and summed-mode LRO NAC images, HORUS provides low-noise, high-resolution images of lunar shadowed regions, closing an important strategic knowledge gap. Importantly, HORUS allows us to tap into the large and growing archive of more than 200,000 NAC images over the lunar north and south pole (beyond 80°N and S). We observe that roughly 25% of the NAC images covering the AoIs considered for this work had useable signal allowing HORUS post-processing to be used, meaning that there could be an estimated total of ~50,000 HORUS images available, enabling studies of an extensive number of small and large shadowed regions, including studies of the temporal and seasonal variations of TSRs and PSRs at an unprecedented temporal and spatial resolution, i.e., on timescales from days to years (Fig. 4). Applying HORUS to a raw NAC image takes less than a minute if graphical processing units (GPUs) are used, meaning that HORUS could be deployed at scale to produce a large archive of denoised images of lunar shadowed regions. HORUS allows us to test hypotheses about the potential connection between PSR surface brightness variations, hypothesized/modeled ice content, large- and small-scale topographic roughness, and surface-subsurface ice abundance, as discussed by3,27,36,56,57, and58, among others. Furthermore, HORUS is not only useful for studying true PSRs, but can also enable the analysis of TSRs which were never photographed in sunlight, due to orbital or other constraints. Whilst effective, it is important to remember that HORUS still needs some photon signal to be present, and given that polar topography governs the amount of secondary illumination in PSRs, some PSRs may be more easily studied with HORUS than others. Furthermore, our validation suggests that whilst HORUS is able to resolve small features in PSRs, depending on the SNR available it may not be able to fully resolve all small features present.
The findings of this study have practical implications for the imminent exploration of PSRs. The lack of direct, visual evidence of frost or ice on the surfaces of small PSRs seems to confirm earlier findings that volatiles—if present—are dispersed and that large concentrations of ice and other volatiles might only be accessible underneath the surface, i.e., require trenching, drilling, or other types of interaction with the surface. Work-based on Mini-RF Radar data59,60 suggested that the presence of surface frost and buried ice deposits in PSRs could be mimicked by surface roughness and rocks (scree), however, our observations made from HORUS images in small PSRs indicate that the respective rocks—if present— would need to be completely buried or much smaller than ~3 m in diameter, at least in the studied small lunar PSRs.
Our preliminary observations do not provide geomorphic evidence for a shallow high porosity surface layer, as could be revealed e.g., by systematically increased crater diameters, but offer potential additional evidence for substantial bearing capacity at depths greater than ~0.5 m, as suggested for low-latitude PSRs by48. It remains unclear to what extent the geomechanical properties of the shallow and deep umbral regolith are controlled by volatiles and the environmental conditions in PSRs. There are regolith-ice configurations which could provide sufficient bearing capacity and traction even in highly porous regolith, such as ice-cemented regolith, ice breccias, and ice-matrix breccias37,48,61 that might be benign to exploration. Figure 8 features a synopsis of information derived by this study as well as by earlier studies. We point out that the number of the sites studied in this work is limited and that AoIs are scattered across the pole. In addition, it is important to note that information about the boulder and crater population < ~3 m is missing and might change the findings of this study.
Despite our extensive efforts to validate HORUS images, many of the initial findings presented here depend on verification and ground truth. Future missions such as NASA’s VIPER mission, the ShadowCam instrument on Korea’s Pathfinder Lunar Orbiter, and the Lunar Trailblazer mission, to be launched in late 2023 and in mid-2022, respectively, will be able to provide such ground truth23,62. In turn, HORUS could augment data products from future missions, such as ShadowCam, where data could be incorporated in the training dataset of HORUS to improve its overall performance, or HORUS could be adapted to enhance ShadowCam images themselves, potentially producing a series of low-noise, high(er)-resolution images of lunar PSRs that spans over a decade—and potentially more.
Methods
HORUS setup, training, testing, and validation
The HORUS denoising workflow is shown in Fig. S1. HORUS consists of two deep neural networks which are applied in sequence to remove different noise sources in the summed- and regular- mode LRO NAC images. The input to HORUS is a raw NAC EDR (experimental data record) image along with a set of metadata recorded at the time of image capture and the final output of HORUS is an estimate of the mean photon signal contained within the image. The first network, called DestripeNet, takes the metadata as input (which consists of the values of the NAC CCD masked pixels, and the other metadata listed in Fig. S1), and outputs a prediction of the CCD dark noise components (such as the dark bias and dark current noise) contained in the image. The network uses a convolutional decoder architecture and is trained in a supervised fashion using over 70,000 dark calibration frames as labels, which were captured over the entire duration of the LRO mission. The predicted dark frame is subtracted from the image, and the nonlinearity and flatfield corrections from ref. 25 (as used in the current Isis3 calibration routine) are then applied. This intermediate image is input to PhotonNet, which estimates the residual noise sources in the image, namely the CCD read noise, compression noise (generated by the compression and subsequent decompression of the EDR image before downlink to Earth), photon (shot) noise, and any residual dark noise which DestripeNet failed to predict. This residual noise estimate is subtracted from the intermediate image, resulting in a clean image which estimates the mean photon signal in DN. PhotonNet uses a U-Net63 architecture and is trained using a synthetically generated dataset of noisy-clean image pairs, where clean images are generated by rescaling many randomly selected NAC images of sunlit regions to low photon counts, and noisy images are generated by adding noise from a physically realistic noise model of the NAC CCD. To ensure the training distribution of PhotonNet is as close to the test distribution of PSR images as possible, 3D ray tracing was used to select clean training images that had similar solar incidence angles to the angle of incidences expected from secondary illumination in PSRs. We refer the interested reader to24 for a more detailed description and characterization of the HORUS denoising workflow.
We validated HORUS using the four approaches discussed in the main body of this paper: (1) a quantitative performance on synthetic data, (2) a cross-comparison of sunlit and shadowed images of TSRs, (3), a cross-comparison of multiple shadowed images of PSRs, and (4) SNR mapping. Validation approach (1) was performed for the HORUS workflow in general, while approaches (2) and (3) have been performed for all images used in this study. Approach (4) has been used for images that cover sites of increased interest, such as sites where intra-PSR crater counting has been performed. We note that approach (4) is not a validation approach by itself, but is useful for increasing our confidence in the images in combination with the other approaches. The SNR maps are derived by determining:
Calculated over a sliding 2D Gaussian-weighted window with a standard deviation (width) of 100 m, where \(S\) is the mean photon signal image output by HORUS (in units of DN), \(I\) is the raw EDR image (in units of DN), and \(N(\bullet )\) is the forward nonlinearity function used in ref. 24.
Image processing and projection
We used compute resources on the Google Cloud Platform, specifically a virtual machine with 24 CPU cores, 200 GB RAM, and 8 NVIDIA GPUs (Tesla V100). The image data was downloaded from the Planetary Data System (http://lroc.sese.asu.edu/data/). Training both HORUS networks took ~12 h, and the processing time for running HORUS after training on a single NAC EDR 52224 × 5064 image was about 30 s using one NVIDIA Tesla V100 GPU. After applying HORUS, we output the images as .cub files and used Isis3 (e.g., ref. 64) (cam2map) to map-project all images to a polar stereographic projection (.geotiff). We note that downloading the raw image as well as the map-projection of the denoised images are significantly more time-consuming than the processing of the images in HORUS itself. We are currently able to output ~30 full map-projected HORUS images (.geotiff) per hour using four GPUs.
Crater counting and CSFD curve comparison
Crater counting was performed on validated HORUS images in QGIS (https://www.qgis.org/de/site/) using the CADDigitize tool by L. Bartoletti, specifically using the two-click circle tool. Here, a first click defines the center of a crater and a second click defines its rim. We consider the accuracy and precision of our mapping to be less than one pixel, i.e., < ~1.5 m. Care has been taken to not include secondary craters as well as unrelated, potentially round geomorphological features. Where possible, we selected the most appropriate images to map craters, i.e., images with the most appropriate illumination conditions to recognize negative relief features.
Our AoI PSRs have areas ranging from 0.18 to 54 km2; all sunlit control areas have the same extent as their associated intra-PSR area and are located in their direct vicinity, governed by the illumination and the available NAC images. The location and extent of all PSRs is taken from ref. 65, who performed illumination modeling based on LOLA topography and provide polar PSR maps with spatial resolutions of 60 and 120 m/pixel. We require a PSR to cover at least 3 by 3 pixels in the 60 m/pixel map presented by ref. 65 to make sure we are only studying true PSRs. Care has been taken to place control areas in the exact same geologic regions and context as their associated intra-PSR areas. All craters that intersect the border of the counting area are mapped and included in the analysis. All cumulative CSFD curves have been plotted and analyzed using the CraterTools and CraterStats2 software package (e.g., ref. 66), following the guidelines established by ref. 67.
Data availability
The raw NAC EDR data used in this study are available via the LROC page at http://lroc.sese.asu.edu/data/. Auxiliary data, such as LOLA products, are available via the NASA PDS (https://pds.nasa.gov) and USGS pages (https://www.usgs.gov/centers/astrogeology-science-center/data-tools). HORUS images and its training dataset will be available on request in the near future. The processed and validated data generated in this study are provided in the supplementary information of this article.
Code availability
We used open-access/open-source software to process and analyze the data used for this paper, specifically Python (https://www.python.org/), PyTorch68 https://pytorch.org/, Isis3 (e.g., ref. 64, https://isis.astrogeology.usgs.gov/), and planetary image (https://pypi.org/project/planetaryimage/). We plan to open-source the HORUS code at a later date; all details are available here: https://openaccess.thecvf.com/content/CVPR2021/html/Moseley_Extreme_Low-Light_Environment-Driven_Image_Denoising_Over_Permanently_Shadowed_Lunar_Regions_CVPR_2021_paper.html.
References
National Aeronautics and Space Administration. Artemis III science definition team report. Report No. NASA/SP-20205009602. (NASA, 2020).
National Aeronautics and Space Administration. NASA’s plan for sustained lunar exploration and development. https://www.nasa.gov/sites/default/files/atoms/files/a_sustained_lunar_presence_nspc_report4220final.pdf (2020).
Watson, K., Murray, B. & Brown, H. On the possible presence of ice on the Moon. J. Geophys. Res. 66, 1598–1600 (1961).
Arnold, J. R. Ice in the lunar polar regions. J. Geophys. Res. 84, 5659–5668 (1979).
Feldman, W. C. et al. Evidence for water ice near the lunar poles. J. Geophys.l Res. 106, 23231–23251 (2011).
Lemelin, M. et al. Framework for coordinated efforts in the exploration of volatiles in the south polar region of the moon. Planet. Sci. J. 2, 103 (2021).
Colaprete, A. et al. Detection of water in the LCROSS ejecta plume. Science 330, 463–468 (2010).
Schultz, P. H. et al. The LCROSS cratering experiment. Science 330, 468–472 (2010).
Fisher, E. A. et al. Evidence for surface water ice in the lunar polar regions using reflectance measurements from the lunar orbiter laser altimeter and temperature measurements from the diviner lunar radiometer experiment. Icarus 292, 74–85 (2017).
Qiao, L., Ling, Z., Head, J. W. III, Ivanov, M. A. & Liu, B. Analyses of lunar orbiter laser altimeter 1,064‐nm albedo in permanently shadowed regions of polar crater flat floors: Implications for surface water ice occurrence and future in situ exploration. Earth Planet. Sci. 6, 467–488 (2019).
Rubanenko, L., Venkatraman, J. & Paige, D. A. Thick ice deposits in shallow simple craters on the Moon and Mercury. Nat. Geosci. 12, 597–601 (2019).
Paige, D. A. et al. Diviner lunar radiometer observations of cold traps in the Moon’s south polar region. Science 330, 479–482 (2010).
Hayne, P. O. et al. Evidence for exposed water ice in the Moon’s south polar regions from lunar reconnaissance orbiter ultraviolet albedo and temperature measurements. Icarus 255, 58–69 (2015).
Hayne, P. O. et al. Global regolith thermophysical properties of the Moon from the diviner lunar radiometer experiment. J. Geophys. Res. 122, 2371–2400 (2017).
Gladstone, G. R. et al. Far‐ultraviolet reflectance properties of the Moon’s permanently shadowed regions. J. Geophys. Res. 117, E00H04 (2012).
Li, S. et al. Direct evidence of surface exposed water ice in the lunar polar regions. Proc. Natl Acad. Sci. USA 115, 8907–8912 (2018).
Kloos, J. L., Moores, J. E., Godin, P. J. & Cloutis, E. Illumination conditions within permanently shadowed regions at the lunar poles: Implications for in-situ passive remote sensing. Acta Astronaut. 178, 432–451 (2021).
Lucey, P. G. et al. The spectral radiance of indirectly illuminated surfaces in regions of permanent shadow on the Moon. Acta Astronaut. 180 25–34 (2021).
Martin, A. C. et al. Comparison of images with direct and indirect illumination: lunar permanently shadowed region analog images. In 52nd Lunar and Planetary Science Conference. #2349 (2021).
Martin, A. C., Denevi, B. W. & Robinson, M. S. Interpreting reflectance differences under indirect illuminations: lunar permanently shadowed region analog images. In 51st Lunar and Planetary Science Conference. #2793 (2020).
Cisneros, E. et al. Lunar reconnaissance orbiter camera permanently shadowed region imaging —Atlas and Controlled Mosaics. In 48th Lunar and Planetary Science Conference (2017).
Haruyama, J. et al. Lack of exposed ice inside lunar south pole Shackleton crater. Science 322, 938–939 (2008).
Colaprete, A. et al. The volatiles investigating polar exploration rover (VIPER) mission—measurements and constraints. In 52nd Lunar and Planetary Science Conference. #2898 (2021).
Moseley, B., Bickel, V. T., Lopez-Francos, I. & Rana, L. Extreme low-light environment-driven image denoising over permanently shadowed lunar regions with a physical noise model. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 6317–6327 (IEEE CVPR, 2021).
Humm, D. C. et al. Flight calibration of the LROC narrow angle camera. Space Sci. Rev. 200, 431–473 (2016).
Robinson, M. S. et al. Lunar reconnaissance orbiter camera (LROC) instrument overview. Space Sci. Rev. 150, 81–124 (2010).
Moon, S., Paige, D. A., Siegler, M. A. & Russell, P. S. Geomorphic evidence for the presence of ice deposits in the permanently shadowed regions of Scott‐E crater on the moon. Geophys. Res. Lett. 48, e2020GL090780 (2020).
Kring, D. A. & Durda, D. D. (eds) A Global Lunar Landing Site Study to Provide the Scientific Context for Exploration of the Moon (Lunar and Planetary Institute, 2012).
Arvidson, R. et al. Cosmic ray exposure ages of features and events at the Apollo landing site. Moon 13, 259–276 (1975).
Hurwitz, D. & Kring, D. A. Identifying the geologic context of Apollo 17 impact melt breccias. Earth Planet. Sci. Lett. 436, 64–70 (2016).
Gawronska, A. J. et al. Geologic context and potential EVA targets at the lunar south pole. Adv. Space Res. 66, 1247–1264 (2020).
Bickel, V. T. & Kring, D. A. Lunar south pole boulders and boulder tracks: implications for crew and rover traverses. Icarus 348, 113850 (2020).
Bickel, V. T. et al. Analysis of lunar boulder tracks: implications for trafficability of pyroclastic deposits. J. Geophys. Res. Planets 124, 1296–1314 (2019).
Bickel, V. T., Aaron, J., Manconi, A., Loew, S. & Mall, U. Impacts drive lunar rockfalls over billions of years. Nat. Commun. 11, (2020).
Gerasimov, M. Lunar volatiles: a clue for understanding the evolution of the Moon and a resource to its exploration. In 40th COSPAR Scientific Assembly, B0.1-27-14 (2014).
Prem, P., Goldstein, D. B., Varghese, P. L. & Trafton, L. M. The influence of surface roughness on volatile transport on the Moon. Icarus 299, 31–45 (2018).
Cannon, K., Deutsch, A., Head, J. W. & Britt, D. T. Stratigraphy of ice and ejecta deposits at the lunar poles. Geophys. Res. Lett. 47, e2020GL088920 (2020).
Luchsinger, K. M. & Chanover, N. J. From transient to sequestered: vertical transport of water ice in seasonally shadowed regions. In 52nd Lunar and Planetary Science Conference. #2548 (2021).
Reiss, P., Warren, T., Sefton-Nash, E. & Trautner, R. Dynamics of subsurface migration of water on the moon. J. Geophys. Res. Planets 126, e2020JE006742 (2021).
Metzger, P. T., Anderson, S. & Colaprete, A. Experiments indicate regolith is looser in the Lunar polar regions than at the lunar landing sites. In 16th Biennial International Conference on Engineering, Science, Construction, and Operations in Challenging Environments (2018).
Jordan, A. P., Stubbs, T. J., Wilson, J. K., Schwadron, N. A. & Spence, H. E. Dielectric breakdown weathering of the Moon’s polar regolith. J. Geophys. Res. Planets 120, 210–225 (2015).
Chen, K. et al. Packing grains by thermal cycling. Nature 442, (2006).
Van der Bogert, C., Pochler, C. M., Kring, D. A. & Hiesinger, H. Absolute model ages for geological units in Schrödinger basin: context for the 2024 PRISM CLPS Mission. In 52nd Lunar and Planetary Science Conference #2351 (2021).
Paige, D. A., Wood, S. E. & Vasavada, A. R. The thermal stability of water ice at the poles of Mercury. Science 258, 643–646 (1992).
Siegler, M., Paige, D., Williams, J. P. & Bills, B. Evolution of lunar polar ice stability. Icarus 255, 78–87 (2015).
Zhang, J. A. & Paige, D. A. Cold‐trapped organic compounds at the poles of the Moon and Mercury: implications for origins. Geophys. Res. Lett. 36, L16203 (2009).
Zhang, J. A. & Paige, D. A. Correction to cold‐trapped organic compounds at the poles of the moon and mercury: implications for origins. Geophys. Res. Lett. 37, L03203 (2010).
Sargeant, H. M. et al. Using boulder tracks as a tool to understand the bearing capacity of permanently shadowed regions of the moon. J. Geophys. Res. Planets 125, e2019JE006157 (2020).
Siegler, M. A., Keane, J. T., & Paige, D. A. Subsurface ice stability on the Moon. In Lunar Polar Volatiles (Lunar and Planetary Institute, 2018).
Hauber, E. et al. Landscape evolution in Martian mid-latitude regions: insights from analogous periglacial landforms in Svalbard. Geol. Soc. Lond. 356, 111 (2011).
Dundas, C. M. & McEwen, A. An assessment of evidence for pingos on Mars using HiRISE. Icarus 205, 244–258 (2010).
Kokelaar, B. P., Bahia, R. S., Joy, K. H., Viroulet, S. & Gray, J. M. N. T. Granular avalanches on the Moon: mass‐wasting conditions, processes, and features. J. Geophys. Res. Planets 122 1893–1925 (2017).
Kreslavsky, M. A., Zharkova, A. Y. & Head, J. W. Meter-scale surface textures on mercury: comparison with the moon. In 49th Lunar and Planetary Science Conference. #1394 (2018).
Xiao, Z., Zeng, Z., Ding, N. & Molaro, J. Mass wasting features on the Moon – how active is the lunar surface? Earth Planet. Sci. Lett. 376, 1–11 (2013).
Bernhardt, H. & Robinson, M. S. Preliminary Geomorphic Map (1:10,000) of Artemis III AoI 001 and 004 on the Shackleton-de Gerlache Ridge. In 52nd Lunar and Planetary Science Conference. #1264 (2021).
Deutsch, A. N., Head, J. W., Neumann, G. A., Kreslavsky, M. A. & Barker, M. K. Assessing the roughness properties of circumpolar lunar craters: Implications for the timing of water‐ice delivery to the moon. Geophys. Res. Lett. 47 e2020GL087782 (2020).
Ahrens, C. J., Petro, N. & Li, S. Preliminary observations of the relationship between Fe-signatures and PSR locations at the lunar south pole. In 52nd Lunar and Planetary Science Conference. #1478 (2021).
Moye, C. G. & Lee, P. Lunar polar water ice: a terrain classification system and optimal sites for moon exploration. In 51st Lunar and Planetary Science Conference. #2594 (2021).
Fa, W. & Cai, Y. Circular polarization ratio characteristics of impact craters from Mini‐RF observations and implications for ice detection at the polar regions of the Moon. J. Geophys. Res. Planets 118, 1582–1608 (2013).
Fa, W. & Eke, V. R. Unravelling the mystery of lunar anomalous craters using radar and infrared observations. J. Geophys. Res. Planets 123, 2119–2137 (2018).
Gertsch, L. S., Rostami, J. & Gustafson, R. Review of lunar regolith properties for design of low power lunar excavators. In 6th International Conference on Case Histories in Geotechnical Engineering (2008).
Robinson, M. S. & ShadowCam Team. ShadowCam: seeing in the shadows. In Lunar Polar Volatiles. 5028 (2018).
Ronneberger, O., Fischer, P. & Brox, T. U-net: convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention 9351, 234–241 (2015).
Torson, J. M. & Becker, K. J. ISIS—A software architecture for processing planetary images. In 28th Annual Lunar and Planetary Science Conference. #1219 (1997).
Mazarico, E., Neumann, G. A., Smith, D. E., Zuber, M. T. & Torrence, M. H. Illumination conditions of the lunar polar regions using LOLA topography. Icarus 211, 1066–1081 (2011).
Riedel, C. et al. A new tool to account for crater obliteration effects in crater size-frequency distribution measurements. Earth Space Sci. 5, 258–267 (2018).
Crater Analysis Techniques Working Group. Standard techniques for presentation and analysis of crater size-frequency data. Icarus 37, 467–474 (1979).
Paszke, A. et al. PyTorch: an imperative style, high-performance deep learning library. Neural Inf. Process. Syst. 32, 8024–8035 (2019).
Stopar, J. D. et al. Relative depths of simple craters and the nature of the lunar regolith. Icarus 298, 34–48 (2017).
Acknowledgements
V.T.B. would like to thank Harald Hiesinger and Carolyn van der Bogert for the insightful discussions about crater counting in particularly small areas with unknown physical properties and Ernst Hauber for generously sharing images of permafrost-related features acquired on Spitsbergen, Norway. The initial development of HORUS was an output from the Frontier Development Lab; all authors would like to thank Loveneesh Rana for his contribution to all FDL-related work. All authors are grateful for the technical, financial, and mentorship support by Google Cloud, the Frontier Development Lab, the SETI Institute, and the Luxembourg Space Agency. All authors thank L. Silverberg for creating the HORUS mission patch. V.T.B. gratefully acknowledges the financial support by the International Max Planck Research School (IMPRS) at the Max Planck Institute for Solar System Research (MPS). This research has made use of the USGS Integrated Software for Imagers and Spectrometers (ISIS).
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
V.T.B., B.M., and I.L.-F. were involved in the development of HORUS. V.T.B. and B.M. were involved in conceptualization, resources, data curation, writing, preparation, visualization, and validation of this work. V.T.B. and M.S. were involved with interpretation and investigation. V.T.B. was involved with formal analysis and revision. All authors were involved in the review of this work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Peer review information Nature Communications thanks Kevin Cannon and the anonymous reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Bickel, V.T., Moseley, B., Lopez-Francos, I. et al. Peering into lunar permanently shadowed regions with deep learning. Nat Commun 12, 5607 (2021). https://doi.org/10.1038/s41467-021-25882-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-021-25882-z
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.