Master Thesis: Deep Learning for Satellite Image Super-Resolution

Forschungszentrum Jülich - FZJ - Helmholtz Association

Jülich, Germany

Work group:

JSC - Jülich Supercomputing Centre


Area of research:

Diploma & Master Thesis


Starting date:

1547550900


Contract time limit:

1547550900


Job description:

Background:The cross-sectional team deep learning at the Jülich Supercomputing Centre (JSC) is conducting basic and applied research in the field of adaptive multi-layer neural network architectures that learn complex tasks from very large amount of unprocessed data. One of the tackled use cases is the processing and analysis of remote sensing images. Acquired data from sensors on-board aircraft and satellite platforms cannot be directly used by the applications. The interpretation of remote sensing images is not straightforward, and it requires a powerful yet highly accurate processing scheme to extract reliable and valuable information. Analytical methods such as machine learning and deep learning need be exploited to derive this value.

Project Description:The goal of the project is to design a deep network for the fusion of disjoint reflectance bands that have different spatial resolution and have been acquired by the same sensor. The considered data are the one acquired by the Sentinel-2 mission [1], which includes a constellation of two satellites that collect multispectral bands of 10m, 20m and 60m spatial resolution for visible, near infrared (NIR) and shortwave infrared (SWIR). The network will be developed for fusing the whole bands to obtain finer spatial resolution versions of the coarse bands.

Benefits:Direct access to high performance multi-GPU systems equipped with the state-of-the-art of deep learning frameworks (i.e., TensorFlow [2]).

Your Tasks:Revise Generative Adversarial Networks (GANs) [3].Reproduce the results of one proposed GAN network [4].Adapt the network for Sentinel-2 data and optimize the hyperparameters.Scale-up the training process.

Material:The candidate should understand what is Pansharpening and its application for remote sensing images. In short, due to physical constrains of satellite sensor instruments, a single sensor cannot acquire images that have both high spatial and spectral resolutions. This limitation can be solved with Pansharpening, that is a set of data fusion approaches which are used to fuse the panchromatic (i.e., high spatial resolution) with the multispectral images (i.e., high spectral resolution) [5][6]. Pansharpening methods can be grouped into 4 categories: component substitution, multiresolution analysis, model, and super-resolution.

[1] sentinel.esa.int/web/sentinel/missions/sentinel-2 [2] www.tensorflow.org [3] arxiv.org/abs/1406.2661 [4] arxiv.org/abs/1805.03371 [5] openremotesensing.net/wp-content/uploads/2015/02/IEEE_TGRS_2015_vivone_pansharpening.pdf [6] www.youtube.com/watch

Your Profile:Master’s student in Computer Science or Electrical/Computer Engineering Medium knowledge of Machine Learning and Deep Learning Medium/advanced knowledge of PythonEnglish proficiency is expected

Information required: Curriculum vitae (max 3 pages)List of previous projects/experiences where Machine Learning and Deep Learning algorithms have been adopted.

We offer:Financial support is provided by JSC for the duration of the thesis (i.e., 6 months with the possibility of extension to 9 months).


Please apply via recruiter’s website.

Quote Reference: Helmholtz-2019M-011

Favorite