Landsat Super-Resolution Enhancement Using Convolution Neural Networks and Sentinel-2 for Training

• Published in: Remote Sensing
• Main Authors: Darren Pouliot, Rasim Latifovic, Jon Pasher, Jason Duffe
• Format: Text
• Language: English
• Published: Multidisciplinary Digital Publishing Institute 2018
• Subjects: super resolution; convolution neural network; Landsat; Sentinel-2; Tundra
• Online Access: https://doi.org/10.3390/rs10030394

Landsat is a fundamental data source for understanding historical change and its effect on environmental processes. In this research we test shallow and deep convolution neural networks (CNNs) for Landsat image super-resolution enhancement, trained using Sentinel-2, in three study sites representing boreal forest, tundra, and cropland/woodland environments. The analysis sought to assess baseline performance and determine the capacity for spatial and temporal extension of the trained CNNs. This is not a data fusion approach and a high-resolution image is only needed to train the CNN. Results show improvement with the deeper network generally achieving better results. For spatial and temporal extension, the deep CNN performed the same or better than the shallow CNN, but at greater computational cost. Results for temporal extension were influenced by change potentiality reducing the performance difference between the shallow and deep CNN. Visual examination revealed sharper images regarding land cover boundaries, linear features, and within-cover textures. The results suggest that spatial enhancement of the Landsat archive is feasible, with optimal performance where CNNs can be trained and applied within the same spatial domain. Future research will assess the enhancement on time series and associated land cover applications.