Generating Views Using Atmospheric Correction for Contrastive Self-Supervised Learning of Multispectral Images

In remote sensing, plenty of multispectral images are publicly available from various landcover satellite missions. Contrastive self-supervised learning is commonly applied to unlabeled data but relies on domain-specific transformations used for learning. When focusing on vegetation, standard transformations from image processing cannot be applied to the near-infrared (NIR) channel, which carries valuable information about the vegetation state. Therefore, we use contrastive learning, relying on different views of unlabeled, multispectral images to obtain a pretrained model to improve the accuracy scores on small-sized remote sensing datasets. This study presents the generation of additional views tailored to remote sensing images using atmospheric correction as an alternative transformation to color jittering. The purpose of the atmospheric transformation is to provide a physically consistent transformation. The proposed transformation can be easily integrated with multiple channels to exploit spectral signatures of objects. Our approach can be applied to other remote sensing tasks. Using this transformation leads to improved classification accuracy of up to 6%.

  • Published in:
    IEEE Geoscience and Remote Sensing Letters IEEE Geoscience and Remote Sensing Letters
  • Type:
    Article
  • Authors:
    Patnala, Ankit; Stadtler, Scarlet; Schultz, Martin G.; Gall, Jürgen
  • Year:
    2023

Citation information

Patnala, Ankit; Stadtler, Scarlet; Schultz, Martin G.; Gall, Jürgen: Generating Views Using Atmospheric Correction for Contrastive Self-Supervised Learning of Multispectral Images, IEEE Geoscience and Remote Sensing Letters, IEEE Geoscience and Remote Sensing Letters, 2023, May, https://ieeexplore.ieee.org/document/10124660, Patnala.etal.2023a,

Associated Lamarr Researchers

lamarr institute person Gall Juergen - Lamarr Institute for Machine Learning (ML) and Artificial Intelligence (AI)

Prof. Dr. Jürgen Gall

Principal Investigator Embodied AI to the profile