Generating Views Using Atmospheric Correction for Contrastive Self-supervised Learning of Multi-spectral Images
In remote sensing, plenty of multi-spectral images are publicly available from various landcover satellite missions. Contrastive self-supervised learning is commonly applied to unlabeled data but relies on domain-specific transformations used for learning. When focusing on vegetation, standard transformations from image processing cannot be applied to the NIR channel, which carries valuable information about the vegetation state. Therefore, we use contrastive learning, relying on different views of unlabelled, multi-spectral images to obtain a pre-trained model to improve the accuracy scores on small-sized remote sensing datasets. This study presents the generation of additional views tailored to remote sensing images using atmospheric correction as an alternative transformation to color jittering. The purpose of the atmospheric transformation is to provide a physically consistent transformation. The proposed transformation can be easily integrated with multiple channels to exploit spectral signatures of objects. Our approach can be applied to other remote sensing tasks. Using this transformation leads to improved classification accuracy of up to 6%.
Verbund - KI: KI S strategy for Earth system data
Federal Ministry for the Environment, Nature Conservation, Nuclear Safety and Consumer ProtectionFind out more...
SFB 1502: Regional Climate Change: Disentangling the Role of Land Use and Water Management
Deutsche ForschungsgemeinschaftFind out more...
Email Address of Submitting Authora.firstname.lastname@example.org
ORCID of Submitting Author0000-0002-8472-7463
Submitting Author's InstitutionForschungszentrum Juelich
Submitting Author's Country