Explainability in CNN Models By Means of Z-Scores

This paper explores the similarities of output layers in Neural Networks (NNs) with logistic regression to explain importance of inputs by Z-scores. The network analyzed, a network for fusion of Synthetic Aperture Radar (SAR) and Microwave Radiometry (MWR) data, is applied to prediction of arctic se...

Full description

Bibliographic Details
Main Authors: Malmgren-Hansen, David, Nielsen, Allan Aasbjerg, Pedersen, Leif Toudal
Format: Text
Language:unknown
Published: 2021
Subjects:
Online Access:http://arxiv.org/abs/2102.05874
Description
Summary:This paper explores the similarities of output layers in Neural Networks (NNs) with logistic regression to explain importance of inputs by Z-scores. The network analyzed, a network for fusion of Synthetic Aperture Radar (SAR) and Microwave Radiometry (MWR) data, is applied to prediction of arctic sea ice. With the analysis the importance of MWR relative to SAR is found to favor MWR components. Further, as the model represents image features at different scales, the relative importance of these are as well analyzed. The suggested methodology offers a simple and easy framework for analyzing output layer components and can reduce the number of components for further analysis with e.g. common NN visualization methods. Comment: Intended and accepted for the "Deep Learning Meets Earth Sciences: From Hybrid Modeling to Explainability" workshop at IGARSS 2020, but was redrawn due to authors being unable to participate when lockdown restrictions moved the conference days. The work was conducted 2019 under the Automated Sea Ice Products (ASIP) project funded by the Innovation Fund Denmark