North Atlantic Right Whales Up-call Detection Using Multimodel Deep Learning

• Main Authors: Ibrahim, Ali K, Zhuang, Hanqi, Ch'erubin, Laurent M., Erdol, Nurgun, Corry-Crowe, Gregory O, Ali, Ali Muhamed
• Format: Article in Journal/Newspaper
• Language: unknown
• Published: arXiv 2020
• Subjects: Audio and Speech Processing eess.AS; Sound cs.SD; FOS Electrical engineering, electronic engineering, information engineering; FOS Computer and information sciences; North Atlantic
• Online Access: https://dx.doi.org/10.48550/arxiv.2005.08356; https://arxiv.org/abs/2005.08356

A new method for North Atlantic Right Whales (NARW) up-call detection using Multimodel Deep Learning (MMDL) is presented in this paper. In this approach, signals from passive acoustic sensors are first converted to spectrogram and scalogram images, which are time-frequency representations of the signals. These images are in turn used to train an MMDL detec-tor, consisting of Convolutional Neural Networks (CNNs) and Stacked Auto Encoders (SAEs). Our experimental studies revealed that CNNs work better with spectrograms and SAEs with sca-lograms. Therefore in our experimental design, the CNNs are trained by using spectrogram im-ages, and the SAEs are trained by using scalogram images. A fusion mechanism is used to fuse the results from individual neural networks. In this paper, the results obtained from the MMDL detector are compared with those obtained from conventional machine learning algorithms trained with handcraft features. It is shown that the performance of the MMDL detector is sig-nificantly better than those of the representative conventional machine learning methods in terms of up-call detection rate, non-up-call detection rate, and false alarm rate.