Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions
Automated detectors are important tools for processing large passive acoustic databases. Assessing the performance of a given method can be challenging and needs to be interpreted in the light of the overall purpose of analysis. Performance evaluation often involves comparison between thedetector ou...
Main Authors: | , , |
---|---|
Format: | Conference Object |
Language: | unknown |
Published: |
2017
|
Subjects: | |
Online Access: | https://epic.awi.de/id/eprint/45309/ https://hdl.handle.net/10013/epic.51457 |
id |
ftawi:oai:epic.awi.de:45309 |
---|---|
record_format |
openpolar |
spelling |
ftawi:oai:epic.awi.de:45309 2024-09-15T17:41:08+00:00 Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions Leroy, Emmanuelle Thomisch, Karolin van Opzeeland, Ilse 2017-06-26 https://epic.awi.de/id/eprint/45309/ https://hdl.handle.net/10013/epic.51457 unknown Leroy, E. , Thomisch, K. orcid:0000-0002-7144-8369 and van Opzeeland, I. (2017) Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions , Third Joint Meeting of the Acoustical Society of America and the European Acoustics Association, Boston, Massachusetts, 25 June 2017 - 29 June 2017 . hdl:10013/epic.51457 EPIC3Third Joint Meeting of the Acoustical Society of America and the European Acoustics Association, Boston, Massachusetts, 2017-06-25-2017-06-29 Conference notRev 2017 ftawi 2024-06-24T04:18:50Z Automated detectors are important tools for processing large passive acoustic databases. Assessing the performance of a given method can be challenging and needs to be interpreted in the light of the overall purpose of analysis. Performance evaluation often involves comparison between thedetector output and a ground-truth data set, which often involves manual analyses of the data. Such analyses may be subjective depending on, e.g., interfering background noise conditions. In this study, we investigated the variability between two analysts in the detection of Antarctic blue whale Zcalls (Balaenoptera musculus intermedia), as well as the intra-analyst variability, in order to understand how this variability impacts the creation of a ground-truth and the assessment of detector performances. Analyses were conducted on two test datasets reflecting two basins and different situations of call abundance and background noise conditions. Using a ground-truth based on combined results of both analysts, we evaluated the performances of two automated detectors, one using spectrogram correlation and the other using a subspace-detection strategy. This evaluation allows understanding how recording sites, vocal activity, and interfering sounds affect the detector performances and highlights the advantages and limitations of each of the methods, and the possible solutions to overcome the main limitations. Conference Object Antarc* Antarctic Balaenoptera musculus Blue whale Alfred Wegener Institute for Polar- and Marine Research (AWI): ePIC (electronic Publication Information Center) |
institution |
Open Polar |
collection |
Alfred Wegener Institute for Polar- and Marine Research (AWI): ePIC (electronic Publication Information Center) |
op_collection_id |
ftawi |
language |
unknown |
description |
Automated detectors are important tools for processing large passive acoustic databases. Assessing the performance of a given method can be challenging and needs to be interpreted in the light of the overall purpose of analysis. Performance evaluation often involves comparison between thedetector output and a ground-truth data set, which often involves manual analyses of the data. Such analyses may be subjective depending on, e.g., interfering background noise conditions. In this study, we investigated the variability between two analysts in the detection of Antarctic blue whale Zcalls (Balaenoptera musculus intermedia), as well as the intra-analyst variability, in order to understand how this variability impacts the creation of a ground-truth and the assessment of detector performances. Analyses were conducted on two test datasets reflecting two basins and different situations of call abundance and background noise conditions. Using a ground-truth based on combined results of both analysts, we evaluated the performances of two automated detectors, one using spectrogram correlation and the other using a subspace-detection strategy. This evaluation allows understanding how recording sites, vocal activity, and interfering sounds affect the detector performances and highlights the advantages and limitations of each of the methods, and the possible solutions to overcome the main limitations. |
format |
Conference Object |
author |
Leroy, Emmanuelle Thomisch, Karolin van Opzeeland, Ilse |
spellingShingle |
Leroy, Emmanuelle Thomisch, Karolin van Opzeeland, Ilse Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions |
author_facet |
Leroy, Emmanuelle Thomisch, Karolin van Opzeeland, Ilse |
author_sort |
Leroy, Emmanuelle |
title |
Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions |
title_short |
Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions |
title_full |
Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions |
title_fullStr |
Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions |
title_full_unstemmed |
Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions |
title_sort |
variability in ground-truth data sets and the performance of two automated detectors for antarctic blue whale calls in different soundscape conditions |
publishDate |
2017 |
url |
https://epic.awi.de/id/eprint/45309/ https://hdl.handle.net/10013/epic.51457 |
genre |
Antarc* Antarctic Balaenoptera musculus Blue whale |
genre_facet |
Antarc* Antarctic Balaenoptera musculus Blue whale |
op_source |
EPIC3Third Joint Meeting of the Acoustical Society of America and the European Acoustics Association, Boston, Massachusetts, 2017-06-25-2017-06-29 |
op_relation |
Leroy, E. , Thomisch, K. orcid:0000-0002-7144-8369 and van Opzeeland, I. (2017) Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions , Third Joint Meeting of the Acoustical Society of America and the European Acoustics Association, Boston, Massachusetts, 25 June 2017 - 29 June 2017 . hdl:10013/epic.51457 |
_version_ |
1810487240339488768 |