AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras
International audience Acoustic cameras, or imaging sonars, are high-potential devices for many applications in aquatic ecology, notably for fisheries management and population monitoring. However, how to extract such data into high-value information without a time-consuming entire data set reading...
Published in: | Aquatic Ecology |
---|---|
Main Authors: | , , , , |
Other Authors: | , , , , , , , , , , , , , , , , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
HAL CCSD
2023
|
Subjects: | |
Online Access: | https://hal.inrae.fr/hal-04540768 https://doi.org/10.1007/s10452-023-10004-2 |
id |
ftunivbrest:oai:HAL:hal-04540768v1 |
---|---|
record_format |
openpolar |
institution |
Open Polar |
collection |
Université de Bretagne Occidentale: HAL |
op_collection_id |
ftunivbrest |
language |
English |
topic |
Deep learning Neural network Artificial Intelligence Fisheries management Acoustic camera [SDE.BE]Environmental Sciences/Biodiversity and Ecology [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] |
spellingShingle |
Deep learning Neural network Artificial Intelligence Fisheries management Acoustic camera [SDE.BE]Environmental Sciences/Biodiversity and Ecology [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] Fernandez Garcia, Guglielmo Corpetti, Thomas Nevoux, Marie Beaulaton, Laurent Martignac, François AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
topic_facet |
Deep learning Neural network Artificial Intelligence Fisheries management Acoustic camera [SDE.BE]Environmental Sciences/Biodiversity and Ecology [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] |
description |
International audience Acoustic cameras, or imaging sonars, are high-potential devices for many applications in aquatic ecology, notably for fisheries management and population monitoring. However, how to extract such data into high-value information without a time-consuming entire data set reading by an operator is still a challenge. Moreover, the analysis of acoustic imaging, due to its low signal-to-noise ratio, is a perfect training ground for experimenting with new approaches, especially concerning deep learning techniques. We present hereby a novel approach that takes advantage of both convolutional neural network (CNN) and classical computer vision (CV) techniques, able to detect fish passages in acoustic video streams. The pipeline pre-treats the acoustic images to localise the signals of interest and to improve the detection performances. The YOLOv3-based model was trained with fish data from multiple species recorded by the two most frequently used models of acoustic cameras, the DIDSON and ARIS, including species of high ecological interest, as Atlantic salmon or European eels. The pre-treatment of images greatly improves the model performance, increasing its F1-score from 0.52 to 0.69. The model we developed provides satisfying results detecting almost 80% of fish passages and minimising the false-positive rate. On a validation data set, 40 h of videos and around 1 800 fish passages, the efficiency increases with the fish sizes, notably reaching a recall higher than 95% for Atlantic salmon. Conversely, the model appears much less efficient for eel detections on ARIS videos than on DIDSON data (31% recall vs 75%). |
author2 |
Dynamique et durabilité des écosystèmes : de la source à l’océan (DECOD) Institut Français de Recherche pour l'Exploitation de la Mer (IFREMER)-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro)-Institut Agro Rennes Angers Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro) Pôle OFB-INRAE-Institut Agro-UPPA pour la gestion des migrateurs amphihalins dans leur environnement (MIAME) Université de Pau et des Pays de l'Adour (UPPA)-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Office français de la biodiversité (OFB)-Institut Agro Rennes Angers Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro)-Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro) Centre National de la Recherche Scientifique (CNRS) Littoral, Environnement, Télédétection, Géomatique (LETG - Rennes ) Université de Brest (UBO)-Université de Rennes 2 (UR2)-Littoral, Environnement, Télédétection, Géomatique UMR 6554 (LETG) Université de Brest (UBO)-Université de Rennes 2 (UR2)-Centre National de la Recherche Scientifique (CNRS)-Institut de Géographie et d'Aménagement Régional de l'Université de Nantes (Nantes Univ - IGARUN) Nantes Université - pôle Humanités Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Nantes Université - pôle Humanités Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Centre National de la Recherche Scientifique (CNRS)-Institut de Géographie et d'Aménagement Régional de l'Université de Nantes (Nantes Univ - IGARUN) Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ) Service conservation et gestion durable des espèces exploitées (OFB SEEX) Direction de la recherche et de l’appui scientifique (OFB - DRAS) Office français de la biodiversité (OFB)-Office français de la biodiversité (OFB) Unité Expérimentale d'Ecologie et d'Ecotoxicologie Aquatique - U3E (Rennes, France) (U3E ) Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE) Pole MIAME, Office Français de la Biodiversité (OFB, French Office for Biodiversity) |
format |
Article in Journal/Newspaper |
author |
Fernandez Garcia, Guglielmo Corpetti, Thomas Nevoux, Marie Beaulaton, Laurent Martignac, François |
author_facet |
Fernandez Garcia, Guglielmo Corpetti, Thomas Nevoux, Marie Beaulaton, Laurent Martignac, François |
author_sort |
Fernandez Garcia, Guglielmo |
title |
AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
title_short |
AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
title_full |
AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
title_fullStr |
AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
title_full_unstemmed |
AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
title_sort |
acousticia, a deep neural network for multi-species fish detection using multiple models of acoustic cameras |
publisher |
HAL CCSD |
publishDate |
2023 |
url |
https://hal.inrae.fr/hal-04540768 https://doi.org/10.1007/s10452-023-10004-2 |
genre |
Atlantic salmon |
genre_facet |
Atlantic salmon |
op_source |
ISSN: 1386-2588 EISSN: 1573-5125 Aquatic Ecology https://hal.inrae.fr/hal-04540768 Aquatic Ecology, 2023, 57 (4), pp.881-893. ⟨10.1007/s10452-023-10004-2⟩ |
op_relation |
info:eu-repo/semantics/altIdentifier/doi/10.1007/s10452-023-10004-2 hal-04540768 https://hal.inrae.fr/hal-04540768 doi:10.1007/s10452-023-10004-2 WOS: 000915685500001 |
op_doi |
https://doi.org/10.1007/s10452-023-10004-2 |
container_title |
Aquatic Ecology |
container_volume |
57 |
container_issue |
4 |
container_start_page |
881 |
op_container_end_page |
893 |
_version_ |
1799477073522196480 |
spelling |
ftunivbrest:oai:HAL:hal-04540768v1 2024-05-19T07:37:43+00:00 AcousticIA, a deep neural network for multi-species fish detection using multiple models of acoustic cameras Fernandez Garcia, Guglielmo Corpetti, Thomas Nevoux, Marie Beaulaton, Laurent Martignac, François Dynamique et durabilité des écosystèmes : de la source à l’océan (DECOD) Institut Français de Recherche pour l'Exploitation de la Mer (IFREMER)-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro)-Institut Agro Rennes Angers Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro) Pôle OFB-INRAE-Institut Agro-UPPA pour la gestion des migrateurs amphihalins dans leur environnement (MIAME) Université de Pau et des Pays de l'Adour (UPPA)-Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE)-Office français de la biodiversité (OFB)-Institut Agro Rennes Angers Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro)-Institut national d'enseignement supérieur pour l'agriculture, l'alimentation et l'environnement (Institut Agro) Centre National de la Recherche Scientifique (CNRS) Littoral, Environnement, Télédétection, Géomatique (LETG - Rennes ) Université de Brest (UBO)-Université de Rennes 2 (UR2)-Littoral, Environnement, Télédétection, Géomatique UMR 6554 (LETG) Université de Brest (UBO)-Université de Rennes 2 (UR2)-Centre National de la Recherche Scientifique (CNRS)-Institut de Géographie et d'Aménagement Régional de l'Université de Nantes (Nantes Univ - IGARUN) Nantes Université - pôle Humanités Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Nantes Université - pôle Humanités Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Centre National de la Recherche Scientifique (CNRS)-Institut de Géographie et d'Aménagement Régional de l'Université de Nantes (Nantes Univ - IGARUN) Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ) Service conservation et gestion durable des espèces exploitées (OFB SEEX) Direction de la recherche et de l’appui scientifique (OFB - DRAS) Office français de la biodiversité (OFB)-Office français de la biodiversité (OFB) Unité Expérimentale d'Ecologie et d'Ecotoxicologie Aquatique - U3E (Rennes, France) (U3E ) Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement (INRAE) Pole MIAME, Office Français de la Biodiversité (OFB, French Office for Biodiversity) 2023-01-20 https://hal.inrae.fr/hal-04540768 https://doi.org/10.1007/s10452-023-10004-2 en eng HAL CCSD Springer Verlag info:eu-repo/semantics/altIdentifier/doi/10.1007/s10452-023-10004-2 hal-04540768 https://hal.inrae.fr/hal-04540768 doi:10.1007/s10452-023-10004-2 WOS: 000915685500001 ISSN: 1386-2588 EISSN: 1573-5125 Aquatic Ecology https://hal.inrae.fr/hal-04540768 Aquatic Ecology, 2023, 57 (4), pp.881-893. ⟨10.1007/s10452-023-10004-2⟩ Deep learning Neural network Artificial Intelligence Fisheries management Acoustic camera [SDE.BE]Environmental Sciences/Biodiversity and Ecology [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] info:eu-repo/semantics/article Journal articles 2023 ftunivbrest https://doi.org/10.1007/s10452-023-10004-2 2024-04-25T15:55:19Z International audience Acoustic cameras, or imaging sonars, are high-potential devices for many applications in aquatic ecology, notably for fisheries management and population monitoring. However, how to extract such data into high-value information without a time-consuming entire data set reading by an operator is still a challenge. Moreover, the analysis of acoustic imaging, due to its low signal-to-noise ratio, is a perfect training ground for experimenting with new approaches, especially concerning deep learning techniques. We present hereby a novel approach that takes advantage of both convolutional neural network (CNN) and classical computer vision (CV) techniques, able to detect fish passages in acoustic video streams. The pipeline pre-treats the acoustic images to localise the signals of interest and to improve the detection performances. The YOLOv3-based model was trained with fish data from multiple species recorded by the two most frequently used models of acoustic cameras, the DIDSON and ARIS, including species of high ecological interest, as Atlantic salmon or European eels. The pre-treatment of images greatly improves the model performance, increasing its F1-score from 0.52 to 0.69. The model we developed provides satisfying results detecting almost 80% of fish passages and minimising the false-positive rate. On a validation data set, 40 h of videos and around 1 800 fish passages, the efficiency increases with the fish sizes, notably reaching a recall higher than 95% for Atlantic salmon. Conversely, the model appears much less efficient for eel detections on ARIS videos than on DIDSON data (31% recall vs 75%). Article in Journal/Newspaper Atlantic salmon Université de Bretagne Occidentale: HAL Aquatic Ecology 57 4 881 893 |