Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning
The advancement of spring is a widespread biological response to climate change observed across taxa and biomes. However, the species level responses to warming are complex and the underlying mechanisms are difficult to disentangle. This is partly due to a lack of data, which are typically collected...
Published in: | Remote Sensing in Ecology and Conservation |
---|---|
Main Authors: | , , , , , |
Format: | Article in Journal/Newspaper |
Language: | English |
Published: |
2022
|
Subjects: | |
Online Access: | https://pure.au.dk/portal/da/publications/automatic-flower-detection-and-phenology-monitoring-using-timelapse-cameras-and-deep-learning(a0005565-1ac0-45e5-b470-9a163e365d79).html https://doi.org/10.1002/rse2.275 http://www.scopus.com/inward/record.url?scp=85131075810&partnerID=8YFLogxK |
id |
ftuniaarhuspubl:oai:pure.atira.dk:publications/a0005565-1ac0-45e5-b470-9a163e365d79 |
---|---|
record_format |
openpolar |
spelling |
ftuniaarhuspubl:oai:pure.atira.dk:publications/a0005565-1ac0-45e5-b470-9a163e365d79 2023-05-15T14:56:57+02:00 Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning Mann, Hjalte M.R. Iosifidis, Alexandros Jepsen, Jane U. Welker, Jeffrey M. Loonen, Maarten J.J.E. Høye, Toke T. 2022-12 https://pure.au.dk/portal/da/publications/automatic-flower-detection-and-phenology-monitoring-using-timelapse-cameras-and-deep-learning(a0005565-1ac0-45e5-b470-9a163e365d79).html https://doi.org/10.1002/rse2.275 http://www.scopus.com/inward/record.url?scp=85131075810&partnerID=8YFLogxK eng eng info:eu-repo/semantics/openAccess Mann , H M R , Iosifidis , A , Jepsen , J U , Welker , J M , Loonen , M J J E & Høye , T T 2022 , ' Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning ' , Remote Sensing in Ecology and Conservation , vol. 8 , no. 6 , pp. 765-777 . https://doi.org/10.1002/rse2.275 Arctic computer vision convolutional neural network Dryas integrifolia Dryas octopetala ecological monitoring life-history variation machine learning article 2022 ftuniaarhuspubl https://doi.org/10.1002/rse2.275 2023-02-08T23:56:15Z The advancement of spring is a widespread biological response to climate change observed across taxa and biomes. However, the species level responses to warming are complex and the underlying mechanisms are difficult to disentangle. This is partly due to a lack of data, which are typically collected by direct observations, and thus very time-consuming to obtain. Data deficiency is especially pronounced in the Arctic where the warming is particularly severe. We present a method for automated monitoring of flowering phenology of specific plant species at very high temporal resolution through full growing seasons and across geographical regions. The method consists of image-based monitoring of field plots using near-surface time-lapse cameras and subsequent automated detection and counting of flowers in the images using a convolutional neural network. We demonstrate the feasibility of collecting flower phenology data using automatic time-lapse cameras and show that the temporal resolution of the results surpasses what can be collected by traditional observation methods. We focus on two Arctic species, the mountain avens Dryas octopetala and Dryas integrifolia in 20 image series from four sites. Our flower detection model proved capable of detecting flowers of the two species with a remarkable precision of 0.918 (adjusted to 0.966) and a recall of 0.907. Thus, the method can automatically quantify the seasonal dynamics of flower abundance at fine scale and return reliable estimates of traditional phenological variables such as the timing of onset, peak, and end of flowering. We describe the system and compare manual and automatic extraction of flowering phenology data from the images. Our method can be directly applied on sites containing mountain avens using our trained model, or the model could be fine-tuned to other species. We discuss the potential of automatic image-based monitoring of flower phenology and how the method can be improved and expanded for future studies. Article in Journal/Newspaper Arctic Climate change Dryas octopetala Mountain avens Aarhus University: Research Arctic Remote Sensing in Ecology and Conservation 8 6 765 777 |
institution |
Open Polar |
collection |
Aarhus University: Research |
op_collection_id |
ftuniaarhuspubl |
language |
English |
topic |
Arctic computer vision convolutional neural network Dryas integrifolia Dryas octopetala ecological monitoring life-history variation machine learning |
spellingShingle |
Arctic computer vision convolutional neural network Dryas integrifolia Dryas octopetala ecological monitoring life-history variation machine learning Mann, Hjalte M.R. Iosifidis, Alexandros Jepsen, Jane U. Welker, Jeffrey M. Loonen, Maarten J.J.E. Høye, Toke T. Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
topic_facet |
Arctic computer vision convolutional neural network Dryas integrifolia Dryas octopetala ecological monitoring life-history variation machine learning |
description |
The advancement of spring is a widespread biological response to climate change observed across taxa and biomes. However, the species level responses to warming are complex and the underlying mechanisms are difficult to disentangle. This is partly due to a lack of data, which are typically collected by direct observations, and thus very time-consuming to obtain. Data deficiency is especially pronounced in the Arctic where the warming is particularly severe. We present a method for automated monitoring of flowering phenology of specific plant species at very high temporal resolution through full growing seasons and across geographical regions. The method consists of image-based monitoring of field plots using near-surface time-lapse cameras and subsequent automated detection and counting of flowers in the images using a convolutional neural network. We demonstrate the feasibility of collecting flower phenology data using automatic time-lapse cameras and show that the temporal resolution of the results surpasses what can be collected by traditional observation methods. We focus on two Arctic species, the mountain avens Dryas octopetala and Dryas integrifolia in 20 image series from four sites. Our flower detection model proved capable of detecting flowers of the two species with a remarkable precision of 0.918 (adjusted to 0.966) and a recall of 0.907. Thus, the method can automatically quantify the seasonal dynamics of flower abundance at fine scale and return reliable estimates of traditional phenological variables such as the timing of onset, peak, and end of flowering. We describe the system and compare manual and automatic extraction of flowering phenology data from the images. Our method can be directly applied on sites containing mountain avens using our trained model, or the model could be fine-tuned to other species. We discuss the potential of automatic image-based monitoring of flower phenology and how the method can be improved and expanded for future studies. |
format |
Article in Journal/Newspaper |
author |
Mann, Hjalte M.R. Iosifidis, Alexandros Jepsen, Jane U. Welker, Jeffrey M. Loonen, Maarten J.J.E. Høye, Toke T. |
author_facet |
Mann, Hjalte M.R. Iosifidis, Alexandros Jepsen, Jane U. Welker, Jeffrey M. Loonen, Maarten J.J.E. Høye, Toke T. |
author_sort |
Mann, Hjalte M.R. |
title |
Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
title_short |
Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
title_full |
Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
title_fullStr |
Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
title_full_unstemmed |
Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
title_sort |
automatic flower detection and phenology monitoring using time-lapse cameras and deep learning |
publishDate |
2022 |
url |
https://pure.au.dk/portal/da/publications/automatic-flower-detection-and-phenology-monitoring-using-timelapse-cameras-and-deep-learning(a0005565-1ac0-45e5-b470-9a163e365d79).html https://doi.org/10.1002/rse2.275 http://www.scopus.com/inward/record.url?scp=85131075810&partnerID=8YFLogxK |
geographic |
Arctic |
geographic_facet |
Arctic |
genre |
Arctic Climate change Dryas octopetala Mountain avens |
genre_facet |
Arctic Climate change Dryas octopetala Mountain avens |
op_source |
Mann , H M R , Iosifidis , A , Jepsen , J U , Welker , J M , Loonen , M J J E & Høye , T T 2022 , ' Automatic flower detection and phenology monitoring using time-lapse cameras and deep learning ' , Remote Sensing in Ecology and Conservation , vol. 8 , no. 6 , pp. 765-777 . https://doi.org/10.1002/rse2.275 |
op_rights |
info:eu-repo/semantics/openAccess |
op_doi |
https://doi.org/10.1002/rse2.275 |
container_title |
Remote Sensing in Ecology and Conservation |
container_volume |
8 |
container_issue |
6 |
container_start_page |
765 |
op_container_end_page |
777 |
_version_ |
1766329005045186560 |