HFR-Video-Based Honeybee Activity Sensing Using Pixel-Level Short-Time Fourier Transform

Shimasaki, Kohei; Jiang, Mingjun; Takaki, Takeshi; Ishii, Idaku; Yamamoto, Kazuhiko

doi:10.1109/icsens.2018.8589744

Cited by 8 publications

(4 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, the authors choose to crop images to only retain a region of interest containing the landing pad. More specialized cameras are used in [Shimasaki et al, 2018] and [Shimasaki et al, 2020] (bees tracking), where 1024 × 1024 images at 2000 and 500 frames per second are captured, respectively. These cameras are placed in front of the beehive, capturing a 4 m × 4 m scene.…”

Section: Bees Countmentioning

confidence: 99%

“…Bee counting (omnidirectional) [Schurischuster et al, 2018] 1920 × 1080 (30fps) GMMs, Color Histograms, Dense SURF, Varroa mites detection Naive Bayes, SVM & RF [Magnier et al, 2018 Edge detection, fit ellipses, concordance Bee tracking & counting [Stojnic et al, 2018] 1280 × 720 SIFT, VLAD & SVM Pollen sacs detection [Sledevic, 2018] 1920 × 1024 (3fps) CNN Pollen sacs detection [Shimasaki et al, 2018] 1024 Bee counting (omnidirectional) [Bjerge et al, 2019] 1296 × 966 (31fps) SIFT, SURF, ORB, LDA & CNN Varroa mites detection [Shimasaki et al, 2020] 1024 × 1024 (500fps) STFT Bee tracking & wing-flapping freq. measures [Mukherjee and Kulyukin, 2020] 160 × 120, 320 × 240 & 640 × 480 (25fps) DPIV Bee tracking (directional) [Ngo et al, 2021]…”

Section: Opencv Algorithmsmentioning

confidence: 99%

“…Other Statistical Methods The authors of [Shimasaki et al, 2018] used Short-time Fourier Transform (STFT) to analyze video data at high frames per second. Doing so, the flight path of bees can be seen as the undulation of the brightness of pixels and tracked with precision.…”

Section: Models and Accuracymentioning

confidence: 99%

See 2 more Smart Citations

Toward an intelligent and efficient beehive: A survey of precision beekeeping systems and services

Hadjur

Ammar

Lefèvre

2022

Computers and Electronics in Agriculture

View full text Add to dashboard Cite

Since the end of the 20 th century, bees are suffering from increasing stress factors, leading domesticated colonies to die or at least be less productive. Precision beekeeping (PB) is an emerging field of agriculture that aims at protecting bees, supporting beekeepers, and optimizing apiary production thanks to digital infrastructures. The digitalization of apiculture first involves systems from the field of the Internet of Things (IoT), with the development of sensors to collect and transfer bee-related data. Then, data analysis comes into play, providing models that connect the data with the biological states of beehives, sometimes thanks to artificial intelligence (AI).In this paper, we describe the recent advances in precision beekeeping as systems and as services. Different types of sensors, networks, and power sources in PB are covered. The collection and use of data are described, and the performances of PB services are assessed. We also estimate the sustainability of the proposed solutions, taking into account their scalability, efficiency, and economic cost, because beekeepers need deployable research results.

show abstract

Section: Bees Countmentioning

confidence: 99%

Section: Opencv Algorithmsmentioning

confidence: 99%

See 1 more Smart Citation

Toward an intelligent and efficient beehive: A survey of precision beekeeping systems and services

Hadjur

Ammar

Lefèvre

2022

Computers and Electronics in Agriculture

View full text Add to dashboard Cite

show abstract

“…Their effectiveness was demonstrated in applications such as high-speed mechanical tracking [60], robot hand grasping [61], and virtual stillness for heart surgery [62]. Dynamic sensing applications, which directly capture the dynamic properties of an object in the audio frequency range, have been developed, such as the analysis of scratching behavior of laboratory mice [63,64], honeybee flight analysis for offline HFR videos [65,66], cell deformation analysis in microchannels [67][68][69], and structural modal analysis [70]. Ultrafast mirror-drive pan-tilt cameras [71,72] that can switch 500 viewpoints per second have been used for structural vibration analysis by acting as multiple cameras capturing different views.…”

Section: Vibration Sensing Using High-speed Visionmentioning

confidence: 99%

High-frame-rate Video-based Multicopter Tracking System Using Pixel-level Short-time Fourier Transform

Shimasaki

Fujiwara

et al. 2021

J Intell Robot Syst

Self Cite

View full text Add to dashboard Cite

In this study, we develop a telephoto pan-tilt drone search and track system for multicopters flying in a wide area spanning hundreds of meters, situated at a distance of hundreds of meters. It can detect periodic brightness changes around the drone propellers, which rotate at a high speed, in a high-frame-rate (HFR) video. The temporal frequency responses of the brightness signals in the HFR video are computed by performing pixel-level short-time Fourier transforms (STFTs) of the signals. By detecting the peak frequencies, the drone propellers are localized as vibration sources, and their rotation speed is estimated to monitor the flight status of the drone. For real-time localization and flight monitoring, the proposed system can perform pixel-level STFTs in a 500 fps video of 720×540 pixels using video processing accelerated by graphic processing units. This allows a multicopter to be tracked in real time at the center of the camera view by a galvanomirror pan-tilt active vision system with visual feedback. We verified its effectiveness by examining HFR videos for flying multicopters of different appearance, and conducted tracking experiments in outdoor scenes involving multicopters flying at an altitude of 70 m and 200 m ahead in a mountainous background.

show abstract

IoT for Smart Apiculture: Issues and Solutions

Amina

Benahmed²,

Mokeddem

et al. 2022

2022 3rd International Conference on Embedded &Amp; Distributed Systems (EDiS)

View full text Add to dashboard Cite

HFR-Video-Based Honeybee Activity Sensing Using Pixel-Level Short-Time Fourier Transform

Cited by 8 publications

References 17 publications

Toward an intelligent and efficient beehive: A survey of precision beekeeping systems and services

Toward an intelligent and efficient beehive: A survey of precision beekeeping systems and services

High-frame-rate Video-based Multicopter Tracking System Using Pixel-level Short-time Fourier Transform

IoT for Smart Apiculture: Issues and Solutions

Contact Info

Product

Resources

About