ホンダ・リサーチ・インスティチュート・ジャパン – 先端技術の研究開発

論文検索 > HARK-Bird-Box: A Portable Real-time Bird Song Scene Analysis System

研究活動

論文検索

Advanced Search

October 2018

HARK-Bird-Box: A Portable Real-time Bird Song Scene Analysis System

  • R. Kojima, O. Sugiyama, K. Hoshiba, R. Suzuki, K. Nakadai,
  • in Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018),
  • IEEE,
  • 2018,
  • pp. 2497-2502,
  • Conference paper

This paper addresses real-time bird song scene analysis. Observation of animal behavior such as communication of wild birds would be aided by a portable device implementing a real-time system that can localize sound sources, measure their timing, classify their sources, and visualize these factors of sources. The difficulty of such a system is an integration of these functions considering the real-time requirement. To realize such a system, we propose a cascaded approach, cascading sound source detection, localization, separation, feature extraction, classification, and visualization for bird song analysis. Our system is constructed by combining an open source software for robot audition called HARK and a deep learning library to implement a bird song classifier based on a convolutional neural network (CNN). Considering portability, we implemented this system on a single-board computer, Jetson TX2, with a microphone array and developed a prototype device for bird song scene analysis. A preliminary experiment confirms a computational time for the whole system to realize a real-time system. Also, an additional experiment with a bird song dataset revealed a trade-off relationship between classification accuracy and time consuming and the effectiveness of our classifier. Index Terms?bird song scene analysis, robot audition, scene understanding, real-time system.

Search by Other Conditions

Keywords
Entry type
Years
to
Authors
Language
Refereed