Combination of microphone array processing and camera image processing for visualizing sound pressure distribution

Goseki, Masafumi; Ding, Ming; Takemura, Hiroshi; Mizoguchi, Hiroshi

doi:10.1109/icsmc.2011.6083656

Cited by 10 publications

(5 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The combination of visual and auditory information processing has attracted the interests of many researchers [47]- [53]. A perception sensor net-work [47] capable of detecting emergency situations was presented for school safety, using a Kinect with four microphones to acquire audio signals.…”

Section: Introductionmentioning

confidence: 99%

Acoustic Enhanced Camera Tracking System Based on Small-Aperture MEMS Microphone Array

Lian

et al. 2020

IEEE Access

View full text Add to dashboard Cite

The camera tracking systems based on visual image processing face a problem that they are completely ineffective in their blind zones. To address this problem, a design of acoustic enhanced tracking system combining visual and auditory target tracking methods is reported in this paper. The system holds the abilities of performing sound direction estimation and target tracking in real-time. Estimating direction of arrival of the sound accompanied with the target helps the camera turn towards the target outside the field of view. This sound-triggered mode of camera operation makes a significant supplement to conventional cameras' working state. Considering the embedded system is necessary in consideration of the cost and size of the system in practical application, we designed a small aperture array with 7 digital omnidirectional MEMS microphones and built the overall system based on FPGA and ARM. The experiments were carried out in a normal indoor environment and the results confirmed that the system can perform auditory and visual tracking in real-time.INDEX TERMS visual target tracking, MEMS microphone array, acoustic localization, computer perception.

show abstract

Section: Introductionmentioning

confidence: 99%

Acoustic Enhanced Camera Tracking System Based on Small-Aperture MEMS Microphone Array

Lian

et al. 2020

IEEE Access

View full text Add to dashboard Cite

show abstract

“…This paper mainly cares about the matching between the trajectory tracking task and the hardware configuration including the sensors. The sampling periods of sensors, like cameras [17], [18], [19], IMU [20], [21], encoders of motors [22], [23], are different. Therefore, the mobile robot cannot track arbitrary trajectory with any tracking speed in practice, and the reasonable hardware configurations make a difference on the performance of the trajectory tracking.…”

Section: Introductionmentioning

confidence: 99%

A new method for trajectory tracking of nonholonomic mobile robot based on frequency spectrum

Liu

Dong

Jin

et al. 2015

2015 IEEE International Conference on Robotics and Biomimetics (ROBIO)

View full text Add to dashboard Cite

It is one of the fundamental issues for the mobile robot motion to track a known trajectory in most cases, such as the AGV in the factory, the mobile car in the physical distribution. This paper presents a new method for controlling a nonholonomic mobile robot to track a desired trajectory considering the sampling period of the sensors equipped on the robot. In natural coordinate system, the Fourier transform is utilized to attain the frequency characteristics of the trajectory. Then it can be confirmed that whether the trajectory can be tracked accurately and how to achieve an effective strategy for trajectory tracking according to the Nyquist's Theory. The simulation results verify the validity of the method proposed in this paper.

show abstract

“…Microphone array signal processing is used to separate an objective sound from mixed sounds. This technology is currently being actively researched for application in areas such as sound source identification apparatus and the environment recognition function of service robots [1]. The novel technology discussed in this paper was developed to spur interest in future science and technology.…”

Section: Introductionmentioning

confidence: 99%

Novel Application of Spherical Microphone Array Sensor with Three-Dimensional Directivity

Nakadai

Taguchi

Mizoguchi

et al. 2014

International Journal on Smart Sensing and Intelligent Systems

View full text Add to dashboard Cite

Mixed sounds can be separated from multiple sound sources by utilizing a microphone array and signal processing. We believe that promotion of interest in this technique can lead to significant developments in future science and technology. Consequently, in order to experience this technique, we designed a language game for children called "KIKIWAKE 3D" that uses a sound source separation system with the aim of arousing children's interest in this technology. In this paper, we discuss the development of a spherical microphone array with threedimensional directivity introduced to make the game more interesting and to facilitate a larger number of participants.

show abstract

Combination of microphone array processing and camera image processing for visualizing sound pressure distribution

Cited by 10 publications

References 2 publications

Acoustic Enhanced Camera Tracking System Based on Small-Aperture MEMS Microphone Array

Acoustic Enhanced Camera Tracking System Based on Small-Aperture MEMS Microphone Array

A new method for trajectory tracking of nonholonomic mobile robot based on frequency spectrum

Novel Application of Spherical Microphone Array Sensor with Three-Dimensional Directivity

Contact Info

Product

Resources

About