SmartDepthSync: Open Source Synchronized Video Recording System of Smartphone RGB and Depth Camera Range Image Frames With Sub-Millisecond Precision

Faizullin, Marsel; Kornilova, Anastasiia; Akhmetyanov, Azat; Pakulev, Konstantin; Sadkov, Andrey; Ferrer, Gonzalo

doi:10.1109/jsen.2022.3150973

Cited by 2 publications

(2 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, the computational cost of determining correspondence between multi-view trajectories remains high. [26][27][28]. Experimental data indicate that the results of this study surpass image data-driven methods by an order of magnitude.…”

Section: Comparison With Related Workmentioning

confidence: 78%

“…Among them, Smid and Matas [26] deployed camera flash as a synchronization tool. Faizullin et al [27] utilized a gyroscope for synchronizing smartphones with commercial depth cameras. Work by Ansari et al [28] enabled multiple Android phones to capture synchronously with sub-millisecond precision, largely leaning on network communication from camera capture software, albeit with high inter-camera dependencies.…”

Section: Related Studiesmentioning

confidence: 99%

See 1 more Smart Citation

Joint Solution for Temporal-Spatial Synchronization of Multi-View Videos and Pedestrian Matching in Crowd Scenes

Yang,

Guo

2023

View full text Add to dashboard Cite

The study of crowd movement and behavioral patterns typically relies on spatio-temporal localization data of pedestrians. While monocular cameras serve the purpose, industrial binocular cameras based on multi-view geometry offer heightened spatial accuracy. These cameras synchronize time through circuits and are calibrated for external parameters after fixing their relative positions. Yet, the flexibility and real-time adaptability of using two different cameras or smartphones in close proximity, forming a short-baseline binocular camera, presents challenges in camera time synchronization, external parameter calibration, and pedestrian feature matching. A method is introduced herein for jointly addressing these challenges. Images are abstracted into spatial-temporal point sets based on human head coordinates and frame numbers. Through point set registration, time synchronization and pedestrian matching are achieved concurrently, followed by the calibration of the shortbaseline camera's external parameters. Numerical results from synthetic and real-world scenarios indicate the proposed model's capability in addressing the aforementioned fundamental challenges. With the sole reliance on crowd image data, devoid of external hardware, software, or manual calibrations, time synchronization precision reaches the submillisecond level, pedestrian matching averages a 92% accuracy rate, and the camera's external parameters align with the calibration board's precision. Ultimately, this research facilitates the self-calibration, automatic time synchronization, and pedestrian matching tasks for short-baseline camera assemblies observing crowds.

show abstract

Section: Comparison With Related Workmentioning

confidence: 78%