3D reconstruction system and multiobject local tracking algorithm designed for billiards

Abstract

The use of virtual reality or augmented reality systems in billiards sports are useful tools for pure entertainment or improving the player’s skills. Depending on the purpose of these systems, tracking algorithms based on computer vision must be used. These algorithms are especially useful in systems aiming to reconstruct the trajectories followed by the balls after a strike. However, depending on the billiard modality, the problem of tracking multiple small identical objects, such as balls, is a complex task. In addition, when an amateur or nontop professional player uses low-frame-rate and low-resolution devices, problems such as blurred balls, blurred contours, or fuzzy edges, among others, arise. These effects have a negative impact on ball-tracking accuracy and reconstruction quality. Thus, this work proposes two contributions. The first contribution is a new tracking algorithm called “multiobject local tracking (MOLT)”. This algorithm can track balls with high precision and accuracy even with motion blur caused by low-resolution and low-frame-rate devices. Moreover, the proposed MOLT algorithm is compared with nine tracking methods and four different metrics, outperforming the rest of the methods in the majority of the cases and providing a robust solution. The second contribution is a whole system to track (using the MOLT algorithm) and reconstruct the movements of the balls on a billiard table in a 3D virtual world using computer vision. The proposed system covers all steps from image capture to 3D reconstruction. The 3D reconstruction results have been qualitatively evaluated by different users through a series of questionnaires, obtaining an overall score of 7.6 (out of 10), which indicates that the system is a promising and useful tool for training. Finally, both the MOLT algorithm and the reconstruction system are tested in three billiard modalities: blackball, carom billiards, and snooker.

Spatial deformable transformer for 3D point cloud registration

“…Point cloud registration is a significant task in the field of computer vision and plays a crucial role in the fields of 3D reconstruction 1 , 2 , SLAM 3 , 4 and autonomous driving 5 , 6 and so on. The process of 3D point cloud registration techniques is to align multiple point clouds from different viewpoints or sensors into a same coordinate system.…”

Image Super-Resolution Reconstruction in Sports Scenarios and Its Application in Motion Analysis

“…The rapid movements and complex scenes in basketball games pose high demands on image capture equipment, and conventional video capture technology often fails to provide sufficient resolution for detailed analysis of subtle motion skills and tactical layouts [4,5]. Therefore, using image super-resolution reconstruction technology to process low-resolution images to restore highresolution details has become a key technique to improve the quality and efficiency of basketball game analysis [6][7][8].…”

Effective recognition design in 8-ball billiards vision systems for training purposes based on Xception network modified by improved Chaos African Vulture Optimizer

“…The development of effective recognition design in vision systems tailored for 8-ball billiards is a significant advancement in this field 7 . These systems are designed to enhance the training process by offering real-time feedback, strategic insights, and detailed analytics of gameplay.…”