Multi-CPU/Multi-GPU Based Framework for Multimedia Processing

Abstract

Abstract. Image and video processing algorithms present a necessary tool for various domains related to computer vision such as medical applications, pattern recognition and real time video processing methods. The performance of these algorithms have been severely hampered by their high intensive computation since the new video standards, especially those in high definitions require more resources and memory to achieve their computations. In this paper, we propose a new framework for multimedia (single image, multiple images, multiple videos, video in real time) processing that exploits the full computing power of heterogeneous machines. This framework enables to select firstly the computing units (CPU or/and GPU) for processing, and secondly the methods to be applied depending on the type of media to process and the algorithm complexity. The framework exploits efficient scheduling strategies, and allows to reduce significantly data transfer times thanks to an efficient management of GPU memories and to the overlapping of data copies by kernels executions. Otherwise, the framework includes several GPUbased image and video primitive functions, such as silhouette extraction, corners detection, contours extraction, sparse and dense optical flow estimation. These primitives are exploited in different applications such as vertebra segmentation in X-ray and MR images, videos indexation, event detection and localization in multi-user scenarios. Experimental results have been obtained by applying the framework on different computer vision methods showing a global speedup ranging from 5 to 100, by comparison with sequential CPU implementations.

Internet of Things: learning and practices. Application to Smart City

“…As future work, we plan to exploit GPU Tegra Mobile Processors that offers high computation power thanks to the exploitation of GPU processors in parallel [14] [15]. In addition to the high performance, the parallel implementations would offer lower power consumption [16] as result of the fast treatment.…”

Irrigation pivot-center connected at low cost for the reduction of crop water requirements

“…In addition to this, the continuous analysis of sound from microphones implemented in chosen places will quickly detect signs of failure and prevent downtime that can be expensive in term of crop profitability. As future work, we plan to exploit GPU Tegra Mobile Processors 1 that offers high computation power thanks to the exploitation of GPU processors in parallel [46] [47]. In addition to the high performance, these cards provide the possibility to exploit artificial intelligence algorithms for a better training and prediction of collected data.…”

Cloud architecture for plant phenotyping research

“…CUDA is so used in the field of image and video processing. [46][47][48] • OpenCL:OpenCL (Open Computing Language) presents the free standard for parallel programming that can be executed on diverse processors such as CPUs, ATI, or NVIDIA GPUs. OpenCL is also used for several image and video processing applications.…”