Interface Overheads in Embedded Multimedia Software

Rintaluoma, Tero; Silvén, Olli; Raekallio, Juuso

doi:10.1007/11796435_3

Cited by 12 publications

(8 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The current multimedia frameworks intended for use on mobile platforms have substantial latencies when the resources are reconfigured for the applications. For instance, Rintaluoma et al 6 found that the Symbian MMF (MultiMedia Framework) consumed approximately 60000 processor cycles for accessing a device driver from the application layer. OpenMAX is claimed to be a lighter weight interface for use in streaming multimedia hardware and software components.…”

Section: Mobile Communications Device Platformsmentioning

confidence: 99%

New video applications on mobile communication devices

Silvén

Hannuksela

López

et al. 2008

Multimedia on Mobile Devices 2008

View full text Add to dashboard Cite

The video applications on mobile communication devices have usually been designed for content creation, access, and playback. For instance, many recent mobile devices replicate the functionalities of portable video cameras and video recorders, and digital TV receivers. These are all demanding uses, but nothing new from the consumer point of view. However, many of the current devices have two cameras built in, one for capturing high resolution images, and the other for lower, typically VGA (640x480 pixels) resolution video telephony. We employ video to enable new applications and describe four actual solutions implemented on mobile communication devices. The first one is a real-time motion based user interface that can be used for browsing large images or documents such as maps on small screens. The motion information is extracted from the image sequence captured by the camera. The second solution is a real-time panorama builder, while the third one assembles document panoramas, both from individual video frames. The fourth solution is a real-time face and eye detector. It provides another type of foundation for motion based user interfaces as knowledge of presence and motion of a human faces in the view of the camera can be a powerful application enabler.

show abstract

Section: Mobile Communications Device Platformsmentioning

confidence: 99%

New video applications on mobile communication devices

Silvén

Hannuksela

López

et al. 2008

Multimedia on Mobile Devices 2008

View full text Add to dashboard Cite

show abstract

“…Since the fine-grained accelerators are intended to be invoked very frequently, the synchronization mechanism needs to be efficient, not to cause unreasonable overhead. For this reason, interrupt-based synchronization is out of question, whereas low-overhead scheduling is much more appealing [2,15]. However, the scheduling has to be done efficiently, which can be shown easily by a brief example: Suppose we have a MPEG-4 -compressed video sequence of resolution 320x240 at 25 frames per second and we schedule the decoding operations of each macroblock.…”

Section: Mpeg-4 Video Decoding With Fine-grained Accelerationmentioning

confidence: 99%

“…Smallscale transaction synchronization has been most often handled with interrupts. However, recent studies have shown that the overheads of interrupt-based synchronization can become high and better alternatives should be developed [15]. In some cases, low-overhead run-time scheduling can be a feasible alternative [2].…”

Section: Introductionmentioning

confidence: 99%

Low-Overhead Run-Time Scheduling for Fine-Grained Acceleration of Signal Processing Systems

Boutellier

Bhattacharyya

Silvén

2007

2007 IEEE Workshop on Signal Processing Systems

Self Cite

View full text Add to dashboard Cite

In this paper, we present four scheduling algorithms that provide flexible utilization of fine-grain DSP accelerators with low run-time overhead. Methods that have originally been used in operations research are implemented in a way that minimizes the amount of run-time computations. These low overhead scheduling methods can be used for synchronization in multi-processor systems, especially when dedicated co-processors implement tasks with low turnaround times. We demonstrate our methods by an application to MPEG-4 video decoding. In this demonstration, MPEG-4 macroblock decoding is modeled as a permutation flowshop problem and our proposed algorithms are applied to schedule co-processors that implement MPEG-4 block decoding operations. Experimental results demonstrate the effectiveness of our scheduling approach.

show abstract

“…However, Rintaluoma et al [3] noted that the high software overheads of traditional interrupt based synchronization would become prohibitive for fine-grained accelerators: context switches would occur with greater frequency than in the coarse-grained case, and cache pollution would ensue from each switch. This paper advocates quasi-static run-time scheduling and orchestration of hardware accelerators.…”

Section: Introductionmentioning

confidence: 99%

Architectural support for the orchestration of fine-grained multiprocessing for portable streaming applications

Boutellier

Cevrero

Brisk

et al. 2009

2009 IEEE Workshop on Signal Processing Systems

View full text Add to dashboard Cite

Handheld devices are expected to start using fine-grained ASIC accelerators to meet energy-efficiency requirements of increasingly complex applications, e.g., video decoding and reconfigurable radio. To avoid overhead, static multiprocessor schedules are preferable for orchestrating fine-grained accelerators. However, as modern applications use accelerators in irregular patterns, static scheduling leads to low hardware utilization.Run-time scheduling for fine-grained accelerators solves the utilization problem, but easily produces significant overhead. We propose an efficient Accelerator Management Unit (AMU) , implemented in hardware. E.g., in video decoding, the AMU takes 3 to 18 cycles to compute a macroblock decoding schedule. The CPU may perform useful work, as the AMU does independent task dispatching.Two experiments are performed, where the AMU is integrated into an FPGA-based multiprocessing prototype system. One experiment does AMU-orchestrated MPEG-4 video decoding and the other demonstrates that the AMU enables low-overhead dynamic scheduling and produces a significant performance advantage over static scheduling.

show abstract

Interface Overheads in Embedded Multimedia Software

Cited by 12 publications

References 4 publications

New video applications on mobile communication devices

New video applications on mobile communication devices

Low-Overhead Run-Time Scheduling for Fine-Grained Acceleration of Signal Processing Systems

Architectural support for the orchestration of fine-grained multiprocessing for portable streaming applications

Contact Info

Product

Resources

About