Hybrid key: An automatic tool for real-time high quality chroma keying

Yin, Lu; Zhao, Jiying

doi:10.1109/icip.2015.7351729

Cited by 2 publications

(2 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[20][21][22] The authors in 23 show the use of a deeplearning-based scheme that uses an encoder-decoder architecture with a novel feature aggregation module to enable highly accurate video matting. Per-frame tasks such as colourisation 24,25 and chroma-keying 26 have also shown to benefit from GPU acceleration. While deep-learning inference can be performed on modern CPUs with many processing cores, the massively parallel architecture on GPUs and library support for mapping applications to these cores enables GPU to achieve superior acceleration in such data-independent tasks.…”

Section: Background and Related Workmentioning

confidence: 99%

A case for FPGA-based accelerators for energy-efficient motion picture video processing

Boyle,

Shanker

2023

Applications of Digital Image Processing XLVI

View full text Add to dashboard Cite

In recent years, computing-based video processing workflows have become an integral part of the motion picture industry. These workloads are highly data- and compute-intensive, requiring capable hardware to achieve the required performance. Currently, general-purpose CPUs and GPUs are used to accelerate video processing functions in motion picture workflows. While such devices are highly suited to software-driven video processing workflows, they consume large amounts of energy in these tasks. In this work, we present a case for deploying an FPGA-based accelerator as an energy-efficient alternative to general-purpose hardware in high-resolution motion picture video processing, using an ingest module as a case study. We show that an FPGA-based accelerator for decoding 8K OpenEXR B44 video frames, designed using a commercial high-level synthesis workflow and executing on a PCIe-connected Alveo U50 device, outperforms a highly parallel, CPU-optimised inbuilt B44 decoder implementation in terms of energy consumption per frame decoded. In our experiments, the FPGA-accelerated B44 was able to decode 8K frames with 47.9 ms latency while consuming 0.98 J of energy per frame, compared to the 58.3 ms achieved by a high-end Intel 11700-K CPU while consuming 4.5 J per frame, when averaged over 1000 runs. We further show that this offload can be seamlessly integrated into state-of-the-art motion picture tools such as NUKE with minimal effort. With FPGAs becoming mainstream in cloud servers, we envision that this work paves the way for more efficient integration and utilisation of custom hardware and FPGAs in compute-intensive motion picture workflows.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

A case for FPGA-based accelerators for energy-efficient motion picture video processing

Boyle,

Shanker

2023

Applications of Digital Image Processing XLVI

View full text Add to dashboard Cite

show abstract

“…In existing approaches, colour is often analysed in rearranged red‐green‐blue (RGB) colour spaces that attempt to be more intuitive and perceptually relevant, such as hue‐saturation‐lightness (HSV) and YC b C r . In this paper, we propose a novel framework to automatically process chroma keying [13, 14]. The chroma consistencies of different advanced colour spaces are compared and CIECAM02 colour appearance model is chosen and used for chroma keying for the first time.…”

Section: Introductionmentioning

confidence: 99%