New chroma-key imagining technique with Hi-Vision background

Shimoda, Shigeru; Hayashi, Masaki; Kanatsugu, Yasuaki

doi:10.1109/11.40835

Cited by 35 publications

(8 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In order to make the assembled videos look more natural and similar to live ensemble performances, we used chroma keying [48] to replace the blue curtain background with a real concert hall image.…”

Section: F Video Background Replacementmentioning

confidence: 99%

Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications

Liu

Dinesh

et al. 2019

IEEE Trans. Multimedia

124

110

View full text Add to dashboard Cite

We introduce a dataset for facilitating audio-visual analysis of music performances. The dataset comprises 44 simple multi-instrument classical music pieces assembled from coordinated but separately recorded performances of individual tracks. For each piece, we provide the musical score in MIDI format, the audio recordings of the individual tracks, the audio and video recording of the assembled mixture, and ground-truth annotation files including frame-level and note-level transcriptions. We describe our methodology for the creation of the dataset, particularly highlighting our approaches for addressing the challenges involved in maintaining synchronization and expressiveness. We demonstrate the high quality of synchronization achieved with our proposed approach by comparing the dataset with existing widely-used music audio datasets.We anticipate that the dataset will be useful for the development and evaluation of existing music information retrieval (MIR) tasks, as well as for novel multi-modal tasks. We benchmark two existing MIR tasks (multi-pitch analysis and scoreinformed source separation) on the dataset and compare with other existing music audio datasets. Additionally, we consider two novel multi-modal MIR tasks (visually informed multi-pitch analysis and polyphonic vibrato analysis) enabled by the dataset and provide evaluation measures and baseline systems for future comparisons (from our recent work). Finally, we propose several emerging research directions that the dataset enables.

show abstract

Section: F Video Background Replacementmentioning

confidence: 99%

Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications

Liu

Dinesh

et al. 2019

IEEE Trans. Multimedia

124

110

View full text Add to dashboard Cite

show abstract

“…In bluescreening, the background film is shot first, and the model or actor is filmed carrying out their actions in front of a bluescreen [6]. As light added, ghostly image is created by placing the foreground shot overlapping the background shot, with a blue-tinged background.…”

Section: Literature Surveymentioning

confidence: 99%

Hardware Co-simulation for Chroma-Keying in Real Time

Kotgire¹,

Mori²,

Nahar³

2015

2015 International Conference on Computing Communication Control and Automation

View full text Add to dashboard Cite

Chroma-key is a robust and important technique for processing image or video. This technique gives immersive feedback on Video, TV production and weather forecast. Chromakey method and hardware architecture for Chroma-key effect in real-time using Xilinx system generator is demonstrated in this paper. VLSI architecture is proposed for this method, which is implemented on FPGA based on K-means method. This proposes an improved method known as "Coarse and Fine Filter", Coarse and Fine Filter method is more appropriate and reliable for hardware design because of small buffer size, by which a user can perform Chroma-key effect with pleasant quality in real-time. The resource utilization is reduced by optimizing it later along with maximum frequency.

show abstract

“…A chroma key method that uses color information about a video image is generally used in extraction or synthesis of live-action video of people and other objects [15]. However, this method has drawbacks in that a special blue or green background set is needed, the color of the actors' costumes is limited, and background reflections and other phenomena occur.…”

Section: Image Synthesis Experimentsmentioning

confidence: 99%

Real‐time depth‐mapping three‐dimension TV camera (Axi‐Vision camera)

Kawakita

Iizuka

Iino

et al. 2006

Systems & Computers in Japan

View full text Add to dashboard Cite

SUMMARYA three-dimension camera (Axi-Vision camera) has been developed that is capable of producing a color image of an object and performing high-speed mapping of depth information from the camera to the object. With this camera, intensity-modulated near-infrared light is irradiated onto the object, and distances to points on the object are computed from the image captured by a camera that has a high-speed shutter. Since a two-dimensional scanning mechanism for a laser beam or complex computational processing is unnecessary in this depth mapping system, the distance to the object can be detected at high speed for each pixel of a TV image. For the present paper, a three-dimension camera adapted to a standard television signal was constructed by development of a high-output light-emitting-diode (LED) array light source capable of high-speed intensity modulation, an image intensifier capable of highspeed shutter operation on the nanosecond order, and an optical system. The prototype camera can output a depth image with a resolution of 768 × 493 pixels at a frame rate of 15 Hz, the characteristic depth mapping resolution of the camera is 1.8 cm (when the distance from the camera to the object is 2 m), and the camera can capture an image of a person-sized object. It was also shown that the depth information thus obtained could be applied to live-action filming and to CG and other new types of image synthesis.

show abstract

New chroma-key imagining technique with Hi-Vision background

Cited by 35 publications

References 1 publication

Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications

Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications

Hardware Co-simulation for Chroma-Keying in Real Time

Real‐time depth‐mapping three‐dimension TV camera (Axi‐Vision camera)

Contact Info

Product

Resources

About