A region-based intra-frame rate control scheme by jointing inter-frame dependency and inter-frame correlation

Hu, Hai‐Miao; Zhou, Mingliang; Liu, Yang; Yin, Naiyu

doi:10.1007/s11042-016-3666-x

Cited by 5 publications

(1 citation statement)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The work used region-based rate control scheme for macro-blocks and grouped regions of similar characteristics as same region for treating them as a basic unit for rate control. Similar works on region-classificationbased rate control for Coding Tree Units (CTUs) in I-frames to improve reconstruction quality of I-frames for suppressing flicker artifacts has been done in [25], region-based interframe rate-control scheme to improve the objective quality and reduce PSNR fluctuations among CTUs [26], moving regions have been used as the RoI for identifying the depth level of CTU [27], and other works [28], [29], [30]. Further progress has been made in the RoI aware rate-control where higher bit rate is allocated to regions of interest human faces [31] and combination of human faces with CTU level [32] and using human faces and tile-based rate control [33].…”

Section: Related Workmentioning

confidence: 99%

An Adaptive Video Acquisition Scheme for Object Tracking and its Performance Optimization

Banerjee¹,

Chopp²,

Serra³

et al. 2021

Preprint

View full text Add to dashboard Cite

We present a novel adaptive host-chip modular architecture for video acquisition to optimize an overall objective task constrained under a given bit rate. The chip is a high resolution imaging sensor such as gigapixel focal plane array (FPA) with low computational power deployed on the field remotely, while the host is a server with high computational power. The communication channel data bandwidth between the chip and host is constrained to accommodate transfer of all captured data from the chip. The host performs objective task specific computations and also intelligently guides the chip to optimize (compress) the data sent to host. This proposed system is modular and highly versatile in terms of flexibility in re-orienting the objective task. In this work, object tracking is the objective task. While our architecture supports any form of compression/distortion, in this paper we use quadtree (QT)-segmented video frames. We use Viterbi (Dynamic Programming) algorithm to minimize the area normalized weighted rate-distortion allocation of resources. The host receives only these degraded frames for analysis. An object detector is used to detect objects, and a Kalman Filter based tracker is used to track those objects. Evaluation of system performance is done in terms of Multiple Object Tracking Accuracy (MOTA) metric. In this proposed novel architecture, performance gains in MOTA is obtained by twice training the object detector with different system generated distortions as a novel 2-step process. Additionally, object detector is assisted by tracker to upscore the region proposals in the detector to further improve the performance.

show abstract