Towards Streaming Egocentric Action Anticipation

Abstract

Egocentric action anticipation is the task of predicting the future actions a camera wearer will likely perform based on past video observations. While in a real-world system it is fundamental to output such predictions before the action begins, past works have not generally paid attention to model runtime during evaluation. Indeed, current evaluation schemes as-

Untrimmed Action Anticipation

“…We believe more research is needed to build new solutions for the proposed task. We would also like to emphasise the attention on terminology: we refer to the proposed task as untrimmed action anticipation rather than streaming action anticipation [7]. For our problem formulation, the inference time does not play a primary role, hence we do not consider real-time evaluation.…”