Multi-task human analysis in still images: 2D/3D pose, depth map, and multi-part segmentation

Sánchez, Daniel; Oliu, Marc; Madadi, Meysam; Baró, Xavier; Escalera, Sérgio

doi:10.1109/fg.2019.8756572

Cited by 5 publications

(1 citation statement)

References 42 publications

(88 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The first approach is an approximation that allows using the standard formulation of a single optimization function. This is commonly done by a linear combination of the loss functions of all tasks (SERMANET et al, 2013;MISRA et al, 2016;KOKKINOS, 2017;TEICHMANN et al, 2018;CHENNUPATI et al, 2019;SANCHEZ et al, 2019;LI et al, 2021), or some variation with adaptive weights (CIPOLLA; GAL; KENDALL, 2018;CHEN et al, 2018;JOHNS;DAVISON, 2019;LI et al, 2016;GUO et al, 2018). Although this approach is simple and has shown promising results, there are two inherent problems, as Gunantara (2018) pointed out.…”

Section: Optimization For Multi-task Learningmentioning

confidence: 99%

Aproveitando o comportamento de convergência para equilibrar tarefas conflitantes no aprendizado de múltiplas tarefas

Nakamura¹

View full text Add to dashboard Cite

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to share the same subset of parameters, creating an inductive bias between them during the training process. Due to its simplicity, potential to improve generalization, and reduce computational cost, it has gained the attention of the scientific and industrial communities. In the literature, the simultaneous learning of multiple tasks is usually performed by a linear combination of loss functions. Nonetheless, tasks' gradients often conflict with each other during losses' optimization, and it is not trivial to combine them so that all tasks converge toward their optimal solution throughout the training process. To address this problem, the idea of multi-objective optimization was adopted to propose a method that takes into account the temporal behavior of the gradients to create a dynamic bias that adjusts the importance of each task during backpropagation. The result of this method is to give more attention to tasks that are diverging or not being benefited during the last iterations, ensuring that the simultaneous learning is heading to the performance maximization of all tasks. To evaluate the performance of the proposed method in learning conflicting tasks, sensitivity analysis and a series of experiments were performed on a public handwritten digit classification dataset, and on the scene understanding problem in the CityScapes Dataset. Through the performed experiments, the proposed method outperformed state-of-the-art methods in learning conflicting tasks. Unlike the adopted baselines, the proposed method ensures that all tasks reach good generalization performances at the same time it speeds up the learning curves.

show abstract