Skeleton-based action recognition has recently attracted a lot of attention. Researchers are coming up with new approaches for extracting spatio-temporal relations and making considerable progress on large-scale skeleton-based datasets. Most of the architectures being proposed are based upon recurrent neural networks (RNNs), convolutional neural networks (CNNs) and graph-based CNNs. When it comes to skeleton-based action recognition, the importance of long term contextual information is central which is not captured by the current architectures. In order to come up with a better representation and capturing of long term spatio-temporal relationships, we propose three variants of Self-Attention Network (SAN), namely, SAN-V1, SAN-V2 and SAN-V3. Our SAN variants has the impressive capability of extracting high-level semantics by capturing long-range correlations. We have also integrated the Temporal Segment Network (TSN) with our SAN variants which resulted in improved overall performance. Different configurations of Self-Attention Network (SAN) variants and Temporal Segment Network (TSN) are explored with extensive experiments. Our chosen configuration outperforms stateof-the-art Top-1 and Top-5 by 4.4% and 7.9% respectively on Kinetics and shows consistently better performance than state-of-the-art methods on NTU RGB+D.
Task-oriented dialog systems enable users to accomplish tasks using natural language. State-of-the-art systems respond to users in the same way regardless of their personalities, although personalizing dialogues can lead to higher levels of adoption and better user experiences. Building personalized dialog systems is an important, yet challenging endeavor and only a handful of works took on the challenge. Most existing works rely on supervised learning approaches and require laborious and expensive labeled training data for each user profile. Additionally, collecting and labeling data for each user profile is virtually impossible. In this work, we propose a novel framework, P-ToD, to personalize task-oriented dialog systems capable of adapting to a wide range of user profiles in an unsupervised fashion using a zero-shot generalizable reward function. P-ToD uses a pre-trained GPT-2 as a backbone model and works in three phases. Phase one performs task-specific training. Phase two kicks off unsupervised personalization by leveraging the proximal policy optimization algorithm that performs policy gradients guided by the zero-shot generalizable reward function. Our novel reward function can quantify the quality of the generated responses even for unseen profiles. The optional final phase fine-tunes the personalized model using a few labeled training examples. We conduct extensive experimental analysis using the personalized bAbI dialogue benchmark for five tasks and up to 180 diverse user profiles. The experimental results demonstrate that P-ToD, even when it had access to zero labeled examples, outperforms state-ofthe-art supervised personalization models and achieves competitive performance on BLEU and ROUGE metrics when compared to a strong fully-supervised GPT-2 baseline.
Task-oriented dialog systems empower users to accom-plish their goals by facilitating intuitive and expres-sive natural language interactions. State-of-the-art ap-proaches in task-oriented dialog systems formulate theproblem as a conditional sequence generation task andfine-tune pre-trained causal language models in the su-pervised setting. This requires labeled training datafor each new domain or task, and acquiring such datais prohibitively laborious and expensive, thus makingit a bottleneck for scaling systems to a wide rangeof domains. To overcome this challenge, we intro-duce a novel Zero-Shot generalizable end-to-end Task-oriented Dialog system, ZS-ToD, that leverages domainschemas to allow for robust generalization to unseen do-mains and exploits effective summarization of the dia-log history. We employ GPT-2 as a backbone model andintroduce a two-step training process where the goal ofthe first step is to learn the general structure of the dialogdata and the second step optimizes the response gen-eration as well as intermediate outputs, such as dialogstate and system actions. As opposed to state-of-the-artsystems that are trained to fulfill certain intents in thegiven domains and memorize task-specific conversa-tional patterns, ZS-ToD learns generic task-completionskills by comprehending domain semantics via domainschemas and generalizing to unseen domains seam-lessly. We conduct an extensive experimental evaluationon SGD and SGD-X datasets that span up to 20 uniquedomains and ZS-ToD outperforms state-of-the-art sys-tems on key metrics, with an improvement of +17% onjoint goal accuracy and +5 on inform. Additionally,we present a detailed ablation study to demonstrate theeffectiveness of the proposed components and trainingmechanism.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.