Semantics- and Syntax-Related Subvectors in the Skip-Gram Embeddings (Student Abstract)

Abstract

We show that the skip-gram embedding of any word can be decomposed into two subvectors which roughly correspond to semantic and syntactic roles of the word.