Interpretable Natural Language Segmentation Based on Link Grammar

Ramesh, Vignav; Kolonin, Anton

doi:10.1109/s.a.i.ence50533.2020.9303220

Cited by 2 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A model for sentence boundary detection based on a set of grammatical rules for the way in which sentences use verbs was proposed in [ 25 ]. A method for sentence boundary detection using a grammatical rule-based system to define the linking structure between words was considered in [ 26 ]. A segmentation method based on a syntactic structural model, which increased in complexity with corpus length, was proposed in [ 27 ].…”

Section: Introductionmentioning

confidence: 99%

Estimating Sentence-like Structure in Synthetic Languages Using Information Topology

Back

Wiles

2022

Entropy

View full text Add to dashboard Cite

Estimating sentence-like units and sentence boundaries in human language is an important task in the context of natural language understanding. While this topic has been considered using a range of techniques, including rule-based approaches and supervised and unsupervised algorithms, a common aspect of these methods is that they inherently rely on a priori knowledge of human language in one form or another. Recently we have been exploring synthetic languages based on the concept of modeling behaviors using emergent languages. These synthetic languages are characterized by a small alphabet and limited vocabulary and grammatical structure. A particular challenge for synthetic languages is that there is generally no a priori language model available, which limits the use of many natural language processing methods. In this paper, we are interested in exploring how it may be possible to discover natural `chunks’ in synthetic language sequences in terms of sentence-like units. The problem is how to do this with no linguistic or semantic language model. Our approach is to consider the problem from the perspective of information theory. We extend the basis of information geometry and propose a new concept, which we term information topology, to model the incremental flow of information in natural sequences. We introduce an information topology view of the incremental information and incremental tangent angle of the Wasserstein-1 distance of the probabilistic symbolic language input. It is not suggested as a fully viable alternative for sentence boundary detection per se but provides a new conceptual method for estimating the structure and natural limits of information flow in language sequences but without any semantic knowledge. We consider relevant existing performance metrics such as the F-measure and indicate limitations, leading to the introduction of a new information-theoretic global performance based on modeled distributions. Although the methodology is not proposed for human language sentence detection, we provide some examples using human language corpora where potentially useful results are shown. The proposed model shows potential advantages for overcoming difficulties due to the disambiguation of complex language and potential improvements for human language methods.

show abstract

Section: Introductionmentioning

confidence: 99%