Text Segmentation via Hierarchical Document Attention Model

Abstract

With the rapid development of natural language processing technology, text segmentation has become an important task in text processing. However, existing text segmentation methods often perform poorly when faced with long texts and complex structures, requiring a more efficient and accurate approach. In this paper, we propose a new text segmentation method based on the Hierarchical Document Attention (HDA), which automatically identifies and segments different paragraphs in the text by analyzing and weighting the hierarchical structure of the text sequence data. Compared with existing methods, the model has higher accuracy and efficiency, and better supports tasks such as text analysis and information extraction. The main contribution of this paper is the proposal of a text segmentation method based on the HDA, which effectively models text sequences through multi-level attention mechanisms. Experimental verification on public datasets shows that this model exhibits good performance in text segmentation tasks.