Statistical Parameters in Pathological Text

Piotrowska, Weronika; Piotrowska, Xenia

doi:10.1080/09296170512331383685

Cited by 3 publications

(4 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It should be noted that this situation occurs only if a language sample is created in the unconstrained and spontaneous conditions. Existing aberrations from a power-law regime have appropriate justifications that have their source in an intellectual disability [25] or in sophisticated creative workshops [17].…”

Section: Zipf Analyses For Language Samplesmentioning

confidence: 99%

In narrative texts punctuation marks obey the same statistics as words

Kulig¹,

Kwapień²,

Stanisz³

et al. 2017

Information Sciences

View full text Add to dashboard Cite

From a grammar point of view, the role of punctuation marks in a sentence is formally defined and well understood. In semantic analysis punctuation plays also a crucial role as a method of avoiding ambiguity of the meaning. A different situation can be observed in the statistical analyses of language samples, where the decision on whether the punctuation marks should be considered or should be neglected is seen rather as arbitrary and at present it belongs to a researcher's preference. An objective of this work is to shed some light onto this problem by providing us with an answer to the question whether the punctuation marks may be treated as ordinary words and whether they should be included in any analysis of the word cooccurences. We already know from our previous study (S. Drożdż et al., Inf. Sci. 331 (2016) 32-44) that full stops that determine the length of sentences are the main carrier of long-range correlations. Now we extend that study and analyze statistical properties of the most common punctuation marks in a few Indo-European languages, investigate their frequencies, and locate them accordingly in the Zipf rank-frequency plots as well as study their role in the word-adjacency networks. We show that, from a statistical viewpoint, the punctuation marks reveal properties that are qualitatively similar to the properties of the most frequent words like articles, conjunctions, pronouns, and prepositions. This refers to both the Zipfian analysis and the network analysis. By adding the punctuation marks to the Zipf plots, we also show * Corresponding author: stanislaw.drozdz@ifj.edu.pl that these plots that are normally described by the Zipf-Mandelbrot distribution largely restore the power-law Zipfian behaviour for the most frequent items.Our results indicate that the punctuation marks can fruitfully be considered in the linguistic studies as their inclusion effectively extends dimensionality of an analysis and, therefore, it opens more space for possible manifestation of some previously unobserved effects.

show abstract

Section: Zipf Analyses For Language Samplesmentioning

confidence: 99%

In narrative texts punctuation marks obey the same statistics as words

Kulig¹,

Kwapień²,

Stanisz³

et al. 2017

Information Sciences

View full text Add to dashboard Cite

show abstract

“…Examples in literature Least effort for α < 1.6 Advanced schizophrenia (Zipf, 1949;Piotrowska and Piotrowska, 2004), young children (Piotrowska and Piotrowska, 2004;Brillouin, 2004) -1.6 ≤ α < 2 Military combat texts (Piotrowska and Piotrowska, 2004), Wikipedia (Serrano et al, 2009), Web pages listed on the open directory project (Serrano et al, 2009) Annotator α = 2 Single author texts (Balasubrahmanyan and Naranan, 1996) Equal effort levels 2 < α ≤ 2.4 Multi author texts (Ferrericancho, 2005) Audience α > 2.4…”

Section: α Valuementioning

confidence: 99%

Section: α Valuementioning

confidence: 99%

“…Fragmented discourse schizophrenia (Piotrowska and Piotrowska, 2004) - Baumgartner et al (2007) suggesting that the enormous increase in proteins requiring annotation is outstripping the provision of this annotation. This issue has been acknowledged by UniProt, with their introduction of automated annotation; therefore, we next investigate this form of annotation.…”

Section: α Valuementioning

confidence: 99%

See 1 more Smart Citation

An approach to describing and analysing bulk biological annotation quality: a case study using UniProtKB

Bell¹,

Gillespie²,

Swan³

et al. 2012

Bioinformatics

View full text Add to dashboard Cite

Motivation: Annotations are a key feature of many biological databases, used to convey our knowledge of a sequence to the reader. Ideally, annotations are curated manually, however manual curation is costly, time consuming and requires expert knowledge and training. Given these issues and the exponential increase of data, many databases implement automated annotation pipelines in an attempt to avoid un-annotated entries. Both manual and automated annotations vary in quality between databases and annotators, making assessment of annotation reliability problematic for users. The community lacks a generic measure for determining annotation quality and correctness, which we look at addressing within this article. Specifically we investigate word reuse within bulk textual annotations and relate this to Zipf's Principle of Least Effort. We use the UniProt Knowledgebase (UniProtKB) as a case study to demonstrate this approach since it allows us to compare annotation change, both over time and between automated and manually curated annotations.Results: By applying power-law distributions to word reuse in annotation, we show clear trends in UniProtKB over time, which are consistent with existing studies of quality on free text English. Further, we show a clear distinction between manual and automated analysis and investigate cohorts of protein records as they mature. These results suggest that this approach holds distinct promise as a mechanism for judging annotation quality.Availability: Source code is available at the authors website: http://homepages.cs.ncl.ac.uk/m.j.bell1/annotation.Contact: phillip.lord@newcastle.ac.uk

show abstract

Spontaneous brain activity as a source of ideal1/fnoise

et al. 2009

View full text Add to dashboard Cite

We study the electroencephalogram ͑EEG͒ of 30 closed-eye awake subjects with a technique of analysis recently proposed to detect punctual events signaling rapid transitions between different metastable states. After single-EEG-channel event detection, we study global properties of events simultaneously occurring among two or more electrodes termed coincidences. We convert the coincidences into a diffusion process with three distinct rules that can yield the same only in the case where the coincidences are driven by a renewal process. We establish that the time interval between two consecutive renewal events driving the coincidences has a waiting-time distribution with inverse power-law index Ϸ 2 corresponding to ideal 1 / f noise. We argue that this discovery, shared by all subjects of our study, supports the conviction that 1 / f noise is an optimal communication channel for complex networks as in art or language and may therefore be the channel through which the brain influences complex processes and is influenced by them.

show abstract

Statistical Parameters in Pathological Text

Cited by 3 publications

References 2 publications

In narrative texts punctuation marks obey the same statistics as words

In narrative texts punctuation marks obey the same statistics as words

An approach to describing and analysing bulk biological annotation quality: a case study using UniProtKB

Spontaneous brain activity as a source of ideal1/fnoise

Contact Info

Product

Resources

About