The language observatory project (LOP)

Mikami, Yoshiki; Zavarsky, Pavol; Rozan, Mohd Zaidi Abd; Takahashi, Masayuki; Maki, Tomohide; Ayob, Irwan Nizan; Boldi, Paolo; Santini, Massimo; Vigna, Sebastiano

doi:10.1145/1062745.1062833

Cited by 13 publications

(12 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This experiment was based on two technical processes: (1) crawling cyberspace initiated by seed URLs and thus fetching web pages (Boldi et al 2004) and (2) running a language identification engine to determine three aspects of the web pages, its LSE triplet (namely Language, Script and Encoding system). The huge data are stored in clusters of 40 servers at Nagaoka University of Technology under the management of the Language Observatory (LO) project (Mikami et al 2005). The system based on N-gram technology (Suzuki et al 2002) has been extensively used in the past four years in a project for LSE identification of huge domains.…”

Section: Snapshots Of Evolutionized Malay (Em) Occurrences In Web Formentioning

confidence: 99%

“…This is followed by information from Gani's short article on the analysis of the SM Internet evolution, and our snapshots on EM occurrences for Malaysian cyberspace based on Language Observatory (LO) project data (Mikami et al 2005). Our main objective is to answer two research questions; 'How are Evolutionized Malay (EM) words able to represent the pronunciation of spoken Malay in a better way?'…”

mentioning

confidence: 99%

See 1 more Smart Citation

Orthographic Reforms of Standard Malay Online: Towards Better Pronunciation and Construction of a Cross-language Environment

Rozan¹,

Mikami²

2007

J. Univers. Lang.

Self Cite

View full text Add to dashboard Cite

The widespread use of communication tools on the Internet has provided greater possibilities as well as increased flexibility for orthographic reforms. As a result, spellings have been established that are closely matched to 'written speech', which emulate verbal expression plus the elegant addition of letters from foreign languages. This study will look in particular at Evolutionized Malay (EM), which is cultivated on the Internet. Our analysis of EM reveals two principal functions: 1) EM words performed better in

show abstract

Section: Snapshots Of Evolutionized Malay (Em) Occurrences In Web Formentioning

confidence: 99%

mentioning

confidence: 99%

Orthographic Reforms of Standard Malay Online: Towards Better Pronunciation and Construction of a Cross-language Environment

Rozan¹,

Mikami²

2007

J. Univers. Lang.

Self Cite

View full text Add to dashboard Cite

show abstract

“…In response to this, the Language Observatory (LO) project was launched in 2003 under the sponsorship of the Japan Science and Technology Agency (JST) and has been implemented in collaboration with several international partners who have common interests with us [6]. After a few years of development work, the LO team has trained our own language identification engine to cover more than three hundred languages of the world, and has acquired the capability to collect terabyte size Web documents from the Internet.…”

Section: Introductionmentioning

confidence: 99%

An Analysis of Asian Language Web Pages

Nandasara

Kodama²,

Choong³

et al. 2009

Int J on Adv. in ICT for Emerging Countries

Self Cite

View full text Add to dashboard Cite

This paper gives an overview and an evaluation of Web pages of Asian languages on the Web, in particular of those languages that have not been focused on so far. The authors have collected over 100 million Asian Web pages downloaded from 42 Asian country domains, identified the languages based on Ngram statistics and analyzed their language properties. Primarily the number of pages written in each language measures the presence of a language. The survey reveals that the digital language divide exists at a serious level in the region. The state of multilingualism and the dominating presence of cross-border languages, English in particular, are analyzed. The paper sheds light on script and encoding issues of Asian language texts on the Web. In order to promote language resource collection and sharing, authors have a vision of creating an observation-collection instrument for Asian language resources on the Web. The results of the survey show the feasibility of this vision, and provide us with a better idea of the steps needed to realize that vision.

show abstract

“…3. This classifier is introduced for use in the Language Observatory Project (or LOP) [2], a census of Web-page population by language and character set. In this project, a crawler robot collects Web pages, and the category of each Web page is checked and characterized by the combination of attributes, i.e., the language, script, and character set.…”

Section: Introductionmentioning

confidence: 99%