Taming the zoo - about algorithms implementation in the ecosystem of Apache Hadoop

Dendek, Piotr Jan; Czeczko, Artur; Fedoryszak, Mateusz; Kawa, Adam; Wendykier, Piotr; Bolikowski, Łukasz

doi:10.48550/arxiv.1303.5367

Search citation statements

Order By: Relevance

Paper Sections

Select...

Hadoopisation1

Development Aspects1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2013

Publication Types

Select...

Book1

Other1

Relationship

Self Cite2

Independent0

Authors

Journals

Cited by 2 publications

(2 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To do that accurately, though, we need to describe some technicalities first. Even more technical details not covered in this article are discussed in [21].…”

Section: Hadoopisationmentioning

confidence: 99%

Large Scale Citation Matching Using Apache Hadoop

Fedoryszak

Tkaczyk

Bolikowski

2013

Research and Advanced Technology for Digital Libraries

Self Cite

View full text Add to dashboard Cite

During the process of citation matching links from bibliography entries to referenced publications are created. Such links are indicators of topical similarity between linked texts, are used in assessing the impact of the referenced document and improve navigation in the user interfaces of digital libraries. In this paper we present a citation matching method and show how to scale it up to handle great amounts of data using appropriate indexing and a MapReduce paradigm in the Hadoop environment.

show abstract

“…To do that accurately, though, we need to describe some technicalities first. Even more technical details not covered in this article are discussed in [21].…”

Section: Hadoopisationmentioning

confidence: 99%

Large Scale Citation Matching Using Apache Hadoop

Fedoryszak

Tkaczyk

Bolikowski

2013

Research and Advanced Technology for Digital Libraries

Self Cite

View full text Add to dashboard Cite

show abstract

“…Workflows implemented in CoAnSys algorithms [17,18] are quite straightforward -no traps, no mazes, very transparent ideas. Crafting them against guidelines mentioned in Section 1.2 had impact not only on practices used, but also on the choice of tools.…”

Section: Development Aspectsmentioning

confidence: 99%

How to perform research in Hadoop environment not losing mental equilibrium - case study

Dendek,

Czeczko,

Fedoryszak

et al. 2013

Preprint

Self Cite

View full text Add to dashboard Cite

Conducting a research in an efficient, repetitive, evaluable, but also convenient (in terms of development) way has always been a challenge. To satisfy those requirements in a long term and simultaneously minimize costs of the software engineering process, one has to follow a certain set of guidelines. This article describes such guidelines based on the research environment called Content Analysis System (CoAnSys) created in the Center for Open Science (CeON). Best practices and tools for working in the Apache Hadoop environment, as well as the process of establishing these rules are portrayed.

show abstract

Taming the zoo - about algorithms implementation in the ecosystem of Apache Hadoop

Cited by 2 publications

References 13 publications

Large Scale Citation Matching Using Apache Hadoop

Large Scale Citation Matching Using Apache Hadoop

How to perform research in Hadoop environment not losing mental equilibrium - case study

Contact Info

Product

Resources

About