Classification in a Distributed System - A Study of Random Forest in the Hadoop MapReduce Framework

Kumar, Kota Arun; Sharma, Neeraj; Ali, Aamir

doi:10.1109/csde48274.2019.9162365

Cited by 1 publication

(1 citation statement)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several research works and projects have suggested and implemented Apache Mahout as a scalable machine learning system to provide high performance and computational analysis. Hadoop and Mahout in [5] have been used to implement random forest algorithm in a distributed environment. Four machines in Hadoop cluster have been employed to run the forest random algorithm.…”

Section: Related Workmentioning

confidence: 99%

Random forest for lung cancer analysis using Apache Mahout and Hadoop based on software defined networking

Khaleel,

Al-Azzawi,

Alkhazraji

2023

IJEECS

View full text Add to dashboard Cite

<span>Random forest is a machine learning algorithm that mainly built as a classification method to make predictions based on decision trees. Many machine learning approaches used random forest to perform deep analysis on different cancer diseases to understand their complex characterstics and behaviour. However, due to massive and complex data generated from such diseases, it has become difficult to run random forest using single machine. Therefore, advanced tools are highly required to run random forest to analyse such massive data. In this paper, random forest algorithm using Apache Mahout and Hadoop based software defined networking (SDN) are used to conduct the prediction and analysis on large lung cancer datasets. Several experiments are conducted to evaluate the proposed system. Experiments are conducted using nine virtual nodes. Experiments show that the implementation of random forest algorithm using the proposed work outperforms its implementation in traditional environment with regard to the execution time. Comparison between the proposed system using Hadoop based SDN and Hadoop only is performed. Results show that random forest using Hadoop based SDN has less execution time than when using Hadoop only. Furthermore, experiments reveal that the performance of implemented system achieved more efficiency regarding execution time, accuracy and reliability.</span>

show abstract

Section: Related Workmentioning

confidence: 99%