An Integrated Distributed Log Management System with Metadata for Network Operation

Abstract

An enormous amount of log data is generated by servers and other devices on the network, and server/network administrators analyze the logs to investigate anomalous communications or troubleshoot. However, server/network management tasks increase in volume and complexity, resulting in greater burden on the administrator. In this paper, we propose an integrated management system for a sensor network where log data is output from many different kinds of sensors. We consider a server or network device as one of the sensors. We also propose a cross-processing system for several kinds of log data. In particular, we describe the management and collection of logs in our campus networks.