Storage systems need to provide high IO transactions in addition to their capacity and availability requirements to achieve high assurance characteristics, such as fault tolerance and timeliness. Caches built in large and medium size storage systems have not been very effective to improve the IO transactions and overall performance of the system. Caches at various layers of the memory hierarchy in computing systems are more fast but very small compared to the adjacent lower level of storage device. This paper proposes a novel concept to exploit local memory as a block device to improve the IO performance of storage systems called Data Transmission System (DTS) concept. This concept is based on hierarchical layered memory utilization and management in the information system. Data accessed frequently is maintained on the managed DTS cache device in close proximity to the CPU. The proposed concept is substantially different from the conventional unmanaged cache in the computing systems. System architecture and detailed system design are presented in this paper to realize the proposed concept. Performance evaluation of the system has been carried out through numerical as well as application scenario. The experimental results show improvement of the order of 10 to 100 times faster IO transactions and reduce CPU wait time significantly.Keyword: DTS (Data Transmission System) cache, Timeliness, Write back cache, Block IO device, Locality of reference, IOPS, Bonnie Bench mark program, iSCSI protocol.
Back groundThere are numerous Web based applications and information services available today. Some of the applications can be characterized as high IO (Input Output) intensive such as video on demand, video services, and medical sciences including healthcare and digital imaging. A number of application domains such as data mining need high IO intensive system to access data from/to hard disk as it cannot fit into the main memory.Consequently, Information technology is enhancing rapidly and it is bringing more useful, convenient, and advance human society system. These emerging applications require continuous operation, non stop service system and timeliness to achieve high assurance [1,3]. However, realization of such system requires the characteristics of Autonomous Decentralized System (ADS) [2,4]. Theoretical foundations of ADS rely on the principles of autonomous controllability and autonomous coordinatability. These two properties assure timeliness, online expansion, fault tolerance and online maintenance of the system. Moreover, the information system computing facility in data centers consume high energy and electric power, mostly for its storage systems. Therefore these systems emit huge amount of CO2 by heat dissipation. There is need to consider how to design information system to achieve efficiency for power consumption. To reduce the electric power consumption on information system, the paper focuses on system characteristics for IO requests. What are the factors of bottleneck and from where these arise? General...