Storing large amounts of data in an efficient way from the point of view of very fast retrieval is an important requirement for many industries like KEMA, a company offering consulting, testing and certification in the energy business. Because their relational database could not cope fast enough with the large amounts of data involved, an alternative way for data storage was proposed, called Hierarchical Data Format 5 (HDF5). HDF5 is a data model, a library, and file format for storing and managing data. Four hierarchical designs for storing and retrieving the large amounts of data involved were investigated. A benchmark was carried out in order to know which hierarchical structure would perform best. Eventually, a benchmark between HDF5 and MS SQL Server was carried out. It could be shown that HDF5 performs four (4) times better for inserting and even 200 times better for retrieving data than the MS. SQL Server.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.