Exploiting Intel Optane SSD for Microsoft SQL Server

Wu, Kan; Arpaci-Dusseau, Andrea C.; Arpaci-Dusseau, Remzi H.; Sen, Rathijit; Park, Kwanghyun

doi:10.1145/3329785.3329916

Cited by 15 publications

(13 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are three major differences between the Intel Optane SSD and a traditional NAND-flashbased SSD: (1) lower access latency in the Intel Optane SSD, (2) higher endurance in the Intel Optane SSD, and (3) higher cost of the Intel Optane SSD device. First, as previous works [88,89,[97][98][99][100][101][102][103] show, performing a 4 kB random read using the Intel Optane SSD is approximately 6× faster than using a traditional NAND-flash-based SSD. Second, the Intel Optane SSD can provide 10× the endurance of a traditional NAND-flash-based SSD [223].…”

Section: Effect Of Using Different Nvm Devicesmentioning

confidence: 85%

“…For the Intel Optane SSD, the device has a system interface similar to current NAND-based flash memory devices, where the system communicates to the device via the PCIe bus [177]. This configuration provides one order of magnitude lower latency than traditional NAND-flash-based SSDs [88,89,[97][98][99][100][101][102][103]. For the Intel Optane DC Persistent DIMM, the device is integrated into the system with a DIMM-based interface, similar to DRAM devices.…”

Section: Intel Optane Ssdmentioning

confidence: 99%

“…Real NVM Devices in Real Systems. Since the release of the Intel Optane SSD, various works [98, 99, 102, 122-124, 126, 250] have experimentally shown that the Intel Optane SSD can improve performance, energy, and cost for different workloads (e.g., databases [98,102], highperformance computing workloads [250], key-value stores [124,126], machine learning [99,122], query processing [123]). Our work differs from these works because we (i) target a different family of workloads (i.e., interactive consumer workloads, and in particular the Google Chrome web browser) and (ii) employ the Intel Optane SSD as an extension of main memory, instead of as a separate storage device.…”

Section: Related Workmentioning

confidence: 99%

“…However, these NVMbased devices are still slower than DRAM [48,50,51,[88][89][90][91][92][93]. For example, the state-of-the-art Intel Optane SSD (solid-state drive) [94], which is a low-latency NVM-based SSD device (i.e., an SSD device that uses NVM as its primary persistent storage media), has an access latency that is two orders of magnitude slower than that of DRAM [95,96] (but it is still one order of magnitude faster than traditional NAND-flash-based SSDs [88,89,[97][98][99][100][101][102][103]), while providing a better cost-per-byte ($1.50 per GB [104] vs. $5 per GB for DRAM [105]). Previous works propose two different ways to integrate an NVM device into state-of-the-art computers in order to alleviate DRAM scalability issues.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Extending Memory Capacity in Consumer Devices with Emerging Non-Volatile Memory: An Experimental Study

F.¹,

Ghose²,

Gómez-Luna³

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

Section: Effect Of Using Different Nvm Devicesmentioning

confidence: 85%

Section: Intel Optane Ssdmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Extending Memory Capacity in Consumer Devices with Emerging Non-Volatile Memory: An Experimental Study

F.¹,

Ghose²,

Gómez-Luna³

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…Flash solid-state drives (SSDs) are widely used to deploy persistent data storage in data centers, both in bare-metal and cloud deployments [23,25,27,39,64,72,74], while also being an integral part of public cloud offerings [5,15,16]. While SSDs with novel technologies such as 3D Xpoint [34,51] offer significant advantages [40,41,79], they are not expected to replace flash-based SSDs anytime soon. These newer technologies are not yet as mature from a technology density standpoint, and have a high cost per GB, which significantly * Work done while at IBM Research.…”

Section: Introductionmentioning

confidence: 99%

Toward a Better Understanding and Evaluation of Tree Structures on Flash SSDs

Didona¹,

Ioannou²,

Stoica³

et al. 2020

Preprint

View full text Add to dashboard Cite

Solid-state drives (SSDs) are extensively used to deploy persistent data stores, as they provide low latency random access, high write throughput, high data density, and low cost. Tree-based data structures are widely used to build persistent data stores, and indeed they lie at the backbone of many of the data management systems used in production and research today.In this paper, we show that benchmarking a persistent tree-based data structure on an SSD is a complex process, which may easily incur subtle pitfalls that can lead to an inaccurate performance assessment. At a high-level, these pitfalls stem from the interaction of complex software running on complex hardware. On one hand, tree structures implement internal operations that have nontrivial effects on performance. On the other hand, SSDs employ firmware logic to deal with the idiosyncrasies of the underlying flash memory, which are well known to lead to complex performance dynamics.We identify seven benchmarking pitfalls using RocksDB and WiredTiger, two widespread implementations of an LSM-Tree and a B+Tree, respectively. We show that such pitfalls can lead to incorrect measurements of key performance indicators, hinder the reproducibility and the representativeness of the results, and lead to suboptimal deployments in production environments. We also provide guidelines on how to avoid these pitfalls to obtain more reliable performance measurements, and to perform more thorough and fair comparison among different design points.

show abstract

Investigating the Overhead of the REST Protocol When Using Cloud Services for HPC Storage

Gadban

Kunkel

Ludwig

2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

With the significant advances in Cloud Computing, it is inevitable to explore the usage of Cloud technology in HPC workflows. While many Cloud vendors offer to move complete HPC workloads into the Cloud, this is limited by the massive demand of computing power alongside storage resources typically required by I/O intensive HPC applications. It is widely believed that HPC hardware and software protocols like MPI yield superior performance and lower resource consumption compared to the HTTP transfer protocol used by RESTful Web Services that are prominent in Cloud execution and Cloud storage. With the advent of enhanced versions of HTTP, it is time to reevaluate the effective usage of cloud-based storage in HPC and their ability to cope with various types of data-intensive workloads. In this paper, we investigate the overhead of the REST protocol via HTTP compared to the HPC-native communication protocol MPI when storing and retrieving objects. Albeit we compare the MPI for a communication use case, we can still evaluate the impact of data communication and, therewith, the efficiency of data transfer for data access patterns. We accomplish this by modeling the impact of data transfer using measurable performance metrics. Hence, our contribution is the creation of a performance model based on hardware counters that provide an analytical representation of data transfer over current and future protocols. We validate this model by comparing the results obtained for REST and MPI on two different cluster systems, one equipped with Infiniband and one with Gigabit Ethernet. The evaluation shows that REST can be a viable, performant, and resource-efficient solution, in particular for accessing large files.

show abstract

Exploiting Intel Optane SSD for Microsoft SQL Server

Cited by 15 publications

References 3 publications

Extending Memory Capacity in Consumer Devices with Emerging Non-Volatile Memory: An Experimental Study

Extending Memory Capacity in Consumer Devices with Emerging Non-Volatile Memory: An Experimental Study

Toward a Better Understanding and Evaluation of Tree Structures on Flash SSDs

Investigating the Overhead of the REST Protocol When Using Cloud Services for HPC Storage

Contact Info

Product

Resources

About