SuperQuant Financial Benchmark Suite for Performance Analysis of Grid Middlewares

Abstract

: Pricing and hedging of higher order derivatives such as multidimensional (up to 100 underlying assets) European and first generation exotic options represent mathematically complex and computationally intensive problems. Grid computing promises to give the capability to handle such intense computations. With several Grid middleware solutions available for gridifying traditional applications, it is cumbersome to select an ideal candidate, to develop financial applications, that can cope up with time critical computational demand for complex pricing requests. In this paper we present SuperQuant Financial Benchmark Suite to evaluate and quantify the overhead imposed by a Grid middleware on throughput of the system and turnaround times for computation. This approach is a step towards producing a middleware independent, reproducible, comparable, self-sufficient and fair performance analysis of Grid middlewares. The result of such performance analysis can be used by middleware vendors to find the bottlenecks and problems in their design and implementation of the system and by financial application developers to verify implementation of their financial algorithms. In this paper we explain the motivation and the details of the proposed benchmark suite. As a proof of concept, we utilize the benchmarks in an International Grid Programming contest and demonstrate the result of initial experiments.

A Survey on Edge Performance Benchmarking

“…GrapBench [111] CROWNBench [163] Rodinia [28] YCSB [35] Cloud transaction processing benchmarks [84] YCSB++ [118] Storage consistency benchmarks [14,15] CloudRank-D [97] CloudSuite [48] Personal cloud storage benchmarks [43] OLTP-Bench [40] Wpress Cloud VM benchmark [22] Cloud benchmarks for scientific applications [73,147,148] Distributed database system benchmarks [86] Database security benchmarks [109] TPCx-HS [112] TPCx-V [21] SPEC Cloud IaaS Dockerized CloudSuite [114] DocLite [152] UK National HPC Benchmarks whitepaper PALMScloud [161] TPCx-IoT D-Cube [131] RIoTBench [136] Voice interaction benchmark [142] LEAF [26] EdgeBench [38] Edge AIBench [61] HERMIT [92] AIoTBench [98] CAVBench [159] pCAMP [168] MAVBench [23] SoftwarePilot [24] Edge FPGA-based Neural Net benchmark [41] IoTBench [89] DeFog [105] Edgedroid [113] Edge machine learning accelerator benchmark [123] Mirovia benchmark [70] DeathStarBench microservice benchmark [53]…”

“…Edge virtualization benchmark [121] SuperQuant [52] SHOC [37] benchmarks, such as those relevant to financial workloads, have also been developed (35).…”

Financial Benchmarking as an Airline Competitiveness Assessment Tool

“…Benchmarks are updated with new financial-year data on an annual basis. The update ensures benchmarks reflect the performance of businesses over time (Gaikwad, Doan, Bossy, Baude, & Abergel, 2012). Financial benchmarking was used by consulting company Frost & Sullivan in a study of 17 global airline groups and focused on the competitive profiling of these airlines.…”