Kernel composition in SYCL

Potter, Ralph; Keir, Paul; Bradford, Russell J.; Murray, Alastair

doi:10.1145/2791321.2791332

Cited by 13 publications

(6 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Over the past decade, there have been standardization efforts of skeletonlike interfaces. One such instance is SYCL [129] from the Khronos Group 3 . The Khronos Group manages open standards, including OpenGL and OpenCL.…”

Section: Syclmentioning

confidence: 99%

“…It may be unlikely to be skipped over in practice, but the compiler must be careful and cannot do anything. However, automatic kernel fusion is not a new idea [54,66,117,129,138]; to some pattern libraries the fusion can even be a natural part of the compilation environment. For extended and automatic kernel fusion in SkePU to be a relevant scientific contribution, it would have to do something new or better than the prior work.…”

Section: Kernel Fusionmentioning

confidence: 99%

See 1 more Smart Citation

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

Ernstsson

2022

Linköping Studies in Science and Technology. Dissertations

View full text Add to dashboard Cite

Contemporary computer architectures utilize wide multi-core processors, accelerators such as GPUs, and clustering of individual computers into complex large-scale systems. These hardware trends are prevalent across computers of all sizes, from the largest supercomputers down to the smallest mobile phones. While these innovations provide high peak computing performance, software developers find it increasingly difficult to effectively target all the processing resources without expert knowledge in parallelization, heterogeneous computing, communication, synchronization, and so on. To ensure that software can keep up with the development of hardware architectures, advanced high-level programming environments and frameworks are needed to bridge the programmability gap. In addition, as the industry is trending towards increased vertical integration of software development stacks, vendor lock-in presents a risk of coupling software projects to proprietary technologies. Combined with problems of technical debt in large-scale software systems, it is clear that portability and open source are desirable properties of high-level parallel programming environments. One example of a programming framework fulfilling the above criteria is SkePU, a framework for high-level data-parallel pattern programming consisting of a compiler toolchain, programming interface, and run-time system.The work presented in this thesis proposes a design of the pattern-centric skeleton programming model of the SkePU framework based on modern C++ with variadic template metaprogramming and state-of-the-art compiler technology. The design enables further flexibility, expressivity, and portability and gives rise to several new performance optimization techniques. The focus lies on a strong set of programming abstractions: providing new and extended patterns, improving the data access locality of existing ones, and using both static and dynamic knowledge about program flow. The work combines novel programming interfaces and implementations with practical evaluation on synthetic and real-world applications. Several contributions are results from international collaborations in application-framework co-design: a single-source parallelization approach of skeleton programs on heterogeneous clusters, an extension mechanism for inserting platform-optimized code variants in high-level skeleton programs, and an integrated abstraction for portable parallel deterministic random number generation. The work places a strong emphasis on programmability aspects to make heterogeneous parallel computing accessible to non-experts, while also providing sufficient performance and interface familiarity for the high-performance computing community. vi First and foremost I want to thank my supervisor at Linköping University (LiU), Professor Christoph Kessler, for continued and tireless efforts, experienced supervision, and caring friendship. Also thanks to my secondary supervisor José Daniel García Sánchez, professor at University Carlos III of Madrid and member of the ISO C+...

show abstract

Section: Syclmentioning

confidence: 99%

Section: Kernel Fusionmentioning

confidence: 99%

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

Ernstsson

2022

Linköping Studies in Science and Technology. Dissertations

View full text Add to dashboard Cite

show abstract

“…There are a few works on SYCL benchmarking as it a relatively new programming model [18,19]. Potter and Keir [18] described a methodology for creating efficient domain specific embedded languages on top of the SYCL for the OpenCL standard. There are also some works which compare different programming models.…”

Section: Related Workmentioning

confidence: 99%

SYCL-Bench: A Versatile Cross-Platform Benchmark Suite for Heterogeneous Computing

Lal

Alpay

Salzmann

et al. 2020

Euro-Par 2020: Parallel Processing

View full text Add to dashboard Cite

The SYCL standard promises to enable high productivity in heterogeneous programming of a broad range of parallel devices, including multicore CPUs, GPUs, and FPGAs. Its modern and expressive C++ API design, as well as flexible task graph execution model give rise to ample optimization opportunities at run-time, such as the overlapping of data transfers and kernel execution. However, it is not clear which of the existing SYCL implementations perform such scheduling optimizations, and to what extent. Furthermore, SYCL's high level of abstraction may raise concerns about sacrificing performance for ease of use. Benchmarks are required to accurately assess the performance behavior of high-level programming models such as SYCL. To this end, we present SYCL-Bench, a versatile benchmark suite for device characterization and runtime benchmarking, written in SYCL. We experimentally demonstrate the effectiveness of SYCL-Bench by performing device characterization of the NVIDIA TITAN X GPU, and by evaluating the efficiency of the hipSYCL and ComputeCpp SYCL implementations.

show abstract

“…There have recently been standardization efforts of skeleton‐like interfaces. The C++ ISO committee has included a parallel version of STL algorithms in C++17, and SYCL from the Khronos Group also includes high‐level functional interface.…”

Section: Related Workmentioning

confidence: 99%

Extending smart containers for data locality‐aware skeleton programming

Ernstsson

Keßler

2018

Concurrency and Computation

View full text Add to dashboard Cite

Summary We present an extension for the SkePU skeleton programming framework to improve the performance of sequences of transformations on smart containers. By using lazy evaluation, SkePU records skeleton invocations and dependencies as directed by smart container operands. When a partial result is required by a different part of the program, the run‐time system will process the entire lineage of skeleton invocations; tiling is applied to keep chunks of container data in the working set for the whole sequence of transformations. The approach is inspired by big data frameworks operating on large clusters where good data locality is crucial. We also consider benefits other than data locality with the increased run‐time information given by the lineage structures, such as backend selection for heterogeneous systems. Experimental evaluation of example applications shows potential for performance improvements due to better cache utilization, as long as the overhead of lineage construction and management is kept low.

show abstract

Kernel composition in SYCL

Cited by 13 publications

References 8 publications

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

SYCL-Bench: A Versatile Cross-Platform Benchmark Suite for Heterogeneous Computing

Extending smart containers for data locality‐aware skeleton programming

Contact Info

Product

Resources

About