HPVM: Hardware-Agnostic Programming for Heterogeneous Parallel Systems

Ejjeh, Adel; Councilman, Aaron; Kothari, Akash; Kotsifakou, Maria; Medvinsky, Leon; Noor, Abdul Rafae; Sharif, Hashim; Zhao, Yifan; Adve, Sarita V.; Misailovíc, Saša; Adve, Vikram

doi:10.1109/mm.2022.3186547

Cited by 3 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, the matrix multiplication operator has a large number of different implementation methods in different chip architectures such as CPU and GPU, and the performance of the implementation methods is greatly different. The compilation system first performs hardware independent optimization on the computation graph [2], such as optimizing the memory arrangement and eliminating redundant nodes in the computation graph. Optimizations occur primarily in the form of operator calls or JIT compilations.…”

Section: Introductionmentioning

confidence: 99%

Compile runtime system technology for airborne high-performance heterogeneous computing

Han¹,

Xu²,

yixuan³

et al. 2023

Second International Conference on Electronic Information Engineering and Computer Communication (EIECC 2022)

View full text Add to dashboard Cite

Most tasks in airborne scenarios are composed of neural networks (NN) and non-NN tasks. On the one hand, Deep neural networks (DNNs) have become the mainstream method of AI task processing. DNNs is accompanied by a large number of complex tensor calculations, as well as network delays and data privacy risks caused by using the cloud to process data. The combination of dedicated AI hardware accelerators and edge computing has become a new solution. On the other hand, dedicated AI hardware accelerators cannot efficiently handle non-NN class tasks (such as signal processing, control flow, etc.), so onboard systems need to design new hardware, complete compiler stacks, and runtime systems to handle non-NN class tasks. In order to effectively deal with multiple tasks in the airborne environment, the airborne computing system needs to establish a set of unified compilation and runtime system, which can optimize multiple tasks and be deployed on the heterogeneous computing platform to achieve "one compilation, multiple deployment". This paper analyzes the development of compiler and runtime systems at home and abroad, and compares the advantages and disadvantages of different technologies. Finally, this paper discusses the application scenarios of the compilation system and runtime in the airborne environment and the technical directions that need to be breakthroughs in the future, so as to provide guidance for the development of the airborne intelligent compilation and runtime system.

show abstract

Section: Introductionmentioning

confidence: 99%