Matrix Algebra and Deep Neural Networks represent foundational classes of computational algorithms across multiple emerging applications like Augmented Reality(AR) or Virtual Reality(VR), autonomous navigation (cars, drones, robots), data science, and various artificial intelligence-driven solutions. An accelerator-based architecture can provide performance and energy efficiency supporting fixed functions through customized data paths. However, constrained Edge systems requiring multiple applications and diverse matrix operations to be efficiently supported, cannot afford numerous custom accelerators. In this paper, we present MxCore, a unified architecture that comprises tightly coupled vector and programmable cores sharing data through highly optimized interconnects along with a configurable hardware scheduler managing the co-execution. We submit MxCore as the generalized approach to facilitate the flexible acceleration of multiple Matrix Algebra and Deep-learning applications across a range of sparsity levels. Unified compute resources improve overall resource utilization and performance per unit area. Aggressive and novel microarchitecture techniques along with block-level sparsity support optimize compute and data-reuse to minimize bandwidth and power requirements enabling ultra-low latency applications for low power and cost-sensitive Edge deployments. MxCore requires a small silicon footprint of 0.2068
mm
2
, in a modern 7nm process at 1GHz and achieves (0.15 FP32 and 0.62 INT8) TMAC/
mm
2
, dissipating only 11.66uW of leakage power. At iso-technology and iso-frequency, MxCore provides an energy efficiency of 651.4x, 159.9x, 104.8x, and 124.2x as compared to the 128-core Nvidia’s Maxwell GPU for dense General Matrix Multiply (GEMM), sparse Deep Neural Network (DNN), Cholesky decomposition, and triangular matrix solve respectively.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.