Accelerating ML Recommendation with over a Thousand RISC-V/Tensor Processors on Esperanto’s ET-SoC-1 Chip

Ditzel, Dave; Espasa, Roger; Aymerich, Nivard; Baum, A.J.; Berg, T.B.; Burr, Jim; Hao, Eric; Iyer, Jayesh; Izquierdo, Miquel; Jayaratnam, Shankar; Jones, Darren; Klingner, Chris; Kim, Jin; Lupon, Marc; Magklis, Grigorios; Maric, Bojan; Nath, Rajib; Neilly, Mike; Northcutt, Duane; Orner, Bill; Renau, Jose; Reves, Gerard; Reves, Xavier; Riordan, Tom; Sanchez, Pedro Luís Próspero; Samudrala, Sri; Sole, Guillem; Tang, Raymond; Thorn, Tommy; Torres, Francisco; Tortella, Sebastia; Yau, Daniel

doi:10.1109/hcs52781.2021.9566904

Cited by 17 publications

(6 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, this is how the communication subsystem is organized in Intel Xeon E5 class processors (it even received the name Intel The idea of organizing a communication subsystem in a NoC in the form of a finegrained mesh-like structure turned out to be very convenient and has been the main one in the NoC design for a long time. For example, this is how the communication subsystem is organized in Intel Xeon E5 class processors (it even received the name Intel Mesh Interconnect) [15,16] or the ET-SoC-1 chip [17] from Esperanto Technologies consisting of 1089 + 4 64-bit RISC-V processor units. Also, with the imperfection of CAD tools for the synthesis of integrated circuits, it is convenient to use simplification when designing and representing individual macroblocks of the network in the form of rectangles compactly located on the die area.…”

Section: Topological Approachmentioning

confidence: 99%

Virtual Coordinate System Based on a Circulant Topology for Routing in Networks-On-Chip

Sukhov,

Romanov,

Selin

2024

Symmetry

View full text Add to dashboard Cite

In this work, the circulant topology as an alternative to 2D mesh in networks-on-chip is considered. A virtual coordinate system for numbering nodes in the circulant topology is proposed, and the principle of greedy promotion is formulated. The rules for constructing the shortest routes between the two nodes based on coordinates are formulated. A technique for calculating optimal network configurations is described. Dense states of the network when all neighborhoods of the central node are filled with nodes and the network has the smallest diameter are defined. It is shown that with an equal number of nodes, the diameter of the circulant is two times smaller than the diameter of the 2D mesh. This is due to the large number of symmetries for the circulant, which leave the set of nodes unchanged. A comparison of communication stability in both topologies in the conditions of failure of network nodes is made, the network behavior under load and failures is modeled, and the advantages of the circulant topology are presented.

show abstract

Section: Topological Approachmentioning

confidence: 99%

Virtual Coordinate System Based on a Circulant Topology for Routing in Networks-On-Chip

Sukhov,

Romanov,

Selin

2024

Symmetry

View full text Add to dashboard Cite

show abstract

“…State-of-the-art Supercomputers on chip (SoC) examples encourage this approach [7,12,38,53]. Future SoC will have all the above-mentioned components in a package, each one as a separate chipset, connected with a high bandwidth on-package interface in a 3D manner.…”

Section: Possible Architecture Of a Supercomputer On A Chipmentioning

confidence: 99%

“…11 MIT, Boston, MA, USA. 12 Technion, Haifa, Israel. 13 Harvard University Medical School, Boston, USA.…”

Section: Author Contributionsmentioning

confidence: 99%

Research in computing-intensive simulations for nature-oriented civil-engineering and related scientific fields, using machine learning and big data: an overview of open problems

Babović,

Bajat,

Đokić

et al. 2023

J Big Data

View full text Add to dashboard Cite

This article presents a taxonomy and represents a repository of open problems in computing for numerically and logically intensive problems in a number of disciplines that have to synergize for the best performance of simulation-based feasibility studies on nature-oriented engineering in general and civil engineering in particular. Topics include but are not limited to: Nature-based construction, genomics supporting nature-based construction, earthquake engineering, and other types of geophysical disaster prevention activities, as well as the studies of processes and materials of interest for the above. In all these fields, problems are discussed that generate huge amounts of Big Data and are characterized with mathematically highly complex Iterative Algorithms. In the domain of applications, it has been stressed that problems could be made less computationally demanding if the number of computing iterations is made smaller (with the help of Artificial Intelligence or Conditional Algorithms), or if each computing iteration is made shorter in time (with the help of Data Filtration and Data Quantization). In the domain of computing, it has been stressed that computing could be made more powerful if the implementation technology is changed (Si, GaAs, etc.…), or if the computing paradigm is changed (Control Flow, Data Flow, etc.…).

show abstract

“…The development of multiprocessor systems-on-chip (MPSoCs) has become a ubiquitous trend and has led to the fact that modern chips can accommodate tens, hundreds or even thousands of processor cores. So, the latest versions of the WSE2 chip from Cerebras can contain up to 850,000 computing cores [1,2], and the project from Esperanto technologies promises 1088 energy-efficient ET-Minion 64-bit RISC-V each with a vector/tensor unit in ET-SoC-1 chip [3]. The operation of such large MPSoCs is not possible without a high-performance communication subsystem, the tasks of which are currently performed by the network-on-chip (NoC).…”

Section: Introductionmentioning

confidence: 99%

“…It should be noted that circulant graphs of dimensions 2 and 3 are used as topologies of multiprocessor systems [15,20,21], and also as promising topologies of NoCs [5,8]. Modern chips already can have more than 1000 cores [1][2][3]. For the most part, they are still connected by mesh topology, but at the same time (due to the large number of nodes), the distance between nodes is too large, which is to be corrected by global ring connections (for example, over a wireless channel [23,24]).…”

Section: Introductionmentioning

confidence: 99%

Adaptive Dynamic Shortest Path Search Algorithm in Networks-on-Chip Based on Circulant Topologies

et al. 2021

View full text Add to dashboard Cite

A new pair routing algorithm for transmitting messages in multiprocessor systems and networks-on-chip based on circulant networks of arbitrary dimension is proposed. It allows using all reserve shortest paths in the presence of destructive factors (deadlocks, livelocks, starvation, failures) at the nodes and channels of the communication network. A distinctive feature of the proposed algorithm is the absence of using the routing tables with fixed shortest paths when message is transmitted. It becomes possible to determine the set of the shortest paths for routing due to the relative addresses of destination nodes based on a parametric description of the network. Estimates of the number of reserve shortest paths are obtained, and an effective algorithm for using these paths to prevent dynamic topology changes and network congestions is proposed. To reduce the required memory in networks-on-chip with a circulant topology, we proposed a version of the routing algorithm for two-dimensional optimal circulants. We experimentally found the minimum number of reference nodes (nodes containing mapping tables) for them and estimates of memory for mapping tables, as well as the average path length for the routing algorithm using the reference nodes.INDEX TERMS pair routing algorithm, reserve shortest path, circulant network, network-on-chip

show abstract

Accelerating ML Recommendation with over a Thousand RISC-V/Tensor Processors on Esperanto’s ET-SoC-1 Chip

Cited by 17 publications

References 1 publication

Virtual Coordinate System Based on a Circulant Topology for Routing in Networks-On-Chip

Virtual Coordinate System Based on a Circulant Topology for Routing in Networks-On-Chip

Research in computing-intensive simulations for nature-oriented civil-engineering and related scientific fields, using machine learning and big data: an overview of open problems

Adaptive Dynamic Shortest Path Search Algorithm in Networks-on-Chip Based on Circulant Topologies

Contact Info

Product

Resources

About