“…They realize an ultra-low-power on-device inference system by hybrid multiplication/accumulation units, speculative decoding, and implicit weight generation, reducing external memory access (EMA) by 74%−81%. In addition, a special forum named Energy-Efficient AI-Computing Systems for Large-Language Models shares more practical thoughts about large language model (LLM) computing systems [9] . Georgia Institute of Technology, NVIDIA, Intel, Google, KAIST, Samsung, Axelera AI, and MediaTek introduce their latest research over LLM training and inference in both cloud and edge.…”