Nonresonant Metasurface for Fast Decoding in Acoustic Communications

Abstract

In this paper, we introduce an improved approach of speculative decoding aimed at enhancing the efficiency of serving large language models. Our method capitalizes on the strengths of two established techniques: the classic two-model speculative decoding approach, and the more recent single-model approach, Medusa. Drawing inspiration from Medusa, our approach adopts a single-model strategy for speculative decoding. However, our method distinguishes itself by employing a single, lightweight draft head with a recurrent dependency design, akin in essence to the small, draft model uses in classic speculative decoding, but without the complexities of the full transformer architecture. And because of the recurrent dependency, we can use beam search to swiftly filter out undesired candidates with the draft head. The outcome is a method that combines the simplicity of single-model design and avoids the need to create a data-dependent tree attention structure only for inference in Medusa. We empirically demonstrate the effectiveness of the proposed method on several popular open source language models, along with a comprehensive analysis of the trade-offs involved in adopting this approach.

A Survey on Underwater Wireless Sensor Networks: Requirements, Taxonomy, Recent Advances, and Open Research Challenges

“…However, acoustic waves still have many shortcomings including scattering, excessive delay because of the low propagation velocities, high attenuation, low bandwidth, and adverse effects on the underwater creatures. Recently, orbital angular momentum has developed as an alternative multiplexing freedom to encrypt data onto vortex beams for enhancing the capacity of acoustic communication [ 18 ]. Due to the limitations of acoustic communication, another approach is to use optical waves.…”

Tunable Asymmetric Transmissions via Anisotropic Acoustic Metamaterials

“…[11] Afterward, acoustic metasurfaces, [12,13] which are used to modulate the wave fronts by controlling the wave responses of each meta-atom, have aroused increasing attention from researchers. Indeed, due to their potential application values in many fields, a series of practical works has been reported, including acoustic communication, [14][15][16] acoustic hologram, [17][18][19] acoustic focusing, [20][21][22][23] and anomalous reflection and refraction. [24][25][26][27] Acoustic asymmetric transmission (AAT), in which an incident acoustic wave is permitted to propagate forward while blocked backward, has been investigated since the first prototype of an acoustic diode was proposed due to its potential utility in engineering fields.…”

Acoustic Bessel Vortex Beam by Quasi-Three-Dimensional Reflected Metasurfaces

“…To overcome these restrictions, the emergence of acoustic metamaterials [14][15][16][17][18][19][20] and metasurfaces [21][22][23][24][25][26][27] have provided alternative design schemes for passive acoustic lenses of vortex beams. As examples, by designing thickness-gradient structures [28,29] or an acoustic plate with a spiral shaped structure [30][31][32], the acoustic vortex beam can be observed around structure surfaces. However, their structures must satisfy the geometric characteristics of spiral distribution.…”