Synthesis of VV Utterances from Muscle Activation to Sound with a 3D Model

Dabbaghchian, Saeed; Arnela, Marc; Engwall, Olov; Guasch, Oriol

doi:10.21437/interspeech.2017-1614

Cited by 4 publications

(3 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The 3D tongue model of ArtiSynth has been used to study physiological activities of the tongue in speech production (Dabbaghchian et al, 2017;Gick et al, 2014;Mayer et al, 2017) and articulatory motivation of phonological patterns (Jang, 2020). In the model, tongue muscles are implemented in a mesh structure based on accurate anatomical data derived from medical studies (Miyawaki, 1974;Netter, 1989;Takemoto, 2001).…”

Section: Biomechanical 3d Tongue Modelmentioning

confidence: 99%

A tutorial on articulatory muscles and ArtiSynth: Tongue and suprahyoid muscles, and 3D tongue model

Jang

2022

Language and Linguist. Compass

View full text Add to dashboard Cite

This article has two main purposes: (i) to review the placement and function of the tongue and suprahyoid muscles concerning speech articulation, and (ii) as a biomechanical simulation tool to study how those muscles are involved in articulation, to introduce a 3D tongue model distributed by a 3D modelling platform called ArtiSynth. The 3D tongue model can be combined with other structural models to provide the outline of the oral cavity. This article presents examples of muscular simulations for/i/and/ɑ/using the jaw‐hyoid‐tongue model in ArtiSynth.

show abstract

Section: Biomechanical 3d Tongue Modelmentioning

confidence: 99%

A tutorial on articulatory muscles and ArtiSynth: Tongue and suprahyoid muscles, and 3D tongue model

Jang

2022

Language and Linguist. Compass

View full text Add to dashboard Cite

show abstract

“…Section 4 finally concludes the paper. A preliminary version of this work was presented in Reference 30.…”

Section: Introductionmentioning

confidence: 99%

Simulation of vowel‐vowel utterances using a 3D biomechanical‐acoustic model

Dabbaghchian

Arnela

Engwall

et al. 2020

Numer Methods Biomed Eng

Self Cite

View full text Add to dashboard Cite

A link is established between biomechanical and acoustic 3D models for the numerical simulation of vowel‐vowel utterances. The former rely on the activation and contraction of relevant muscles for voice production, which displace and distort speech organs. However, biomechanical models do not provide a closed computational domain of the 3D vocal tract airway where to simulate sound wave propagation. An algorithm is thus proposed to extract the vocal tract boundary from the surrounding anatomical structures at each time step of the transition between vowels. The resulting 3D geometries are fed into a 3D finite element acoustic model that solves the mixed wave equation for the acoustic pressure and particle velocity. An arbitrary Lagrangian–Eulerian framework is considered to account for the evolving vocal tract. Examples include six static vowels and three dynamic vowel‐vowel utterances. Plausible muscle activation patterns are first determined for the static vowel sounds following an inverse method. Dynamic utterances are then generated by linearly interpolating the muscle activation of the static vowels. Results exhibit nonlinear trajectory of the vocal tract geometry, similar to that observed in electromagnetic midsagittal articulography. Clear differences are appreciated when comparing the generated sound with that obtained from direct linear interpolation of the vocal tract geometry. That is, interpolation between the starting and ending vocal tract geometries of an utterance, without resorting to any biomechanical model.

show abstract

“…In an early attempt by the authors, a method was proposed to construct a tube‐like cavity excluding subbranches, which was used for the numerical simulation of three cardinal vowels. Later, the method was revised substantially to improve the stability and speed for the numerical simulation of vowel‐vowel sequences. Still, it was limited to the main cavity.…”

Section: Introductionmentioning

confidence: 99%

Reconstruction of vocal tract geometries from biomechanical simulations

Dabbaghchian

Arnela

Engwall

et al. 2018

Numer Methods Biomed Eng

Self Cite

View full text Add to dashboard Cite

Medical imaging techniques are usually utilized to acquire the vocal tract geometry in 3D, which may then be used, eg, for acoustic/fluid simulation. As an alternative, such a geometry may also be acquired from a biomechanical simulation, which allows to alter the anatomy and/or articulation to study a variety of configurations. In a biomechanical model, each physical structure is described by its geometry and its properties (such as mass, stiffness, and muscles). In such a model, the vocal tract itself does not have an explicit representation, since it is a cavity rather than a physical structure. Instead, its geometry is defined implicitly by all the structures surrounding the cavity, and such an implicit representation may not be suitable for visualization or for acoustic/fluid simulation. In this work, we propose a method to reconstruct the vocal tract geometry at each time step during the biomechanical simulation. Complexity of the problem, which arises from model alignment artifacts, is addressed by the proposed method. In addition to the main cavity, other small cavities, including the piriform fossa, the sublingual cavity, and the interdental space, can be reconstructed. These cavities may appear or disappear by the position of the larynx, the mandible, and the tongue. To illustrate our method, various static and temporal geometries of the vocal tract are reconstructed and visualized. As a proof of concept, the reconstructed geometries of three cardinal vowels are further used in an acoustic simulation, and the corresponding transfer functions are derived.

show abstract

Synthesis of VV Utterances from Muscle Activation to Sound with a 3D Model

Cited by 4 publications

References 23 publications

A tutorial on articulatory muscles and ArtiSynth: Tongue and suprahyoid muscles, and 3D tongue model

A tutorial on articulatory muscles and ArtiSynth: Tongue and suprahyoid muscles, and 3D tongue model

Simulation of vowel‐vowel utterances using a 3D biomechanical‐acoustic model

Reconstruction of vocal tract geometries from biomechanical simulations

Contact Info

Product

Resources

About