In-Tool Motion Sensing for Evaluation of Violin Performance

Fujisaki, Kodai; Katsura, Seiichiro

doi:10.1541/ieejjia.21005498

Cited by 8 publications

(2 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, this demands interaction with the violin, which can be challenging when precise force, position control, or extensive freedom is required. In response, the study in [11] introduced a motion sensing method that avoids interference, effectively measuring violin playing skills. This method was applied to compare the abilities of skilled and novice violinists using data captured by the system.…”

Section: Releated Workmentioning

confidence: 99%

ViolinTalk: Violin Robots as Internet of Things Devices

Huang,

Lin

2023

IEEE Access

View full text Add to dashboard Cite

In recent years, the application of intelligent robots in the field of music has gradually emerged. Among string instruments, the violin stands as an unparalleled musical marvel, representing the soprano voice. Countless composers have penned masterpieces for this cherished instrument. This paper proposes ViolinTalk, a system for controlling XY-type violin robots as Internet of Things (IoT) devices. ViolinTalk enhances the performance of robots through calibration and testing. ViolinTalk has improved the software of violin robots with an IoT-based modular design, resulting in a better development environment. In this environment, we have made key contributions, including: (1) The development of two control modes for the bowing servo motors, comprising displacement-based control and time-based control; (2) Utilizing bowing speed control to introduce variations in volume and tone, enriching the performance effects; (3) Analyzing errors in playing speed and establishing correction parameters for future use; (4) Analyzing the robot's mechanism to enhance its stability and durability. ViolinTalk also leverages IoT technology to facilitate seamless connections between different music instruments for ensemble performances. Multiple robots have been successfully integrated into a string orchestra, featuring two violins, one viola, and one cello, capable of performing standard chamber music. This development has resulted in the acquisition of a total of 8 patents from Taiwan.INDEX TERMS Arts and humanities, Bow speed control, Internet of Things (IoT), string control, violin robot

show abstract

Section: Releated Workmentioning

confidence: 99%

ViolinTalk: Violin Robots as Internet of Things Devices

Huang,

Lin

2023

IEEE Access

View full text Add to dashboard Cite

show abstract

“…As examples of targeting violin, optical motion capture has been used to measure the bowing of a violin (Tuner-Stokes, et al, 1999), and methods have been proposed to improve the effectiveness of practice by feeding back the data ( Van der Linden, et al, 2011). In another case, a system that can measure not only the bowing motion but also the force to apply the bow to the string has been produced for the purpose of preserving the playing motion (Fujisaki, et al, 2022). However, there have been no examples of measuring mandolin-playing movements.…”

Section: Introductionmentioning

confidence: 99%

Motion measurement of the hand during playing tremolo on mandolin using an inertial sensor (Difference between tremolo by the wrist and by the elbow)

FUKUNAGA

2023

JBSE

View full text Add to dashboard Cite

Tremolo is a technique to produce the same note continuously in short spans, and is an important technique for musical performance on a mandolin. However, it is not easy for beginners to master this technique, nor is it easy for even expert players to perform a wide range of expressions. There is no unified view on the proper behavior of tremolo playing, and there are no examples of measured tremolo behavior. In this study, we measured the hand movements during tremolo playing on a mandolin. One test subject was included in this study. An inertial sensor was attached to the back of the hand, and the movement was evaluated by the angles which were the time integrated angular velocity on each axis. Tremolo playing is a combination of elbow and wrist motion. We examined how those motions were used for playing strong/weak tones or fast/slow tremolos. The results showed that there was a clear difference in motion between tremolo using the wrist and tremolo using the elbow. The results also suggested that the combination of each joint motion was changed when adjusting the volume and tremolo speed. It indicated that the measurement of hand movements by inertial sensors could be used to evaluate tremolo playing. Our future plan includes a more detailed analysis of the relationship between musical expression and tremolo movement, and an examination of how movement changes with practice.

show abstract

Identification of Wrist Elastic Moment in Healthy Subjects for Control by Functional Electrical Stimulation

Shimomura

Katsura

2022

2022 15th International Conference on Human System Interaction (HSI)

View full text Add to dashboard Cite

In-Tool Motion Sensing for Evaluation of Violin Performance

Cited by 8 publications

References 16 publications

ViolinTalk: Violin Robots as Internet of Things Devices

ViolinTalk: Violin Robots as Internet of Things Devices

Motion measurement of the hand during playing tremolo on mandolin using an inertial sensor (Difference between tremolo by the wrist and by the elbow)

Identification of Wrist Elastic Moment in Healthy Subjects for Control by Functional Electrical Stimulation

Contact Info

Product

Resources

About