Integrated GWF/PDMS composite sensors with Bluetooth wireless communication and smartphone function as a wireless wearable musical instrument.

Time-sync video tagging aims to automatically generate tags for each video shot. It can improve the user's experience in previewing a video's timeline structure compared to traditional schemes that tag an entire video clip. In this paper, we propose a new application which extracts time-sync video tags by automatically exploiting crowdsourced comments from video websites such as Nico Nico Douga, where videos are commented on by online crowd users in a time-sync manner. The challenge of the proposed application is that users with bias interact with one another frequently and bring noise into the data, while the comments are too sparse to compensate for the noise. Previous techniques are unable to handle this task well as they consider video semantics independently, which may overfit the sparse comments in each shot and thus fail to provide accurate modeling. To resolve these issues, we propose a novel temporal and personalized topic model that jointly considers temporal dependencies between video semantics, users' interaction in commenting, and users' preferences as prior knowledge. Our proposed model shares knowledge across video shots via users to enrich the short comments, and peels off user interaction and user bias to solve the noisy-comment problem. Log-likelihood analyses and user studies on large datasets show that the proposed model outperforms several state-of-the-art baselines in video tagging quality. Case studies also demonstrate our model's capability of extracting tags from the crowdsourced short and noisy comments.

No abstract

No abstract

No abstract

No abstract

The time-varying spectra of eight musical instrument sounds were randomly altered by a time-invariant process to determine how detection of spectral alteration varies with degree of alteration, instrument, musical experience, and spectral variation. Sounds were resynthesized with centroids equalized to the original sounds, with frequencies harmonically flattened, and with average spectral error levels of 8%, 16%, 24%, 32%, and 48%. Listeners were asked to discriminate the randomly altered sounds from reference sounds resynthesized from the original data. For all eight instruments, discrimination was very good for the 32% and 48% error levels, moderate for the 16% and 24% error levels, and poor for the 8% error levels. When the error levels were 16%, 24%, and 32%, the scores of musically experienced listeners were found to be significantly better than the scores of listeners with no musical experience. Also, in this same error level range, discrimination was significantly affected by the instrument tested. For error levels of 16% and 24%, discrimination scores were significantly, but negatively correlated with measures of spectral incoherence and normalized centroid deviation on unaltered instrument spectra, suggesting that the presence of dynamic spectral variations tends to increase the difficulty of detecting spectral alterations. Correlation between discrimination and a measure of spectral irregularity was comparatively low.

Though previous research has shown the effects of reverberation on clarity, spaciousness, and other perceptual aspects of music, it is still largely unknown to what extent reverberation influences the emotional characteristics of musical instrument sounds. This paper investigates the effect of simple parametric reverberation on music emotion, in particular, the effect of reverberation length and amount. We conducted a listening test to compare the effect of reverberation on the emotional characteristics of eight instrument sounds representing the wind and bowed string families. We compared these sounds over eight emotional categories. We found that reverberation length and amount had a strongly significant effect on the emotional characteristics Romantic and Mysterious and a medium effect on Sad, Scary, and Heroic for the samples we tested. Interestingly, for Comic, reverberation length and amount had the opposite effect; that is, anechoic tones were judged most Comic. Reverb had a mild effect on Happy and relatively little effect on Shy. These results give audio engineers and musicians an interesting perspective on simple parametric artificial reverberation. INTRODUCTIONPrevious research has shown that musical instrument sounds have strong and distinctive emotional characteristics [1][2][3][4][5]. For example, that the trumpet is happier in character than the horn, even in isolated sounds apart from musical context.In light of this, one might wonder what effect reverberation has on the character of music emotion. This leads to a host of follow-up questions: Do all emotional characteristics become stronger with more reverberation? Or, are some emotional characteristics affected more and others less (e.g., positive emotional characteristics more, negative less)? In particular, what are the effects of reverberation time and amount? What are the effects of hall size and listener position? Which instruments sound emotionally stronger to listeners in the front or back of small and large halls? Are dry sounds without reverberation emotionally dry as well, or, do they have distinctive emotional characteristics?We cannot address all of the above questions definitively in this paper with only a simple parametric reverberator and a few parameter settings, but we can make a good start. This work will give audio engineers and musicians an interesting perspective on simple parametric artificial reverberation. More studies with different reverberation models and parameters should be carried out to get more definitive answers. Understanding how listeners perceive emotional characteristics in reverberation can help us engineer potentially even more expressive recordings and opens new possibilities for interactive music systems and applications. BACKGROUND Music Emotion and TimbrePrevious work has investigated emotion recognition in music, especially addressing melody [6], harmony [7,8], rhythm [9,10], lyrics [11], and localization cues [12]. Similarly, researchers have found timbre to be useful in a number of applications such ...