Comprehensive query-dependent fusion using regression-on-folksonomies

Zhang, Bingjun; Xiang, Qiao-Liang; Lu, Hao; Shen, Jialie; Wang, Ye

doi:10.1145/1631272.1631303

Cited by 10 publications

(10 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The tags usually consisted of one or more words (M = 2.48, SD = 1.86), with only a small proportion containing long sentences (6% with five words or more). Previous studies have tokenized [20,25] and stemmed [26] the tags to remove common words and normalize the data. In this study however, a tag is considered as a holistic unit representing an element of the vocabulary (cf.…”

Section: Emergent Structure Of Timbre From Social Tagsmentioning

confidence: 99%

Semantic structures of timbre emerging from social and acoustic descriptions of music

Ferrer

Eerola

2011

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

The perceptual attributes of timbre have inspired a considerable amount of multidisciplinary research, but because of the complexity of the phenomena, the approach has traditionally been confined to laboratory conditions, much to the detriment of its ecological validity. In this study, we present a purely bottom-up approach for mapping the concepts that emerge from sound qualities. A social media (http://www.last.fm) is used to obtain a wide sample of verbal descriptions of music (in the form of tags) that go beyond the commonly studied concept of genre, and from this the underlying semantic structure of this sample is extracted. The structure that is thereby obtained is then evaluated through a careful investigation of the acoustic features that characterize it. The results outline the degree to which such structures in music (connected to affects, instrumentation and performance characteristics) have particular timbral characteristics. Samples representing these semantic structures were then submitted to a similarity rating experiment to validate the findings. The outcome of this experiment strengthened the discovered links between the semantic structures and their perceived timbral qualities. The findings of both the computational and behavioural parts of the experiment imply that it is therefore possible to derive useful and meaningful structures from free verbal descriptions of music, that transcend musical genres, and that such descriptions can be linked to a set of acoustic features. This approach not only provides insights into the definition of timbre from an ecological perspective, but could also be implemented to develop applications in music information research that organize music collections according to both semantic and sound qualities.

show abstract

Section: Emergent Structure Of Timbre From Social Tagsmentioning

confidence: 99%

Semantic structures of timbre emerging from social and acoustic descriptions of music

Ferrer

Eerola

2011

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

show abstract

“…Among these methods, CSA and RankBoost emphasize the combination of result lists from different feature types, and hence these methods can be considered as late fusion solutions. Similar work can be founded in [28], which also views this problem as a late fusion problem, and designs an innovative parameter tun-ing strategy based on regression. In [20], Tollari et al utilized a late fusion framework that linearly combines the result lists of textual and visual features for Web image retrieval.…”

Section: Related Workmentioning

confidence: 93%

“…These sites not only host huge amounts of user-contributed multimedia materials of wide diversity, but also serve as platforms where people express and entertain themselves and form user communities of common interests. The multimedia objects appearing in such Web sites are generally associated with textual, visual and user information, which is different from either traditional text information on the Web or multimedia objects in classic media databases [2,11,20,21,24,27,28]. Such new characteristics of multimedia objects in the social media environment bring new research problems to Web applications, such as media retrieval, recommendation, classification, etc.…”

Section: Introductionmentioning

confidence: 99%

Multiple feature fusion for social media applications

Cui

Tung

Zhang

et al. 2010

Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data

View full text Add to dashboard Cite

The emergence of social media as a crucial paradigm has posed new challenges to the research and industry communities, where media are designed to be disseminated through social interaction. Recent literature has noted the generality of multiple features in the social media environment, such as textual, visual and user information. However, most of the studies employ only a relatively simple mechanism to merge the features rather than fully exploit feature correlation for social media applications. In this paper, we propose a novel approach to fusing multiple features and their correlations for similarity evaluation. Specifically, we first build a Feature Interaction Graph (FIG) by taking features as nodes and the correlations between them as edges. Then, we employ a probabilistic model based on Markov Random Field to describe the graph for similarity measure between multimedia objects. Using that, we design an efficient retrieval algorithm for large social media data. Further, we integrate temporal information into the probabilistic model for social media recommendation. We evaluate our approach using a large real-life corpus collected from Flickr, and the experimental results indicate the superiority of our proposed method over stateof-the-art techniques.

show abstract

“…The data information of this space is presented in Table 1 More detailed descriptions of this space can be found in [9].…”

Section: User Information Need Spacementioning

confidence: 99%

“…However, this strategy is inadequate due to the fact that all queries are not equally created and they may have different information focuses. QDF emerges with the goal to improve the retrieval performance by adopting different fusion strategies for each query class (e.g., [1,2,7,6]) or individual query (e.g., [9]). Noted that these approaches focus on deriving the optimal fusion strategy by only considering queries.…”

Section: Introductionmentioning

confidence: 99%

Document dependent fusion in multimodal music retrieval

Zhang

Wang

2011

Proceedings of the 19th ACM International Conference on Multimedia

Self Cite

View full text Add to dashboard Cite

In this paper, we propose a novel multimodal fusion framework, document dependent fusion (DDF), which derives the optimal combination strategy for each individual document in the fusion process. For each document, we derive a document weight vector by estimating the descriptive abilities of its different modalities. The document weight vector also enables our framework to be easily integrated with existing multimodal fusion schemes, and achieve a better combination strategy for each document given a query. Experiments are conducted on a 17174-song music database to compare the retrieval accuracy of traditional query independent fusion and query dependent fusion approaches, and that obtained after integrating DDF with them. Experimental results indicate that DDF can significantly improve the retrieval performance of current fusion approaches.

show abstract

Comprehensive query-dependent fusion using regression-on-folksonomies

Cited by 10 publications

References 20 publications

Semantic structures of timbre emerging from social and acoustic descriptions of music

Semantic structures of timbre emerging from social and acoustic descriptions of music

Multiple feature fusion for social media applications

Document dependent fusion in multimodal music retrieval

Contact Info

Product

Resources

About