Using Artificial Neural Network for Multimedia Information Retrieval

Abstract

Multimedia Information Retrieval (MIR) is an important field due to the great amount of information going through the Internet. Multimedia data can be considered as raw data or the features that compose it. Raw multimedia data consists of data structures with diverse characteristics such as image, audio, video, and text. The big challenge of MIR is a semantic gap, which is the difference between the human perception of a concept and how it can be represented using a machine-level language. The aim of this paper is to use different algorithms through two stages one for training and the other for testing. The first algorithm depends on the nature of the query language to retrieve the text document using two models, Vector Space Model (VSM) and Latent Semantic Index (LSI). The second algorithm is based on the extracted features using curvelet decomposition and the statistic parameters such as mean, standard deviation and energy of signals. The other algorithm is based on the discrete wavelet transform (DWT) and features of signals to retrieve audio signals, then the neural network is applied to describe the information retrieval model which retrieves the information from the multimedia. The neural network model, based on multiplayer perceptron and spreading activation network type, accepts the structure of conceptually and linguistically oriented model.

Sobre la aplicación de modelos del espacio semántico de la música en el análisis integrador de obras musicales y educación musical con tecnologías informáticas musicales

“…Another important issue is the role of music computer technologies (MCT) in the creation of different "virtual realities" based on musical synesthesia and using such realities in art synthesis and the corresponding development of an integrated model of the semantic space of music both in music science (musicology) and in its applied aspects (Gorbunova, 2019;Mahmood, Al-Kubaisy and Al-Khateeb, 2019;Hassan, Al-Mashhadi, Hassan and Jawad, 2019). The most significant of these is currently musiceducation.…”

Recovering Scientific Literature on COVID-19 using level-based Text Analysis

“…In [20], multimedia information retrieval (image, audio, video, and text) is used. Document retrieval is performed using vector space models, LSI, and a neural network approach.On the other hand, in [21] visual semantic embedding (VSE) networks are used in the image-text retrieval task on a Flickr30K dataset.…”

Development of models for recognition of technological situations in the operation of electric centrifugal pumps for oil production

“…Currently, artifi cial neural networks, along with other data mining technologies, are quite successfully used to solve a wide range of tasks that can be assigned to groups of problems of classifi cation, forecasting and modeling [27,28,29]. Neural networks with multi-layer perceptron architecture are most commonly used (according to some sources, up to 80% of neural network applications).…”