A new design of multimedia big data retrieval enabled by deep feature learning and Adaptive Semantic Similarity Function

Abstract

Nowadays, multimedia big data have grown exponentially in diverse applications like social networks, transportation, health, and e-commerce, etc. Accessing preferred data in large-scale datasets needs efficient and sophisticated retrieval approaches. Multimedia big data consists of the most significant features with different types of data. Even though the multimedia supports various data formats with corresponding storage frameworks, similar semantic information is expressed by the multimedia. The overlap of semantic features is most efficient for theory and research related to semantic memory. Correspondingly, in recent years, deep multimodal hashing gets more attention owing to the efficient performance of huge-scale multimedia retrieval applications. On the other hand, the deep multimodal hashing has limited efforts for exploring the complex multilevel semantic structure. The main intention of this proposal is to develop enhanced deep multimedia big data retrieval with the Adaptive Semantic Similarity Function (A-SSF). The proposed model of this research covers several phases “(a) Data collection, (b) deep feature extraction, (c) semantic feature selection and (d) adaptive similarity function for retrieval. The two main processes of multimedia big data retrieval are training and testing. Once after collecting the dataset involved with video, text, images, and audio, the training phase starts. Here, the deep semantic feature extraction is performed by the Convolutional Neural Network (CNN), which is again subjected to the semantic feature selection process by the new hybrid algorithm termed Spider Monkey-Deer Hunting Optimization Algorithm (SM-DHOA). The final optimal semantic features are stored in the feature library. During testing, selected semantic features are added to the map-reduce framework in the Hadoop environment for handling the big data, thus ensuring the proper big data distribution. Here, the main contribution termed A-SSF is introduced to compute the correlation between the multimedia semantics of the testing data and training data, thus retrieving the data with minimum similarity. Extensive experiments on benchmark multimodal datasets demonstrate that the proposed method can outperform the state-of-the-art performance for all types of data.

The Application of MIR Technology in Higher Vocational English Teaching

“…Media resources In many applications, the color image is transformed from RGB space to HSI space for retrieval [32]. The conversion formula from RGB to HSI is:…”

The Metabolism Grey Prediction Model Based on Big Data and Internet of Things Technology

“…Through the construction of the above human telecontrol aerobic metabolic function and evaluation parameter index system, the original sample data of athletes' aerobic metabolic function analysis and evaluation index [13,14] are obtained. Based on the analysis method of metabolic grey prediction model, the athletes' aerobic metabolic cycle function is analyzed, and the decline characteristics of the model are used to characterize the aerobic metabolic consumption.…”