Image and audio caps: automated captioning of background sounds and images using deep learning

Abstract

Image recognition based on computers is something human beings have been working on for many years. It is one of the most difficult tasks in the field of computer science, and improvements to this system are made when we speak. In this paper, we propose a methodology to automatically propose an appropriate title and add a specific sound to the image. Two models have been extensively trained and combined to achieve this effect. Sounds are recommended based on the image scene and the headings are generated using a combination of natural language processing and state-of-the-art computer vision models. A Top 5 accuracy of 67% and a Top 1 accuracy of 53% have been achieved. It is also worth mentioning that this is also the first model of its kind to make this forecast.

Style classification of media painting images by integrating ResNet and attention mechanism

“…It provides important reference and guidance for the research of object detection and recognition methods. Poongodi et al [ 12 ] proposed a method to adapt media titles and add specific sounds to images. To achieve this effect, a computer vision model of image scene recommendation and natural language processing is combined.…”

A smart IoMT based architecture for E-healthcare patient monitoring system using artificial intelligence algorithms

“…( Poongodi et al., 2022a ) In this research, we suggest a way to automatically suggest a suitable title and add a particular sound to the image. To get this result, two models that have been intensively trained together.…”

Design of Computer Recognition System Based on Graphic Image

“…The degree of impact is as small as possible [18]. The auxiliary function of the image recognition system adopts a modular design scheme, which improves the scalability of the system and facilitates the access of subsequent algorithms and functions [19]. By analyzing the characteristics of the sensitive image recognition algorithm and user characteristics, it summarizes the needs of the system's auxiliary functions, which include the application startup module, the image recognition API module, and the image storage module.…”