Sports Video Classification Framework Using Enhanced Threshold Based Keyframe Selection Algorithm and Customized CNN on UCF101 and Sports1-M Dataset

Abstract

The computer vision community has taken a keen interest in recent developments in activity recognition and classification in sports videos. Advancements in sports have a broadened the technical interest of the computer vision community to perform various types of research. Images and videos are the most frequently used components in computer vision. There are numerous models and methods that can be used to classify videos. At the same time, there no specific framework or model for classifying and identifying sports videos. Hence, we proposed a framework based on deep learning to classify sports videos with their appropriate class label. The framework is to perform sports video classification using two different benchmark datasets, UCF101 and the Sports1-M dataset. The objective of the framework is to help sports players and trainers to identify specific sports from the large data source, then analyze and perform well in the future. This framework takes sports video as an input and produces the class label as an output. In between, the framework has numerous intermediary processes. Preprocessing is the first step in the proposed framework, which includes frame extraction and noise reduction. Keyframe selection is carried out by candidate frame extraction and an enhanced threshold-based frame difference algorithm, which is the second step. The final step of the sports video classification framework is feature extraction and classification using CNN. The proposed framework result is compared with pretrained neural networks such as AlexNet and GoogleNet, and then the results are also compared. Three different evaluation metrics are used to measure the accuracy and performance of the framework.

A wearable-based sports health monitoring system using CNN and LSTM with self-attentions

“…Labelling these videos is a meticulously executed process. Automated labelling is employed, wherein the YouTube Topics API assigns one of the 487 sports classes to each video [ 24 ]. The training dataset constituted 80% of the data, while the validation and testing set accounted for 10%.…”

Implementation of Sports Classification and Person Recognition System

“…M. Ramesh and K. Mahesh (2022) [1] put forward a CNN (Convolution Neutral Network) on UCF101 and Sports1-M Dataset. Sports video classification begins with preprocessing.…”

A Study on the Promotion and Health Concept of Short Videos on Exercise and Fitness among College Students on Douyin App

“…According to scholars Ramesh M. & Mahesh K., there is a mutually reinforcing relationship between the development of sports and the development of electronic visuals [1]. In China, this promotion and integration are reflected in the development of short videos that record sports routines, share fitness habits, popularize sports and health knowledge and convey health concepts, which have become a type of fixed forms and content on the platform, that is, exercise and fitness short videos.…”