Video captioning using weakly supervised convolutional neural networks

Flaute, Dylan; Narayanan, Barath Narayanan

doi:10.1117/12.2568016

Applications of Machine Learning 2020 2020

DOI: 10.1117/12.2568016

|View full text |Cite

Video captioning using weakly supervised convolutional neural networks

Dylan Flaute

Barath Narayanan Narayanan

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2020

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The proposed solution utilized CNNs pretrained on the ImageNet-1K. In future work, Facebook's ResNeXt Weakly Supervised Learning (WSL) CNNs [53,54] could be adapted for further improvements in the current solution. WSL CNNs can act as fixed feature extractors to extract image-level features from the proposed dataset [54].…”

mentioning

confidence: 99%

See 1 more Smart Citation

Transfer Detection of YOLO to Focus CNN’s Attention on Nude Regions for Adult Content Detection

et al. 2020

View full text Add to dashboard Cite

Video pornography and nudity detection aim to detect and classify people in videos into nude or normal for censorship purposes. Recent literature has demonstrated pornography detection utilising the convolutional neural network (CNN) to extract features directly from the whole frames and support vector machine (SVM) to classify the extracted features into two categories. However, existing methods were not able to detect the small-scale content of pornography and nudity in frames with diverse backgrounds. This limitation has led to a high false-negative rate (FNR) and misclassification of nude frames as normal ones. In order to address this matter, this paper explores the limitation of the existing convolutional-only approaches focusing the visual attention of CNN on the expected nude regions inside the frames to reduce the FNR. The You Only Look Once (YOLO) object detector was transferred to the pornography and nudity detection application to detect persons as regions of interest (ROIs), which were applied to CNN and SVM for nude/normal classification. Several experiments were conducted to compare the performance of various CNNs and classifiers using our proposed dataset. It was found that ResNet101 with random forest outperformed other models concerning the F1-score of 90.03% and accuracy of 87.75%. Furthermore, an ablation study was performed to demonstrate the impact of adding the YOLO before the CNN. YOLO–CNN was shown to outperform CNN-only in terms of accuracy, which was increased from 85.5% to 89.5%. Additionally, a new benchmark dataset with challenging content, including various human sizes and backgrounds, was proposed.

show abstract

mentioning

confidence: 99%

“…In future work, Facebook's ResNeXt Weakly Supervised Learning (WSL) CNNs [53,54] could be adapted for further improvements in the current solution. WSL CNNs can act as fixed feature extractors to extract image-level features from the proposed dataset [54]. Furthermore, the advantage of fine-tuning these CNNs on ImageNet-1K could also be explored.…”

mentioning

confidence: 99%

Transfer Detection of YOLO to Focus CNN’s Attention on Nude Regions for Adult Content Detection

et al. 2020

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Video captioning using weakly supervised convolutional neural networks

Cited by 1 publication

References 0 publications

Transfer Detection of YOLO to Focus CNN’s Attention on Nude Regions for Adult Content Detection

Transfer Detection of YOLO to Focus CNN’s Attention on Nude Regions for Adult Content Detection

Contact Info

Product

Resources

About