Three-dimensional convolutional neural networks (3D CNNs) have demonstrated their outstanding classification accuracy for human action recognition (HAR). However, the large number of computations and parameters in 3D CNNs limits their deployability in real-life applications. To address this challenge, this paper adopts an algorithm-hardware co-design method by proposing an efficient 3D CNN building unit called 3D-1 bottleneck residual block (3D-1 BRB) at the algorithm level, and a corresponding FPGA-based hardware architecture called F-E3D at hardware level. Based on 3D-1 BRB, a novel 3D CNN model called E3DNet is developed, which achieves nearly 37 times reduction in model size and 5% improvement in accuracy compared to standard 3D CNNs on the UCF101 dataset. Together with several hardware optimizations, including 3D fused BRB, online blocking and kernel reuse, the proposed F-E3D is nearly 13 times faster than a previous FPGA design for 3D CNNs, with performance and accuracy comparable to other state-of-the-art 3D CNN models on GPU platforms while requiring only 7% of their energy consumption.
This paper proposes a novel latency-hiding hardware architecture based on column-wise matrix-vector multiplication to eliminate data dependency, improving the throughput of systems of RNN models. In addition, a flexible checkerboard tiling strategy is introduced to allow large weight matrices, while supporting element-based parallelism and vector-based parallelism. These optimizations improve the exploitation of the available parallelism to increase run-time hardware utilization and boost inference throughput. Furthermore, a quantization scheme with fine-tuning is proposed to achieve high accuracy. Evaluation results show that the proposed architecture can enhance performance and energy efficiency with little accuracy loss. It achieves 1.05 to 3.35 times better performance and 1.22 to 3.92 times better hardware utilization than a state-of-theart FPGA-based LSTM design, which shows that our approach contributes to high performance FPGA-based LSTM systems.
Characterization of parotid tumors is important for treatment planning and prognosis, and parotid tumor discrimination has recently been developed at the molecular level. The aim of the present study was to establish a machine learning (ML) predictive model based on multiparametric traditional multislice CT (MSCT) radiomic and clinical data analysis to improve the accuracy of differentiation among pleomorphic adenoma (PA), Warthin tumor (WT) and parotid carcinoma (PCa). A total of 345 patients (200 with WT, 91 with PA and 54 with PCa) with pathologically confirmed parotid tumors were retrospectively enrolled from five independent institutions between January 2010 and May 2019. A total of 273 patients recruited from institutions 1, 2 and 3 were randomly assigned to the training model; the independent validation set consisted of 72 patients treated at institutions 1, 4 and 5. Data were investigated using a linear discriminant analysis-based ML classifier. Feature selection and dimension reduction were conducted using reproducibility testing and a wrapper method. The diagnostic accuracy of the predictive model was compared with histopathological findings as reference results. This classifier achieved a satisfactory performance for the discrimination of PA, WT and PCa, with a total accuracy of 82.1% in the training cohort and 80.5% in the validation cohort. In conclusion, ML-based multiparametric traditional MSCT radiomics can improve the accuracy of differentiation among PA, WT and PCa. The findings of the present study should be validated by multicenter prospective studies using completely independent external data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.