The surge of pre-trained language models has begun a new era in the field of Natural Language Processing (NLP) by allowing us to build powerful language models. Among these models, Transformer-based models such as BERT have become increasingly popular due to their stateof-the-art performance. However, these models are usually focused on English, leaving other languages to multilingual models with limited resources. This paper proposes a monolingual BERT for the Persian language (ParsBERT), which shows its state-of-the-art performance compared to other architectures and multilingual models. Also, since the amount of data available for NLP tasks in Persian is very restricted, a massive dataset for different NLP tasks as well as pre-training the model is composed. ParsBERT obtains higher scores in all datasets, including existing ones and gathered ones, and improves the state-of-the-art performance by outperforming both multilingual BERT and other prior works in Sentiment Analysis, Text Classification, and Named Entity Recognition tasks.
The diagnosis of benign and malignant breast cancer is a challenging issue today. Breast cancer is the most common cancer that women suffer from. The sooner the cancer is detected, the easier and more successful it is to treat it. The most common diagnostic method is the mammography of a simple radiographic picture of the chest. The use of image processing techniques and identifying patterns in the detection of breast cancer from mammographic images reduces human errors in detecting tumors, and speeds up diagnosis time. Artificial Neural Network (ANN) has been widely used to detect breast cancer, and has significantly reduced the percentage of errors. Therefore, in this paper, Convolution as Neural Network (CNN), which is the most effective method, is used for the detection of various types of cancers. This study presents a Multiscale Convolutional Neural Network (MCNN) approach for the classification of tumors. Based on the structure of MCNN, which presents mammography picture to several deep CNN with different size and resolutions, the classical handcrafted features extraction step is avoided. The proposed approach gives better classification rates than the classical state-of-the-art methods allowing a safer Computer-Aided Diagnosis of pleural cancer. This study reaches the diagnosis accuracy of [Formula: see text] using multiscale convolution technique which reveals the efficient proposed method.
In this paper, a novel approach is proposed for adjusting the position of a magnetic levitation system using projection recurrent neural network-based adaptive backstepping control (PRNN-ABC). The principles of designing magnetic levitation systems have widespread applications in the industry, including in the production of magnetic bearings and in maglev trains. Levitating a ball in space is carried out via the surrounding attracting or repelling magnetic forces. In such systems, the permissible range of the actuator is significant, especially in practical applications. In the proposed scheme, the procedure of designing the backstepping control laws based on the nonlinear state-space model is carried out first. Then, a constrained optimization problem is formed by defining a performance index and taking into account the control limits. To formulate the recurrent neural network (RNN), the optimization problem is first converted into a constrained quadratic programming (QP). Then, the dynamic model of the RNN is derived based on the Karush-Kuhn-Tucker (KKT) optimization conditions and the variational inequality theory. The convergence analysis of the neural network and the stability analysis of the closed-loop system are performed using the Lyapunov stability theory. The performance of the closed-loop system is assessed with respect to tracking error and control feasibility.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.