As a special case of machine learning, incremental learning can acquire useful knowledge from incoming data continuously while it does not need to access the original data. It is expected to have the ability of memorization and it is regarded as one of the ultimate goals of artificial intelligence technology. However, incremental learning remains a long term challenge. Modern deep neural network models achieve outstanding performance on stationary data distributions with batch training. This restriction leads to catastrophic forgetting for incremental learning scenarios since the distribution of incoming data is unknown and has a highly different probability from the old data. Therefore, a model must be both plastic to acquire new knowledge and stable to consolidate existing knowledge. This review aims to draw a systematic review of the state of the art of incremental learning methods. Published reports are selected from Web of Science, IEEEXplore, and DBLP databases up to May 2020. Each paper is reviewed according to the types: architectural strategy, regularization strategy and rehearsal and pseudo-rehearsal strategy. We compare and discuss different methods. Moreover, the development trend and research focus are given. It is concluded that incremental learning is still a hot research area and will be for a long period. More attention should be paid to the exploration of both biological systems and computational models.
We designed magneto-electro-elastic piezoelectric, electromagnetic (EM) metamaterials (MEEPEM) by using a square lattice of the periodic arrays of conducting wires, piezoelectric photonic crystal (PPC), and split-ring resonators (SRRs). We analyzed the mechanism for multi-field coupling in MEEPEM. The magnetic field of the EM wave excites an attractive Ampère force in SRRs, which periodically compress MEEPEM, and this can create electric polarization due to the piezoelectric effect. The electric field of the EM wave can excite a longitudinal superlattice vibration in the PPC, which can also create electric polarization. The electric polarization can couple to the electric field of the periodic arrays of conducting wires. The coupled electric field will couple to the EM wave. These interactions result in multi-field coupling in MEEPEM. The coupling creates a type of polariton, called multi-field coupling polaritons, corresponding to a photonic band gap, namely, the multi-field coupling photonic band gap. We calculated the dielectric functions, the reflection coefficients, and the effective magnetic permeability of MEEPEM. By using them, we analyzed the transmission properties of EM waves in the MEEPEM. We analyzed the possibility of MEEPEM as left-handed metamaterials and zero refractive index material.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.