Machine learning (ML) is a data intensive process. For training of ML algorithms huge datasets are required.There are times when enough data is not available due to multitude of reasons. This could be due to lack ofavailability of annotated data in a particular domain or paucity of time in data collection process resulting innon-availability of enough data. Many a times data collection is very expensive and in few domains data collectionis very difficult. In such cases, if methods can be designed to reuse the knowledge gained in one domain havingenough training data, to some other related domain having less training data, then problems associated with lackof data can be overcome. Transfer Learning (TL) is one such method. TL improves the performance of the targetdomain through knowledge transfer from some different but related source domain. This knowledge transfer canbe in form of feature extraction, domain adaptation, rule extraction for advice and so on. TL also works withvarious kinds of ML tasks related to supervised, unsupervised and reinforcement learning. The ConvolutionalNeural Networks are well suited for the TL approach. The general features learned on a base network (source)are shifted to the target network. The target network then uses its own data and learns new features specific toits requirement.
This paper surveys transfer learning as a sustainable knowledge transfer mechanism. Conventional machine learning algorithms require a huge amount of labeled data for supervised learning. In absence of such data, the models suffer from performance degradation. Transfer learning enables the prior knowledge gained in doing a particular task to be reused or transferred to another new task of similar nature. This can speed up and improve the learning curve of the tasks in the new domain. The paper gives an overview of the transfer learning process and highlights how this innovative artificial intelligence (AI) technique can help achieve the goals of sustainable development. The literature survey highlights widely used mechanisms of Transfer Learning like homogeneous, heterogeneous, as well as instance-based, parameter-based, and relational-based implementation of transfer learning. It discusses how these mechanisms are utilized to create efficient AI-based applications which aid sustainability in the long run.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.