Lightweight Deep Learning

Abstract

Lightweight deep learning is a subfield of artificial intelligence and machine learning that prioritises efficiency and compactness while developing deep learning models. It is ideal for low-powered mobile phones, embedded systems, and internet-of-things devices due to their speed and low latency. To make lightweight deep learning models, pruning and quantization are used to remove unnecessary parameters and reduce model weight accuracy. Transfer learning is used to fine-tune a pre-trained deep learning model on a smaller dataset. This chapter introduces the fundamentals of lightweight deep learning, including various lightweight models and their applications across different industries.