A Machine Learning-Oriented Survey on Tiny Machine Learning

Abstract

The emergence of Tiny Machine Learning (TinyML) has positively revolutionized the field of Artificial Intelligence by promoting the joint design of resource-constrained IoT hardware devices and their learning-based software architectures. TinyML carries an essential role within the fourth and fifth industrial revolutions in helping societies, economies, and individuals employ effective AI-infused computing technologies (e.g., smart cities, automotive, and medical robotics). Given its multidisciplinary nature, the field of TinyML has been approached from many different angles: this comprehensive survey wishes to provide an up-to-date overview focused on all the learning algorithms within TinyML-based solutions. The survey is based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodological flow, allowing for a systematic and complete literature survey. In particular, firstly, we will examine the three different workflows for implementing a TinyML-based system, i.e., MLoriented, HW-oriented, and co-design. Secondly, we propose a taxonomy that covers the learning panorama under the TinyML lens, examining in detail the different families of model optimization and design, as well as the state-of-the-art learning techniques. Thirdly, this survey will present the distinct features of hardware devices and software tools that represent the current state-of-the-art for TinyML intelligent edge applications. Finally, we discuss the challenges and future directions.

A lightweight optimization framework for real-time object detector on the embedded GPU platform

“…Single board computers (SBCs) with small size and low power consumption are the main carrier of edge computing and edge intelligence [1][2][3][4]. Currently, many chip companies are working on developing AI accelerators that can be integrated into SBCs to increase the computing power of edge devices, such as NVIDIA's embedded GPU, Intel's VPU, SOPHGO's TPU and Horizon's BPU.…”

Analytical Study of the World's First EU Artificial Intelligence (AI) Act, 2024

“…Gen AI has experienced a notable transformation in recent years, marked by exceptional innovations and rapid advancements 2 and over the past decade, digital advancements in AI, LLMs, and NLP have significantly impacted the digital domain, expanding into more complex areas like unsupervised, semisupervised, reinforcement, LLM, NLP, and deep learning techniques 3 . Recent research Shevlane, T. (2024) 4 presents a novel approach for assessing the potentially severe hazards associated with GenAI models, such as deceit, manipulation, and cyber-offence features.…”