Abstract:Abstract. Hierarchical convolutional neural networks are a well-known robust image-recognition model. In order to apply this model to robot vision or various intelligent vision systems, its VLSI implementation with high performance and low power consumption is required. This paper proposes a convolutional network VLSI architecture using a hybrid approach composed of pulse-width modulation (PWM) and digital circuits. We call this approach merged/mixed analog-digital architecture. The VLSI includes PWM neuron ci… Show more
“…Deep Learning (DL) approaches are based on the principle of using ANNs with multiple hidden layers, where training is both unsupervised (bottom-up) to generate higher level representations of sensory data which can then be used for training a classifier (top down) based on standard supervised training algorithms (Hinton & Salakhutdinov, 2006). Feature learning methods are based on supervised approaches such as Deep NNs, Convolutional NNs and Recurrent NNs along with unsupervised techniques such as Deep Belief Networks and Convolutional Neural Networks (CNNs) and provide deep architecture that combine structural elements of local receptive fields, shared weights, and pooling that aims to imitate the processing of simple and complex cortical cells found in animal vision systems (Korekado et al, 2003).…”
Section: Computational Intelligence For Big Data Analyticsmentioning
a b s t r a c tBig Data has a significant impact in modern society. In this paper we investigated the importance of Big Data in modern life, and in terms of the economy, and discussed the challenges arising from Big Data utilization. Different computational intelligence techniques have been considered as tools for Big Data analytics. We also explored the potential of the powerful combination of Big Data and Computational intelligence and identified a number of areas where novel applications in real world problems can be developed by utilizing these powerful tools and technologies. We presented a novel data modelling methodology which introduces a novel biologically inspired universal generative modelling approach called Hierarchical Spatial-Temporal State Machine (HSTSM). In this paper, we have also discussed various implications of policy, protection, valuation and commercialization related to Big Data, its applications and deployment.
“…Deep Learning (DL) approaches are based on the principle of using ANNs with multiple hidden layers, where training is both unsupervised (bottom-up) to generate higher level representations of sensory data which can then be used for training a classifier (top down) based on standard supervised training algorithms (Hinton & Salakhutdinov, 2006). Feature learning methods are based on supervised approaches such as Deep NNs, Convolutional NNs and Recurrent NNs along with unsupervised techniques such as Deep Belief Networks and Convolutional Neural Networks (CNNs) and provide deep architecture that combine structural elements of local receptive fields, shared weights, and pooling that aims to imitate the processing of simple and complex cortical cells found in animal vision systems (Korekado et al, 2003).…”
Section: Computational Intelligence For Big Data Analyticsmentioning
a b s t r a c tBig Data has a significant impact in modern society. In this paper we investigated the importance of Big Data in modern life, and in terms of the economy, and discussed the challenges arising from Big Data utilization. Different computational intelligence techniques have been considered as tools for Big Data analytics. We also explored the potential of the powerful combination of Big Data and Computational intelligence and identified a number of areas where novel applications in real world problems can be developed by utilizing these powerful tools and technologies. We presented a novel data modelling methodology which introduces a novel biologically inspired universal generative modelling approach called Hierarchical Spatial-Temporal State Machine (HSTSM). In this paper, we have also discussed various implications of policy, protection, valuation and commercialization related to Big Data, its applications and deployment.
“…Deep Learning (DL) approaches are based on the principle of using ANNs with multiple hidden layers, where training is both unsupervised (bottom-up) to generate higher level representations of sensory data which can then be used for training a classifier (top down) based on standard supervised training algorithms (Hinton and Salakhutdinov, 2006). Feature learning methods are based on supervised approaches such as Deep NNs, Convolutional NNs and Recurrent NNs along with unsupervised techniques such as Deep Belief Networks and Convolutional Neural Networks (CNNs) provide deep architecture that combine structural elements of local receptive fields, shared weights, and pooling that aim to imitate the processing of simple and complex cortical cells found in animal vision systems (Korekado et al, 2003).…”
Section: Computational Intelligence For Big Data Analyticsmentioning
Big Data has significant impact in developing functional smart cities and supporting modern societies. In this paper, we investigate the importance of Big Data in modern life and economy, and discuss challenges arising from Big Data utilization. Different computational intelligence techniques have been considered as tools for Big Data analytics. We also explore the powerful combination of Big Data and Computational Intelligence (CI) and identify a number of areas, where novel applications in real world smart city problems can be developed by utilizing these powerful tools and techniques. We present a case study for intelligent transportation in the context of a smart city, and a novel data modelling methodology based on a biologically inspired universal generative modelling approach called Hierarchical Spatial-Temporal State Machine (HSTSM). We further discuss various implications of policy, protection, valuation and commercialization related to Big Data, its applications and deployment.
“…One of the first CNN implementations on hardware dates back to the early 90's where an ANNA chip (a mixed analog/digital neural-network chip) was used to implement a CNN [33][34][35]. Korekado et al [36] proposed a VLSI architecture of high performance and low power was used to implement a CNN. This architecture uses a hybrid approach composed of pulse-width modulation (PWM) and a digital circuitry.…”
Specific information about types of appliances and their use in a specific time window could help determining in details the electrical energy consumption information. However, conventional main power meters fail to provide any specific information. One of the best ways to solve these problems is through non-intrusive load monitoring, which is cheaper and easier to implement than other methods. However, developing a classifier for deducing what kind of appliances are used at home is a difficult assignment, because the system should identify the appliance as fast as possible with a higher degree of certainty. To achieve all these requirements, a convolution neural network implemented on hardware was used to identify the appliance through the voltage and current (V-I) trajectory. For the implementation on hardware, a field programmable gate array (FPGA) was used to exploit processing parallelism in order to achieve optimal performance. To validate the design, a publicly available Plug Load Appliance Identification Dataset (PLAID), constituted by 11 different appliances, has been used. The overall average F-score achieved using this classifier is 78.16% for the PLAID 1 dataset. The convolution neural network implemented on hardware has a processing time of approximately 5.7 ms and a power consumption of 1.868 W.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.