A Customer Behavior Recognition Method for Flexibly Adapting to Target Changes in Retail Stores

Abstract

To provide analytic materials for business management for smart retail solutions, it is essential to recognize various customer behaviors (CB) from video footage acquired by in-store cameras. Along with frequent changes in needs and environments, such as promotion plans, product categories, in-store layouts, etc., the targets of customer behavior recognition (CBR) also change frequently. Therefore, one of the requirements of the CBR method is the flexibility to adapt to changes in recognition targets. However, existing approaches, mostly based on machine learning, usually take a great deal of time to re-collect training data and train new models when faced with changing target CBs, reflecting their lack of flexibility. In this paper, we propose a CBR method to achieve flexibility by considering CB in combination with primitives. A primitive is a unit that describes an object’s motion or multiple objects’ relationships. The combination of different primitives can characterize a particular CB. Since primitives can be reused to define a wide range of different CBs, our proposed method is capable of flexibly adapting to target CB changes in retail stores. In experiments undertaken, we utilized both our collected laboratory dataset and the public MERL dataset. We changed the combination of primitives to cope with the changes in target CBs between different datasets. As a result, our proposed method achieved good flexibility with acceptable recognition accuracy.

Prediction of Consumers’ Adoption Behavior of Products with Water Efficiency Labeling Based on Hidden Markov Model

“…Compared to other machine learning algorithms, HMM will not appear overfitted due to the increase in the number of hidden states, nor will the prediction accuracy decrease with the increase in the number of input features [64]. This has been verified in other scholars' studies, where HMM has shown better prediction performance [65][66][67]. However, the prediction results have specific errors since the training samples cannot cover all the observed states.…”

Towards Marketing 4.0: Vision and Survey on the Role of IoT and Data Science

“…The information obtained can then be used to devise marketing strategies. More recently, in [35], Wen et al proposed making use of customer behaviour primitives in conjunction with object tracking to achieve accurate customer behaviour recognition. In [36], Radhakrishnan et al also looked at detecting such activities, but instead by using sensor data from wearable devices in combination with smartphones.…”

Methodological Insights Towards Leveraging Performance in Video Object Tracking and Detection

“… Customer Experience: ODT can extract the customer's actions during store visits. It can assist in understanding the possibilities of assistance that any visiting customer may require [24].…”