Reduced Tilting Effect of Smartphone CMOS Image Sensor in Visible Light Indoor Positioning

Abstract

Visible light positioning (VLP) using complementary metal–oxide–semiconductor (CMOS) image sensors is a cost-effective solution to the increasing demand for an indoor positioning system. However, in most of the existing VLP systems with an image sensor, researchers assume that the receiving image sensor is positioned parallel to the indoor floor without any tilting and, thus, have only focused on the high-precision positioning algorithm and ignored the proper light-emitting diode (LED)-ID recognition. To address these limitations, we present, herein, a smartphone CMOS image sensor and visible light-based indoor localization system for a receiver device in a tilted position, and we have applied a machine learning approach for optimized LED-ID detection. For detection of the LED-ID, we generated different features for different LED-IDs and utilize a machine learning method to identify each ID as opposed to using the conventional coding and decoding method. An image processing method was used for the image features extraction and selection. We utilized the rolling shutter mechanism of the smartphone CMOS image sensor in our indoor positioning system. Additionally, to improve the LED-ID detection and positioning accuracy with the tilting of the receiver, we utilized the embedded fusion sensors of the smartphone (e.g., accelerometer, gyroscope, and magnetometer, which can be used to extract the yaw, pitch, and roll angles). The experimental results for the proposed positioning system show that it can provide 2.49, 4.63, 8.46, and 12.20 cm accuracy with angles of 0, 5, 10, and 15°, respectively, within a 2 m × 2 m × 2 m positioning area.

A Review of Optical Sensors in CMOS

“…Due to the inherent advantages of CMOS technology, these imagers are present everywhere, such as in cellphones, cameras, security systems, traffic devices, medical equipment, and indoor positioning systems, among many others [71][72][73]. Figure 8b illustrates the concept of the readout circuits used in a CMOS, which is also composed of several columns with arrays of photodetectors [66,73].…”

A Top-Down Survey on Optical Wireless Communications for the Internet of Things

“…VLC systems can be used for indoor positioning applications where various LEDs send their location to a PD placed on the user's device or the object to be located [119]- [121]. VLC-based positioning systems are also feasible in situations where the transmitter [122] or receiver [123], [124] is tilted. Similarly, VLC systems are implemented for indoor tracking applications such as remotely controlling a mobile robot or tracking an intruder for security purposes [125], [126].…”

Machine Learning for Intelligent-Reflecting-Surface-Based Wireless Communication towards 6G: A Review

“…Depending on the input and output data connection, the model can be built up. After that, a fresh data set is input into the model to obtain a prediction result [ 69 , 70 , 71 ]. SL is one of the strongest branches of ML, which includes regression, decision tree and random forest, K-nearest neighbors (KNN), support vector machines (SVM), and Bayes classification.…”