Despite their enormous potential, the use of indoor localization systems (ILS) remains seldom. One reason is the lack of market transparency and stakeholders’ trust in the systems’ performance as a consequence of insufficient use of test and evaluation (T&E) methodologies. The heterogeneous nature of ILS, their influences, and their applications pose various challenges for the design of a methodology that provides meaningful results. Methodologies for building-wide testing exist, but their use is mostly limited to associated indoor localization competitions. In this work, the T&E 4iLoc Framework is proposed—a methodology for T&E of indoor localization systems in semi-controlled environments based on a system-level and black-box approach. In contrast to building-wide testing, T&E in semi-controlled environments, such as test halls, is characterized by lower costs, higher reproducibility, and better comparability of the results. The limitation of low transferability to real-world applications is addressed by an application-driven design approach. The empirical validation of the T&E 4iLoc Framework, based on the examination of a contour-based light detection and ranging (LiDAR) ILS, an ultra wideband ILS, and a camera-based ILS for the application of automated guided vehicles in warehouse operation, demonstrates the benefits of T&E with the T&E 4iLoc Framework.
Despite their enormous potential the use of Indoor Localization Systems (ILS) remains 1 seldom. One reason is the lack of market transparency and stakeholders’ trust in the systems’ 2 performance as a consequence of insufficient use of Test and Evaluation (T&E) methodologies. The 3 heterogeneous nature of ILS, their influences, and their applications pose various challenges for 4 the design of a methodology that provides meaningful results. Methodologies for building-wide 5 testing exist, but their use is mostly limited to associated indoor localization competitions. In this 6 work, the T&E 4iLoc Framework is proposed - a methodology for T&E of indoor localization systems 7 in semi-controlled environments based on a system-level and black-box approach. In contrast to 8 building-wide testing, T&E in semi-controlled environments, such as test halls is characterized by 9 lower costs, higher reproducibility, and better comparability of the results. The limitation of low 10 transferability to real world applications is addressed by an application-driven design approach. 11 The empirical validation of the T&E 4iLoc Framework, based on the examination of a contour-based 12 Light Detection and Ranging ILS, an Ultra Wideband ILS, and a camera-based ILS for the application 13 of Automated Guided Vehicles in warehouse operation, demonstrates the benefits of T&E with the 14 T&E 4iLoc Framework.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.