Standards-Based IoT Testing with Open-Source Test Equipment

Kaiser, Alexander; Hackel, Sascha

doi:10.1109/qrs-c.2019.00085

Cited by 9 publications

(12 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several studies suggest test strategies and approaches for IoT systems that consist of general test levels (e.g., unit testing, integration testing, and acceptance testing) and approaching these test levels informally (e.g., testing of individual sensors, testing or integration, and security testing) [44,47,42,19,54,43,26,39,30,21,56]. These studies can be used as a basis for setting up a test strategy for an IoT system.…”

Section: Rq5: Used Testing Techniques and Approachesmentioning

confidence: 99%

Interoperability and Integration Testing Methods for IoT Systems: a Systematic Mapping Study

Bureš¹,

Klima²,

Rechtberger³

et al. 2020

Preprint

View full text Add to dashboard Cite

The recent active development of Internet of Things (IoT) solutions in various domains has led to an increased demand for security, safety, and reliability of these systems. Security and data privacy are currently the most frequently discussed topics; however, other reliability aspects also need to be focused on to maintain smooth and safe operation of IoT systems. Until now, there has been no systematic mapping study dedicated to the topic of interoperability and integration testing of IoT systems specifically; therefore, we present such an overview in this study. We analyze 803 papers from four major primary databases and perform detailed assessment and quality check to find 115 relevant papers. In addition, recently published testing techniques and approaches are analyzed and classified; the challenges and limitations in the field are also identified and discussed. Research trends related to publication time, active researchers, and publication media are presented in this study. The results suggest that studies mainly focus only on general testing methods, which can be applied to integration and interoperability testing of IoT systems; thus, there are research opportunities to develop additional testing methods focused specifically on IoT systems, so that they are more effective in the IoT context.

show abstract

Section: Rq5: Used Testing Techniques and Approachesmentioning

confidence: 99%

Interoperability and Integration Testing Methods for IoT Systems: a Systematic Mapping Study

Bureš¹,

Klima²,

Rechtberger³

et al. 2020

Preprint

View full text Add to dashboard Cite

show abstract

“…Following the advanced test methodology developed within ETSI MTS, it was decided to apply TDL-TO for the definition of test purposes within the work on the IoT-Testware [2] project. Based on our experiences, we have determined that it is essential to define test scenarios in a formalised way to avoid misinterpretation and to enable the application of suitable tools supporting consistency checking and formatting during development and maintenance.…”

Section: Experiences With Tdlmentioning

confidence: 99%

Using TDL for Standardised Test Purpose Definitions

Makedonski

Gheorghe-Pop

Rennoch

et al. 2020

2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C)

View full text Add to dashboard Cite

This article reports on experiences from the use of the ETSI Test Description Language (TDL) and its extension for structured test objective specification (TDL-TO) for the definition of functional and non-functional test purposes in the Internet of Things (IoT) domain. The experiences are based on results from different working groups at ETSI TC MTS and the ETSI Specialist Task Force (STF) 574, focusing on the definition of test purposes for functional, security, and performance testing of the CoAP and MQTT protocols as well as VxLTE interoperability testing.

show abstract

“…Testing involves ensuring that an IoT application meets its desired purpose and functionality. Test cases can be executed objectively to improve the system, understand risks and refine the related business processes [1]. Whitebox testing or clear box testing exploits the internal structure of the implementation design of the software.…”

Section: Introductionmentioning

confidence: 99%

“…Among these components, the application component is the only area which applies to all types of testing such as functionality, security, usability, operational stability, services, performance and compatibility testing. In the research by [1], the testing of IoT systems revolves around overall quality of communication protocol implementation and comparison of quality. They have tried to prove the hypothesis experimentally with open source protocol brokers.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Can Commercial Testing Automation Tools Work for IoT? A Case Study of Selenium and Node-Red

Varghese

Sinha

2020

IECON 2020 the 46th Annual Conference of the IEEE Industrial Electronics Society

View full text Add to dashboard Cite

Background: Testing IoT software is challenging due to large scale, volume of data and heterogeneity. Testing automation is a much-needed feature in the domain. Aims: The first goal of this research is to explore the requirements and challenges of IoT testing automation. The second goal is to integrate testing automation tools used in commercial software into the IoT context. Method: A systematic literature review is carried out to elicit requirements for testing automation in IoT. A design science approach is followed to build a testing automation tool for IoT applications written in the Node-Red platform, using the commercial testing automation tool Selenium. The resulting framework uses the Selenium Web Driver for browser-based testing automation for IoT applications. Results: The proposed framework has been functionally tested on multiple browsers with preliminary evaluation on maintainability, browser capability and comprehensiveness. Conclusions: The use of commercial tools for testing automation in IoT is feasible. However, major challenges like high data volumes and parallel transmission and processing of data need to be addressed comprehensively for complete integration.

show abstract

Standards-Based IoT Testing with Open-Source Test Equipment

Cited by 9 publications

References 3 publications

Interoperability and Integration Testing Methods for IoT Systems: a Systematic Mapping Study

Interoperability and Integration Testing Methods for IoT Systems: a Systematic Mapping Study

Using TDL for Standardised Test Purpose Definitions

Can Commercial Testing Automation Tools Work for IoT? A Case Study of Selenium and Node-Red

Contact Info

Product

Resources

About