A Methodology for Generating Tests for Evaluating User-Centric Performance of Mobile Streaming Applications

Al‐tekreeti, Mustafa; Naik, Kshirasagar; Abdrabou, Atef; Zaman, Musharraf; Srivastava, Pradeep

doi:10.1007/978-3-030-11030-7_18

Cited by 2 publications

(2 citation statements)

References 50 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Virtual Test Engineer [3] has been developed to convert the UML (Unified Modeling Language) sequence diagram into Android APK (Android Application Package) to test Android mobile applications. A model-based test generation methodology has been proposed to evaluate the impact of the interaction of the environment, the wireless network, and the app configurations on the performance of a mobile streaming app and thereby, on the experience of the end user [1].…”

Section: Introductionmentioning

confidence: 99%

Evaluation of the Automated Testing Framework: A Case Study

Méndez-Porras¹,

Alfaro-Velásco²,

Martinez³

2020

View full text Add to dashboard Cite

Developing mobile applications without defects or in a minimum number is an important challenge for programmers and quality assurance teams. Automated software test can be the key to improve the traditional manual testing, often time consuming and repetitive. Mobile applications support user-interaction characteristics, whichareindependentfromtheapplicationlogic.Theyincludecontentpresentationornavigationfeatures,such as scroll or zoom into screens, and a rotating device. In this paper, an automated testing framework is proposed and evaluated. This framework integrates user- interaction features, historical bug information, and an interest points detector and descriptor to identify new bugs. It has shown that it works well detecting bugs associated with user-interactions.

show abstract

Section: Introductionmentioning

confidence: 99%

Evaluation of the Automated Testing Framework: A Case Study

Méndez-Porras¹,

Alfaro-Velásco²,

Martinez³

2020

View full text Add to dashboard Cite

show abstract

“…We show, using two evaluation metrics, that metamorphic testing can successfully be used to alleviate the test oracle problem in performance testing. The whole work is part of the first author's PhD dissertation . In summary, we make the following contributions: we propose a test generation methodology to evaluate the interaction of network conditions and application configurations on the performance of a mobile networked application; we propose two performance testing coverage criteria to enhance the quality of the generated test cases; and we show how metamorphic testing can be used to minimize the cost of test oracles in performance testing. …”

Section: Introductionmentioning

confidence: 99%

An end‐user‐centric test generation methodology for performance evaluation of mobile networked applications

Al‐tekreeti

Abdrabou

Naik

2019

Software Testing Verif & Rel

Self Cite

View full text Add to dashboard Cite

We propose a model-based test generation methodology to evaluate the impact of the interaction of the wireless network and application configurations on the performance of mobile networked applications. We consider waiting time delay to model wireless network quality. We classify mobile applications into two groups. Group I represents applications where end-user experience is mainly affected by waiting time delay during service consumption, while group II represents applications where end-user experience is affected by waiting time delay before service consumption. Test generation is formulated as an inversion problem. However, for group I applications, solving the inversion problem is expensive. Therefore, we utilize metamorphic testing to mitigate the cost of test oracles. We formulate metamorphic test generation as maximization of the distance between seed and follow-up test cases. Two test coverage criteria are proposed: user experience and user-experience-and-input interaction. Network models are developed for a mobile device that has network access through a WiFi hot spot and uses either transmission control protocol or user datagram protocol. Two mobile applications are used to demonstrate the methodology: multimedia streaming and web browsing. Application of the methodology when user actions are taken into consideration is also addressed. The effectiveness of the methodology is evaluated using two metrics: the incurred time cost and redundancy in the generated test suite. The obtained results show the advantage of casting test generation as an inversion problem, compared with random testing. For apps with intensive performance models, combining metamorphic testing with the methodology has tremendously reduced the cost of test oracles. 15 of 38 state y. Therefore, the SUT desired behaviour introduces the following two constraints (Procedure 3.S1), where B, M , and L are defined as an integer number of multimedia frames:M Ä B and L Ä M 1:(4) 4.1.2. The wireless network model. The end user is streaming via a WiFi hot spot and using the UDP. We assume all the fluctuations in the wireless link and the queuing effects of the different routers along the path from the server to the client device manifest as a time delay. That is, packet loss is negligible. A reusable network model for the UDP scenario was developed in our previous work [15]. We have developed two analytical expressions for the mean and variance of packet interarrival time delay. The probability distribution was matched with the hyper-Erlang distribution. The network impact is captured by three operating parameters (NOPs): the data rate (D), the mean rate of frame arrivals into the access point ( ) per user, and the number of end users (N ) connected to the AP. The data rate according to the IEEE 802.11 a/g standard can be in one of the following values: 6, 9, 12, 18, 24, 32, 48, or 54 Mbps. It mainly relates to the quality of the wireless connection between the AP and the end user. Regarding the number of users N , the network model is validated...

show abstract

A Methodology for Generating Tests for Evaluating User-Centric Performance of Mobile Streaming Applications

Cited by 2 publications

References 50 publications

Evaluation of the Automated Testing Framework: A Case Study

Evaluation of the Automated Testing Framework: A Case Study

An end‐user‐centric test generation methodology for performance evaluation of mobile networked applications

Contact Info

Product

Resources

About