A Framework for Benchmarking BPMN 2.0 Workflow Management Systems

Ferme, Vincenzo; Ivanchikj, Ana; Pautasso, Cesare

doi:10.1007/978-3-319-23063-4_18

Cited by 23 publications

(9 citation statements)

References 8 publications

(8 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…According to the authors, the use of Docker as a solution to automatically deploy and execute the different program reversions has clearly facilitated the testing process. Another Docker‐based approach is presented in the BenchFlow2 project that focuses on benchmarking BPMN 2.0 engines . This project is dedicated to the performance testing of workflow engines.…”

Section: Related Workmentioning

confidence: 99%

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Boussaa

Barais

Sunyé

et al. 2019

Software Testing Verif & Rel

View full text Add to dashboard Cite

SUMMARY Generative software development has paved the way for the creation of multiple code generators that serve as a basis for automatically generating code to different software and hardware platforms. In this context, the software quality becomes highly correlated to the quality of code generators used during software development. Eventual failures may result in a loss of confidence for the developers, who will unlikely continue to use these generators. It is then crucial to verify the correct behaviour of code generators in order to preserve software quality and reliability. In this paper, we leverage the metamorphic testing approach to automatically detect inconsistencies in code generators via so‐called “metamorphic relations”. We define the metamorphic relation (i.e., test oracle) as a comparison between the variations of performance and resource usage of test suites running on different versions of generated code. We rely on statistical methods to find the threshold value from which an unexpected variation is detected. We evaluate our approach by testing a family of code generators with respect to resource usage and performance metrics for five different target software platforms. The experimental results show that our approach is able to detect, among 95 executed test suites, 11 performance and 15 memory usage inconsistencies.

show abstract

Section: Related Workmentioning

confidence: 99%

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Boussaa

Barais

Sunyé

et al. 2019

Software Testing Verif & Rel

View full text Add to dashboard Cite

show abstract

“…Business process modelling, which was originally termed as "workflow" provides good graphical representation of the processes, events, communication, flows, roles and many attributes that an organization is looking for in their BPI pursuit. Over a period of time, it has been realized that BPM is beyond workflow and the term "workflow" is now considered outdated [41,42]. Today, with increasing global competition, more organisations are adopting BPI initiatives to be integrated with their enterprise systems, and therefore the need for the BPM approach to be revisited is escalating [43,44].…”

Section: Related Workmentioning

confidence: 99%

Process Innovation and Improvement Using Business Object-Oriented Process Modelling (BOOPM) Framework

Venkatraman¹,

Venkatraman

2019

ASI

View full text Add to dashboard Cite

In the past decades, a number of methodologies have been proposed to innovate and improve business processes that play an important role in enhancing the operational efficiency of an organisation in order to attain business competitiveness. Traditional business process modelling (BPM) approaches are process-centric and focus on the workflow, ignoring the data modelling aspects that are essential for today’s data-centric landscape of modern businesses. Hence, a majority of BPM initiatives have failed in several organisations due to the lack of data-driven insights into their business performance. On the other hand, the information systems of today focus more on dataflows using object-oriented modelling (OOM) approaches. Even standard OOM approaches, such as unified modelling language (UML) methods, exhibit inherent weaknesses due to their lack of formalized innovation with business objects and the dynamic control-flows of complex business processes. In addition to these issues, both BPM and OOM approaches have been augmented with an array of complex software tools and techniques which have confused businesses. There is a lack of a common generalized framework that integrates the well-formalised control-flow based BPM approach and the dataflow based OOM approach that is suitable for today’s enterprise systems in order to support organisations to achieve successful business process improvements. This paper takes a modest step to fill this gap. We propose a framework using a structured six-step business process modelling (BPM) guideline combined with a business object-oriented methodology (BOOM) in a unique and practical way that could be adopted for improving an organisation’s process efficiency and business performance in contemporary enterprise systems. Our proposed business object-oriented process modelling (BOOPM) framework is applied to a business case study in order to demonstrate the practical implementation and process efficiency improvements that can be achieved in enterprise systems using such a structured and integrated approach.

show abstract

“…The load tester is implemented relying on the Faban framework 5 used for the BenchFlow framework [3]. It enables the specification of complex workload, as well as the number of simulated users that are interacting with the SUT, and the duration of the interaction.…”

Section: Experiments Frameworkmentioning

confidence: 99%

Evaluating Multi-tenant Live Migrations Effects on Performance

Rosinosky

Labba

Ferme

et al. 2018

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Multitenancy is an important feature for all Everything as a Service providers like Business Process Management as a Service. It allows to reduce the cost of the infrastructure since multiple tenants share the same service instances. However, tenants have dynamic workloads. The resource they share may not be sufficient at some point in time. It may require Cloud resource (re-)configurations to ensure a given Quality of Service. Tenants should be migrated without stopping the service from a configuration to another to meet their needs while minimizing operational costs on the provider side. Live migrations reveal many challenges: service interruption must be minimized and the impact on cotenants should be minimal. In this paper, we investigate live tenants migrations duration and its effects on the migrated tenants as well as the co-located ones. To do so, we propose a generic approach to measure these effects for multi-tenant Software as a Service. Further, we propose a testing framework to simulate workloads, and observe the impact of live migrations on Business Process Management Systems. The experimental results highlight the efficiency of our approach and show that migration time depends on the size of data that have to be transferred and that the effects on co-located tenants should not be neglected.

show abstract

A Framework for Benchmarking BPMN 2.0 Workflow Management Systems

Cited by 23 publications

References 8 publications

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Leveraging metamorphic testing to automatically detect inconsistencies in code generator families

Process Innovation and Improvement Using Business Object-Oriented Process Modelling (BOOPM) Framework

Evaluating Multi-tenant Live Migrations Effects on Performance

Contact Info

Product

Resources

About