Quality Attributes of Systems-of-Systems: A Systematic Literature Review

Bianchi, Thiago; Santos, Daniel Soares; Felizardo, Katia Romero

doi:10.1109/sesos.2015.12

Cited by 27 publications

(22 citation statements)

References 53 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Bianchi et al [5] determined that the QA's most addressed in several SoS application domains (Military, IT systems, Smart Grid, Automotive, Transport) are Security, Performance, Interoperability, and Reliability. However, our SLM found that only Performance and Reliability are among the QA's most addressed by architectural evaluations (with 11 and 6 proposals, respectively).…”

Section: Synthesis and Discussionmentioning

confidence: 99%

“…Bianchi et al [5] performed a SLR with to determine the QA's most important in the SoS, and analyzed the coverage of the ISO/IEC 25010 quality model. The study yield 56 QA's, among which the most important were security, interoperability, performance, reliability, and safety.…”

Section: Related Workmentioning

confidence: 99%

“…The goal of this article is to identify and characterize extant proposals for architectural evaluation of SoS according to their goals, QA's, and methods used. SoS Previous work to address this goal focuses on in making a holistic description of the SoS areas (specially [4] [5]) or are reviews related not conducted as rigorous systematic reviews [3].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Characterizing Architectural Evaluations and Identifying Quality Attributes addressed in Systems-of-Systems: A Systematic Mapping Study

Gatica

Ponce

Noël

et al. 2018

EasyChair Preprints

View full text Add to dashboard Cite

System-of-Systems (SoS) are composed by heterogeneous constituent systems that are autonomous, independently managed and operated, and geographically distributed. Architectural evaluation is a key activity of all systems design, construction and operation; unfortunately, the interrelationships among SoS constituent systems and quality attributes (QA) make hard to evaluate SoS. Several evaluation techniques have been proposed, but this corpus of knowledge has not yet been organized for easy access. This article describes the design, execution and results of a Systematic Literature Mapping (SLM) of architectural evaluation proposals, focusing on the QA's they address and the techniques they use. The SLM yield 1675 articles, of which 22 were selected for detailed analysis; most of them take a quantitative perspective (82\%) and the rest are hybrid quantitative/qualitative (18\%); most proposals offer no empirical validation at all (64\%); and the most addressed QA's are performance and robustness.

show abstract

Section: Synthesis and Discussionmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Characterizing Architectural Evaluations and Identifying Quality Attributes addressed in Systems-of-Systems: A Systematic Mapping Study

Gatica

Ponce

Noël

et al. 2018

EasyChair Preprints

View full text Add to dashboard Cite

show abstract

“…Again, there might be challenges in conducting traditional system testing at SoS level due to constituent systems being in independent asynchronous development cycles. A recent study indicated that five most relevant quality attributes for a SoS are security, interoperability, performance, reliability, and safety (Bianchi et. al., 2015).…”

Section: Architecture and Evolution Challenges In Complex Sosmentioning

confidence: 99%

Knowledge Based Decision Model for Architecting and Evolving Complex System‐of‐Systems

Raman

D’Souza

2017

INCOSE International Symp

View full text Add to dashboard Cite

Architecting complex System‐of‐System (SoS) has evinced keen interest recently, specifically towards factoring in the operational and managerial independence of the constituent systems, and the evolutionary and adaptive nature of SoS development. Architectural decisions have a significant bearing on the operational measures of success, referred to as Measures of Effectiveness (MOEs), of the SoS. There is inherent uncertainty while making an architectural decision for complex SoS due to the incomplete knowledge on the implications of the decision. The impact on the MOEs of the SoS may be realized only later in the development lifecycle, influencing the performance and the emergent behavior of the SoS. Further, when learning cycles on the architectural decisions are experienced, once the implication of decision is realized, there needs to be means for incorporating the feedback on the decisions taken, and to reflect back on the uncertainty associated with the decisions. This paper proposes a knowledge based decision model for architecting and evolving complex SoS, that takes into account the uncertainty associated with architectural decisions and the learning cycles and feedback loops experienced. It also enables augmenting the architectural knowledge base, both at a constituent system level as well as at the System‐of‐System level. The proposed model adopts a decision oriented view that enables factoring in uncertainty, learning cycles and feedback loops in architectural decisions. It facilitates exploring the implications of various SoS evolution scenarios on architectural decisions, while analyzing MOEs of the SoS in relation to the MOEs of the constituent systems.

show abstract

“…They can be found in many sectors and application domains, mainly critical ones. Good examples of SoS can be found in representative domains, such as robotics, airport, avionics, smart-* systems (e.g., smart-grid, smart-cities, smart-buildings, and smart-farms), and in the military domain (e.g., aerospace, warfare, and global earth observation) (Bianchi et al, 2015;Jamshidi, 2008;Lane, 2013;Nakagawa et al, 2013). Differently from classical software systems, SoS present a set of characteristics that make them unique (Maier, 1998): (i) operational independence of constituent systems; (ii) managerial independence of constituent systems; (iii) evolutionary development; (iv) emergent behavior from the collaboration of constituents; and (v) distribution of the constituent systems, geographically or not.…”

Section: List Of Tables Introductionmentioning

confidence: 99%

Quality Evaluation Model for Crisis and Emergency Management Systems-of-Systems

Santos¹

Self Cite

View full text Add to dashboard Cite

Systems-of-Systems (SoS) have performed an important and even essential role to the whole society and refer to complex softwareintensive systems, resulted from interoperability of independent constituent systems that work together to achieve more complex missions. SoS have emerged specially in critical application domains and, therefore, high level of quality must be assured during their development and evolution. However, dealing with quality of SoS still presents great challenges, as SoS present a set of unique characteristics that can directly affect the quality of such systems. Moreover, there are not comprehensive models that can support the quality evaluation of SoS. Motivated by this scenario, the main contribution of this Master's project is to present a SoS Evaluation Model, more specifically, addressing the crisis/emergency management domain, built in the context of a large international research project. The proposed model covers important evaluation activities and considers all SoS characteristics and challenges not usually addressed by other models. This model was applied to evaluate a crisis/emergency management SoS and our results have shown it viability to the effective management of the SoS quality.

show abstract

Quality Attributes of Systems-of-Systems: A Systematic Literature Review

Cited by 27 publications

References 53 publications

Characterizing Architectural Evaluations and Identifying Quality Attributes addressed in Systems-of-Systems: A Systematic Mapping Study

Characterizing Architectural Evaluations and Identifying Quality Attributes addressed in Systems-of-Systems: A Systematic Mapping Study

Knowledge Based Decision Model for Architecting and Evolving Complex System‐of‐Systems

Quality Evaluation Model for Crisis and Emergency Management Systems-of-Systems

Contact Info

Product

Resources

About