Common Threats and Mitigation Strategies in Requirements Engineering Experiments with Student Participants

Daun, Marian; Salmon, Andrea; Bandyszak, Torsten; Weyer, Thorsten

doi:10.1007/978-3-319-30282-9_19

Cited by 7 publications

(6 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The experiment was designed to last about 30 minutes to minimize participants' mortality because of losing interest. This setup was chosen on the basis of best practices to mitigate common threats to validity, particularly arising when using student participants [42].…”

Section: Experiments Design and Proceduresmentioning

confidence: 99%

See 1 more Smart Citation

On the Impact of the Model-Based Representation of Inconsistencies to Manual Reviews

Daun

Brings

Weyer

2017

Conceptual Modeling

Self Cite

View full text Add to dashboard Cite

To ensure fulfilling stakeholder wishes, it is crucial to validate the documented requirements. This is often complicated by the fact that the wishes and intentions of different stakeholders are somewhat contradictory, which manifests itself in inconsistent requirements. To aid requirements engineers in identifying and resolving inconsistent requirements, we investigated the usefulness for manual reviews of two different model-based representation formats for inconsistent requirements; one that represent the inconsistent requirements in separate diagrams and one that represents them integrated into one diagram using annotations. The results from a controlled experiment show that the use of such integrated review diagrams can significantly increase efficiency of manual reviews, without sacrificing effectiveness.

show abstract

Section: Experiments Design and Proceduresmentioning

confidence: 99%

“…To address threats to validity, which exist for this type of study (cf. [43]), we have employed certain mitigation strategies [42]. The most relevant validity threats are discussed below: Construct Validity.…”

Section: Threats To Validitymentioning

confidence: 99%

On the Impact of the Model-Based Representation of Inconsistencies to Manual Reviews

Daun

Brings

Weyer

2017

Conceptual Modeling

Self Cite

View full text Add to dashboard Cite

show abstract

“…The simulated startups were designed based on Startup characteristics as discussed in [1] and the use of RE practices in a small setting as mentioned in [14], [15]. The reason we simulated two startups in a Master's level course using students as subjects was that students are quite similar to the industry group when evaluating a new technique and their use is common when conducting empirical research in requirements engineering [16], [17]. The two simulated startups were configured in such a way so that they could exhibit as a potential competitor to each other.…”

Section: Rq: Does a Potential Competitor's Interaction With A Startup's Internal Team Improve The Effort Estimation Process Of The Startumentioning

confidence: 99%

“…The study was conducted as a blocked subject-object study, as there is more than one subject and object in the study. [13] 2) Experimental units: To conduct the experiment, we used students as experimental subjects, which is common when conducting empirical research in requirements engineering; students are also quite similar to the industry group when evaluating a new technique [16], [17]. In order to simulate a startup environment and conduct the experiment, we planned and executed two software development exercise projects during the autumn of 2015 in the Software Development in Global Environment (SDGE) course [22] at the University of Oulu.…”

Section: A Experiments Planning 1) Goal Definitionmentioning

confidence: 99%

See 1 more Smart Citation

The Effect of Competitor Interaction on Startup’s Product Development

Tripathi

Seppänen

Oivo

et al. 2017

2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA)

View full text Add to dashboard Cite

Context and motivation] Due to lack of resources and teams with low levels of experience, startups face several challenges during their product development, such as product customization, attracting new customers, and mastering the technology uncertainty. To increase their market presence and compensate for their lack of resources, startups need to consider other options such as joint ventures and partnerships.[Question/problem] Some companies that share highly similar resources and businesses can be potential competitors with one another. The effect of interaction with such potential competitors with respect to startups to obtain expertise has not been often reported in the literature to date. [Principal ideas/results] In this study, we simulated two software startups in a controlled experiment to evaluate the effect of interaction with a potential competitor in the effort estimation process. A real startup case was also involved in analyzing the effect. The results of the study show that there is a statistically significant difference in the effectiveness when co-operating with a competitor in the process. Experiment participants also considered the interaction with the potential competitor useful based on the exchange of important information and ideas regarding the product domain.[Contribution] This paper contributes by demonstrating the effect of interaction with a potential competitor in the effort estimation process. In addition, our study encourages further research on startups working in with the competitors in other software engineering knowledge areas.

show abstract

Group versus individual use of power-only EPMcreate as a creativity enhancement technique for requirements elicitation

Mich

Berry

2017

Empir Software Eng

View full text Add to dashboard Cite

Creativity is often needed in requirements elicitation, i.e., generating ideas for requirements, and therefore, techniques to enhance creativity are believed to be useful. [Objective] How does the size of a group using the Power-Only EPMcreate (POEPMcreate) creativity enhancement technique affect the group's and each member of the group's effectiveness in generating requirement ideas? [Method] This paper describes an experiment in which individuals and two-person and four-person groups used POEPMcreate to generate ideas for requirements for enhancing a high school's public Web site.[Results] The data of this experiment combined with the data of two previous experiments involving two-person and four-person groups using POEPMcreate show that, similar to what has been observed for brainstorming, the size of a group using POEPMcreate does affect the number of raw and new requirement ideas generated by the group and by the average member of the group. [Conclusions] The data allow concluding that a two-person group using POEPMcreate generates more raw and new requirement ideas, both per group and per group member or individual, than does a four-person group and than does an individual. This conclusion is partially corroborated by qualitative data gathered from a survey of professional business or requirements analysts about group sizes and creativity enhancement techniques.See the section titled "Compliance with Ethical Standards", just before the references, for a statement about previous publication of parts of this paper's contents.

show abstract

Common Threats and Mitigation Strategies in Requirements Engineering Experiments with Student Participants

Cited by 7 publications

References 33 publications

On the Impact of the Model-Based Representation of Inconsistencies to Manual Reviews

On the Impact of the Model-Based Representation of Inconsistencies to Manual Reviews

The Effect of Competitor Interaction on Startup’s Product Development

Group versus individual use of power-only EPMcreate as a creativity enhancement technique for requirements elicitation

Contact Info

Product

Resources

About