Notifying and Involving Users in Experimentation: Ethical Perceptions of Software Practitioners

Yaman, Sezin Gizem; Fagerholm, Fabian; Munezero, Myriam; Mäenpää, Hanna; Männistö, Tomi

doi:10.1109/esem.2017.31

Cited by 5 publications

(3 citation statements)

References 19 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Yaman et al [Yaman et al 2017] explore the importance of understanding ethical considerations associated with experimentation as a company development strategy. Specifically, they focus on the need to notify users when they engage in an experiment.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Ethical Issues in Continuous Experimentation

Lopes,

França

2023

Anais Estendidos Do XXII Simpósio Brasileiro De Qualidade De Software (SBQS Estendido 2023)

View full text Add to dashboard Cite

Continuous experimentation (CE) is a software practice used in organizations to verify the feasibility of a product and its features. It provides procedures to verify the effect of a change by comparing different variants of a product or its features with the original version. Usually, it works as a series of online experiments with final users as participants, i.e., people with rights and duties, which experimenters need to take care of. This research aims to provide a process for addressing ethical issues in CE to support experts in designing experiments while providing ethically acceptable decisions. This paper brings reflection on ethical issues in the existing related literature and discusses them in the context of CE. Link: https://youtu.be/t53y3DdcJ3M

show abstract

Section: Related Workmentioning

confidence: 99%

“…Usually, it works as experiments under the application infrastructure with final users as participants, who have rights and duties. Organizations use experiments for many reasons, such as to increase product value to their users, understand user behavior, increase customer numbers, and improve their content [Yaman et al 2017].…”

Section: Introductionmentioning

confidence: 99%

Ethical Issues in Continuous Experimentation

Lopes,

França

2023

Anais Estendidos Do XXII Simpósio Brasileiro De Qualidade De Software (SBQS Estendido 2023)

View full text Add to dashboard Cite

show abstract

“…Whenever user data is involved there is a potential for ethical dilemmas. When Yaman et al [129] surveyed software engineering practitioners, the only question they agreed on was that users should be notified if personal information is collected. Since GDPR went into effect in 2018 this is now a requirement.…”

Section: Ethical Challengesmentioning

confidence: 99%

Controlled Experimentation in Continuous Experimentation: Knowledge and Challenges

Auer¹,

Ros²,

Kaltenbrunner³

et al. 2021

Preprint

View full text Add to dashboard Cite

Context: Continuous experimentation and A/B testing is an established industry practice that has been researched for more than 10 years. Our aim is to synthesize the conducted research.Objective: We wanted to find the core constituents of a framework for continuous experimentation and the solutions that are applied within the field. Finally, we were interested in the challenges and benefits reported of continuous experimentation.Method: We applied forward snowballing on a known set of papers and identified a total of 128 relevant papers. Based on this set of papers we performed two qualitative narrative syntheses and a thematic synthesis to answer the research questions.Results: The framework constituents for continuous experimentation include experimentation processes as well as supportive technical and organizational infrastructure. The solutions found in the literature were synthesized to nine themes, e.g. experiment design, automated experiments, or metric specification. Concerning the challenges of continuous experimentation, the analysis identified cultural, organizational, business, technical, statistical, ethical, and domain-specific challenges. Further, the study concludes that the benefits of experimentation are mostly implicit in the studies.Conclusions: The research on continuous experimentation has yielded a large body of knowledge on experimentation. The synthesis of published research presented within include recommended infrastructure and experimentation process models, guidelines to mitigate the identified challenges, and what problems the various published solutions solve.

show abstract