Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite exercising unchanged code. In this work, we examine the perceptions of software developers about the nature, relevance, and challenges of flaky tests.We asked 21 professional developers to classify 200 flaky tests they previously fixed, in terms of the nature and the origin of the flakiness, as well as of the fixing effort. We also examined developers' fixing strategies. Subsequently, we conducted an online survey with 121 developers with a median industrial programming experience of five years. Our research shows that: The flakiness is due to several different causes, four of which have never been reported before, despite being the most costly to fix; flakiness is perceived as significant by the vast majority of developers, regardless of their team's size and project's domain, and it can have effects on resource allocation, scheduling, and the perceived reliability of the test suite; and the challenges developers report to face regard mostly the reproduction of the flaky behavior and the identification of the cause for the flakiness. Data and materials [https://doi.org/10.5281/zenodo.3265785].
CCS CONCEPTS• Software and its engineering → Software testing and debugging.
Desires to increase in extraversion and conscientiousness as well as to decrease in neuroticism are the three most prevalent personality change goals. This study describes characteristics of people who wanted to change one of these personality traits (total N = 1,196) with the help of a digital personality change intervention. The extent to which characteristics predicted the selection of one change goal over the other two was explored using machine learning. Individuals desired to change traits with lower (in case of desires to increase) or higher (in case of desires to decrease) self-and observer-reports and with greater self-other discrepancies. This identification of characteristics of people who desired to change certain personality traits informs future interventions.
Desires to increase in extraversion and conscientiousness as well as to decrease in neuroticism are the three most prevalent personality change goals. This study describes characteristics of people who wanted to change one of these personality traits (total N = 1,196) with the help of a digital personality change intervention. The extent to which characteristics predicted the selection of one change goal over the other two was explored using machine learning. Individuals desired to change traits with lower (in case of desires to increase) or higher (in case of desires to decrease) self- and observer-reports and with greater self-other discrepancies. This identification of characteristics of people who desired to change certain personality traits informs future interventions.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.