The art test of interaction: a robust and powerful rank test of interaction in factorial models

Salter, K. C.; Fawcett, Richard

doi:10.1080/03610919308813085

Cited by 89 publications

(57 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Then, a repeated measures ANOVA is performed on the aligned ranks. Readers interested in the nonparametric factorial ART procedure are directed to prior work [15,16,27,28].…”

Section: Analysis Of Datamentioning

confidence: 99%

“…One approach would be to use a rank transform (RT) method [13], but prior statistical research [15] has shown this to be unreliable for interaction effects (i.e., for exploring VFR*VSR). Therefore, we used the aligned rank transform (ART) [16] procedure, which preserves interaction effects by first aligning the data [28] before ranking it. Then, a repeated measures ANOVA is performed on the aligned ranks.…”

Section: Analysis Of Datamentioning

confidence: 99%

See 1 more Smart Citation

A web-based user survey for evaluating power saving strategies for deaf users of mobileASL

Tran

Johnson

Kim

et al. 2010

Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility

View full text Add to dashboard Cite

MobileASL is a video compression project for two-way, real-time video communication on cell phones, allowing Deaf people to communicate in the language most accessible to them, American Sign Language. Unfortunately, running MobileASL quickly depletes a full battery charge in a few hours. Previous work on MobileASL investigated a method called variable frame rate (VFR) to increase the battery duration. We expand on this previous work by creating two new power saving algorithms, variable spatial resolution (VSR), and the application of both VFR and VSR. These algorithms extend the battery life by altering the temporal and/or spatial resolutions of video transmitted on MobileASL. We found that implementing only VFR extended the battery life from 284 minutes to 307 minutes; implementing only VSR extended the battery lif e to 306 minutes, and implementing both VFR and VSR extended the battery life to 315 minutes. We evaluated all three algorithms by creating a linguistically accessible online survey to investigate Deaf people's perceptions of video quality when these algorithms were applied. In our survey results, we found that VFR produces perceived video choppiness and VSR produces perceived video blurriness; however, a surprising finding was that when both VFR and VSR are used together, they largely ameliorate the choppiness and blurriness perceived, i.e., they each improve the use of the other. This is a useful finding because using VFR and VSR together saves the most battery life.

show abstract

“…Then, a repeated measures ANOVA is performed on the aligned ranks. Readers interested in the nonparametric factorial ART procedure are directed to prior work [15,16,27,28].…”

Section: Analysis Of Datamentioning

confidence: 99%

Section: Analysis Of Datamentioning

confidence: 99%

A web-based user survey for evaluating power saving strategies for deaf users of mobileASL

Tran

Johnson

Kim

et al. 2010

Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility

View full text Add to dashboard Cite

show abstract

“…The Aligned Rank Transform (ART) [2,10] corrects this problem, providing accurate nonparametric treatment for both main and interaction effects [4,5,11]. It relies on a preprocessing step that first "aligns" the data for each effect (main or interaction) before assigning ranks, averaged in the case of ties.…”

Section: Introductionmentioning

confidence: 99%

“…Conover and Iman's [1] Rank Transform (RT) applies ranks, averaged in the case of ties, over a data set, and then uses the parametric F-test on the ranks, resulting in a nonparametric factorial procedure. However, it was subsequently discovered that this process produces inaccurate results for interaction effects [5,11], making the RT method unsuitable for factorial designs.…”

Section: Introductionmentioning

confidence: 99%

The aligned rank transform for nonparametric factorial analyses using only anova procedures

Wobbrock

Findlater

Gergle

et al. 2011

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

1,571

836

View full text Add to dashboard Cite

Nonparametric data from multi-factor experiments arise often in human-computer interaction (HCI). Examples may include error counts, Likert responses, and preference tallies. But because multiple factors are involved, common nonparametric tests (e.g., Friedman) are inadequate, as they are unable to examine interaction effects. While some statistical techniques exist to handle such data, these techniques are not widely available and are complex. To address these concerns, we present the Aligned Rank Transform (ART) for nonparametric factorial data analysis in HCI. The ART relies on a preprocessing step that "aligns" data before applying averaged ranks, after which point common ANOVA procedures can be used, making the ART accessible to anyone familiar with the F-test. Unlike most articles on the ART, which only address two factors, we generalize the ART to N factors. We also provide ARTool and ARTweb, desktop and Web-based programs for aligning and ranking data. Our re-examination of some published HCI results exhibits advantages of the ART.

show abstract

“…As the normal theory F-tests are used for testing these rank statistics, the question arises if their asymptotic distribution is the same. Salter & Fawcett (1993) showed that at least for the ART these tests are valid.…”

Section: Introductionmentioning

confidence: 99%

The aligned rank transform and discrete variables: A warning

Luepsen

2017

Communications in Statistics - Simulation and Computation

View full text Add to dashboard Cite

For two-way layouts in a between subjects anova design the aligned rank transform (ART) is compared with the parametric F-test as well as six other nonparametric methods: rank transform (RT), inverse normal transform (INT), a combination of ART and INT, Puri & Sen's L statistic, van der Waerden and Akritas & Brunners ATS. The type I error rates are computed for the uniform and the exponential distributions, both as continuous and in several variations as discrete distribution. The computations had been performed for balanced and unbalanced designs as well as for several effect models. The aim of this study is to analyze the impact of discrete distributions on the error rate. And it is shown that this scaling impact is restricted to the ARTas well as the combination of ART-and INT-method. There are two effects: first with increasing cell counts their error rates rise beyond any acceptable limit up to 20 percent and more. And secondly their rates rise when the number of distinct values of the dependent variable decreases. This behaviour is more severe for underlying exponential distributions than for uniform distributions. Therefore there is a recommendation not to apply the ART if the mean cell frequencies exceed 10.

show abstract

The art test of interaction: a robust and powerful rank test of interaction in factorial models

Cited by 89 publications

References 14 publications

A web-based user survey for evaluating power saving strategies for deaf users of mobileASL

A web-based user survey for evaluating power saving strategies for deaf users of mobileASL

The aligned rank transform for nonparametric factorial analyses using only anova procedures

The aligned rank transform and discrete variables: A warning

Contact Info

Product

Resources

About