CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks into Everyday Internet Surfing

Haug, Saskia; Benke, Ivo; Fischer, Daniel; Maedche, Alexander

doi:10.1145/3544548.3580994

Cited by 1 publication

(3 citation statements)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In research, various studies on crowd-feedback systems exist. A big advantage compared to simple surveys as they can be created with tools like LimeSurvey or Google Forms is that crowd-feedback systems usually enable the feedback collection while the feedback provider is actually using the system (e.g., [9,30]. Crowd-feedback systems can also apply dedicated features that are not available in online survey tools like markers to pin comments to a specific element [10].…”

Section: Crowd-feedback Systemsmentioning

confidence: 99%

“…While feedback collection mechanisms (questionnaire, free text field, categories, selection, and direct manipulation) conceptualize all features to collect feedback, the interactivity cues (collaboration, markers, context, and recording) describe additional features that help feedback providers to improve their feedback quality or enrich their feedback [11]. While researchers have demonstrated that crowdsourcing high-quality feedback is feasible with dedicated crowd-feedback systems, there are still discussions about definitions and measures for design feedback quality [9]. Also, feedback might be less honest when people are paid for providing feedback [9].…”

Section: Crowd-feedback Systemsmentioning

confidence: 99%

“…While researchers have demonstrated that crowdsourcing high-quality feedback is feasible with dedicated crowd-feedback systems, there are still discussions about definitions and measures for design feedback quality [9]. Also, feedback might be less honest when people are paid for providing feedback [9]. Most of the existing crowd-feedback systems have focused on evaluating static designs like posters.…”

Section: Crowd-feedback Systemsmentioning

confidence: 99%

See 2 more Smart Citations

Scalable Design Evaluation for Everyone! Designing Configuration Systems for Crowd-Feedback Request Generation

Haug,

Sommerrock,

Benke

et al. 2023

Mensch Und Computer 2023

Self Cite

View full text Add to dashboard Cite

Design evaluation is an important step during software development to ensure users' requirements are met. Crowd feedback represents an effective approach to tackling scalability issues of traditional design evaluation methods. Crowd-feedback systems are usually developed for a fixed use case and designers lack knowledge on how to build individual crowd-feedback systems by themselves. Consequently, they are rarely applied in practice. To address this challenge, we propose the design of a configuration system to support designers in creating individual crowd-feedback requests. By conducting expert interviews (N=14) and an exploratory literature review, we derive four design rationales for such configuration systems and propose a prototypical configuration system instantiation. We evaluate this instantiation in exploratory focus groups (N=10). The results show that feedback requesters appreciate guidance. However, there seems to be a trade-off between complexity and flexibility. With our research, we contribute with a generalizable concept to support feedback requesters to create individualized crowd-feedback requests to support scalable design evaluation for everyone. CCS CONCEPTS• Human-centered computing → HCI design and evaluation methods.

show abstract

Section: Crowd-feedback Systemsmentioning

confidence: 99%

Section: Crowd-feedback Systemsmentioning

confidence: 99%