Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-efficacy

Dow, Steven P.; Glassco, Alana; Kass, Jonathan; Schwarz, Melissa; Schwartz, Daniel L.; Klemmer, Scott R.

doi:10.1007/978-3-642-21643-5_8

Cited by 68 publications

(83 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…We sought evaluations from people with design knowledge, so we required crowd workers to score 80% or higher on a true/false design knowledge quiz that was previously validated [9]. Thirty-seven crowd workers passed the quiz and participated in the evaluation.…”

Section: Methodsmentioning

confidence: 99%

Structuring, Aggregating, and Evaluating Crowdsourced Design Critique

Luther

Tolentino

et al. 2015

Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work &Amp; Social Computing

Self Cite

126

View full text Add to dashboard Cite

Feedback is an important component of the design process, but gaining access to high-quality critique outside a classroom or firm is challenging. We present CrowdCrit, a webbased system that allows designers to receive design critiques from non-expert crowd workers. We evaluated CrowdCrit in three studies focusing on the designer's experience and benefits of the critiques. In the first study, we compared crowd and expert critiques and found evidence that aggregated crowd critique approaches expert critique. In a second study, we found that designers who got crowd feedback perceived that it improved their design process. The third study showed that designers were enthusiastic about crowd critiques and used them to change their designs. We conclude with implications for the design of crowd feedback services.

show abstract

Section: Methodsmentioning

confidence: 99%

Structuring, Aggregating, and Evaluating Crowdsourced Design Critique

Luther

Tolentino

et al. 2015

Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work &Amp; Social Computing

Self Cite

126

View full text Add to dashboard Cite

show abstract

“…We conducted an extensive literature review in the fields of human computer interaction (HCI) [7,8,9,12,16,19,20,21,22,25,26,27,28,29,30,31,38,47,57,63,64,65,83] and social science [6,14,18,24,32,62,81,87,93] in hopes of finding methodologies that we could apply directly to design study research. Instead, we found an intellectual territory full of quagmires where the very issues we ourselves struggled with were active subjects of nuanced debate.…”

Section: Introductionmentioning

confidence: 99%

Design Study Methodology: Reflections from the Trenches and the Stacks

Sedlmair¹,

Meyer

Munzner³

2012

IEEE Trans. Visual. Comput. Graphics

633

694

View full text Add to dashboard Cite

Abstract-Design studies are an increasingly popular form of problem-driven visualization research, yet there is little guidance available about how to do them effectively. In this paper we reflect on our combined experience of conducting twenty-one design studies, as well as reading and reviewing many more, and on an extensive literature review of other field work methods and methodologies. Based on this foundation we provide definitions, propose a methodological framework, and provide practical guidance for conducting design studies. We define a design study as a project in which visualization researchers analyze a specific real-world problem faced by domain experts, design a visualization system that supports solving this problem, validate the design, and reflect about lessons learned in order to refine visualization design guidelines. We characterize two axes-a task clarity axis from fuzzy to crisp and an information location axis from the domain expert's head to the computer-and use these axes to reason about design study contributions, their suitability, and uniqueness from other approaches. The proposed methodological framework consists of 9 stages: learn, winnow, cast, discover, design, implement, deploy, reflect, and write. For each stage we provide practical guidance and outline potential pitfalls. We also conducted an extensive literature survey of related methodological approaches that involve a significant amount of qualitative field work, and compare design study methodology to that of ethnography, grounded theory, and action research.

show abstract

“…Initial designs were generated via a parallel prototyping process (Dow et al 2010) whereby individual researchers each devised a prototype independently. These prototypes were built as paper sketches before being shared amongst members of the design group.…”

Section: Design Processmentioning

confidence: 99%

Designing an exploratory visual interface to the results of citizen surveys

Slingsby

Dykes

Wood

et al. 2014

International Journal of Geographical Information Science

View full text Add to dashboard Cite

This is the unspecified version of the paper.This version of the publication may differ from the final published version. Surveys are used by public authorities to monitor the quality and reach of public services and provide information needed to help improve them. The results of such surveys tend to be used in internal reports, with highly-aggregated summaries being released to the public. Even where data are released, many citizens do not have the capability to explore and interpret them. This offers limited scope for citizens to explore the results and use them to help hold service providers to account -objectives that are increasingly important in public service provision. We work closely with an English local authority to develop an innovative interactive interface to a citizen survey to demonstrate what can be achieved by applying a visual approach to the exploration of such data. In so doing we (a) make a case for web-based interactive visualisation to make this kind of information accessible both internally to those working in local government and externally to citizens in a way that is not achieved through a regular Open Data release or existing applications; (b) use techniques from both cartography and information visualization to inform the design of fluid visual interactions that enable diverse users -from the casual citizen browser to those interested in more in-depth analysis -to view, compare and interpret the survey outputs from a wide variety of perspectives; and (c) document experiences and reactions to the provision of information in this form, with log analysis playing a role in this exercise. Our reflections on our successes and otherwise will inform future exploratory interface design to help citizens access information and hold public service providers to account. Permanent repository link

show abstract

Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-efficacy

Cited by 68 publications

References 36 publications

Structuring, Aggregating, and Evaluating Crowdsourced Design Critique

Structuring, Aggregating, and Evaluating Crowdsourced Design Critique

Design Study Methodology: Reflections from the Trenches and the Stacks

Designing an exploratory visual interface to the results of citizen surveys

Contact Info

Product

Resources

About