Title
Soylent: a word processor with a crowd inside
Abstract
This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, complex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with pragmatics, but for higher-level help, writers commonly turn to other people. We thus present Soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd programming pattern, which splits tasks into a series of generation and review stages. Evaluation studies demonstrate the feasibility of crowdsourced editing and investigate questions of reliability, cost, wait time, and work time for edits.
Year
DOI
Venue
2010
10.1145/2791285
user interface software and technology
Keywords
Field
DocType
find-fix-verify crowd programming pattern,crowdsourced human contribution,word processor,evaluation study,mechanical turk worker,higher-level help,crowdsourced editing,authoring tools offer help,complex endeavor,interaction pattern,work time
Pragmatics,Programming language,On demand,Computer science,User interface,Multimedia,Word processing
Conference
Volume
Issue
ISSN
58
8
0001-0782
Citations 
PageRank 
References 
353
20.09
24
Authors
8
Search Limit
100353
Name
Order
Citations
PageRank
Michael S. Bernstein18604393.80
Greg Little2142096.33
Robert C. Miller34412326.00
Bjorn-Oliver Hartmann43151177.43
Mark S. Ackerman54393498.35
David R. Karger6193672233.64
David Crowell735320.09
Katrina Panovich885343.34