Title
Citizen Engineering: Methods for "Crowdsourcing" Highly Trustworthy Results
Abstract
Citizen Engineering seeks to leverage a large number of ordinary citizens to solve real-world problems. Emerging information technologies provide us with opportunities to answer a long-standing challenge in citizen engineering -- can we effectively extract reliable results from a myriad of crowd inputs of varying quality? To investigate efficient approaches to achieving this "wisdom of crowds", we established a prototype site, where 242 students, acting as surrogate citizen engineers, signed up, logged in, and performed engineering tasks -- tagging photographs of earth-quake damage. Based on the analysis of user online behaviors, we developed an operable data mining algorithm to retrieve highly trustworthy results from thousands of limited size submissions collected from a cohort of contributors. By converging weight assignments and crowd consensus step- by-step, this extraction algorithm improves the quality of the results over time.
Year
DOI
Venue
2012
10.1109/HICSS.2012.151
HICSS
Keywords
Field
DocType
crowd input,engineering task,ordinary citizen,civil engineering computing,information technology,surrogate citizen engineer,real world problems,crowdsourcing,wisdom of crowds,emerging information technology,surrogate citizen engineers,earthquake damage photograph tagging,ordinary citizens,crowd consensus step,user online behavior analysis,operable data mining algorithm,highly trustworthy results,extraction algorithm,data mining,citizen engineering,social networking (online),trustworthy results,information technologies,social sciences computing,varying quality,prototypes,algorithm design,algorithm design and analysis
Data science,World Wide Web,Algorithm design,Computer science,Information technology,Crowdsourcing,Extraction algorithm,Trustworthiness,Wisdom of crowds,Data mining algorithm
Conference
ISSN
ISBN
Citations 
1530-1605 E-ISBN : 978-0-7695-4525-7
978-0-7695-4525-7
4
PageRank 
References 
Authors
0.58
3
5
Name
Order
Citations
PageRank
Zhi Zhai1275.01
David Hachen29612.38
Tracy Kijewski-Correa371.63
Feng Shen440.58
Greg Madey51539.65