Online Crowd Behavior and Production[go to overview]
The course discusses theories, methods and algorithms used to understand and shape online crowd behavior and the production of digital goods and services by crowds. Examples come from collaborative authoring systems, social media, online social networks and health applications. The goal of this course is to enable students to competently analyze and understand crowd behavior and –production in online environments.
Students taking this course will be able to:
Understand online crowd behavior and –production research and the literature it generates
Analyze online crowd behavior and –production in specific application domains, with a focus on social media and health related applications.
Discuss selected instruments and methods to shape online crowd behavior and –production
Know how to evaluate crowd-based production systems
Understand relationships between online crowd behavior and the artifacts it generates
Appreciate the social-computational complexity of online crowd behavior and –production
Preliminary Week by Week Outline
Week 1: Motivation and introduction
A general introduction and motivation of the topics of this seminar will take place.
In Week 1, students will pick the topics (from subseqent weeks) that they will present, discuss and research on during the course of the seminar.
We will discuss Examples: http://en.wikipedia.org/wiki/Medpedia
The Social Determinants of Health, WHO report
BREAK: A couple of weeks break for students to work on their topics.
Week 2: Encouraging contributions from online crowds
We will discuss how contributions from online crowds can be encouraged and shaped.
A. Cabrera, E.F. Cabrera. Knowledge-sharing Dilemmas. Organization Studies 23 (5) (2002) 687–710.
Kraut, R. E. & Resnick, P. Chapter 2: Encouraging contributions to online communities, In Kraut, R. E. & Resnick, P. (Under contract). Building Successful Online Communities: Evidence-based social design. Cambridge, MA: MIT Press.
Week 3: Online crowd formation and consensus engineering
In this week, we will discuss the ways in which crowds form and how consensus emerges.
Q. Lu, G. Korniss, and B.K. Szymanski, The Naming Game on Social Networks: Community Formation and Consensus Engineering, Journal of Economic Interaction and Coordination, vol. 4(2), 2009
Week 4: Models of influence
In this week, we will discuss different models of influence in online crowds, and the reflection problem.
David Easley and Jon Kleinberg, Chapter 16. Information Cascades, In Networks, Crowds, and Markets: Reasoning About a Highly Connected World, Cambridge University Press (2010)
David Easley and Jon Kleinberg, Chapter 19. Cascading Behavior in Networks, In Networks, Crowds, and Markets: Reasoning About a Highly Connected World, Cambridge University Press (2010)
Charles F Manski, Identification of Endogenous Social Effects: The Reflection Problem, The Review of Economic Studies, Volume: 60, Issue: 3, (1993) Pages: 531-542
Week 5: Conflict and coordination
In this week, we will discuss mechanisms of conflict and coordination in collaborative authoring systems such as wikis.
A. Kittur, R.E. Kraut, Beyond Wikipedia: Conflict and coordination in online production groups. CSCW 2010: Proceedings of the ACM Conference on Computer-Supported Cooperative Work. New York: ACM Press (2010)
Aniket Kittur, Bongwon Suh, Bryan A Pendleton, Ed H Chi, He Says, She Says: Conflict and Coordination in Wikipedia, Proceedings of the SIGCHI conference on Human factors in computing systems CHI 07 (2007)
Week 6: Identifying expertise & experts
The identification of experts and expertise in online crowds will be discussed in this week.
M. G. Noll, C.-M. Au Yeung, N. Gibbins, C. Meinel, N. Shadbolt, Telling Experts from Spammers: Expertise Ranking in Folksonomies, Proceedings of 32nd ACM SIGIR Conference, Boston, USA, July 2009, pp. 612-619
E. Smirnova and K. Balog. A User-oriented Model for Expert Finding, In: 33rd European Conference on Information Retrieval (ECIR 2011), LNCS 6611, pages 580-592, April 2011.
Week 7: Voting mechanisms and manipulation
In this week we will discuss mechanisms of manipulation of crowds, and how to tackle them.
Vahed Qazvinian, Emily Rosengren, Dragomir R. Radev, and Qiaozhu Mei, Rumor has it: Identifying Misinformation in Microblogs, Empirical Methods on Natural Language Processing (EMNLP 2011).
Nguyen Tran, Bonan Min, Jinyang Li, Lakshminarayanan Subramanian, Sybil-Resilient Online Content Voting, In Proceedings of the 6th USENIX Symposium on Networked Systems Design and Implementation (NSDI), Boston, April 2009.
Week 8: Crowdsourcing and microwork
In this week, we will discuss microworking platforms such as Mechanical Turk.
G. Paolacci, G. Chandler and P.G. Ipeirotis. Running Experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5, (2010) 411-419.
Week 9:Analyzing epidemics in crowd-generated data
In this week, we will discuss epidemic models and how crowd-generated data can be utilized for identifying epidemics.
David Easley and Jon Kleinberg, Chapter 21. Epidemics, In Networks, Crowds, and Markets: Reasoning About a Highly Connected World, Cambridge University Press (2010)
Jeremy Ginsberg, Matthew H. Mohebbi, Rajan S. Patel, Lynnette Brammer, Mark S. Smolinski & Larry Brilliant, Detecting influenza epidemics using search engine query data, Nature 457, 1012-1014(19 February 2009)
Philip Munz, Ioan Hudea, Joe Imad and Robert J, Smith, When Zombies Attack!: Mathematical Modelling of an Outbreak of Zombie Infection, In “Infectious Disease Modelling Research Progress,” eds. J.M. Tchuenche and C. Chiyaka, Nova Science Publishers, Inc. pp. 133-150, 2009.
Week 10: Crowd Production of Medical Knowledge
In this week, we will discuss an ongoing effort to crowdsource a large medical taxonomy.
T. Tudorache, S. Falconer, N.F. Noy, C. Nyulas, T.B. Ustun, M.-A. Storey, M.A. Musen, Ontology Development for the Masses: Creating ICD-11 in WebProtege, In EKAW 2010 - Knowledge Engineering and Knowledge Management by the Masses, Lisbon, Portugal, 2010.
Sean M. Falconer, Tania Tudorache, Natalya Fridman Noy: An analysis of collaborative patterns in large-scale ontology development projects. K-CAP 2011: 25-32
A presentation and leading a corresponding discussion on a selected topic (during the seminar)
A paper, 6 pages ACM Style (at the end of the seminar)
- Kraut, R. E. & Resnick, P. (2012). Building successful online communities: Evidence-based social design. Cambridge, MA: MIT Press.
Available online at: http://kraut.hciresearch.org/content/books