Tutorial 6. Amazon Mechanical Turk

Tutorial Overview

Graphic of three people's heads in different colors. Amazon Mechanical Turk (MTurk) is an online crowdsourcing platform that enables researchers to conduct large-scale experiments on the Internet. Many experiments described in this course were conducted on MTurk. (Image ® Amazon.com. All rights reserved. This content is excluded from our Creative Commons license. For more information, see http://ocw.mit.edu/help/faq-fair-use/)

How can Amazon Mechanical Turk (MTurk) enable you to conduct large-scale experiments on how people perform simple tasks involving perception, learning, or decision making? Or enable you to create a large database of labeled images or videos? In this introduction to MTurk, you will learn about the kinds of tasks for which MTurk is well suited, how to get started on setting up an experiment, the advantages and concerns of conducting experiments on MTurk, some tips for using this tool effectively, and additional resources for learning more about MTurk.

Unit Activities

Useful Background

  • No background is needed for this tutorial.

Videos and Slides

Further Study

Gureckis, T. M., J. Martin, et al. “psiTurk: An Open-Source Framework for Conducting Replicable Behavioral Experiments Online.” Behavioral Research Methods 48, no. 3 (2015): 829–42.

Litman, L., J. Robinson, and T. Abberbock. “TurkPrime.com: A Versatile Crowdsourcing Data Acquisition Platform for the Behavioral Sciences.” Behavioral Research Methods (2016): 1–10.

Also see other online forums for the use of Amazon Mechanical Turk, including Turker Nation, Mturkgrind, and additional tools such as Turkopticon.

Course Info

Learning Resource Types

theaters Other Video
theaters Lecture Videos
notes Lecture Notes
group_work Projects
co_present Instructor Insights