{"id":7371,"date":"2018-03-26T01:09:39","date_gmt":"2018-03-26T05:09:39","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/when-the-mechanical-turk-starts-breaking-down\/"},"modified":"2018-03-26T01:09:39","modified_gmt":"2018-03-26T05:09:39","slug":"is-amazons-mechanical-turk-breaking-down","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/","title":{"rendered":"Is Amazon\u2019s Mechanical Turk breaking down?"},"content":{"rendered":"

\u201cMechanical Turk\u201d is a term first used in the 18th<\/sup> century to describe a device that appeared to automate chess-playing. Players believed they were playing against an automated machine, but they were actually competing against a human hidden inside of the device (see illustration below).<\/p>\n

\"\"<\/p>\n

The name has since been applied to Amazon\u2019s platform to offer \u201cartificial artificial intelligence.\u201d Created in 2005, Mechnical Turk, or \u201cMTurk,\u201d connects organizations with individuals (\u201cTurkers\u201d) to perform Human Intelligence Tasks (\u201cHIT\u201d), microtasks that are challenging for computers, but simple for people. For example, a human would have no issue picking an item out of a photo, but it would be very difficult for a computer. Since its inception 12 years ago, MTurk workers are responsible for the foundations of algorithms all around us, leveraged by familiar companies like YouTube and Google, but it has largely stayed under the radar.<\/p>\n

As of 2015, it was estimated that MTurk had about 500,000 registered Turkers globally, though it\u2019s unclear how many of those are active. Another report estimates that 500,000 tasks are available daily. As noted, companies often leverage MTurk to train their code, yet most of the tasks are repetitive and mind-numbing. Turkers may be asked to make various faces into their webcam to help an algorithm identify facial expressions. Another HIT may ask Turkers to identify dozens of materials or textures in a photo (e.g. metal, hair, water, wax). Payment terms are dictated by the party requesting the HIT, typically ranging from $0-60 per task. They are also obligated to pay 10% commission to Amazon. A research study showed that 61% of tasks offer payment of 10 cents or less. Turkers are rated based on their completed tasks and can achieve higher status, which in turn gives them access to better tasks.<\/p>\n

\"\"<\/p>\n

Reviews, identification of \u201csuper\u201d workers, commission structure \u2013 MTurk doesn\u2019t sound any different from the other marketplaces in the gig economy. So what went wrong? In December 2014, timed around Christmas and posed as Christmas letters sent directly to Jeff Bezos, Turkers organized a public campaign to demand better pay and representation. HIT requesters can pay $0 for a task with no consequence. Turkers wanted Amazon to better educate requesters and the world that they are not all unskilled workers, and thus shouldn\u2019t be paid or represented as such. Some also demanded the ability to review company requesters after completing tasks. Many others complained that they never received payment from Amazon, which was often supposedly lost during transit, but instead received the offer for Amazon credits. Amazon quickly cut off the movement by shutting down the account used by the campaign to verify Turkers. Since then, Turkers have reportedly been leaving MTurk in search of marketplaces that offer fairer pay and terms, though the magnitude is unclear due to lack of reporting on MTurk\u2019s size.\"\"<\/p>\n

\"\"<\/p>\n

Though Amazon\u2019s MTurk continues to exist and has not yet failed, it\u2019s clear that Turkers are becoming more aware of their collective power. Once isolated from one another and hidden behind MTurk\u2019s platform, Turkers are creating forums to build networks among themselves. Amazon could have avoided the Christmas campaign and negative publicity by setting terms that gave Turkers some leverage on the platform. For example, they should have an opportunity to review companies back. One common issue on MTurk is that task descriptions may be imprecise, so they take much longer or are more complex than expected. If this happens, Turkers have no way of offering feedback to the platform. Amazon should be incentivized to improve this precision because it will lead to greater satisfaction across both parties, requesters and Turkers. They could also ban tasks with $0 compensation, even setting a floor as low as $0.10 would help Turkers to feel relatively more protected.<\/p>\n

Alternatives are appearing that favor the workers. For example, a director competitor called Daemo has been created, that offers workers $10 per hour and increased transparency. It is gaining momentum, though it will be interesting to see if they can attract companies used to Amazon\u2019s low rates and flexibility.<\/p>\n

 <\/p>\n

Sources:<\/p>\n

Harris, Mark. \u201cAmazon’s Mechanical Turk workers protest: ‘I am a human being, not an algorithm.\u2019\u201d The Guardian<\/em>, Technology, 3 Dec. 2014. https:\/\/www.theguardian.com\/technology\/2014\/dec\/03\/amazon-mechanical-turk-workers-protest-jeff-bezos.<\/p>\n

Hitlin, Paul. \u201cResearch in the Crowdsourcing Age, a Case Study.\u201d Pew Research Center<\/em>, Internet & Technology, 11 Jul. 2016. http:\/\/www.pewinternet.org\/2016\/07\/11\/what-is-mechanical-turk\/.<\/p>\n

Katz, Miranda. \u201cAmazon\u2019s Turker Crowd Has Had Enough.\u201d Wired<\/em>, 23 Aug. 2017, https:\/\/www.wired.com\/story\/amazons-turker-crowd-has-had-enough\/.<\/p>\n

Limer, Eric. \u201cMy Brief and Curious Life as a Mechanical Turk.\u201d Gizmodo<\/em>, 28 Oct. 2014. https:\/\/gizmodo.com\/my-brief-and-curious-life-as-a-mechanical-turk-1587864671.<\/p>\n

Matsakis, Louise. \u201cA Window Into How YouTube Trains AI to Moderate Videos.\u201d Wired<\/em>, 22 Mar. 2018. https:\/\/www.wired.com\/story\/youtube-mechanical-turk-content-moderation-ai\/.<\/p>\n

We Are Dynamo. http:\/\/www.wearedynamo.org\/dearjeffbezos.<\/p>\n","protected":false},"excerpt":{"rendered":"

Workers are disgruntled in Amazon’s MTurk marketplace, but can they successfully demand more rights?<\/p>\n","protected":false},"author":2411,"featured_media":7374,"comment_status":"open","ping_status":"closed","template":"","categories":[156,1063,382],"class_list":["post-7371","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-amazon","category-gig-economy","category-two-sided-marketplace","hck-taxonomy-organization-amazon","hck-taxonomy-industry-service","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/competing-with-or-against-crowds\/","yoast_head":"\nIs Amazon\u2019s Mechanical Turk breaking down? - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Is Amazon\u2019s Mechanical Turk breaking down? - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"Workers are disgruntled in Amazon's MTurk marketplace, but can they successfully demand more rights?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2018\/03\/mturk2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"367\" \/>\n\t<meta property=\"og:image:height\" content=\"137\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/\",\"name\":\"Is Amazon\u2019s Mechanical Turk breaking down? - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2018\\\/03\\\/mturk2.png\",\"datePublished\":\"2018-03-26T05:09:39+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2018\\\/03\\\/mturk2.png\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2018\\\/03\\\/mturk2.png\",\"width\":367,\"height\":137},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/is-amazons-mechanical-turk-breaking-down\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Is Amazon\u2019s Mechanical Turk breaking down?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Is Amazon\u2019s Mechanical Turk breaking down? - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/","og_locale":"en_US","og_type":"article","og_title":"Is Amazon\u2019s Mechanical Turk breaking down? - Digital Innovation and Transformation","og_description":"Workers are disgruntled in Amazon's MTurk marketplace, but can they successfully demand more rights?","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/","og_site_name":"Digital Innovation and Transformation","og_image":[{"width":367,"height":137,"url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2018\/03\/mturk2.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/","name":"Is Amazon\u2019s Mechanical Turk breaking down? - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2018\/03\/mturk2.png","datePublished":"2018-03-26T05:09:39+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2018\/03\/mturk2.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2018\/03\/mturk2.png","width":367,"height":137},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/is-amazons-mechanical-turk-breaking-down\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"Is Amazon\u2019s Mechanical Turk breaking down?"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/7371","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/2411"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=7371"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/7371\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media\/7374"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=7371"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=7371"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}