{"id":1689,"date":"2015-10-29T20:54:50","date_gmt":"2015-10-30T00:54:50","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/duolingo-crowdsourcing-text-translation-to-support-free-language-learning\/"},"modified":"2015-10-31T15:28:32","modified_gmt":"2015-10-31T19:28:32","slug":"lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/","title":{"rendered":"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing"},"content":{"rendered":"<p>Duolingo has become the most popular way to learn languages online. With over 100 million users, it is a free technology driven language education platform that includes a website, app, a crowdsourced text translation platform, and a language proficiency assessment center.<\/p>\n<p>A 2013 Forbes article describes the company\u00a0succinctly: \u201cDuolingo famously marries two objectives: the app uses Rosetta stone-style interfaces and quizzes to teach users a new language, for free. As part of the learning process, many users will translate English-language articles into their native tongues and for that, Duolingo makes money\u201d (1).<\/p>\n<p><iframe loading=\"lazy\" title=\"Duolingo - Inside Luis Von Ahn&#039;s Creative Language Learning App\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/aNIwduQSdOc?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>Indeed, from the beginning, Duolingo\u2019s founder Luis von Ahn (founder of reCAPTCHA a very clever crowdsourcing trick unto itself) has been committed to providing free language education to the world. Unlike the non-profit Khan Academy, and despite receiving significant VC support from the beginning, von Ahn planned to fund the platform\u2019s free education by building a sustainable business (2). And he believed that that model would come in the form of students translating real-world documents as a way to practice foreign language skills. Duolingo could then sell those translations. The business model is based on a mutually beneficial arrangement wherein students receive high-quality free language education and businesses receive translation services powered by the students.<\/p>\n<p>Duolingo found early traction with their business model. The 2013 announcement of partnerships with CNN and Buzzfeed, two highly regarded news organizations, seemed to legitimize von Ahn\u2019s vision of creating a sustainable business model through crowdsourcing (2). According to Forbes, Duolingo charged CNN and Buzzfeed for each word translated through its platform (1).<\/p>\n<p>As with any crowdsourcing model, scale is essential to Duolingo. With more active students, Duolingo is better able to deliver high-quality translations in volume within hours. Duolingo uses an algorithm to combine the multiple efforts of students translating each phrase to produce a crowdsourced translation as accurate as those of a professional translator. Each article is translated by 30 to 40 people (1). For example, as part of a\u00a0Duolingo lesson, students can read and translate trending Buzzfeed articles. Once nearly 50 students have translated the article, Duolingo combines their work into one synthesized translation and provides it to Buzzfeed for a fee.<\/p>\n<p>At first glance, the platform seemed well positioned to exploit the fundamental benefits of crowdsourcing: It appears to match the cheap supply of a crowd with demand that might otherwise turn to more centralized and expensive options. By taking a closer look, however, and with the benefit of time, it\u2019s clear Duolingo\u2019s approach to crowdfunding was challenged by some important issues. These challenges are instructive to a broader crowdsourcing analysis.<\/p>\n<ol>\n<li><strong>Quality control:<\/strong> Translation requires quality control. Someone has to check the quality and accuracy of each translated article before it appears, for example, on CNN. The question then is should the quality checker be on the Duolingo side or the publisher\u2019s side? As a publisher, I\u2019d be concerned about the quality of Duolingo\u2019s output and would be inclined to have someone check it. This in turn diminishes the value of the service that Duolingo provides.\u00a0The question is whether crowdsourcing tools can deliver at a high enough quality. Duolingo attacked this by synthesizing the translations of many people. This is a central challenge to crowdsourcing.<\/li>\n<\/ol>\n<ol start=\"2\">\n<li><strong>Timeliness:<\/strong> When publishing the news, there is a need to match supply and demand in a timely manner. News publishers in particular work on tight timelines to publish breaking news. What if there are not enough users translating an article to ensure a high-quality and timely translation?\u00a0The crowd is extremely powerful, but it can also be unwieldy and difficult to organize. Where the output of a crowd needs to be generated quickly, it steepens the challenge of corralling the crowd\u2019s intelligence. In contrast, the content of other successful crowdsourcing platforms like Yelp and Wikipedia is more &#8220;evergreen&#8221; and therefore can constantly be revised and updated by other users. The evergreen nature of this content is better suited than a breaking news story for crowdsourcing because many new stories lose relevance and value within a short time of being published.<\/li>\n<\/ol>\n<ol start=\"3\">\n<li><strong>Incentivization and transparency:<\/strong> Finally, in terms of incentives, Duolingo\u2019s model lacks certain incentives that can motivate &#8220;workers&#8221;. Users studying a new language are apt to have very different levels of engagement in terms of quantity and quality. Is the desire to learn a language motivating enough to ensure high quality and consistent participation? Moreover, Duolingo did not exploit a rating system for top translators nor did it share fees with with translators. The company\u2019s system is generally opaque. This leaves users unaware of how their translations are being used.\u00a0To fully motivate a crowd, quality incentives and transparency around compensation structures \u2013 however defined \u2013 is crucial.<\/li>\n<\/ol>\n<p>As a result, I\u2019d argue that Duolingo has not fully exploited its crowdsourcing opportunity. If we compare Duolingo to other successful crowdsourcing platforms like Yelp and Wikipedia, the fundamental difference seems to be around timing and alignment of interests. Yelp and Wikipedia users are motivated to review a place or share knowledge about a topic that interests them. In contrast, Duolingo\u2019s partnership with breaking news organizations requires instant translations of content that might not be well suited with what type of vocabulary a student is learning at any given time.<\/p>\n<p>In June 2015, Duolingo raised an additional $45 million investment round led by Google Capital. Previous investor such as Union Square Ventures, NEA, Kleiner Perkins Caufield &amp; Byers, Ashton Kutcher and Tim Ferris also participated in the round. Duolingo\u2019s total funding to date is\u00a0$83.3 million, and the company says its valuation is now around $470 million (4).<\/p>\n<p>But what is next for Duolingo? Since the 2013 announcement, it does not appear that the firm has signed up any big name publishers and there is a scarce amount of data about the success of the Buzzfeed and CNN partnership. These publisher partnerships were not mentioned in the last press release for the recent round of fundraising. Instead, Duolingo seems to be more focused on the certification opportunity to monetize. This past September, Duolingo and Uber announced a new partnership called UberEnglish Program, which uses the Duolingo Test Center English Certificate to verify the English skills of Uber drivers without interviewing drivers individually. The Duolingo Certificate Exam costs $20 and takes 20 minutes on a user\u2019s mobile phone or desktop (5).<\/p>\n<p>&nbsp;<\/p>\n<p>Sources:<\/p>\n<p>(1)\u00a0<a href=\"http:\/\/www.forbes.com\/sites\/parmyolson\/2013\/11\/13\/language-app-duolingo-to-translate-more-sites-after-buzzfeed-and-cnn\/\">http:\/\/www.forbes.com\/sites\/parmyolson\/2013\/11\/13\/language-app-duolingo-to-translate-more-sites-after-buzzfeed-and-cnn\/<\/a><\/p>\n<p>(2)\u00a0<a href=\"https:\/\/www.duolingo.com\/comment\/954969\">https:\/\/www.duolingo.com\/comment\/954969<\/a><\/p>\n<p>(3)\u00a0<a href=\"http:\/\/www.forbes.com\/sites\/parmyolson\/2014\/01\/22\/crowdsourcing-capitalists-how-duolingos-founders-offered-free-education-to-millions\/2\/\">http:\/\/www.forbes.com\/sites\/parmyolson\/2014\/01\/22\/crowdsourcing-capitalists-how-duolingos-founders-offered-free-education-to-millions\/2\/<\/a><\/p>\n<p>(4)\u00a0<a href=\"http:\/\/techcrunch.com\/2015\/06\/10\/duolingo-raises-45-million-series-d-round-led-by-google-ventures-now-valued-at-470m\/#.ddoc8k:6xia\">http:\/\/techcrunch.com\/2015\/06\/10\/duolingo-raises-45-million-series-d-round-led-by-google-ventures-now-valued-at-470m\/#.ddoc8k:6xia<\/a><\/p>\n<p>(5)\u00a0<a href=\"http:\/\/www.bizjournals.com\/pittsburgh\/blog\/techflash\/2015\/09\/duolingo-uber-partner-to-certify-english-speaking.html\">http:\/\/www.bizjournals.com\/pittsburgh\/blog\/techflash\/2015\/09\/duolingo-uber-partner-to-certify-english-speaking.html<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>@duolingo crowdsourced text translation platform allows users to learn a new languages online for free<\/p>\n","protected":false},"author":90,"featured_media":1690,"comment_status":"open","ping_status":"closed","template":"","categories":[673,718,719,384,721,670],"class_list":["post-1689","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-crowdsourcing","category-duolingo","category-quality-control","category-uber","category-wikipedia","category-yelp"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/leveraging-the-collective-intelligence-and-effort-of-digital-crowds\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"@duolingo crowdsourced text translation platform allows users to learn a new languages online for free\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"article:modified_time\" content=\"2015-10-31T19:28:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2015\/10\/Duolingo-logo-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"236\" \/>\n\t<meta property=\"og:image:height\" content=\"213\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/\",\"name\":\"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2015\\\/10\\\/Duolingo-logo-2.png\",\"datePublished\":\"2015-10-30T00:54:50+00:00\",\"dateModified\":\"2015-10-31T19:28:32+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2015\\\/10\\\/Duolingo-logo-2.png\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2015\\\/10\\\/Duolingo-logo-2.png\",\"width\":236,\"height\":213},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/","og_locale":"en_US","og_type":"article","og_title":"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing - Digital Innovation and Transformation","og_description":"@duolingo crowdsourced text translation platform allows users to learn a new languages online for free","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/","og_site_name":"Digital Innovation and Transformation","article_modified_time":"2015-10-31T19:28:32+00:00","og_image":[{"width":236,"height":213,"url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2015\/10\/Duolingo-logo-2.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/","name":"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2015\/10\/Duolingo-logo-2.png","datePublished":"2015-10-30T00:54:50+00:00","dateModified":"2015-10-31T19:28:32+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2015\/10\/Duolingo-logo-2.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2015\/10\/Duolingo-logo-2.png","width":236,"height":213},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/lessons-from-duolingos-effort-to-support-free-language-learning-from-crowdsourcing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"Lessons from Duolingo\u2019s Effort to Support Free Language Learning from Crowdsourcing"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/1689","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/90"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=1689"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/1689\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media\/1690"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=1689"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=1689"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}