  {"id":30445,"date":"2018-11-12T23:04:42","date_gmt":"2018-11-13T04:04:42","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-with-machine-learning\/"},"modified":"2018-11-12T23:04:42","modified_gmt":"2018-11-13T04:04:42","slug":"duolingo-from-hello-to-hallo-through-machine-learning","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/","title":{"rendered":"Duolingo: From Hello to Hallo through Machine Learning"},"content":{"rendered":"<p>Duolingo, one of the leading free language learning services, utilizes machine learning across thousands of exercises to help users learn and retain new languages.<\/p>\n<p>One of the most important aspects of Duolingo\u2019s product influenced by machine learning is measuring how easy it is to retain each word. Simply put, some words are easier or harder to remember, and Duolingo uses machine learning to more precisely identify this trend. Duolingo looks across every exercise ever completed and determines how easy or difficult a word is to remember based on how well students fared next time they saw that word. With enough data, it predicts how quickly students forget that word, and then predicts when it should test you on this word again. If you get the word right or wrong the next time you see it, Duolingo recalibrates the formula based on how other students like you learned the word over time, and tweaks how quickly you\u2019ll be tested on the word again.<sup>1<\/sup><\/p>\n<p>This approach is important because everyone learns languages differently. Duolingo uses many methods, from matching exercises to rote translation, to help students learn. By studying how well students retain words based on different methods of learning, it can also optimize the algorithms to teach certain words using certain activities (or a clever combination of activities). Even the order in which concepts are taught can be optimized \u2013 should one learn adverbs or past tense verbs first?<sup>2<\/sup><\/p>\n<p>Duolingo has also developed an English proficiency test that measures a test taker\u2019s English abilities. To build their test, Duolingo analyzed the Common European Frame of Reference, the global standard for measuring language proficiency. It processed tens of thousands of passages corresponding to different language levels and used machine learning techniques to develop algorithms about which words or concepts were most important to test at each level.<sup>3<\/sup><\/p>\n<p>Looking forward, Duolingo is focused on driving more users to the platform. Machine learning techniques work best when they have a robust data set to work from. While some languages pairs, like English to Spanish, are used at a higher frequency, other pairs have fewer users which makes it more difficult to train the algorithms \u2013 what might have been an easy cognate for an English speaker learning Spanish might be a totally different looking and more challenging word when the speaker\u2019s native language is Hungarian.<\/p>\n<p>Duolingo also wants to improve their ability help students reach more advanced language proficiency. To address this, they\u2019re developing the Stories feature, which lets students review long form passages with more complex words and answer questions about what they\u2019ve heard or read. Different from the traditional Duolingo approach, there are a set number of stories and topics which aren\u2019t algorithmically generated. This highlights the limitation of Duolingo\u2019s approach with advanced levels \u2013 few users make it to the end of the lessons, so there is less data to track for more advanced words and topics. As the volume of data thins and as the language (and how people acquire it) becomes more complex, Duolingo has tweaked their algorithmic-based, machine learning-driven approach that made its core offering so successful.<sup>4<\/sup><\/p>\n<p>Long term, Duolingo is exploring how they take their insights with language learning and apply them to other subjects, from physics to reading. It\u2019s extremely difficult for many across the world to access a high-quality education, and while services like Duolingo don\u2019t address the structural issues that prevent people from accessing high quality education, Duolingo could help provide a similar machine learning-driven approach to helping those without resources learn more than just language.<sup>5<\/sup><\/p>\n<p>There is still opportunity to improve Duolingo\u2019s approach. Duolingo focuses its machine learning on what users put into the app, or how well users recall a word when it comes up on the screen. But as any language learner knows, stepping up to counter and ordering something in a new language is very different that remembering flashcards. For users who are trying to use their new language as they learn it, Duolingo can feel disconnected from this real-life experience. But real life provides an incredibly rich data set for Duolingo to analyze and finding a way to integrate it into their algorithms would be a huge next step. Whether it\u2019s allowing users to input words that they forgot each day or even allowing Duolingo to capture and analyze your spoken conversations, the platform could better track how users are actually behaving and provide even better recommendations about what to learn or improve next.<\/p>\n<p>One critical question is how improved translation services will change the role and necessity of language learning. As Google Translate and other similar services get better at accurately translating longer and more complex passages, will people feel compelled to learn new languages? Does Google Translate and similar apps represent a competitive threat for Duolingo? (796 Words)<\/p>\n<ol>\n<li><a href=\"http:\/\/making.duolingo.com\/how-we-learn-how-you-learn\">http:\/\/making.duolingo.com\/how-we-learn-how-you-learn<\/a><\/li>\n<li><a href=\"https:\/\/www.zdnet.com\/article\/duolingo-the-app-teaching-humans-new-languages-while-teaching-machines-how-to-learn\/\">https:\/\/www.zdnet.com\/article\/duolingo-the-app-teaching-humans-new-languages-while-teaching-machines-how-to-learn\/<\/a><\/li>\n<li><a href=\"https:\/\/s3.amazonaws.com\/duolingo-papers\/other\/DET_ShortPaper.pdf\">https:\/\/s3.amazonaws.com\/duolingo-papers\/other\/DET_ShortPaper.pdf<\/a><\/li>\n<li><a href=\"https:\/\/forum.duolingo.com\/comment\/23206010\/Introducing-Duolingo-StoriesBeta\">https:\/\/forum.duolingo.com\/comment\/23206010\/Introducing-Duolingo-StoriesBeta<\/a><\/li>\n<li><a href=\"https:\/\/www.quora.com\/What-are-Luis-Von-Ahns-future-plans-for-Duolingo\">https:\/\/www.quora.com\/What-are-Luis-Von-Ahns-future-plans-for-Duolingo<\/a><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Duolingo is using machine learning to help users acquire new lanaguages and verify their current language skills &#8211; are broader educational applications for Duolingo&#039;s machine learning next?<\/p>\n","protected":false},"author":11273,"featured_media":30446,"comment_status":"open","ping_status":"closed","template":"","categories":[2067,2068],"class_list":["post-30445","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-duolingo","category-languages","hck-taxonomy-organization-duolingo","hck-taxonomy-industry-education","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Duolingo: From Hello to Hallo through Machine Learning - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Duolingo: From Hello to Hallo through Machine Learning - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"Duolingo is using machine learning to help users acquire new lanaguages and verify their current language skills - are broader educational applications for Duolingo&#039;s machine learning next?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/duolingo.png\" \/>\n\t<meta property=\"og:image:width\" content=\"512\" \/>\n\t<meta property=\"og:image:height\" content=\"250\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/\",\"name\":\"Duolingo: From Hello to Hallo through Machine Learning - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/duolingo.png\",\"datePublished\":\"2018-11-13T04:04:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/duolingo.png\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/duolingo.png\",\"width\":512,\"height\":250},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/duolingo-from-hello-to-hallo-through-machine-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Duolingo: From Hello to Hallo through Machine Learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Duolingo: From Hello to Hallo through Machine Learning - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/","og_locale":"en_US","og_type":"article","og_title":"Duolingo: From Hello to Hallo through Machine Learning - Technology and Operations Management","og_description":"Duolingo is using machine learning to help users acquire new lanaguages and verify their current language skills - are broader educational applications for Duolingo&#039;s machine learning next?","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/","og_site_name":"Technology and Operations Management","og_image":[{"width":512,"height":250,"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/duolingo.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/","name":"Duolingo: From Hello to Hallo through Machine Learning - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/duolingo.png","datePublished":"2018-11-13T04:04:42+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/duolingo.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/duolingo.png","width":512,"height":250},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/duolingo-from-hello-to-hallo-through-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Duolingo: From Hello to Hallo through Machine Learning"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/30445","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11273"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=30445"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/30445\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/30446"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=30445"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=30445"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}