  {"id":34963,"date":"2018-11-13T18:37:38","date_gmt":"2018-11-13T23:37:38","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/"},"modified":"2018-11-13T18:37:38","modified_gmt":"2018-11-13T23:37:38","slug":"blended-learning-the-rise-of-machine-learners","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/","title":{"rendered":"Blended Learning: The Rise of Machine Learners"},"content":{"rendered":"<p>In 2010, only 54% students from grades 9-11 in the Dallas Independent School District (DISD) passed the math portion of the assessment test. In contrast, ~80% students from grades 3-6 met the minimum standard on Texas\u2019s assessment test. That means nearly half these students (~12000 in DISD) fell behind on basic math skills by high school.<sup>[1]<\/sup> Ideally, teachers could identify and prioritize the diverse needs of students, especially those who need intervention. However, resource constraints in school districts can seriously limit the personalized attention that students receive.<\/p>\n<p>In such cases, introduction of \u201cintelligent\u201d tutoring systems that use machine learning (ML) to gauge pre-existing knowledge, provide personalized tutoring and analyze performance, can dramatically improve learning outcomes. Reasoning Minds (RM), an adaptive video game that teaches math, does exactly that \u2013 A virtual \u201cgenie\u201d guides middle-schoolers through personalized math lessons where students progress through levels only after they\u2019ve mastered certain concepts.<sup>[2]<\/sup> Meanwhile, it alerts teachers if a student is stuck, allowing them to monitor individual progress and effectively intervene when needed instead of having to simultaneously field wide-ranging questions. Furthermore, students can access this learning platform (provided internet availability) even in the absence of teachers.<\/p>\n<p style=\"text-align: center\"><em><a href=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-34905 aligncenter\" src=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png\" alt=\"\" width=\"347\" height=\"257\" srcset=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png 661w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5-300x222.png 300w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5-600x444.png 600w\" sizes=\"auto, (max-width: 347px) 100vw, 347px\" \/><\/a>Figure 1: Sample guided study screen<\/em><\/p>\n<p>Given the promise of ML solutions, DISD decided to pilot RM in the short-term. ~2500 third and fourth graders were enrolled onto the platform in 2009 and another ~1000 in 2010. As the program demonstrated success, DISD expanded it to all grade 2 students in 2011, and to grade 3 students in 2012.<sup> [3]<\/sup> By 2016, ~33,000 students were enrolled for RM, adoption and usage continuing to flourish. Researchers measured 89% time on-task in RM when implemented with fidelity, potentially leading to up to 40 extra hours of instruction in a year.<sup>[4]<\/sup> Hence, it is no surprise that DISD teachers revealed strong support for RM, with 86% of supported and 71% of non-supported teachers stating RM benefits students, and 80% and 62% of supported and non-supported teachers willing to recommend it to others. <sup>[5]<\/sup><\/p>\n<p>Such ML-based tools that can \u201cpersonalize\u201d learning in classrooms (and outside) are expected to grow to a $6B+ world-wide market by 2024, with U.S. K-12 classrooms and consumers driving ~20% of that growth.<sup>[6]<\/sup> Tools like RM that customize content to individual learning patterns will continue to enhance student engagement and learning outcomes. In addition to the contribution to students\u2019 learning, ML offers significant advantages for teachers too. It can reduce their workload, allowing them time to focus on students one-on-one or on more complex problems. ML tools also provide teachers (and parents) with real-time feedback on students\u2019 progress, allowing them to intervene timely instead of waiting until periodic exams, when it might be too late.<\/p>\n<p><a href=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/2-6.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter  wp-image-34917\" src=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/2-6.png\" alt=\"\" width=\"522\" height=\"281\" srcset=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/2-6.png 650w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/2-6-300x162.png 300w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/2-6-600x323.png 600w\" sizes=\"auto, (max-width: 522px) 100vw, 522px\" \/><\/a><\/p>\n<p style=\"text-align: center\"><em>Figure 2: Expected growth of machine learning application in education<\/em><\/p>\n<p>For DISD specifically, as it extends usage of ML in the near-term, it should first assess the culture and technical readiness of schools before integrating these tools into traditional class formats and curricula. It must invest in technology infrastructure and standardize data sets (e.g. grade records) throughout the network to facilitate quicker implementation and adoption. While the technology adoption is at its nascent stage, DISD can also codify learnings from its RM programs thus far, defining best practices on how to efficiently leverage these tools for maximum benefit. Finally, DISD can start establishing strict security protocols in advance, as data privacy concerns are bound to arise.<\/p>\n<p>Longer term, as ML undertakes more responsibilities away from teachers, like time-consuming routine tasks of grading and record keeping, teachers\u2019 roles will have to evolve. Teachers will have to be trained in new skills, primarily developing a sophisticated understanding of technological tools so that they can utilize them effectively. To that effect, DISD should also start involving teachers in co-designing ML tools so that their proven pedagogical techniques can be embedded into these intelligent tutoring systems. This will also help DISD address teachers\u2019 fears of being replaced by technology and facilitate better adoption. On a more strategic level, as classrooms move towards a blended learning model &#8211; combining human and artificial intelligence, DISD will need to define a) the right balance between the two components, and b) the pace and stage(s) at which it introduces virtual teaching agents into students\u2019 lives.<\/p>\n<p>For schools to answer the above-mentioned questions, it will be critical to evaluate the design and impact of blended learning more holistically. Hence, I\u2019m curious to hear opinions on (1) the potential negative impacts, if any, of using ML tools on student learning, and (2) what if we flipped ML application in education on its head? Instead of machines learning how children think\/learn, what if these tools could proactively shape how children think &#8211; urging their curiosity and expanding their imagination?<\/p>\n<p>(785 words)<\/p>\n<p><strong>References<\/strong><\/p>\n<p>[1] Dallas News (Dec 2011). \u201cDallas ISD to expand computer-based math program\u201d\u2013 Melissa Repko <a href=\"https:\/\/www.dallasnews.com\/news\/education\/2011\/12\/19\/dallas-isd-to-expand-computer-based-math-program\">https:\/\/www.dallasnews.com\/news\/education\/2011\/12\/19\/dallas-isd-to-expand-computer-based-math-program<\/a>. Accessed on November 12, 2018<\/p>\n<p>[2] <a href=\"http:\/\/www.reasoningmind.org\">www.reasoningmind.org<\/a>. Accessed on November 11, 2018<\/p>\n<p>[3] Victor Kostyuk, Leigh Mingle, Steven Gaudino, Diedre Douglas (2015). \u201cReasoning Mind DISD 2015 Report\u201d. <a href=\"https:\/\/www.reasoningmind.org\/rmwp\/wp-content\/uploads\/sites\/4\/2015\/12\/2014-2015-Dallas-ISD-Report.pdf\">https:\/\/www.reasoningmind.org\/rmwp\/wp-content\/uploads\/sites\/4\/2015\/12\/2014-2015-Dallas-ISD-Report.pdf<\/a>. Accessed on November 11, 2018<\/p>\n<p>[4] Jaclyn Ocumpaugh, Ryan S.J.d. Baker, Steven Gaudino, Matthew J. Labrum, Travis Dezendorf (2011). \u201cField Observations of Engagement in Reasoning Mind\u201d, <em>Springer-Verlag Berlin Heidelberg 2011. <\/em>Accessed on November 12, 2018<\/p>\n<p>[5] Bush, J. &amp; Kim, M. (2015). \u201cEvaluation of Reasoning Mind: Final Report 2014\u201315\u201d. Accessed on November 13, 2018<\/p>\n<p>[6] Global Market Insights report (2018). \u201cArtificial Intelligence (AI) in Education Market worth over $6bn by 2024\u201d. <a href=\"https:\/\/www.gminsights.com\/pressrelease\/artificial-intelligence-ai-in-education-market\">https:\/\/www.gminsights.com\/pressrelease\/artificial-intelligence-ai-in-education-market<\/a>. Accessed on November 10, 2018<\/p>\n<p>Note: Supported teachers refers to those instructors who received additional training and implementation support from Reasoning Minds specialists<\/p>\n<p>&nbsp;<\/p>\n<p><em>\u00a0<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In 2010, only 54% students from grades 9-11 in the Dallas Independent School District (DISD) passed the math portion of the assessment test. In contrast, ~80% students from grades 3-6 met the minimum standard on Texas\u2019s assessment test. That means [&hellip;]<\/p>\n","protected":false},"author":11481,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[2664,346],"class_list":["post-34963","hck-submission","type-hck-submission","status-publish","hentry","category-education-technology","category-machine-learning"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Blended Learning: The Rise of Machine Learners - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Blended Learning: The Rise of Machine Learners - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"In 2010, only 54% students from grades 9-11 in the Dallas Independent School District (DISD) passed the math portion of the assessment test. In contrast, ~80% students from grades 3-6 met the minimum standard on Texas\u2019s assessment test. That means [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/\",\"name\":\"Blended Learning: The Rise of Machine Learners - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/1-5.png\",\"datePublished\":\"2018-11-13T23:37:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/1-5.png\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/1-5.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/blended-learning-the-rise-of-machine-learners\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Blended Learning: The Rise of Machine Learners\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Blended Learning: The Rise of Machine Learners - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/","og_locale":"en_US","og_type":"article","og_title":"Blended Learning: The Rise of Machine Learners - Technology and Operations Management","og_description":"In 2010, only 54% students from grades 9-11 in the Dallas Independent School District (DISD) passed the math portion of the assessment test. In contrast, ~80% students from grades 3-6 met the minimum standard on Texas\u2019s assessment test. That means [&hellip;]","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/","og_site_name":"Technology and Operations Management","og_image":[{"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/","name":"Blended Learning: The Rise of Machine Learners - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png","datePublished":"2018-11-13T23:37:38+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/1-5.png"},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/blended-learning-the-rise-of-machine-learners\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Blended Learning: The Rise of Machine Learners"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/34963","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11481"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=34963"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/34963\/revisions"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=34963"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=34963"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}