{"id":5353,"date":"2017-04-05T23:47:29","date_gmt":"2017-04-06T03:47:29","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/"},"modified":"2017-04-06T00:06:26","modified_gmt":"2017-04-06T04:06:26","slug":"constraints-on-data-driven-systems-in-public-education","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/","title":{"rendered":"Constraints on Data-driven Systems in Public Education"},"content":{"rendered":"

A typical public school classroom\u00a0is run in 2017 similarly to how it was run in 1917. Many public schools still have a hard time achieving basic graduation rates, and it eludes them to diagnose what methods work and which don\u2019t. But school systems have tons of great longitudinal data. They’ve used it to compare student performance, set exam benchmarks, allocate school resources and hold administrators accountable to targets. Yet, our public schools tend to be far behind in fully adopting analytics and data-driven systems at a micro level to improve teaching and learning outcomes.<\/p>\n

The Minneapolis Public Schools (MPS) for example set 3-year strategic goals in 2008 but by 2011 had to extend the timeline on these goals to 2014 due to lack of conclusive results or improvements in student performance. Academic success seems to evade some schools, and even when improvements are made, it\u2019s hard to pin point what exactly drove them.\u00a0Why have public education systems like the MPS largely missed the technological advancements in data analytics even when they’ve tried?<\/p>\n

There are at least 3 key constraints to the effective use of data-driven teaching.<\/p>\n

 <\/p>\n

1) It\u2019s difficult to define the variables.<\/h3>\n

It\u2019s hard to operationally define long-term academic success of a child. First, one defines the core competencies a student needs at various schooling stages (e.g. reading comprehension, logic, analytical skills, creativity). Each competency must then be translated to a measurable variable (e.g. a test score). These variables must then be fit into a model that determines a successful outcome (call it, entry into college). Consider the below from MPS’s “Steps to Student Success” project.<\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

The MPS identified metrics, at various K-12 grade levels, that were the statistically strongest predictors of college entry. There is an implicit model fitting these independent variables. MPS then set goals for each of these metrics and focused its administrators on reaching them. However, a mistake in (a) defining the variables, (b) measuring the variables, and\/or (c) determining a cutoff for what is acceptable, could all be very costly, especially given the long time horizon of strategic planning in school systems.<\/p>\n

 <\/p>\n

2) It\u2019s difficult to establish causation.<\/h3>\n

To tease out a causation, one needs a controlled trial. One would need to hold certain variables constant and manipulate others\u00a0at a time. However, A\/B testing might be difficult to do in the K-12 context due to ethical issues. The idea of public schools \u201cexperimenting on children\u201d is not politically palatable. Charter schools or private educational tech companies might serve well in this regard.<\/p>\n

 <\/p>\n

3) Implementation requires educating the educators.<\/h3>\n

Data collection is one barrier, as is the analysis of and use of the collected data. Many teachers don’t believe in the need for data-driven decision making. One NYC public school teacher told me there is “too much data. Data is bull***t.” Others are overwhelmed by the amount of data they need to collect and track. One way this issue is being tackled is by including a data literacy component in state teaching license requirements.<\/p>\n

 <\/p>\n

If we can overcome some of the constraints, perhaps we can move toward a model of high autonomy of schools and classrooms to provide customized learning experiences for students. We might be able to use live, real-time data to measure progress of a student (minute-to-minute, during the lesson, and post-lesson), provide support, and deliver the right content in the right format to best educate that student.<\/p>\n

 <\/p>\n

Sources<\/h3>\n

Minneapolis Public Schools Strategic Plan<\/a><\/p>\n

ELearning Article<\/a><\/p>\n

Interviews with current and former teachers<\/p>\n","protected":false},"excerpt":{"rendered":"

Why haven’t public school systems been able to better use data-driven decision making to improve outcomes for their students? <\/p>\n","protected":false},"author":1183,"featured_media":5354,"comment_status":"open","ping_status":"closed","template":"","categories":[651],"class_list":["post-5353","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-education"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/data-and-analytics-as-digital-assets\/","yoast_head":"\nConstraints on Data-driven Systems in Public Education - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Constraints on Data-driven Systems in Public Education - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"Why haven't public school systems been able to better use data-driven decision making to improve outcomes for their students?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"article:modified_time\" content=\"2017-04-06T04:06:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/educational-data-analytics-technologies-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"820\" \/>\n\t<meta property=\"og:image:height\" content=\"460\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/\",\"name\":\"Constraints on Data-driven Systems in Public Education - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/04\\\/educational-data-analytics-technologies-1.jpg\",\"datePublished\":\"2017-04-06T03:47:29+00:00\",\"dateModified\":\"2017-04-06T04:06:26+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/04\\\/educational-data-analytics-technologies-1.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/04\\\/educational-data-analytics-technologies-1.jpg\",\"width\":820,\"height\":460},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/constraints-on-data-driven-systems-in-public-education\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Constraints on Data-driven Systems in Public Education\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Constraints on Data-driven Systems in Public Education - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/","og_locale":"en_US","og_type":"article","og_title":"Constraints on Data-driven Systems in Public Education - Digital Innovation and Transformation","og_description":"Why haven't public school systems been able to better use data-driven decision making to improve outcomes for their students?","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/","og_site_name":"Digital Innovation and Transformation","article_modified_time":"2017-04-06T04:06:26+00:00","og_image":[{"width":820,"height":460,"url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/educational-data-analytics-technologies-1.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/","name":"Constraints on Data-driven Systems in Public Education - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/educational-data-analytics-technologies-1.jpg","datePublished":"2017-04-06T03:47:29+00:00","dateModified":"2017-04-06T04:06:26+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/educational-data-analytics-technologies-1.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/educational-data-analytics-technologies-1.jpg","width":820,"height":460},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/constraints-on-data-driven-systems-in-public-education\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"Constraints on Data-driven Systems in Public Education"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/5353","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/1183"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=5353"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/5353\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media\/5354"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=5353"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=5353"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}