  {"id":32998,"date":"2018-11-13T16:09:23","date_gmt":"2018-11-13T21:09:23","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/"},"modified":"2018-11-13T16:10:35","modified_gmt":"2018-11-13T21:10:35","slug":"disney-a-whole-new-world-of-machine-learning","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/","title":{"rendered":"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning"},"content":{"rendered":"<p><strong>Situation<\/strong><\/p>\n<p>Disney is an entertainment powerhouse &#8211; it captured 61% of movie industry earnings in 2016 [1]. In 2017, the studio entertainment division earned 2.3 billion dollars [2]. This is a small part of the company\u2019s earnings, but it is the lifeblood as the characters and stories create the basis for merchandise, theme parks and interactive experiences [3].<\/p>\n<p>However, Disney is not immune to changing consumer preferences pressuring the profitability of the industry (more demand for streaming, lower willingness to buy tickets etc.) [1]. To remain competitive, it is crucial to pick the right content and produce it quickly, at low cost without sacrificing quality. Thus, Disney is leveraging the power of machine learning to stay ahead of consumer preferences and automate the animation process.<\/p>\n<p><strong>Current solutions<\/strong><\/p>\n<p>In the short term, Disney is working on further automating the animation process using machine learning. Getting the lighting of animations right is a difficult process, which when sped up produces visual imperfections known as \u201cnoise\u201d [4]. In collaboration with Pixar and the University of California Santa Barbara, Disney has improved the previously time-intensive and partly manual \u201cdenoising\u201d by using a \u201cConvolutional Neural Network\u201d [4]. This deep-learning model relies on previous Disney movies as guides to improve the image quality of new productions [5]. Thus, Disney can save time and money in producing its future movies and leverage past productions.<\/p>\n<p>In the medium term, Disney is moving towards leveraging machine learning to guide content choices. Disney has been capturing the second-by-second facial reactions of its audiences [6]. Using an algorithm, factorized variational autoencoders (FVAEs), millions of data-points can be interpreted to signal which moments in a movie elicited which audience response [7]. This technique could be used in assessing different versions of movies before releases and gives Disney a vast knowledge base to how content decisions affect viewers [3]. While using test-audiences is not new, this innovation allows for massively more data to be analyzed and does not rely on subjective customer feedback gathered through surveys or interviews [3]. This FVAE technology also has a dual application \u2013 its large calculation power can be used to analyze how scenes behave in nature and translate that into automation [6]. For instance, it can capture how different trees on a hill react to wind and automate the translation of this image into animation [6].<\/p>\n<p>The most ambitious use of machine learning is Disney\u2019s attempt to judge potential content through neural networks [8]. This would mean not only making small adaptations based on audience preferences, but deciding to produce stories identified by AI. For now, the research has focused on predicting the popularity of \u201cQuora\u201d posts as an indication of the attractiveness of a narrative, but Disney has high hopes [9]. The end outcome might be to have scripts or movie ideas evaluated and altered by machine learning to speed up the production process.<\/p>\n<p><strong>Further considerations<\/strong><\/p>\n<p>Disney is clearly pioneering using machine learning to facilitate the animation process. Complex tasks are being rendered less labor intensive and thus cheaper [10]. Disney has purposefully founded The Walk Disney Studios LAB, together with HP Enterprises, Cisco and Accenture Interactive, to explore how technological innovations can improve story-telling [11]. It is unclear if these changes will result in enough cost and time savings to allow Disney to better adapt to industry pressures (e.g. producing more content for streaming services).<\/p>\n<p>The bigger challenge will be instituting the right guardrails for using machine learning to dictate content decisions. It will be crucial for Disney to monitor biases and errors machine learning-based content choices can create:<\/p>\n<ul>\n<li>FVAEs are already being questioned. For instance, they might misread the natural human tendency to mirror an expression seen on-screen (e.g. smiling because we see a smiling baby on screen) as a genuine positive reaction to the image as opposed to an automatic response [12].<\/li>\n<li>By not ensuring a diverse enough audience in the FVAE screenings, certain customer segment preferences could be excluded [13]. This is especially relevant for a global company as cultural differences will affect reactions to content.<\/li>\n<li>Supplying the neural networks with historically-successful narratives might not produce the forward-thinking Disney has tried to become known for, like diverse characters such as in Moana or The Princess and the Frog [14].<\/li>\n<\/ul>\n<p>Along with improving the content-generating technology, Disney should ensure content-choices based on machine learning will be evaluated critically and adjusted by human judgement as necessary [13].<\/p>\n<p><strong>Questions <\/strong><\/p>\n<ul>\n<li>Disney is investing heavily into novel technologies \u2013 do they intend to use them only in the entertainment space or is there room for them to branch into other applications? (e.g. using FVAEs to improve care for patients unable to speak [6])<\/li>\n<li>What is the long-term relationship between human imagination and machine learning in determining content to produce?<\/li>\n<\/ul>\n<p>(798 words)<\/p>\n<p>&nbsp;<\/p>\n<p>[1] Lang, Brent. \u201cThe Reckoning: Why the Movie Business Is in Big Trouble.\u201d\u00a0<em>Variety<\/em>, 27 Mar. 2017. Accessed 12 Nov. 2018<\/p>\n<p>[2] The Walt Disney Company.\u00a0<em>Fiscal Year 2017 Annual Financial Report<\/em>. 2017. Accessed 12 Nov. 2018<\/p>\n<p>[3] McKenna, Beth. \u201cDisney and NVIDIA Team Up on Artificial Intelligence for Making Better Movies.\u201d\u00a0<em>The Motley Fool<\/em>, 27 Aug. 2017. Accessed 12 Nov. 2018<\/p>\n<p>[4] \u201cDisney Research, Pixar Animation Studios and UCSB Accelerate Rendering with AI.\u201d\u00a0<em>Disney Research<\/em>, Accessed 12 Nov. 2018<\/p>\n<p>[5] Bako, Steve, et al. \u201cKernel-Predicting Convolutional Networks for Denoising Monte Carlo Renderings.\u201d\u00a0<em>ACM Transactions on Graphics<\/em>, vol. 36, no. 4, 2017, Accessed 12 Nov. 2018 via Disney Research Website<\/p>\n<p>[6] Perkins, Robert. \u201cNeural Networks Model Audience Reactions to Movies | Caltech.\u201d\u00a0<em>The California Institute of Technology<\/em>, 21 July 2017, Accessed 12 Nov. 2018<\/p>\n<p>[7] Johnson, Madeleine. \u201cHere&#8217;s How Disney Is Implementing Artificial Intelligence.\u201d\u00a0 Nasdaq, 27 July 2017, Accessed 12 Nov. 2018<\/p>\n<p>[8] Nield, David.\u00a0<em>Disney Is Developing an AI That Can Judge What Makes For a Truly Great Story<\/em>. ScienceAlert, 23 Aug. 2017, Accessed 12 Nov. 2018<\/p>\n<p>[9] LeFebvre, Rob. \u201cDisney Research Taught AI How to Judge Short Stories.\u201d\u00a0<em>Engadget<\/em>, 21 Aug. 2017, Accessed 12 Nov. 2018<\/p>\n<p>[10] Editorial team. \u201cTrends in Entertainment Industry Push Enterprises Toward AI.\u201d\u00a0<em>InsideBIGDATA<\/em>, 19 Sept. 2018, Accessed 12 Nov. 2018<\/p>\n<p>[11] \u201cThe Walt Disney Studios StudioLAB Advances the Art of Storytelling Through Next-Generation Technology.\u201d\u00a0<em>The Walt Disney Company<\/em>, 16 July 2018, Accessed 12 Nov. 2018<\/p>\n<p>[12] Breakey, Julia. \u201cDisney Uses AI to Predict Viewers&#8217; Expressions, but It Isn&#8217;t Foolproof.\u201d\u00a0<em>Memeburn<\/em>, 28 July 2017. \u00a0Accessed 12 Nov. 2018<\/p>\n<p>[13] Bloomberg, Jason.\u00a0<em>Bias Is AI&#8217;s Achilles Heel. Here&#8217;s How To Fix It<\/em>. Forbes Magazine, 20 Aug. 2018. Accessed 12 Nov. 2018<\/p>\n<p>[14] Desta, Yohana.\u00a0<em>The Year Disney Started to Take Diversity Seriously<\/em>. Vanity Fair, 23 Nov. 2016, Accessed 12 Nov. 2018<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Let us explore how the masters of imagination are using machine learning to alter the movie production and animation processes<\/p>\n","protected":false},"author":11033,"featured_media":32999,"comment_status":"open","ping_status":"closed","template":"","categories":[346],"class_list":["post-32998","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-machine-learning","hck-taxonomy-organization-the-walt-disney-company","hck-taxonomy-industry-entertainment-and-recreation","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Disney \u2013 \u201cA Whole New World\u201d of Machine Learning - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"Let us explore how the masters of imagination are using machine learning to alter the movie production and animation processes\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"article:modified_time\" content=\"2018-11-13T21:10:35+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Disney-Logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"425\" \/>\n\t<meta property=\"og:image:height\" content=\"238\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/\",\"name\":\"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Disney-Logo.jpg\",\"datePublished\":\"2018-11-13T21:09:23+00:00\",\"dateModified\":\"2018-11-13T21:10:35+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Disney-Logo.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Disney-Logo.jpg\",\"width\":425,\"height\":238},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/disney-a-whole-new-world-of-machine-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/","og_locale":"en_US","og_type":"article","og_title":"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning - Technology and Operations Management","og_description":"Let us explore how the masters of imagination are using machine learning to alter the movie production and animation processes","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/","og_site_name":"Technology and Operations Management","article_modified_time":"2018-11-13T21:10:35+00:00","og_image":[{"width":425,"height":238,"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Disney-Logo.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/","name":"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Disney-Logo.jpg","datePublished":"2018-11-13T21:09:23+00:00","dateModified":"2018-11-13T21:10:35+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Disney-Logo.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Disney-Logo.jpg","width":425,"height":238},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/disney-a-whole-new-world-of-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Disney \u2013 \u201cA Whole New World\u201d of Machine Learning"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/32998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11033"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=32998"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/32998\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/32999"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=32998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=32998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}