  {"id":29562,"date":"2018-11-12T20:52:47","date_gmt":"2018-11-13T01:52:47","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/"},"modified":"2018-11-12T20:52:47","modified_gmt":"2018-11-13T01:52:47","slug":"machine-learning-in-theatres-now","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/","title":{"rendered":"Machine Learning \u2013 In Theatres Now"},"content":{"rendered":"<p><strong><em>Importance of the megatrend: Machine learning as a predictive tool for movie viewership<\/em><\/strong><\/p>\n<p>Given the lengthy time periods and high costs associated with producing feature films, studios are strongly incentivized to invest in projects with maximum potential viewership. Estimating future demand for any given title is difficult, so studios have used past experience to inform investment decisions on new scripts. This approach can risky, especially for original stories.<a href=\"#_ftn1\" name=\"_ftnref1\">[1]<\/a> Major movie studios have started to use data science to better understand the composition of their audiences and more accurately forecast demand for new releases.<a href=\"#_ftn2\" name=\"_ftnref2\">[2]<\/a> Using machine learning to analyze movie trailers and overlay historical viewing data, 20<sup>th<\/sup> Century Fox hopes to learn more about movie goers to better predict what kind of movies they may want to see in the future. Studios have historically relied on traditional methods such as interviews and questionnaires for insights on audience composition<a href=\"#_ftn3\" name=\"_ftnref3\">[3]<\/a>, but the limitations of these methods made granular audience segmentation challenging.<a href=\"#_ftn4\" name=\"_ftnref4\">[4]<\/a> Without such \u2018micro-segmentation\u2019 of an audience, demand forecasting for an individual title is almost impossible. Researchers at 20<sup>th<\/sup> Century Fox have built \u201can experimental movie attendance prediction and recommendation system,\u201d<a href=\"#_ftn5\" name=\"_ftnref5\">[5]<\/a> called Merlin, which they hope to use to inform greenlighting decisions, as well as marketing and distribution strategies for new releases.<\/p>\n<p><strong><em>Organization&#8217;s response: 20<sup>th<\/sup> Century Fox applies ML to movie trailers<\/em><\/strong><\/p>\n<p>Fox partnered with Google Cloud, using its ML deep learning framework TensorFlow<a href=\"#_ftn6\" name=\"_ftnref6\">[6]<\/a> to create Merlin, a computer vision tool that learns patterns in movie trailers to predict a trailer\u2019s future audience up to a year in advance of film release. This is an example of a pure cold-start prediction that is challenging for brand new movies<a href=\"#_ftn7\" name=\"_ftnref7\">[7]<\/a>. Merlin first scans the trailer, returning the most frequently occurring elements, taking into account the sequence in which they appear, since timing of each object\u2019s appearance is correlated with film genre.<a href=\"#_ftn8\" name=\"_ftnref8\">[8]<\/a> Merlin then compares this information with analyses from past trailers and combines it with historical viewership data to create predictions of audience behavior. A comparison of Merlin\u2019s predictions for viewers of <em>Logan<\/em> (right hand column) with actual results (left hand column) demonstrates that Merlin correctly predicted all 5 of the top actual movies (in green in the left hand column), but fails to rank them correctly.<\/p>\n<p><a href=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-large wp-image-29543\" src=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900-1024x695.png\" alt=\"\" width=\"640\" height=\"434\" srcset=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900-1024x695.png 1024w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900-300x204.png 300w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900-768x521.png 768w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900-600x407.png 600w, https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Results_output.max-1900x1900.png 1900w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p>However, there are some noteworthy mismatches, such as the prediction that <em>Tarzan <\/em>and <em>The Revenant <\/em>will be popular with fans of superhero movie <em>Logan.<\/em>\u00a0Despite these kinks, in a little over a year, Fox has created a predictive tool that is now used routinely in making business decisions. Looking further ahead, management is refining how to use Merlin to further inform marketing strategy and its performance tracking of new releases. The team is introducing scorecards that compare actual versus predicted box office performance for new releases which can be shared with the rest of the organisation.<\/p>\n<p><strong><em>Recommendation and Key question: Can machines really be movie buffs?<\/em><\/strong><\/p>\n<p>In the short term, researchers at Fox need to improve Merlin\u2019s accuracy to make its predictions more useful. In the medium term, however, it remains to be seen whether or not the tool can accurately determine future demand or decide what kind of movies to make. This is in part due to the nature of the attendance data on which the Merlin model is trained. A variety of factors influence consumers\u2019 decision to see a particular movie, including who they are with, title availability, and even the impact of impulsive behavior. Research has demonstrated that people are more likely to depart from their preferences when making consumption decisions in a group (a frequent movie goer configuration)<a name=\"_ftnref9\"><\/a><a href=\"#_ftn9\">[9]<\/a>. The fact that an individual watched <em>Logan <\/em>in the cinema in the past is not necessarily an indicator that he or she will go see another superhero movie under different circumstances. I would therefore be cautious in inferring too much from historical viewership data, and use the tool primarily to gain granular insights on the composition of past audiences. When it comes to the tool\u2019s ability to guide future content creation, it is important to recall that people are notoriously poor at predicting what they will like in the future, and past preferences are not necessarily an indication of future tastes. Accordingly, a model that uses past viewing patterns to determine content of future films could have serious limitations, suffering the same pitfalls that plagued Amazon\u2019s machine learning hiring algorithm<a name=\"_ftnref10\"><\/a><a href=\"#_ftn10\">[10]<\/a>. As Netflix series Stranger Things has demonstrated, often the most popular original concepts are not engineered based on what has worked in the past, but rather created by visionary screenwriters who have the ability to create something truly novel. In the age of cookies, in which the consumer is bombarded with content based on past purchasing behavior, do audiences want more than ever to be surprised and delighted by cinema, or is content based on past viewing patterns more likely to be a hit?<\/p>\n<p>Word count:\u00a0808<\/p>\n<p><a href=\"#_ftnref1\" name=\"_ftn1\">[1]<\/a> Miguel Campo and Sona Oakley, \u201cHow 20th Century Fox uses ML to predict a movie audience,\u201d <em>Google Cloud Blog, <\/em>29 October 2018, <a href=\"https:\/\/cloud.google.com\/blog\/products\/ai-machine-learning\/how-20th-century-fox-uses-ml-to-predict-a-movie-audience\">https:\/\/cloud.google.com\/blog\/products\/ai-machine-learning\/how-20th-century-fox-uses-ml-to-predict-a-movie-audience<\/a><\/p>\n<p><a href=\"#_ftnref2\" name=\"_ftn2\">[2]<\/a> Cheng-Kang Hsieh, Miguel Campo et al, \u201cConvolutional Collaborative Filter Network for Video Based Recommendation Systems,\u201d (October 2018)<\/p>\n<p><a href=\"#_ftnref3\" name=\"_ftn3\">[3]<\/a> James Vincent, \u201c20th Century Fox is using AI to analyze movie trailers and find out what films audiences will like\u201d, <em>The Verge, <\/em>November 2, 2018, <a href=\"https:\/\/www.theverge.com\/2018\/11\/2\/18055514\/fox-google-ai-analyze-movie-trailer-predict-success-logan\">https:\/\/www.theverge.com\/2018\/11\/2\/18055514\/fox-google-ai-analyze-movie-trailer-predict-success-logan<\/a><\/p>\n<p><a href=\"#_ftnref4\" name=\"_ftn4\">[4]<\/a> Campo Oakley, \u201cHow 20th Century Fox uses ML to predict a movie audience\u201d<\/p>\n<p><a href=\"#_ftnref5\" name=\"_ftn5\">[5]<\/a> Hsieh, Campo et al, \u201cConvolutional Collaborative Filter Network for Video Based Recommendation Systems,\u201d (October 2018)<\/p>\n<p><a href=\"#_ftnref6\" name=\"_ftn6\">[6]<\/a> <a href=\"https:\/\/www.tensorflow.org\/\">https:\/\/www.tensorflow.org\/<\/a><\/p>\n<p><a href=\"#_ftnref7\" name=\"_ftn7\">[7]<\/a> Ibid.<\/p>\n<p><a href=\"#_ftnref8\" name=\"_ftn8\">[8]<\/a> Vincent, \u201c20th Century Fox is using AI to analyze movie trailers and find out what films audiences will like\u201d, <em>The Verge, <\/em>November 2, 2018<\/p>\n<p><a href=\"#_ftnref9\" name=\"_ftn9\">[9]<\/a> Ratner, R. K., &amp; Kahn, B. E. (2002). The impact of private versus public consumption on variety-seeking behavior. Journal of Consumer Research,29(2), 246-257. <a href=\"https:\/\/www.jstor.org\/stable\/pdf\/10.1086\/341574.pdf\">https:\/\/www.jstor.org\/stable\/pdf\/10.1086\/341574.pdf<\/a><\/p>\n<p><a href=\"#_ftnref10\" name=\"_ftn10\">[10]<\/a> Alex Woodie, \u201cDo Amazon\u2019s Biased Algorithms Spell the End of AI in Hiring?,\u201d 18 October 2018 <a href=\"https:\/\/www.datanami.com\/2018\/10\/16\/do-amazons-biased-algorithms-spell-the-end-of-ai-in-hiring\/\">https:\/\/www.datanami.com\/2018\/10\/16\/do-amazons-biased-algorithms-spell-the-end-of-ai-in-hiring\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Movie studios are using machine learning to try to predict audience demand and develop new titles<\/p>\n","protected":false},"author":11893,"featured_media":29718,"comment_status":"open","ping_status":"closed","template":"","categories":[2462,4348,346,148,2677,4296],"class_list":["post-29562","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-deep-learning","category-google-cloud-platform","category-machine-learning","category-movies","category-predictive-analytics","category-studios","hck-taxonomy-organization-fox","hck-taxonomy-industry-entertainment-and-recreation","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Machine Learning \u2013 In Theatres Now - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Machine Learning \u2013 In Theatres Now - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"Movie studios are using machine learning to try to predict audience demand and develop new titles\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Logan_Claws.0-2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1\" \/>\n\t<meta property=\"og:image:height\" content=\"1\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/\",\"name\":\"Machine Learning \u2013 In Theatres Now - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Logan_Claws.0-2.jpg\",\"datePublished\":\"2018-11-13T01:52:47+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Logan_Claws.0-2.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Logan_Claws.0-2.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-theatres-now\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Machine Learning \u2013 In Theatres Now\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Machine Learning \u2013 In Theatres Now - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/","og_locale":"en_US","og_type":"article","og_title":"Machine Learning \u2013 In Theatres Now - Technology and Operations Management","og_description":"Movie studios are using machine learning to try to predict audience demand and develop new titles","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/","og_site_name":"Technology and Operations Management","og_image":[{"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Logan_Claws.0-2.jpg","width":1,"height":1,"type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/","name":"Machine Learning \u2013 In Theatres Now - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Logan_Claws.0-2.jpg","datePublished":"2018-11-13T01:52:47+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Logan_Claws.0-2.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Logan_Claws.0-2.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-theatres-now\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Machine Learning \u2013 In Theatres Now"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/29562","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11893"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=29562"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/29562\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/29718"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=29562"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=29562"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}