  {"id":29559,"date":"2018-11-12T20:25:20","date_gmt":"2018-11-13T01:25:20","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/"},"modified":"2018-11-12T20:26:44","modified_gmt":"2018-11-13T01:26:44","slug":"netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/","title":{"rendered":"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process?"},"content":{"rendered":"<p><strong>Netflix\u2019s affection with machine learning and its current dilemma<\/strong><\/p>\n<p>Machine learning has been at the heart of Netflix\u2019s business strategy and catalyst for growth since its inception in 1997. From the earliest form of its business model as a physical DVD-by-mail rental service, Netflix has started analyzing vast amount of user rating and behavior data to identify the type of movies its customers enjoyed watching in the past and developing proprietary algorithm to predict what movies the same customers will likely enjoy watching in the future. Netflix then utilized the result to recommend each individual customer a personalized playlist of movies &amp; TV shows [1]. In addition, it leveraged the aggregate result to make an important business decision: determining which are the most popular contents it will need to buy from the DVD distribution companies and place in the rental library to anticipate future customers demand [2].<\/p>\n<p>Riding the tailwind of internet proliferation phenomenon, Netflix began to convert its core business model into an online streaming service in 2007 [3]. The transformation allowed Netflix to deliver movies and TV shows instantaneously, reach new customers all around the globe, and significantly boost the number of subscribers. This new business model is a boon for its movie recommendation engine \u2013 the vast amount of fresh data helps to refine the algorithm and improve the prediction accuracy [4].<\/p>\n<p>The increased confidence on the ability to predict customer\u2019s taste led Netflix to a new venture \u2013 acquiring and creating its own original contents (movies and TV shows) [5]. While past decision on which DVD titles to be bought for its library is purely transactional, selecting and dropping casts have more risk and complex relationship effects. In one example, Netflix\u2019s machine learning engine indicated that more users clicked on \u201cGrace and Frankie\u201d show when the image does not contain Jane Fonda. Netflix is struggling on whether to drop her from the marketing image at the risk of irritating the actress [6]. As experts think that similar tensions will occur more often, it\u2019s decision today may set an important precedent on how the company approach similar types of problem going forward [7].<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p><strong>Current solution to balance the machine learning insight <\/strong><\/p>\n<p>The issue was stirring up internal debate within Netflix\u2019s production and technology team. Production team \u201cdon\u2019t believe numbers as much as people in Silicon Valley\u201d; while technology team argued the data should not be ignored [7].<\/p>\n<p>To resolve this impasse, the management team took on two-steps action plan. First, it cultivated the culture of open communication across different teams in voicing out the benefits and concerns of each options. Secondly, it encouraged the teams to also consider the \u201cintangible impacts\u201d that are not yet captured in the machine learning\u2019s algorithm, such as the potential risk of alienating the actress, inability to partner with the actress for any future production titles featuring her, and repercussion of violating the contract agreement [7].<\/p>\n<p>Under this framework, the two teams were able to \u201creach common ground\u201d. Human judgement is introduced into the decision-making process \u2013 Netflix decided to keep the promotional image that also featured Jane Fonda [7].<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p><strong>Additional step to consider<\/strong><\/p>\n<p>In high level, I agree with the management\u2019s approach to incorporate human judgement to overcome machine learning\u2019s limitation in considering crucial \u201cintangible impacts\u201d that are out of scope for the algorithm. Augmented intelligence should serve as an input in the decision-making process, helping to suggest rather than dictate the final decision.<\/p>\n<p>However, I think Netflix still can generate deeper insight to drive its business decision by conducting more rigorous analysis to separate the signal from the noise [8]. Currently the algorithm captures in one specific instance, there is negative correlation between Jane Fonda\u2019s appearance in the image and the number of click. It does not tell convincingly whether it is truly because of Jane Fonda or other factors in the images such as color tone, background settings, etc. Having more result from other tests in a controlled environment will help to separate consistent relationship from the random correlation \u2013 it might even predict causality whether Jane Fonda is actually less desirable than her co-star, Lily Tomlin and drive the business decision in the future.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Open Questions<\/strong><\/p>\n<p>Netflix has been good at providing its customers new contents based on machine learning result of what they like in the past. However, in media and entertainment industry there is a saturation point where people are bored and weary watching the similar things again and again. What should Netflix do to avoid this situation from happening? Also, how should Netflix orient its business model to ensure it can capitalize on new trends \u2013 something that did not exist in the past hence not showing up in the machine learning result, but once introduced the customers will like in the future?<\/p>\n<p>Word Count: 793<\/p>\n<p>&nbsp;<\/p>\n<p><strong>References:<\/strong><\/p>\n<p>[1] Netflix, Inc., \u201cCompany Timeline,\u201d https:\/\/signup.netflix.com\/MediaCenter\/Timeline, accessed November 2018.<\/p>\n<p>[2] Willy Shih, Stephen Kaufman, and David Spinola, \u201cNetflix,\u201d HBS No. 9-607-138 (Boston: 性视界 Business School Publishing, 2007).<\/p>\n<p>[3] Miguel Helft. \u201cNetflix to Deliver Movies to the PC.\u201d The New York Times, January 16, 2017, <a href=\"https:\/\/www.nytimes.com\/2007\/01\/16\/technology\/16netflix.html\">https:\/\/www.nytimes.com\/2007\/01\/16\/technology\/16netflix.html<\/a>, accessed November 2018<\/p>\n<p>[4] Francois Brochet, Suraj Srinivasan, Michael Norris, \u201cNetflix: Valuing a New Business Model\u201d, HBS No. 9-113-018 (Boston: 性视界 Business School Publishing, 2017)<\/p>\n<p>[5]\u00a0Gina Keating (2012).\u00a0Netflixed: The Epic Battle for America&#8217;s Eyeballs. Portfolio\/ Penguin.<\/p>\n<p>[6] Travis Clark, \u201cNetflix reportedly had an internal debate after its testing favored &#8216;Grace and Frankie&#8217; promos without Jane Fonda.\u201d Business Insider, November 11, 2018, https:\/\/nordic.businessinsider.com\/netflix-tests-liked-grace-and-frankie-without-jane-fonda-wsj-2018-11, accessed November 2018<\/p>\n<p>[7] Shalini Ramachandran and Joe Flint, \u201cAt Netflix, Who Wins When It\u2019s Hollywood vs. the Algorithm?\u201d The Wall Street Journal, November 10, 2018, <a href=\"https:\/\/www.wsj.com\/articles\/at-netflix-who-wins-when-its-hollywood-vs-the-algorithm-1541826015\">https:\/\/www.wsj.com\/articles\/at-netflix-who-wins-when-its-hollywood-vs-the-algorithm-1541826015<\/a>, accessed November 2018<\/p>\n<p>[8] Mike Yeomans (2015) \u2018What Every Manager Should Know About Machine Learning\u2019, 性视界 Business Review Digital Articles, pp. 2\u20136. Available at: http:\/\/ezp-prod1.hul.harvard.edu\/login?url=http:\/\/search.ebscohost.com\/login.aspx?direct=true&amp;db=bth&amp;AN=118667151&amp;site=ehost-live&amp;scope=site (Accessed: 12 November 2018).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Netflix has been relying on its state-of-the-art movies recommendation engine to propel it to various new heights. Should it keep utmost faith on the engine that took the company to where it is today or is this the time to hit the break and bring back human judgement?<\/p>\n","protected":false},"author":11576,"featured_media":29604,"comment_status":"open","ping_status":"closed","template":"","categories":[346,143,2373,4367,3673],"class_list":["post-29559","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-machine-learning","category-netflix","category-process-improvement","category-recommendation-engine","category-streaming-movies","hck-taxonomy-organization-netflix","hck-taxonomy-industry-media-and-broadcasting","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process? - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process? - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"Netflix has been relying on its state-of-the-art movies recommendation engine to propel it to various new heights. Should it keep utmost faith on the engine that took the company to where it is today or is this the time to hit the break and bring back human judgement?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"article:modified_time\" content=\"2018-11-13T01:26:44+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/GRACE-AND-FRANKIE-key-art2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"435\" \/>\n\t<meta property=\"og:image:height\" content=\"245\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/\",\"name\":\"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process? - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/GRACE-AND-FRANKIE-key-art2.jpg\",\"datePublished\":\"2018-11-13T01:25:20+00:00\",\"dateModified\":\"2018-11-13T01:26:44+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/GRACE-AND-FRANKIE-key-art2.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/GRACE-AND-FRANKIE-key-art2.jpg\",\"width\":435,\"height\":245},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process? - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/","og_locale":"en_US","og_type":"article","og_title":"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process? - Technology and Operations Management","og_description":"Netflix has been relying on its state-of-the-art movies recommendation engine to propel it to various new heights. Should it keep utmost faith on the engine that took the company to where it is today or is this the time to hit the break and bring back human judgement?","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/","og_site_name":"Technology and Operations Management","article_modified_time":"2018-11-13T01:26:44+00:00","og_image":[{"width":435,"height":245,"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/GRACE-AND-FRANKIE-key-art2.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/","name":"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process? - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/GRACE-AND-FRANKIE-key-art2.jpg","datePublished":"2018-11-13T01:25:20+00:00","dateModified":"2018-11-13T01:26:44+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/GRACE-AND-FRANKIE-key-art2.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/GRACE-AND-FRANKIE-key-art2.jpg","width":435,"height":245},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/netflix-machine-learning-to-what-extent-should-machine-learning-influence-a-strategic-decision-making-process\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Netflix &amp; Machine Learning: To what extent should Machine Learning influence a strategic decision-making process?"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/29559","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11576"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=29559"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/29559\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/29604"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=29559"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=29559"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}