{"id":33877,"date":"2018-11-13T17:23:40","date_gmt":"2018-11-13T22:23:40","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/"},"modified":"2018-11-13T17:23:40","modified_gmt":"2018-11-13T22:23:40","slug":"machine-learning-in-the-video-game-industry","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/","title":{"rendered":"Machine Learning in the Video Game Industry"},"content":{"rendered":"

The video game market has grown rapidly in the decade and is now estimated to reach $143.5 billion dollars by 2020.[1]<\/sup><\/a> The innovative nature of the industry has driven great advancements in software development, such as ultra-realistic 3D visualizations and physics modeling. But this dynamic industry has not seen much incorporation of modern machine learning and artificial intelligence applications into game development.<\/p>\n

Industry leaders like Activision Blizzard (ATVI) are currently using machine learning and data mining on their business intelligence teams. Their goal is to better understand their player base to drive player engagement, which is increasingly key to a game\u2019s success. Increased player engagement leads to more in-game purchases, brand loyalty, and product evangelism.<\/p>\n

Blizzard has also joined several other game studios in making games and APIs available to notable AI research companies like Google\u2019s DeepMind and Elon Musk\u2019s OpenAI to help them advance the technology.[2]<\/sup><\/a> Games such as Blizzard\u2019s popular real-time strategy game, StarCraft II, are excellent training grounds for AI and machine learning research. Although researchers have seen success in developing AIs to defeat human players in well-known games like chess and Go, the enormous complexity of these competitive video games provide the next logical challenge. Yet, although the gaming industry is driving machine learning advancements in general, game companies still seem slow to apply the technology to their own game development.<\/p>\n

This year, Activision rolled out \u201cCall of Duty: WWII Skill\u201d through a partnership with Amazon\u2019s Alexa.[3]<\/sup><\/a> In it, machine learning algorithms compare the way a player plays the game to that of all other players through cluster analysis, taking into account more and less successful playstyles and strategies. It then uses the Amazon Alexa speaker to deliver live coaching feedback and advice to that player while they play the game, making recommendations to hopefully improve success. Although the program is out of beta, there doesn\u2019t seem to be much consensus on the effectiveness or usefulness of the technology. It is also a free application and Activision has said they currently have no plans to monetize it through an upfront fee or in-app purchases. Call of Duty: WWII Skill seems to be more of a proof of concept for the company, but it will hopefully lead to other new ideas .<\/p>\n

The obvious evolution of machine learning in gaming is the application of machine learning techniques in the actual game development. One potential use being the creation of smarter, more realistic, and more responsive characters in game, that are able to learn from the actions of players and then react to and counter player tactics and strategies as well as develop the ability to deliver unscripted comments and responses when they observe player in-game actions.<\/p>\n

Additionally, monetization models in gaming have been steadily shifting to lower upfront pricing (all the way down to free to play) balanced with increased in-game purchases and microtransactions which provide revenue over time. However, this model of course requires both long term player engagement and desirable in-game purchases. Machine learning can assist in the design of these products and in deciding when and how to present them to the player.[4]<\/sup><\/a><\/p>\n

Another potential application for machine learning is in game community moderation. Gaming has struggle with cyberbullying and toxicity in in-game chat and player interaction for years. As gaming has become more mainstream and these unhealthy virtual interactions begin to have significant wider social implications, pressure to address this problem has increased. One recent study used machine learning to aid in data collection of cyberbullying activity from in-game chat logs.[5]<\/sup><\/a> The machine learning algorithm was a sentiment text analysis service that attempted to identify and classify negative behavior in a popular online game. Although their implementation was somewhat ineffective and the researchers ultimately relied more on simple feature detection for bad language and racism, the idea is an interesting one. Creating a healthier, more inviting game environment for online players to dive into is almost certain to improve player engagement.<\/p>\n

There remain a number of unanswered questions regarding the potential applications of machine learning in the gaming industry. First, improved adversary AI will likely lead to greater difficulty in games. Although this may be appealing to some players, others may find this to be more frustrating. A sense of individual improvement in a game increases player engagement, and playing against an unbeatable opponent may do just the opposite. Second, if machine learning models progress to the point that they are able to dynamically recognize player interests and desires and work with a \u201csmart\u201d game engine to procedurally generate and deliver that content, does this diminish the role of creatives in the game development process? These are just a couple of the secondary effects and factors to think about as this machine learning applications become more prevalent in the gaming industry. (798 words)<\/p>\n

[1]<\/sup><\/a> Takahashi, Dean. \u201cNewzoo: Game industry growing faster than expected, up 10\/7% to $116 billion 2017.\u201d Accessed at https:\/\/venturebeat.com\/2017\/11\/28\/newzoo-game-industry-growing-faster-than-expected-up-10-7-to-116-billion-2017\/.<\/p>\n

[2]<\/sup><\/a> Ewalds, Gaffney, and Vinyals. \u201cDeepMind and Blizzard open StarCraft II as an AI research environment.\u201d Accessed at https:\/\/deepmind.com\/blog\/deepmind-and-Blizzard-open-starcraft-ii-ai-research-environment\/.<\/p>\n

[3]<\/sup><\/a> Crecente, Brian. \u201cActivision Bets on AI Video Game Coaching to Drive Success.\u201d Accessed at https:\/\/variety.com\/2018\/gaming\/news\/ai-video-game-coach-alexa-1202764169\/.<\/p>\n

[4]<\/sup><\/a> Bertens, P., Guitart, A., Chen, P., & Peri\u00e1\u00f1ez, &. (2018). A Machine-Learning Item Recommendation System for Video Games.<\/p>\n

[5]<\/sup><\/a> Murnion, S., Buchanan, W., Smales, A., & Russell, G. (2018). Machine learning and semantic analysis of in-game chat for cyberbullying. Computers & Security, 76, 197.<\/p>\n","protected":false},"excerpt":{"rendered":"

The video game market has grown rapidly in the decade and is now estimated to reach $143.5 billion dollars by 2020.[1] The innovative nature of the industry has driven great advancements in software development, such as ultra-realistic 3D visualizations and […]<\/p>\n","protected":false},"author":11290,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[],"class_list":["post-33877","hck-submission","type-hck-submission","status-publish","hentry"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"\nMachine Learning in the Video Game Industry - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Machine Learning in the Video Game Industry - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"The video game market has grown rapidly in the decade and is now estimated to reach $143.5 billion dollars by 2020.[1] The innovative nature of the industry has driven great advancements in software development, such as ultra-realistic 3D visualizations and […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-the-video-game-industry\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-the-video-game-industry\\\/\",\"name\":\"Machine Learning in the Video Game Industry - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"datePublished\":\"2018-11-13T22:23:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-the-video-game-industry\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-the-video-game-industry\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/machine-learning-in-the-video-game-industry\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Machine Learning in the Video Game Industry\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Machine Learning in the Video Game Industry - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/","og_locale":"en_US","og_type":"article","og_title":"Machine Learning in the Video Game Industry - Technology and Operations Management","og_description":"The video game market has grown rapidly in the decade and is now estimated to reach $143.5 billion dollars by 2020.[1] The innovative nature of the industry has driven great advancements in software development, such as ultra-realistic 3D visualizations and […]","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/","og_site_name":"Technology and Operations Management","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/","name":"Machine Learning in the Video Game Industry - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"datePublished":"2018-11-13T22:23:40+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/machine-learning-in-the-video-game-industry\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Machine Learning in the Video Game Industry"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/33877","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11290"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=33877"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/33877\/revisions"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=33877"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=33877"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}