{"id":29610,"date":"2018-11-12T21:03:46","date_gmt":"2018-11-13T02:03:46","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-cancer-imaging\/"},"modified":"2018-11-12T21:03:46","modified_gmt":"2018-11-13T02:03:46","slug":"from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/","title":{"rendered":"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer"},"content":{"rendered":"

The notion that the same underlying technology that currently helps you master the Boot Scootin\u2019 Boogie<\/em> line dance on Country Dance All Stars<\/em> for Xbox 360 could soon help your doctor develop your cancer treatment plan sounds absurd, but that\u2019s exactly what Microsoft is attempting to do with Project InnerEye [1].<\/p>\n

For over four decades, Microsoft has been at the forefront of consumer technological innovation and has launched a host of products that have dramatically transformed various aspects of human interaction. From MS-DOS and Windows altering how humans interact with machines; to Microsoft Office changing how people interact with their colleagues, clients, and customers; to Xbox Kinect transforming how gamers interact with their consoles and, by extension, their friends [2]. But the tech giant now has its sights set on disrupting yet another interaction: the delicate relationship between physicians and their patients. Microsoft\u2019s Project InnerEye is leveraging machine learning and computer vision technology to develop tools to aid radiation oncologists in identifying, targeting, and monitoring cancer in their patients. The question remains, however, whether the team will be able to successfully apply their deep expertise in AI research to the complex, slow-moving, and heavily regulated world of healthcare [3].<\/p>\n

Unlike the Kinect, which captures a gamer\u2019s movements by looking at the outside of their body, Project InnerEye is doing exactly what its name suggests: looking inside a patient\u2019s body. However, the software and hardware innovations that enable both pieces of technology are the same: (1) a supervised machine learning algorithm developed by Microsoft called Random Forest and (2) Field Programmable Gate Array (FPGA) supercomputers that enable both computational speed and programming flexibility and which are based upon Graphical Processing Units (GPUs) initially developed for gaming applications [4]. With Project InnerEye and other healthcare-focused programs that are currently being pursued under Microsoft\u2019s Healthcare NExT initiative, the company is trying to marry its history of technological prowess with recent advances in machine learning and cloud computing to compete in the deeply challenging but meaningful space of healthcare innovation [5].<\/p>\n

Project InnerEye\u2019s approach to machine learning is one that its researchers call \u201cAssisted AI,\u201d which focuses on developing tools that supplement rather than substitute the expertise of the human physicians that have traditionally been tasked with performing the work Project InnerEye is automating [6]. Without the assistance of machine learning, radiation oncologists are forced to spend hours per patient manually analyzing a set of diagnostic images slice by slice in order to identify and delineate cancerous vs. healthy tissue. Only after carefully performing this time-consuming and highly specialized task can he or she begin to develop the radiotherapy treatment plan. Project InnerEye promises to offload this particular task from the physician in order to enable him or her to focus on other equally critical but less tedious tasks. With InnerEye, a physician simply sends anonymous and encrypted scan images directly to the program, which is then able to complete the markup and develop a 3D model of the tissue in a matter of minutes [7]. To get to this point, the team at Project InnerEye trained its machine learning algorithm using scans from hundreds of patients that represented a wide range of hospital geographies, imaging modalities (e.g. MRI vs. CT vs. PET), and image resolution and then validated its accuracy by comparing the results to those of resident experts [8].<\/p>\n

Looking forward to the future, in addition to offloading tasks currently performed by physicians, the Project InnerEye technology could be used to alter the treatment paradigm for cancer patients. Whereas today imaging and markup is generally only performed once due to the time and expense involved, Project InnerEye could help usher in an era of \u201cadaptive radiotherapy\u201d in which these tasks are performed more regularly during a treatment series to actively monitor the tumor\u2019s progression and more precisely target the therapy [7]. Interestingly, Project InnerEye will likely face some challenges with adoption that other AI-enabled technology has not. Whereas AI and automation have already started to dramatically alter the workforce for many low-skilled jobs that managers have determined machines can perform more cost effectively than human labor (e.g. cashiers, call centers, etc\u2026), Project InnerEye\u2019s targeted end-users are the very same people whose work it intends to perform. This reality requires the team to carefully thread the needle of providing valuable automation without wholly replacing the role of the physician in the process, which requires close-knit and interactive relationships with the physician community to understand their needs and motivations.<\/p>\n

While Project InnerEye has shown impressive potential, many questions remain regarding its future adoption. Will physicians ever fully trust a machine to provide patient-critical health information? If the machine learning algorithm makes a mistake that results in a serious adverse event for a patient, who is to blame \u2013 Microsoft or the treating physician?<\/p>\n

 <\/p>\n

(Word Count: 798)<\/p>\n

 <\/p>\n

[1] Game Mill Entertainment, \u201cCountry Dance All Stars,\u201d http:\/\/game-mill.com\/games\/country-dance-all-stars\/<\/a>, accessed November 2018.<\/p>\n

[2] Malathi Nayak, \u201cTimeline: Microsoft\u2019s journey: four decades, three CEOs,\u201d Reuters Business News, February 4, 2014, https:\/\/www.reuters.com\/article\/us-microsoft-succession-timeline\/timeline-microsofts-journey-four-decades-three-ceos-idUSBREA131R720140204<\/a>, accessed November 2018.<\/p>\n

[3] Allison Linn, \u201cMicrosoft looks to healthcare partners for ways to bring AI benefits to cancer patients,\u201d The AI Blog<\/em>, Microsoft<\/em>, November 28, 2017, https:\/\/blogs.microsoft.com\/ai\/project-innereye-cancer-treatment\/<\/a>, accessed November 2018.<\/p>\n

[4] Gerald Lynch, \u201cFrom Kinect to InnerEye \u2013 How Microsoft is supercharging gaming tech with AI smarts to help diagnose cancer,\u201d Tech Radar, May 9, 2017, https:\/\/www.techradar.com\/news\/from-kinect-to-innereye-how-microsoft-is-supercharging-gaming-tech-with-ai-smarts-to-help-diagnose-cancer<\/a>, accessed November 2018.<\/p>\n

[5] Tom Warren, \u201cMicrosoft Healthcare is a new effort to push doctors to the cloud,\u201d The Verge, June 27, 2018, https:\/\/www.theverge.com\/2018\/6\/27\/17509096\/microsoft-healthcare-cloud-systems<\/a>, accessed November 2018.<\/p>\n

[6] Microsoft Research, \u201cFive-minute overview of the InnerEye research project ,\u201d YouTube, published September 22, 2016, https:\/\/www.youtube.com\/watch?v=9IXgVmLxVtQ<\/a>, accessed November 2018.<\/p>\n

[7] Ian Sample, \u201c\u2019It\u2019s going to create a revolution\u2019: how AI is transforming the NHS,\u201d The Guardian, July 4, 2018, https:\/\/www.theguardian.com\/technology\/2018\/jul\/04\/its-going-create-revolution-how-ai-transforming-nhs<\/a>, accessed November 2018.<\/p>\n

[8] Cynthia E. Keen, \u201cAI drives analysis of medical images,\u201d Healthcare-In-Europe.com, February 27, 2018, https:\/\/healthcare-in-europe.com\/en\/news\/ai-drives-analysis-of-medical-images.html<\/a>, accessed November 2018.<\/p>\n

[9] Ian Sample, \u201cJoseph Stiglitz on artificial intelligence: \u2018We\u2019re going towards a more divided society,\u2019\u201d The Guardian, September 28, 2018, https:\/\/www.theguardian.com\/technology\/2018\/sep\/08\/joseph-stiglitz-on-artificial-intelligence-were-going-towards-a-more-divided-society<\/a>, accessed November 2018.<\/p>\n","protected":false},"excerpt":{"rendered":"

Can machine learning help transform radiation therapy for cancer?<\/p>\n","protected":false},"author":11306,"featured_media":29611,"comment_status":"open","ping_status":"closed","template":"","categories":[1869,232,41,346,1520,4475,4476],"class_list":["post-29610","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-ai","category-cancer","category-healthcare","category-machine-learning","category-microsoft","category-mri","category-radiation","hck-taxonomy-organization-microsoft","hck-taxonomy-industry-health","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"\nFrom gaming to healthcare: Microsoft\u2019s approach to visualizing cancer - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"Can machine learning help transform radiation therapy for cancer?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/magnetic-resonance-image-mri-brain-450w-590081462.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"450\" \/>\n\t<meta property=\"og:image:height\" content=\"412\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/\",\"name\":\"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/magnetic-resonance-image-mri-brain-450w-590081462.jpg\",\"datePublished\":\"2018-11-13T02:03:46+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/magnetic-resonance-image-mri-brain-450w-590081462.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/magnetic-resonance-image-mri-brain-450w-590081462.jpg\",\"width\":450,\"height\":412},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/","og_locale":"en_US","og_type":"article","og_title":"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer - Technology and Operations Management","og_description":"Can machine learning help transform radiation therapy for cancer?","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/","og_site_name":"Technology and Operations Management","og_image":[{"width":450,"height":412,"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/magnetic-resonance-image-mri-brain-450w-590081462.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/","name":"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/magnetic-resonance-image-mri-brain-450w-590081462.jpg","datePublished":"2018-11-13T02:03:46+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/magnetic-resonance-image-mri-brain-450w-590081462.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/magnetic-resonance-image-mri-brain-450w-590081462.jpg","width":450,"height":412},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/from-gaming-to-healthcare-microsofts-approach-to-visualizing-cancer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"From gaming to healthcare: Microsoft\u2019s approach to visualizing cancer"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/29610","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11306"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=29610"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/29610\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/29611"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=29610"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=29610"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}