  {"id":36336,"date":"2018-11-13T19:57:16","date_gmt":"2018-11-14T00:57:16","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/"},"modified":"2018-11-13T19:58:27","modified_gmt":"2018-11-14T00:58:27","slug":"risk-management-on-the-path-to-the-machine-learning-prize-at-workday","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/","title":{"rendered":"Risk management on the path to the machine learning prize at Workday"},"content":{"rendered":"<p>According to Synergy Research Group, \u201cspending on SaaS [software as a service] remains relatively small compared to on-premise software, meaning that SaaS growth will remain buoyant for many years.\u201d [1] With this shift, Workday, Inc., which specializes in SaaS systems for human resources and financial management, will continue to accumulate large amounts of customer data on its platform. The rapid introduction of machine learning (ML) techniques, though, presents both large opportunities and significant risks for Workday that must be actively managed as Workday develops its future product roadmap.<\/p>\n<p>&nbsp;<\/p>\n<p>First, the opportunity: Workday is poised to leverage ML to provide value to customers in new ways because of the company\u2019s position as a cloud SaaS provider \u2013 it can train and test algorithms using data from its full customer base, a substantially larger dataset than a single on-site standalone customer. Workday, therefore, has the opportunity to build and offer ML-based products to its customers as add-ons to its human capital management (HCM) and finance platforms at a time when companies are looking to \u201ctap into the technologies they need right away, and pay only for what they use,\u201d according to a Deloitte study. [2] These product offerings would help customers predict root causes of key people issues like employee retention, talent management, and diversity, and make more accurate financial forecasts. [3]<\/p>\n<p>&nbsp;<\/p>\n<p>However, the development of these products does present substantial risk for Workday, especially given their strong position in human capital-focused products. \u201cWith the spread of artificial intelligence to employment functions such as recruitment\u2026 bad inputs can mean biased outputs,\u201d according to Wendy Hall, who led a review into artificial intelligence on behalf of the UK government. [4] Beyond bias, though, Workday will have to grapple with other challenges unique to ML. On the April 2018 earnings call, CEO Aneel Shusri pointed to customer data quality, stating that \u201cmany customers have plans to use [ML] in the next 12 to 18 months, once they get their data\u2026 in order. And a big part of that is getting clean data going forward.\u201d [5] Given the importance of data quality to algorithmic predictions, Shusri\u2019s comments suggest immediate adoption would risk output accuracy. Data \u201cbreadth\u201d is also important for Workday to consider as it develops ML products. \u201cThese methods are great at determining how certain features of the data are related to the outcomes you are interested in. What these methods cannot do is access any knowledge outside of the data you provide,\u201d according to Anastassia Fedyk. [6] Given Workday\u2019s relatively narrow position as primarily an HCM provider, failure to properly scope ML algorithms could drive extraneous results in a real-world customer application.<\/p>\n<p>&nbsp;<\/p>\n<p>Recent announcements by Workday indicate that management is beginning to execute on a strategy to integrate ML into the company\u2019s core product. The company recently announced Workday People Analytics, which the company states will incorporate ML to drive pattern recognition in organizations and underlie an \u201caugmented analytics\u201d interface. Workday\u2019s Prism Analytics product aims to be a \u201chub\u201d for finance and HR data, both from inside and outside the organization (the latter through application programming interfaces with other cloud services), which helps solve for some of the data \u201cbreadth\u201d concern related to deploying ML on a focused platform. Over time, Workday is aiming to deploy similar ML applications to augment decision making outside of the HCM product line. [7] Acquisitions this year like SkipFlag [8] and RallyTeam [9] have bolstered the engineering team and IP portfolio for a broader expansion into these ML applications.<\/p>\n<p>&nbsp;<\/p>\n<p>For Workday management to successfully lead the way as a ML innovator among focused SaaS companies, management should also think about how to maximize customer transparency into the outputs of the algorithms that they deploy. While unsupervised deployment of complex algorithms would increase rollout speed and lower cost, they could have \u201climited visibility and [increased] risk of the \u2018machine running wild.\u2019\u201d [10] Management should roll out these algorithms with a few key customers and maintain a tight interface between Workday data scientists and the customer team using the algorithms to inform decisions. Management should also leverage ML techniques on their platform to proactively flag and clean data on behalf of customers. Further, I would caution Workday against positioning their machine learning products as a definitive source of truth (e.g. \u201cWorkday People Analytics tells you what you need to know\u201d [11]), and instead suggestion positioning them as a best in class tools to augment decision making.<\/p>\n<p>&nbsp;<\/p>\n<p>But while Workday can take steps to prevent its ML products from being deployed appropriately in companies, it is ultimately up to their customers to either work with Workday to understand their algorithmic products, or use the \u201cblack box\u201d appropriately (read: without blind faith). What further steps can Workday take in product development to ensure that their algorithms are used to their capability?<\/p>\n<p>&nbsp;<\/p>\n<p>(799 words)<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Endnotes<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p>1 Synergy Research Group. \u201cMicrosoft Leads in SaaS Market; Salesforce, Adobe, Oracle and SAP Follow.\u201d\u00a0 \u00a0 \u00a0 \u00a0 https:\/\/www.srgresearch.com\/articles\/microsoft-leads-saas- market-salesforce-adobe-oracle-and-sap-follow, accessed November 2018.<\/p>\n<p>2 Deloitte.Insights. \u201cState of AI in the Enterprise, 2nd Edition.\u201d https:\/\/www2.deloitte.com\/insights\/us\/en\/focus\/cognitive-technologies\/state-of-ai-and-intelligent-automation-in-business-survey.html, accessed November 2018.<\/p>\n<p>3 Schlampp, Pete. \u201cAnnouncing Workday People Analytics: Leveraging the Strength of \u00a0 AI, Machine Learning, and Augmented Analytics.\u201d Forbes.com, October 18, 2018. https:\/\/www.forbes.com\/sites\/workday\/2018\/10\/18\/announcing-workday-people-analytics-leveraging-the-strength-of-ai-machine-learning-and-augmented- analytics\/#3373c2a977dd, accessed November 2018.<\/p>\n<p>4 Ram, Aliya. \u201cAI risks replicating tech\u2019s ethnic minority bias across business.\u201d FT.com, May 30, 2018. https:\/\/www.ft.com\/content\/d61e8ff2-48a1-11e8-8c77-ff51caedcde6, accessed November 2018.<\/p>\n<p>5 The Motley Fool. \u201cWorkday, Inc. (WDAY) Q1 2019 Earnings Conference Call Transcript\u201d https:\/\/www.fool.com\/earnings\/call-transcripts\/2018\/05\/31\/workday-inc-wday-q1-2019-earnings-conference-call.aspx, accessed November 2018.<\/p>\n<p>6 Fedyk, Anastassia. \u201cHow to Tell If Machine Learning Can Solve Your Business Problem.\u201d <em>性视界 Business Review Digital Articles<\/em>, November 15, 2016. ABI\/INFORM via ProQuest, accessed October 2018.<\/p>\n<p>7 Schlampp, Pete. Workday. \u201cAnnouncing Workday People Analytics: Leveraging the \u00a0\u00a0\u00a0 Strength of AI, Machine Learning, and Augmented Analytics.\u201d https:\/\/blogs.workday.com\/announcing-workday-people-analytics-leveraging-the- strength-of-ai-machine-learning-and-augmented-analytics\/, accessed November 2018.<\/p>\n<p>8 Gagliordi, Natalie. \u201cWorkday buys SkipFlag to bolster machine learning capabilities.\u201d \u00a0 ZDNet.com, Jan 16, 2018. https:\/\/www.zdnet.com\/article\/workday-buys-skipflag-to-bolster-machine-learning-capabilities\/, accessed November 2018.<\/p>\n<p>9\u00a0 Miller, Ron. \u201cWorkday acquires Rallyteam to fuel machine learning efforts.&#8221; Techcrunch.com, Jun 6, 2018. https:\/\/techcrunch.com\/2018\/06\/08\/workday-acquires-rallyteam-to-fuel-machine-learning-efforts\/, accessed November 2018.<\/p>\n<p>10 Fedyk, Anastassia. \u201cThe Risk of Machine-Learning Bias (and How to Prevent It).\u201d\u00a0<em>MIT Sloan Management Review Digital Articles<\/em>, March 26, 2018, https:\/\/sloanreview.mit.edu\/article\/the-risk-of-machine-learning-bias-and-how-to-prevent-it\/, accessed November 2018.<\/p>\n<p>11 Schlampp, Pete. Workday. \u201cAnnouncing Workday People Analytics: Leveraging the \u00a0 Strength of AI, Machine Learning, and Augmented Analytics.\u201d https:\/\/blogs.workday.com\/announcing-workday-people-analytics-leveraging-the- strength-of-ai-machine-learning-and-augmented-analytics\/, accessed November 2018.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>While machine learning creates a large opportunity for cloud software-as-a-service provider Workday to build solutions beyond their core enterprise human capital management and financial forecasting software, the prospect of designing and implementing complex algorithms presents significant risks that must be managed before an unsupervised implementation. This paper digs into the opportunity and risk mitigation tactics that Workday management should take over the next 3-5 years as they launch and scale these products.<\/p>\n","protected":false},"author":11317,"featured_media":36503,"comment_status":"open","ping_status":"closed","template":"","categories":[4627,258,346],"class_list":["post-36336","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-artificial-intellgience","category-enterprise-technology","category-machine-learning","hck-taxonomy-organization-workday","hck-taxonomy-industry-technology","hck-taxonomy-country-united-states"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-rctom\/assignment\/rc-tom-challenge-2018\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Risk management on the path to the machine learning prize at Workday - Technology and Operations Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Risk management on the path to the machine learning prize at Workday - Technology and Operations Management\" \/>\n<meta property=\"og:description\" content=\"While machine learning creates a large opportunity for cloud software-as-a-service provider Workday to build solutions beyond their core enterprise human capital management and financial forecasting software, the prospect of designing and implementing complex algorithms presents significant risks that must be managed before an unsupervised implementation. This paper digs into the opportunity and risk mitigation tactics that Workday management should take over the next 3-5 years as they launch and scale these products.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/\" \/>\n<meta property=\"og:site_name\" content=\"Technology and Operations Management\" \/>\n<meta property=\"article:modified_time\" content=\"2018-11-14T00:58:27+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Screen-Shot-2018-11-13-at-7.58.11-PM.png\" \/>\n\t<meta property=\"og:image:width\" content=\"296\" \/>\n\t<meta property=\"og:image:height\" content=\"238\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/\",\"name\":\"Risk management on the path to the machine learning prize at Workday - Technology and Operations Management\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Screen-Shot-2018-11-13-at-7.58.11-PM.png\",\"datePublished\":\"2018-11-14T00:57:16+00:00\",\"dateModified\":\"2018-11-14T00:58:27+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Screen-Shot-2018-11-13-at-7.58.11-PM.png\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2018\\\/11\\\/Screen-Shot-2018-11-13-at-7.58.11-PM.png\",\"width\":296,\"height\":238},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Risk management on the path to the machine learning prize at Workday\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/\",\"name\":\"Technology and Operations Management\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-rctom\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Risk management on the path to the machine learning prize at Workday - Technology and Operations Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/","og_locale":"en_US","og_type":"article","og_title":"Risk management on the path to the machine learning prize at Workday - Technology and Operations Management","og_description":"While machine learning creates a large opportunity for cloud software-as-a-service provider Workday to build solutions beyond their core enterprise human capital management and financial forecasting software, the prospect of designing and implementing complex algorithms presents significant risks that must be managed before an unsupervised implementation. This paper digs into the opportunity and risk mitigation tactics that Workday management should take over the next 3-5 years as they launch and scale these products.","og_url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/","og_site_name":"Technology and Operations Management","article_modified_time":"2018-11-14T00:58:27+00:00","og_image":[{"width":296,"height":238,"url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Screen-Shot-2018-11-13-at-7.58.11-PM.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/","url":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/","name":"Risk management on the path to the machine learning prize at Workday - Technology and Operations Management","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Screen-Shot-2018-11-13-at-7.58.11-PM.png","datePublished":"2018-11-14T00:57:16+00:00","dateModified":"2018-11-14T00:58:27+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Screen-Shot-2018-11-13-at-7.58.11-PM.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-content\/uploads\/sites\/4\/2018\/11\/Screen-Shot-2018-11-13-at-7.58.11-PM.png","width":296,"height":238},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/risk-management-on-the-path-to-the-machine-learning-prize-at-workday\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-rctom\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-rctom\/submission\/"},{"@type":"ListItem","position":3,"name":"Risk management on the path to the machine learning prize at Workday"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-rctom\/#website","url":"https:\/\/d3.harvard.edu\/platform-rctom\/","name":"Technology and Operations Management","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-rctom\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/36336","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/users\/11317"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/comments?post=36336"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/hck-submission\/36336\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media\/36503"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/media?parent=36336"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-rctom\/wp-json\/wp\/v2\/categories?post=36336"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}