  {"id":4411,"date":"2017-03-19T17:09:50","date_gmt":"2017-03-19T21:09:50","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/"},"modified":"2017-03-19T17:09:50","modified_gmt":"2017-03-19T21:09:50","slug":"3-kaggles-krowd-woes","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/","title":{"rendered":"3: Kaggle&#8217;s Krowd Woes"},"content":{"rendered":"<p>Earlier this month, Google acquired Kaggle, a platform that hosts competitions to crowdsource machine learning solutions to company-submitted problems.\u00a0 Companies post a problem and an accompanying dataset to the Kaggle community of some 140,000+ members.<a href=\"#_ftn1\" name=\"_ftnref1\">[1]<\/a>\u00a0 The winner receives a prize, historically ranging from $3,000 to $3,000,000.<a href=\"#_ftn2\" name=\"_ftnref2\">[2]<\/a>\u00a0 For instance, Deloitte recently posted a $70,000 prize for the algorithm that best predicted which customers would leave an insurance company in the next 12 months.<a href=\"#_ftn3\" name=\"_ftnref3\">[3]<\/a><\/p>\n<p>The Kaggle community consists of both data science experts and less experienced users.\u00a0 In fact, it seems that anyone can create an account: I was able to sign up with my personal email and even had the option of entering a competition.\u00a0 That said, users are subjected to an incredibly raw level of transparency that self-police submission quality.\u00a0 Competition entrants are ranked on a public leaderboard with statistics on how their rank has changed over the last week, total entries to date, and score.\u00a0 Furthermore, companies can limit competitors to the top tier of Kagglers through a service called <em>Kaggle Connect<\/em>.<a href=\"#_ftn4\" name=\"_ftnref4\">[4]<\/a><\/p>\n<p>The community comes to Kaggle for more than just prize money, however.\u00a0 The platform includes a substantial learning component, <em>Kernels, <\/em>where users can download the latest libraries, learn cutting-edge techniques, engage in discussion, and give and receive feedback on others\u2019 work.<\/p>\n<p>Finally, Kaggle offers companies recruiting exposure via its jobs board.<\/p>\n<p>&nbsp;<\/p>\n<p><u>Value Creation and Capture<\/u><\/p>\n<p>Like many crowd-sourcing efforts, Kaggle creates value by allowing companies to affordably tap a long-tail of data science talent.\u00a0 <em>But the key value creation element here is the <strong>transparency<\/strong> it creates in data science outcomes, which drives both company postings and community engagement from actual experts<\/em>.\u00a0 The public manner in which leaderboards publish the efficacy of solutions and surface talent encourages user competition and engagement.\u00a0 This has created a certain brand equity around the Kaggle ranking.\u00a0 Not only do users take pride in their rank, but employers have begun asking for it in job posting responses.<a href=\"#_ftn5\" name=\"_ftnref5\">[5]<\/a>\u00a0 This transparency also <em>promotes innovation<\/em>, where users can easily identify winners and learn and continually hone the latest techniques.<\/p>\n<p>Kaggle <strong>captures value<\/strong> through fees from its competition and job postings.<\/p>\n<p>&nbsp;<\/p>\n<p><u>What went wrong<\/u><\/p>\n<p>In 2015, Kaggle faced earnings pressure, laying off 1\/3 of its workforce and shutting down a pivot attempt that provided consulting services to the energy industry.<a href=\"#_ftn6\" name=\"_ftnref6\">[6]<\/a>\u00a0 While the team blamed market cyclicality, additional elements were likely at play here \u2013 for both the consulting service and Kaggle overall:<\/p>\n<ul>\n<li>Kaggle competition solutions didn\u2019t drive adequate ROI.<a href=\"#_ftn7\" name=\"_ftnref7\">[7]<\/a><\/li>\n<li>Lack of a recurring need for Kaggle-sourced solutions \u2013 possibly evidence that internal talent is getting better and\/or new data science challenges aren\u2019t popping up as frequently as Kaggle needs to sustain its business. <a href=\"#_ftn8\" name=\"_ftnref8\">[8]<\/a><\/li>\n<li>Deep vertical or industry-level knowledge is needed to solve business problems adequately \u2013 something Kagglers may not possess. Palantir ran into a similar problem with this as well.<a href=\"#_ftn9\" name=\"_ftnref9\">[9]<\/a><\/li>\n<li>In-house data science competition puts Kaggle\u2019s business at odds with client success.<\/li>\n<li>Kaggle\u2019s community can still be tapped by other company recruiting channels.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><u>Alternative approach<\/u><\/p>\n<p>At the risk adding another minimally valuable post-mortem critique to the many out there, I would have considered the alternative of productizing a data science toolkit that data scientists could use to solve common analytical pain points learned on <em>Kernels<\/em>, such as a model or data quality health-grader, a data cleaner for frequently used datasets, or a best practices checklist.\u00a0 Kaggle has amassed tremendous knowledge from its community of co-innovators, and this transparency might have had substantial, recurring commercial potential.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"#_ftnref1\" name=\"_ftn1\">[1]<\/a> http:\/\/www.inc.com\/magazine201403\/darren-dahl\/big-data-crowdsourcing-kaggle.html<\/p>\n<p><a href=\"#_ftnref2\" name=\"_ftn2\">[2]<\/a> https:\/\/www.theatlantic.com\/technology\/archive\/2013\/04\/how-kaggle-is-changing-how-we-work\/274908\/<\/p>\n<p><a href=\"#_ftnref3\" name=\"_ftn3\">[3]<\/a> http:\/\/www.inc.com\/magazine201403\/darren-dahl\/big-data-crowdsourcing-kaggle.html<\/p>\n<p><a href=\"#_ftnref4\" name=\"_ftn4\">[4]<\/a> https:\/\/www.theatlantic.com\/technology\/archive\/2013\/04\/how-kaggle-is-changing-how-we-work\/274908\/<\/p>\n<p><a href=\"#_ftnref5\" name=\"_ftn5\">[5]<\/a> https:\/\/www.theatlantic.com\/technology\/archive\/2013\/04\/how-kaggle-is-changing-how-we-work\/274908\/<\/p>\n<p><a href=\"#_ftnref6\" name=\"_ftn6\">[6]<\/a> https:\/\/www.wired.com\/2015\/02\/data-science-darling-kaggle-cuts-one-third-staff\/<\/p>\n<p><a href=\"#_ftnref7\" name=\"_ftn7\">[7]<\/a> http:\/\/venturebeat.com\/2017\/03\/15\/what-the-kaggle-acquisition-by-google-means-for-crowdsourcing\/<\/p>\n<p><a href=\"#_ftnref8\" name=\"_ftn8\">[8]<\/a> http:\/\/venturebeat.com\/2017\/03\/15\/what-the-kaggle-acquisition-by-google-means-for-crowdsourcing\/<\/p>\n<p><a href=\"#_ftnref9\" name=\"_ftn9\">[9]<\/a> https:\/\/www.buzzfeed.com\/williamalden\/inside-palantir-silicon-valleys-most-secretive-company?utm_term=.xfM08En1a#.ov8BlRnbE<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Kaggle\u2019s recent acquisition by Google casts doubt on the viability of crowd-sourced expertise as a service.\u00a0 What went wrong?<\/p>\n","protected":false},"author":972,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[1265,1266],"class_list":["post-4411","hck-submission","type-hck-submission","status-publish","hentry","category-data-science","category-kaggle"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/managing-digital-crowds\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>3: Kaggle&#039;s Krowd Woes - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"3: Kaggle&#039;s Krowd Woes - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"Kaggle\u2019s recent acquisition by Google casts doubt on the viability of crowd-sourced expertise as a service.\u00a0 What went wrong?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/3-kaggles-krowd-woes\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/3-kaggles-krowd-woes\\\/\",\"name\":\"3: Kaggle's Krowd Woes - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"datePublished\":\"2017-03-19T21:09:50+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/3-kaggles-krowd-woes\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/3-kaggles-krowd-woes\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/3-kaggles-krowd-woes\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"3: Kaggle&#8217;s Krowd Woes\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"3: Kaggle's Krowd Woes - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/","og_locale":"en_US","og_type":"article","og_title":"3: Kaggle's Krowd Woes - Digital Innovation and Transformation","og_description":"Kaggle\u2019s recent acquisition by Google casts doubt on the viability of crowd-sourced expertise as a service.\u00a0 What went wrong?","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/","og_site_name":"Digital Innovation and Transformation","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/","name":"3: Kaggle's Krowd Woes - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"datePublished":"2017-03-19T21:09:50+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/3-kaggles-krowd-woes\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"3: Kaggle&#8217;s Krowd Woes"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/4411","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/972"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=4411"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/4411\/revisions"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=4411"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=4411"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}