{"id":4252,"date":"2017-02-28T00:32:26","date_gmt":"2017-02-28T05:32:26","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/"},"modified":"2017-02-28T00:32:26","modified_gmt":"2017-02-28T05:32:26","slug":"most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/","title":{"rendered":"&#8220;Most of the smartest people work for somebody else&#8230;&#8221; Kaggle in the new world of data science"},"content":{"rendered":"<p><strong><em>\u201cNo matter who you are, most of the smartest people work for somebody else.\u201d -Bill Joy, co-founder of Sun Microsystems<\/em><\/strong><\/p>\n<p><span style=\"font-weight: 400\">Today software companies stay competitive through applying a layer of machine intelligence to their product offerings. Google\u2019s generalized AI platform, DeepMind, is seen as the primary pathway to future dominance. However, the data scientists and engineers that create, maintain, and improve these machine intelligence layers are notoriously hard to recruit and retain. Good talent is constantly being poached away. Moreover, the best breakthroughs in algorithmic approaches, the ones that yield significant jumps in accuracy, are often developed by outsiders who thinking orthogonally to the existing teams and their approaches. As we saw in the IMB TOM case last year, the Watson team made its most significant progress when external developers and engineers were invited to create independent and even competing algorithms.<\/span><\/p>\n<p>In 2010, Kaggle capitalized on this trend by launching a platform that hosted predictive modeling and analytics competitions. On one side of the platform are teams of data scientists. On the other side are corporations offering data modeling competitions with prizes in worth millions of dollars.<\/p>\n<p><span style=\"font-weight: 400\">Kaggle creates value through: <\/span><\/p>\n<ul>\n<li><span style=\"font-weight: 400\">Providing data scientists a single destination to search, filter, and find competitions<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Providing corporations a platform on which to run competition leaderboards, host competition datasets, accept code submissions, and automatically score submissions<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Hosting and curating public datasets<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Rating and curating data science teams<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Distributing analytics content, best practices, and analytics innovations through its blog and discussion forum.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Kaggle captures value through:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Job postings<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Hosting private competitions where only select groups of data science teams can participate<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Directly matching data scientist teams to corporations with analytics needs<\/span><\/li>\n<\/ul>\n<p>Traditionally, the market of data science was one with low multihoming. Data scientists worked for individual corporations solving a narrow set of problems using a relatively static set of datapoints. Work was rarely shared outside of the academic community. The network effects were also quite low as the human capital management issues and salary costs of bloated data scientist teams tended to create sub-optimal performance.<\/p>\n<p><span style=\"font-weight: 400\">Kaggle creates a situation of high multihoming where independent teams of data scientists can work on many different problems, spanning unique sectors, and a variety of analytics techniques and datasets. The network effects are also immense. The live leaderboard and Scripts, Kaggle\u2019s proprietary tool to share code, encourages all participants to learn and innovate against the current best practice. Kaggle also maintains a blog to publish the prize-winning techniques so they can be applied elsewhere. <\/span><\/p>\n<p><span style=\"font-weight: 400\">The work here is all the more valuable as much of the innovation has moved from the open academic community to walled-up private corporations. Uber <a href=\"https:\/\/www.wsj.com\/articles\/is-uber-a-friend-or-foe-of-carnegie-mellon-in-robotics-1433084582\">poached<\/a> much of Carnaige Melon\u2019s robotics research group<\/span><span style=\"font-weight: 400\">, Stanford\u2019s most celebrated artificial intelligence professor, Andrew Ng, <a href=\"http:\/\/venturebeat.com\/2014\/07\/30\/andrew-ng-baidu\/\">left<\/a> to be Cheif Data Scientist of Baidu, and Facebook <a href=\"https:\/\/www.wired.com\/2013\/12\/facebook-yann-lecun-qa\/\">hired<\/a> away NYU\u2019s Yann LeCunn. Without Kaggle\u2019s platform data science could revert back to a data science world of low-multihoming and low network effects. As Bill Joy accurately identified, in this world companies are constantly left with the second best talent working on their most important technique problems.\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Kaggle&#8217;s online data science platform is every software company&#8217;s critical new tool<\/p>\n","protected":false},"author":477,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[655,1265,1266,241],"class_list":["post-4252","hck-submission","type-hck-submission","status-publish","hentry","category-data","category-data-science","category-kaggle","category-platforms"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/growing-businesses-in-the-age-of-platforms\/","yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>&quot;Most of the smartest people work for somebody else...&quot; Kaggle in the new world of data science - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"&quot;Most of the smartest people work for somebody else...&quot; Kaggle in the new world of data science - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"Kaggle&#039;s online data science platform is every software company&#039;s critical new tool\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\\\/\",\"name\":\"\\\"Most of the smartest people work for somebody else...\\\" Kaggle in the new world of data science - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"datePublished\":\"2017-02-28T05:32:26+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"&#8220;Most of the smartest people work for somebody else&#8230;&#8221; Kaggle in the new world of data science\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\"Most of the smartest people work for somebody else...\" Kaggle in the new world of data science - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/","og_locale":"en_US","og_type":"article","og_title":"\"Most of the smartest people work for somebody else...\" Kaggle in the new world of data science - Digital Innovation and Transformation","og_description":"Kaggle's online data science platform is every software company's critical new tool","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/","og_site_name":"Digital Innovation and Transformation","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/","name":"\"Most of the smartest people work for somebody else...\" Kaggle in the new world of data science - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"datePublished":"2017-02-28T05:32:26+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/most-of-the-smartest-people-work-for-somebody-else-kaggle-in-the-new-world-of-data-science\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"&#8220;Most of the smartest people work for somebody else&#8230;&#8221; Kaggle in the new world of data science"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/4252","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/477"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=4252"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/4252\/revisions"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=4252"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=4252"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}