{"id":4462,"date":"2017-03-20T01:23:59","date_gmt":"2017-03-20T05:23:59","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/"},"modified":"2017-03-20T01:40:47","modified_gmt":"2017-03-20T05:40:47","slug":"2-kaggle-building-deep-communities-for-deep-learning","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/","title":{"rendered":"[2] Kaggle: Building deep communities for deep learning"},"content":{"rendered":"

What is the common denominator of grading high school essays and improving the search for Higgs Boson at CERN? The answer is deep learning<\/em>! Being one of the most promising areas of research, deep learning has attracted several successful commercial players,\u00a0Kaggle<\/strong> being one of them.<\/p>\n

\"\"<\/a><\/p>\n

Founded in 2010 by Anthony Goldbloom and Ben Hamner, Kaggle is one of the leading platforms hosting data science competitions focused on deep learning solutions. The platform is a perfect case example to the democratization of innovation through crowdsourcing that multibillion dollar companies are leveraging today. While the company has several competitors like TopCoder and HackerRank, it has managed to stay ahead thanks to its focus on deep\u00a0learning. Since its inception, Kaggle turned from just being a competition platform to a \u201chub for applied machine learning research\u201d.<\/p>\n

How does Kaggle create and capture value?\u00a0<\/strong><\/p>\n

Kaggle\u2019s biggest asset is its community consisting of 880,000+ data science members spanning more than 200 countries. Kaggle creates value both for its community of data scientists and the companies\/organizations that host competitions on the website. As for the community, the primary value is created through monetary prizes offered in competitions, which range from as low as few hundred dollars to millions of dollars.<\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

\"\"<\/a>Besides immediate monetary benefits, Kaggle posts job opportunities for its community members. The platform has become an important resource for its job-seeking members who have landed jobs in companies such as Walmart and \u00a0DeepMind. The platform also offers\u00a0intrinsic motivations to its community such as the flexibility for participants to self-select, creativity and impact potential of competitions, which\u00a0are at least as important as the extrinsic monetary motivations.\u00a0Moreover,\u00a0Kaggle offers immense learning opportunities to its community members. Through Kaggle Scripts<\/em> (which were renamed to Kernels<\/em> in 2016), Kaggle encourages users to publicly share their code on the platform. Also in 2016, Kaggle released the Datasets<\/em> product, which made key datasets public on the platform.<\/p>\n

 <\/p>\n

As for the companies working with Kaggle, the solutions developed usually offer big advantages and cost savings. An example of a successful project was the development of computer-aided medicine, aiming to leverage deep learning to detect symptoms of vision loss due to diabetes. Around 80% of diabetes patients develop retinal damage that lead to vision loss, which is often preventable if detected early. California HealthCare Foundation (CHCF) used Kaggle participants to develop an algorithm that would accurately identify diabetes-related retinal damage 85% of the time for a cash prize of $100,000. Such a solution created big advantages for CHCF allowing for fast diagnosis as opposed to having to wait for laboratory results and obviating the need to have trained doctors.<\/p>\n

\"\"<\/a><\/p>\n

In terms of value capture, Kaggle earns money by charging companies for the algorithms developed in competitions. Companies are given access to algorithms for 6 months for a flat fee, after 6 months companies are charged a monthly license fee.<\/p>\n

Google acquisition and the path forward<\/strong><\/p>\n

While the crowdsourcing approach for deep learning innovations has worked well so far, the key challenge for Kaggle is to stay relevant in this low entry barrier-business. Except for its\u00a0large community, the company’s business model can easily be replicated and many companies are building in-house solutions to crowdsourcing. Internally, Kaggle is also faced with the challenge of keeping its community motivated and retaining high level of participation. Since\u00a0the size of monetary awards for contests does not depend on the number of submissions, it is crucial for Kaggle to attract participants by offering\u00a0problems that are both interesting and approachable (for example they shouldn\u2019t require supercomputers to solve problems!). Kaggle seems to be able to offer a wide range of problems that attract 3,500 competition submissions per day. On the other hand, the intelligence of trained models\u00a0in deep learning increases in proportion to the size of data and computation power. Therefore, users are likely to require more computing power which is most commonly provided by cloud computing products. Currently, Amazon Web Services (AWS) is the undisputed market leader in cloud computing.<\/p>\n

Just as the importance of cloud computing is increasing, an important turn of events happened to Kaggle recently. On\u00a0March 8th<\/sup>, 2017 Kaggle CEO Anthony Goldbloom has announced that Kaggle will join Google Cloud and is reported that the company will continue to “operate as a distinct brand”. While there is excitement around the unlocking of potential from the combination of Kaggle\u2019s large data science community with Google’s cloud business, there is also significant concern about losing the independence of the platform and losing the high level of participation. Building the ‘deep’ community was Kaggle’s differentiating play and\u00a0Google is rumored to have acquired the company in order to tap into its vast pool of talent. Therefore, it is crucial for Kaggle to sustain the rate of growth in its community participation, otherwise the company can quickly become obsolete.<\/p>\n

 <\/p>\n

[1] https:\/\/techcrunch.com\/2017\/03\/07\/google-is-acquiring-data-science-community-kaggle\/<\/p>\n

[2] https:\/\/techcrunch.com\/2017\/01\/12\/kaggle-hosting-1m-competition-to-improve-lung-cancer-detection-with-machine-learning\/<\/p>\n

[3] http:\/\/www.economist.com\/blogs\/babbage\/2011\/04\/incentive_prizes<\/p>\n

[4] http:\/\/www.economist.com\/news\/science-and-technology\/21664943-computers-can-recognise-complication-diabetes-can-lead-blindness-now<\/p>\n

[5] http:\/\/blog.kaggle.com\/2017\/03\/08\/kaggle-joins-google-cloud\/<\/p>\n

[6] https:\/\/en.wikipedia.org\/wiki\/Kaggle<\/p>\n

[7] http:\/\/blog.udacity.com\/2016\/07\/companies-kaggle-machine-learning-talent.html<\/p>\n

[8]\u00a0http:\/\/www.datamation.com\/cloud-computing\/slideshows\/top-10-cloud-computing-companies.html<\/p>\n

[9]\u00a0http:\/\/venturebeat.com\/2017\/03\/15\/what-the-kaggle-acquisition-by-google-means-for-crowdsourcing\/<\/p>\n

[10]\u00a0http:\/\/www.inc.com\/magazine201403\/darren-dahl\/big-data-crowdsourcing-kaggle.html<\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

Kaggle is a competition platform that leverages crowdsourcing to find solutions for deep learning problems. This blog summarizes how Kaggle managed to create value and its challenge to stay relevant<\/p>\n","protected":false},"author":868,"featured_media":4463,"comment_status":"open","ping_status":"closed","template":"","categories":[1299,673,1139,1266],"class_list":["post-4462","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-competition-platforms","category-crowdsourcing","category-deep-learning","category-kaggle"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/managing-digital-crowds\/","yoast_head":"\n[2] Kaggle: Building deep communities for deep learning - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"[2] Kaggle: Building deep communities for deep learning - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"Kaggle is a competition platform that leverages crowdsourcing to find solutions for deep learning problems. This blog summarizes how Kaggle managed to create value and its challenge to stay relevant\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"article:modified_time\" content=\"2017-03-20T05:40:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/03\/download-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"333\" \/>\n\t<meta property=\"og:image:height\" content=\"151\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/\",\"name\":\"[2] Kaggle: Building deep communities for deep learning - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/03\\\/download-1.png\",\"datePublished\":\"2017-03-20T05:23:59+00:00\",\"dateModified\":\"2017-03-20T05:40:47+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/03\\\/download-1.png\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/03\\\/download-1.png\",\"width\":333,\"height\":151},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/2-kaggle-building-deep-communities-for-deep-learning\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"[2] Kaggle: Building deep communities for deep learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"[2] Kaggle: Building deep communities for deep learning - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/","og_locale":"en_US","og_type":"article","og_title":"[2] Kaggle: Building deep communities for deep learning - Digital Innovation and Transformation","og_description":"Kaggle is a competition platform that leverages crowdsourcing to find solutions for deep learning problems. This blog summarizes how Kaggle managed to create value and its challenge to stay relevant","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/","og_site_name":"Digital Innovation and Transformation","article_modified_time":"2017-03-20T05:40:47+00:00","og_image":[{"width":333,"height":151,"url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/03\/download-1.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/","name":"[2] Kaggle: Building deep communities for deep learning - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/03\/download-1.png","datePublished":"2017-03-20T05:23:59+00:00","dateModified":"2017-03-20T05:40:47+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/03\/download-1.png","contentUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/03\/download-1.png","width":333,"height":151},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/2-kaggle-building-deep-communities-for-deep-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"[2] Kaggle: Building deep communities for deep learning"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/4462","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/868"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=4462"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/4462\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media\/4463"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=4462"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=4462"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}