{"id":5045,"date":"2017-04-05T19:29:52","date_gmt":"2017-04-05T23:29:52","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/"},"modified":"2017-04-05T19:29:52","modified_gmt":"2017-04-05T23:29:52","slug":"one-robot-to-rule-them-all","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/","title":{"rendered":"One Robot to Rule Them All"},"content":{"rendered":"

Imagine you founded a successful business…<\/strong><\/p>\n

Your product is\u00a0getting traction and even revenue. You’re also collecting tons of interesting data. In order to stay competitive you need to use that data – perhaps to predict user behavior, recommend content, customize the experience, or price more effectively. But that means you must hire\u00a0a data scientist. It is one of the most in-demand, and expensive skill sets on the market today. Even if you’re able to find a good one, you will end up paying him or her\u00a0more than $150,000 a year in salary alone [1<\/a>] And it is going to take a few months for that person to ramp up… In comes DataRobot.<\/p>\n

DataRobot<\/a> is a software company that attempts to automate the work done by data scientists. It promises to be better, faster, and cheaper.<\/p>\n

This sounds too good to be true…<\/strong><\/p>\n

\n

DataRobot uses brute force to ingest your datasets and algorithmically\u00a0output the best predictive model for it. The\u00a0platform evaluates 1000’s of models in open source libraries. It then “searches through millions of possible combinations of algorithms, pre-processing steps, features, transformations and tuning parameters to deliver the best models for your dataset and prediction target” [2<\/a>]. The process is computationally expensive, but far\u00a0more comprehensive, cheaper, and quicker than hiring a data scientist.<\/p>\n

DataRobot creates value by running state of the art analytics on your datasets. It captures it through charging a fee for\u00a0use of an\u00a0API that encapsulates the best possible predictive model for\u00a0that dataset. So now, with only one additional line of code, your software makes an\u00a0API call and adds a predictive analytics layer to your software. Its like magic!<\/p>\n

For a visual explanation\u00a0of how DataRobot works, see this video<\/a>.<\/p>\n

 <\/p>\n<\/div>\n

Who else is out there?<\/strong><\/p>\n

Today, DataRobot’s primary competition are data scientists. And good ones are hard to find, easy to lose, and expensive to retain. They do not pose a great threat to DataRobot. But other companies are attempting to build platforms that\u00a0are just like Data Robot, such as\u00a0Watson Analytics<\/a>, and\u00a0Loom Systems<\/a>. These is even, machineJS<\/a>, a push in the open source community to build this platform. These pose a more serious threat than humans. DataRobot’s “brute force” method – testing every open source predictive model on\u00a0a dataset and picking the best combination – is not particularly opaque. So it is likely that these competitors can easily catch up. What is more, this brute force method requires a lot of servers and computational power, which is expensive. And the bigger competitors, such as Amazon and Google, which have their own cloud infrastructures, can do this at less of a cost than DataRobot, which relies on AWS for the heavy lifting. However, DataRobot has one interesting advantage: data about its data. It can develop a broad understanding of what kinds\u00a0of algorithmic methods work best for any given datasets. Given\u00a0a certain data type, distribution, size, or shape, it can look to previous analysis it has conducted and reduce its compute time and costs. In order to stay competitive, DataRobot must optimize, and learn from, its own previous analysis attempts.<\/p>\n

So while today we see data scientists and software engineers building tools to successfully replace many high skilled jobs – we about to also see them automate their own work!<\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

Sources<\/p>\n

\n
    \n
  1. https:\/\/www.glassdoor.com\/Salaries\/data-scientist-salary-SRCH_KO0,14.htm<\/li>\n
  2. https:\/\/www.crunchbase.com\/organization\/datarobot<\/li>\n<\/ol>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Data scientists and software engineers have built tools to successfully replace many high skilled jobs. But are we about to automate the data scientists themselves? <\/p>\n","protected":false},"author":477,"featured_media":5047,"comment_status":"open","ping_status":"closed","template":"","categories":[162,131,654,872,1391,802],"class_list":["post-5045","hck-submission","type-hck-submission","status-publish","has-post-thumbnail","hentry","category-automation","category-boston","category-cloud-computing","category-data-scientist","category-parallel-processing","category-startup"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/data-and-analytics-as-digital-assets\/","yoast_head":"\nOne Robot to Rule Them All - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"One Robot to Rule Them All - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"Data scientists and software engineers have built tools to successfully replace many high skilled jobs. But are we about to automate the data scientists themselves?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/robot2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"254\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/\",\"name\":\"One Robot to Rule Them All - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/04\\\/robot2.jpg\",\"datePublished\":\"2017-04-05T23:29:52+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/#primaryimage\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/04\\\/robot2.jpg\",\"contentUrl\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2017\\\/04\\\/robot2.jpg\",\"width\":800,\"height\":254},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/one-robot-to-rule-them-all\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"One Robot to Rule Them All\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"One Robot to Rule Them All - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/","og_locale":"en_US","og_type":"article","og_title":"One Robot to Rule Them All - Digital Innovation and Transformation","og_description":"Data scientists and software engineers have built tools to successfully replace many high skilled jobs. But are we about to automate the data scientists themselves?","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/","og_site_name":"Digital Innovation and Transformation","og_image":[{"width":800,"height":254,"url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/robot2.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/","name":"One Robot to Rule Them All - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"primaryImageOfPage":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/#primaryimage"},"image":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/#primaryimage"},"thumbnailUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/robot2.jpg","datePublished":"2017-04-05T23:29:52+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/#primaryimage","url":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/robot2.jpg","contentUrl":"https:\/\/d3.harvard.edu\/platform-digit\/wp-content\/uploads\/sites\/2\/2017\/04\/robot2.jpg","width":800,"height":254},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/one-robot-to-rule-them-all\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"One Robot to Rule Them All"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/5045","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/477"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=5045"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/5045\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media\/5047"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=5045"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=5045"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}