{"id":2633,"date":"2015-11-22T19:41:14","date_gmt":"2015-11-23T00:41:14","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/"},"modified":"2015-11-22T19:47:24","modified_gmt":"2015-11-23T00:47:24","slug":"nailed-it-youtubes-deep-learning-automatic-thumbnail-generator","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/","title":{"rendered":"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator"},"content":{"rendered":"

They say you shouldn\u2019t judge a book by its cover, but we all do : vibrant\u00a0colors, bold graphics, and eye-catching text draws us in. Many of YouTube\u2019s top content creators and video uploaders spend hours perfecting their thumbnails, because thumbnails\u00a0are often the first things viewers see while looking for something interesting to watch. Displaying thumbnails that accurately and appealingly represent content is a great marketing tool to draw viewers in. In contrast, if\u00a0thumbnails do not accurately reflect the content the videos\u00a0represent, they can leave the users disappointed and annoyed, leading to poor\u00a0performance on metrics such as watch time and back-button clicks. This in turn causes the videos to\u00a0become less prominent on YouTube, resulting in lower clicks, views, follow-on clicks, and ad revenue.\u00a0Better thumbnails, therefore, create value for all the parties involved with the YouTube platform: the users, the content providers, and the advertisers, and help Google capture a part of this created value by charging advertisers a revenue share.<\/p>\n

YouTube employs “Deep Learning” techniques to solve this problem of automatically and intelligently generating the “right” thumbnail for its videos. Often coined machine learning or neural networking, Deep Learning involves \u201ctraining\u201d a computational model so it can decipher natural language. The model relates terms and words to infer meaning once it is fed information. It\u2019s then quizzed on this information and \u201clearns\u201d from the experience – like a child learning to communicate.<\/p>\n

Inspired by the\u00a0remarkable advances of\u00a0deep neural networks\u00a0(DNNs) in computer vision (such as\u00a0image\u00a0and\u00a0video\u00a0classification), YouTube recently launched an automatic thumbnail generator to help creators showcase their video content. Here is how it works:\u00a0While a video is being uploaded, YouTube first samples frames from the video at one frame per second. Each sampled frame is then run by a quality model\u00a0and assigned a quality score. The frames with the highest scores are selected, enhanced and rendered as thumbnails with different sizes and aspect ratios.<\/p>\n

Now, judging the “quality” of a video frame can be very subjective – people often have very different opinions and preferences when selecting frames as video thumbnails. To overcome this challenge, YouTube\u00a0collected a large set of well-annotated training examples to feed into their neural network. Fortunately, on YouTube, in addition to having algorithmically generated thumbnails, many YouTube videos also come with carefully designed custom thumbnails uploaded by creators. Those thumbnails typically follow the recommended practices when it comes to choosing a thumbnail: they are well framed, in-focus, and center on a specific subject (e.g. the main character in the video). To train the DNN model,\u00a0YouTube’s developers fed it\u00a0custom thumbnails from popular videos as positive (high-quality) examples, and randomly screen captures\u00a0as negative (low-quality) examples.\u00a0Compared to the previous automatically generated thumbnails, the DNN-powered model is able to select frames with much better quality. YouTube reports that, in a human evaluation, the thumbnails produced by the new model are preferred to those from the previous thumbnail in more than 65% of side-by-side ratings.<\/p>\n

Youtube’s DNN powered thumbnail generator is a great example of a company employing advanced machine learning and data analytics techniques to make computers scalably perform tasks that could traditionally only be performed best by human beings. Deep learning is an interesting space to watch, and applications can vary from generating better YouTube thumbnails, to better accent recognition and sentiment analysis, and improved drug discovery and toxicology.<\/p>\n

Sources:<\/p>\n

https:\/\/creatoracademy.withgoogle.com\/page\/lesson\/tell-a-story-through-your-thumbnail-title-description?hl=en<\/a><\/p>\n

http:\/\/googleresearch.blogspot.com\/2015\/10\/improving-youtube-video-thumbnails-with.html<\/a><\/p>\n

https:\/\/en.wikipedia.org\/wiki\/Deep_learning#Applications<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

They say you shouldn\u2019t judge a book by its cover, but we all do : vibrant\u00a0colors, bold graphics, and eye-catching text draws us in. Many of YouTube\u2019s top content creators and video uploaders spend hours perfecting their thumbnails, because thumbnails\u00a0are […]<\/p>\n","protected":false},"author":169,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","categories":[],"class_list":["post-2633","hck-submission","type-hck-submission","status-publish","hentry"],"connected_submission_link":"https:\/\/d3.harvard.edu\/platform-digit\/assignment\/data-driven-value-creation-value-capture-and-operating-models\/","yoast_head":"\nNailed it: YouTube\u2019s deep learning automatic thumbnail generator - Digital Innovation and Transformation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator - Digital Innovation and Transformation\" \/>\n<meta property=\"og:description\" content=\"They say you shouldn\u2019t judge a book by its cover, but we all do : vibrant\u00a0colors, bold graphics, and eye-catching text draws us in. Many of YouTube\u2019s top content creators and video uploaders spend hours perfecting their thumbnails, because thumbnails\u00a0are […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/\" \/>\n<meta property=\"og:site_name\" content=\"Digital Innovation and Transformation\" \/>\n<meta property=\"article:modified_time\" content=\"2015-11-23T00:47:24+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\\\/\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\\\/\",\"name\":\"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator - Digital Innovation and Transformation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\"},\"datePublished\":\"2015-11-23T00:41:14+00:00\",\"dateModified\":\"2015-11-23T00:47:24+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Submissions\",\"item\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/submission\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/#website\",\"url\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/\",\"name\":\"Digital Innovation and Transformation\",\"description\":\"MBA Student Perspectives\",\"potentialAction\":[{\"@type\":\"性视界Action\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/d3.harvard.edu\\\/platform-digit\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator - Digital Innovation and Transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/","og_locale":"en_US","og_type":"article","og_title":"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator - Digital Innovation and Transformation","og_description":"They say you shouldn\u2019t judge a book by its cover, but we all do : vibrant\u00a0colors, bold graphics, and eye-catching text draws us in. Many of YouTube\u2019s top content creators and video uploaders spend hours perfecting their thumbnails, because thumbnails\u00a0are […]","og_url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/","og_site_name":"Digital Innovation and Transformation","article_modified_time":"2015-11-23T00:47:24+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/","url":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/","name":"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator - Digital Innovation and Transformation","isPartOf":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website"},"datePublished":"2015-11-23T00:41:14+00:00","dateModified":"2015-11-23T00:47:24+00:00","breadcrumb":{"@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/nailed-it-youtubes-deep-learning-automatic-thumbnail-generator\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/d3.harvard.edu\/platform-digit\/"},{"@type":"ListItem","position":2,"name":"Submissions","item":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/"},{"@type":"ListItem","position":3,"name":"Nailed it: YouTube\u2019s deep learning automatic thumbnail generator"}]},{"@type":"WebSite","@id":"https:\/\/d3.harvard.edu\/platform-digit\/#website","url":"https:\/\/d3.harvard.edu\/platform-digit\/","name":"Digital Innovation and Transformation","description":"MBA Student Perspectives","potentialAction":[{"@type":"性视界Action","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/d3.harvard.edu\/platform-digit\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/2633","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission"}],"about":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/types\/hck-submission"}],"author":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/users\/169"}],"replies":[{"embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/comments?post=2633"}],"version-history":[{"count":0,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/hck-submission\/2633\/revisions"}],"wp:attachment":[{"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/media?parent=2633"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/d3.harvard.edu\/platform-digit\/wp-json\/wp\/v2\/categories?post=2633"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}