{"id":5534,"date":"2017-04-23T19:35:43","date_gmt":"2017-04-23T23:35:43","guid":{"rendered":"https:\/\/digital.hbs.edu\/platform-digit\/submission\/facebook-mind-reading-the-ultimate-vrar-interface\/"},"modified":"2017-04-26T07:30:17","modified_gmt":"2017-04-26T11:30:17","slug":"facebook-mind-reading-the-ultimate-vrar-interface","status":"publish","type":"hck-submission","link":"https:\/\/d3.harvard.edu\/platform-digit\/submission\/facebook-mind-reading-the-ultimate-vrar-interface\/","title":{"rendered":"Facebook mind reading: the ultimate VR\/AR interface"},"content":{"rendered":"
\"\"
Dean Pelton’s haptic VR set-up (from the TV show Community<\/em>)<\/figcaption><\/figure>\n

There are many problems that VR\/AR has yet to solve. One of these is how we, the users, are going to command and interface with these new virtual environments. Keyboards are impractical, haptic gear is too unwieldy and text-to-speech is indiscreet and unsuited for many uses (\u2018Close all windows except the window that I\u2019m looking at right now and resize that window to fill the entire field of vision\u2019). The holy grail of VR\/AR interfaces? Mind reading.<\/p>\n

Facebook is investigating how to tap into mind reading as a \u201cnew means for input to AR\u201d.[1]<\/a> One use case they\u2019ve proposed is the \u201cbrain click\u201d – \u201cyou could brain click to dismiss a notification that popped up on your AR glasses, for example.\u201c[2]<\/a><\/p>\n

\"\"<\/a>
Facebook executive Regina Dugan announcing Facebook’s mind reading research (at the F8 Developer Conference, 19 April 2017)<\/figcaption><\/figure>\n

We\u2019re closer to this reality than you might think. Already, researchers have been able to use neural transmission to move cursors,[3]<\/a> type letters[4]<\/a> and convey basic words. [5]<\/a><\/p>\n

It\u2019s not far-fetched to consider that, in the near future, Facebook will develop technology that\u2019s capable of basic instructional interpretations (the VR\/AR equivalent of moving a mouse, clicking), reading basic emotions (sadness, excitement, etc.), and typing.<\/p>\n

The temptation for Facebook:<\/strong><\/p>\n

Once Facebook develops MindReader\u2122 (let\u2019s call it that for now), they will be tempted to keep the technology proprietary. This vertical integration fits in with their other moves in VR\/AR so far including acquiring their own hardware (Oculus) and developing their own virtual worlds (Facebook Spaces[6]<\/a>). In such a scenario, the technology will be treated like a feature. Value creation will come from making Facebook\u2019s VR\/AR software more user-friendly and featureful; value capture from revenue streams (probably ads) on Facebook\u2019s software, and selling Facebook’s hardware.<\/p>\n

\"\"<\/a>
Facebook’s VR app, Spaces. Does Facebook have the operating model capabilities required to win in VR social media? It’s not so clear that they do.<\/figcaption><\/figure>\n

Though there\u2019s nothing inherently wrong with this approach, it\u2019s predicated on Facebook\u2019s proprietary ecosystem winning the VR\/AR wars. This is anything but certain. VR\/AR is anyone\u2019s game both in terms of hardware and software. Moreover, Facebook\u2019s operating model doesn\u2019t currently have strong capabilities in creating awesome digital environments or developing hardware.<\/p>\n

What Facebook\u2019s should do:<\/strong><\/p>\n

Rather than keep the technology for proprietary use, Facebook has a greater chance of making MindReader\u2122 a success if they allow it to be freely available. Specifically, they should:<\/p>\n