Tag: ar

  • Productivity in the Age of Mixed Reality

    Productivity in the Age of Mixed Reality

    In the past few years we’ve witnessed the launch of more than a dozen HMDs (Head Mounted Displays). Several of them are already available in large numbers. HMDs focused on entertainment (Oculus, Vive) rely on taking over visual perception completely via Virtual Reality. HMDs focused on productivity (HoloLens) mix real life with computer generated imagery drawn upon a transparent display. There are other combinations and means of mixing visual information, so all of this technology has recently been put under the umbrella term Mixed Reality.

    This post concerns the productivity aspects of Mixed Reality. It’s a topic I’ve been meaning to play with for more than a year. I find it quite fitting to debut the Futurology^ section on Mentatul with this text, especially since just as I was preparing to write, I stumbled upon the following news (this has to be the work of a muse):

    http://www.tomshardware.com/news/microsoft-trials-hololens-technologies-construction,33490.html^

    The purpose behind any post in the Futurology^ category is to launch a wild, boundless speculation regarding what the future holds regarding a certain concept. To get things going, here are some of the things I imagine can be accomplished in the future (productivity-wise) using Mixed Reality.

    I’ll list my ideas chronologically, starting with the first things that came to my mind back when I read about what Google Glass can do. Feel free to submit your own ideas in the comments below. With your approval I may integrate these in the article, giving proper credit.

    • Workers are busy adding the finishing touches to a building. Using an HMD similar to a pair of glasses (like HoloLens for instance), they see the position of all other workers, as if they would see through walls. All wiring and pipes are also drawn in their exact positions inside the walls as the user looks around.
      All workers see directions pointing them towards the location of the next task. Let’s take for example the installation of a network socket. The worker is helped to locate all tools required for the task. After the task is completed, a test immediately shows if the connection is successful. If it is not, the worker can simply look around through the walls and see where to go and fix the connection.
    • Operators of large machinery are assisted in anything they do by architectural plans projected over real life terrain. Machines are integrated with this projection and “snap” automatically to the highlighted locations, needing only rough supervision. Of course, operators will soon become completely unnecessary because…
    • Architects are allowed to control and direct robots directly from their office. Work done in CAD applications, after passing several simulations and authorizations, is downloadable by robots that simply print out the structures. Architects are able to use Mixed Reality to fly around the construction site from the comfort of their homes. This technology can be used to construct human-ready colonies as well as mining stations anywhere in the solar system.
    • Before AI becomes sufficiently advanced to perform all these tasks, humans are recruited to supervise the operation of these robots (as is already done in the mining industry^). Gamers might find employment opportunities in a future that relies on a person’s multi-tasking skill, quick reflexes and ability to channel one’s mind into an alternate reality. Think of it as a huge real time strategy game where a gamer controls an army of construction robots.
    • Taking this to the next step, humans supervise self-driving vehicles that are stuck for some reason or require human intervention. Planes, boats and anything that moves is accessible in a “first person” view.
    • The security implications of all that I’ve written are enormously hugely massively gargantuan, and that’s an understatement. However, quantum cryptography might address this issue.
    • Repair manuals are displayed onto a device as the user is fixing it (this tech already on its way!^). With a good system in place for spare parts management, this enables any reasonably handy person to fix almost anything. Of course, this means that the religion of Consumerism^ should give up on one of its founding principles: planned obsolescence.
    • Taking this one step further, in times of crisis when a hospital is not accessible, simple surgical programs can help lightly trained individuals to perform tasks that would normally be beyond their capability.

    The Futurology Disclaimer: I do not claim that my ideas are original. I’m sure these suggestions are just scratching the surface of what can be achieved, but hopefully they’ve scratched enough to get anybody inspired to come up with more. I’m also sure many of these ideas are already being worked on by several organizations. If any of the ideas listed by anybody on this page are original and will benefit any organization, I expect credit to be given where it’s due.

    Version history:

    2017-02-08 – 1.0 – Written.

    [ax_meta lnimgurl=’http://mentatul.com/wp-content/uploads/2017/04/01866-ProductivityMixedReality-Thumb.jpg’ lnimgw=’250′ lnimgh=’250′ title=’Productivity in the Age of Mixed Reality’ desc=’Here are some of the things that may be accomplished in the future (productivity-wise) using Mixed Reality.’]

  • Smart Contact Lenses Will Soon Be upon Us

    Smart Contact Lenses Will Soon Be upon Us

    After Google experimented with integrating a glucose level sensor^ on a contact lens, it was only a matter of time before we would see more innovation in this field. A recent patent filing from Sony describes the intention of putting a camera inside a contact lens^.

    Privacy concerns

    While this toy won’t exactly be invisible –at least not at first – the privacy implications are quite serious. We’re still at least a few years away from market availability, but I imagine that after several product cycles, such a camera could reach a pretty good recording resolution. Coupled with wireless transmission to a storage device, people will eventually be able to record everything they see, everywhere they go.

    To be sure, there are many advantages to having this sort of camera hidden in plain sight – pun intended. For example, it could be used as a self-defense mechanism because it would give the possibility to apprehend criminals and present irrefutable evidence against them in court. There’s also the enormous convenience of being able to record important moments or useful information at the blink of an eye.

    When it comes to privacy, as our technology progresses, it will be increasingly difficult to detect and prohibit the use of this sort of devices. Evidently, in the wrong hands, such gizmos can also do a lot of harm. We will likely have to adapt to these changes and hope that the path they lead us on will be a good one.

    All this reminds me of an episode^ from the fascinating “Black Mirror” series, where people use a similar technology to record and relive any part of their lives. Such discoveries will drastically change our culture and society.

    Potential

    There are quite a few challenges that will have to be overcome, such as powering the contact lens. We are already able to wirelessly power devices, but let’s also not forget that the human body itself is also capable of generating and conducting electricity and therefore even data.

    The potential of the contact lens as a carrier for various technologies is enormous. When manufacturers will finally be able to integrate even a half-decent display on a contact lens, we’ll witness the birth of an extremely lucrative business segment. The first steps towards this breakthrough have already been taken^.

    So far, all our experiments regarding augmented reality have involved clunky glasses. In seven to fifteen years, we might be able to have our smartphones implanted in our eyes and ears. Many will find this prospect rather scary, but many also consider their grandparents to be woefully out of touch with technology. It might soon be our turn to be out of touch.

    Conclusion

    I think that we can say with a fair degree of certainty that smart contact lenses will flourish in the years to come. At least until we’re able to feed information directly to the optic nerve, their form factor makes them the holy grail of augmented reality. Perhaps they’ll never reach the high performance of larger devices, but I imagine contact lenses will become one of the most important “wearable” technologies of the 20s.

    As nanotechnology progresses, humans are bound to integrate more and more devices with their bodies. I don’t know if this is good or bad. It’s up to us as a society to correctly negotiate this upcoming technological leap.

    [ax_meta fbimgurl=’http://mentatul.com/wp-content/uploads/2016/05/00580-SonyWantsToPutCameraOnEyeballs-Share.jpg’ lnimgurl=’http://mentatul.com/wp-content/uploads/2016/05/00580-SonyWantsToPutCameraOnEyeballs-Thumb.jpg’ fbimgw=’1170′ fbimgh=’350′ lnimgw=’250′ lnimgh=’250′ title=’Smart Contact Lenses Will Soon Be upon Us’ desc=’A recent patent filing from Sony describes the intention of putting a camera inside a contact lens.’]

  • The Virtual Reality Revolution

    The Virtual Reality Revolution

    Every single person that I’ve witnessed give virtual reality a try has been floored by the experience – especially the ones that didn’t see it coming. Even those who knew what it’s all about came back with amazed expressions once they took off the HMD (head mounted display) for the first time. I placed my bets on the fact that virtual reality is going to skyrocket faster than most people expect it to.

    The rather expensive hardware required will definitely make some customers think twice. However, there already are plenty of gamers out there who own powerful hardware. They will be joined by early adopters who will make sure that they can properly run most of the VR experiences. They will show these programs to relatives and friends, which will feed the wave of excitement. And so, a new technological revolution will begin.

    The next step in the evolution of entertainment

    Virtual reality is more than most people expect it to be. This is why, when referring to VR content, I write about “experiences” or “programs”. Whoever thinks that this about games or movies couldn’t be further from the truth.

    What we have here is a whole new dimension for experiencing art, one which wraps a world around us rather than showing it to us through a small rectangular window. Indeed, for now, the field of view of most HMDs is quite narrow (110 degrees), but 2nd generation devices such as StarVR^, with its 210 degrees of coverage, will bring large improvements in that regard.

    Expect the 2nd generation to show up in 2017, probably along with the 1st generation HoloLens – Microsoft’s augmented reality HMD. When exactly in 2017? That, remains to be determined by the level of hysteria to be reached during the 2016 holiday season once people realize the amount of fun they can have with these things.

    The first generation of HMDs faces other limitations too. One of the worst is the requirement to be plugged into the PC – with the exception of smartphone-powered HMDs, which are not nearly as convincing in terms of graphical quality as their PC-powered cousins. I expect plenty inventive solutions to address such problems in the next couple of years.

    Despite any limitations, I continue to believe that VR and AR will take off faster than expected. Almost everybody that I’ve discussed with is perfectly happy to tolerate a few temporary problems, given what they’ll be getting in return. It’s hard to understand the potential of VR without experiencing it, but let’s just say that it’s a step forward at least as big as from paper to radio or from radio to TV.

    Impressive potential for innovation

    Today, there’s a very important difference compared to when the newspaper, radio or TV appeared. That difference is called “technology proficiency”. In this age, there are millions of people able to create digital art. And then there’s this thing called “the Internet”, which means that we are all but a few clicks away from enjoying the work of some talented young team toiling away in a garage across the ocean.

    The reason why VR & AR will spread faster than expected is that the emergence of a new medium for expressing our creativity will usher in a staggering amount of innovation and original art. The transition from 2D to 3D graphics will seem like a baby step in comparison. There’s an army of engineers and content creators out there, the likes of which this Earth has never seen before.

    They’ve made gloves^ that can not only allow the precise tracking of hand movements in VR, but also showcase our first try at feeling objects in the imaginary world. There’s even a suit^ with temperature controls! There’s eye tracking^. There’s spatial awareness^. There’s mobility^. And all this happened in less than three years. Such a density of innovation completely dwarfs anything we’ve seen during previous technological leaps.

    By now, a lot of companies have realized what’s at stake. They are investing a lot of money into making this technological revolution happen, because if it does, it will fuel demand for entertainment and the hardware to power it. Manufacturers of video cards are especially ecstatic about this area, but pretty much all companies involved in producing PC components should probably get their champagnes ready.

    Should we line ourselves up for pre-orders?

    Despite my obvious enthusiasm towards this technology, the answer to this question is a definite NO. I’ve found an article that does an excellent job of explaining why. There is only one matter that the author hasn’t emphasized enough: the amount of high quality VR content is still quite low. I would recommend waiting at least until the 2016 holiday season before jumping in. By then, a lot of bugs will be worked out and more content will be available.

    Don’t pre-order any HMD:

    http://www.extremetech.com/gaming/222843-why-you-shouldnt-pre-order-an-oculus-rift^

    We’re less than two months away before tens of thousands of customers will receive their Oculus Rifts, the HMD most likely to reach retail availability first. Very soon after, the Vive Pre will follow. These first representatives of the high-end VR experience will open the door for many others. Personally, I’m probably going to order my HMD after November 2016. I haven’t made up my mind regarding the brand. I’ll be patient and read a few dozens of reviews before parting with my money.

    [ax_meta fbimgurl=’http://mentatul.com/wp-content/uploads/2016/02/00240-TheVRRevolution-Share.jpg’ lnimgurl=’http://mentatul.com/wp-content/uploads/2016/02/00240-TheVRRevolution-Thumb.jpg’ fbimgw=’1170′ fbimgh=’350′ lnimgw=’250′ lnimgh=’250′ title=’The Virtual Reality Revolution’ desc=’Every single person that I've witnessed give virtual reality a try has been floored by the experience – especially those that didn't see it coming.’]