1

Christine Perey to Speak at the EPRI Information, Communication and Cyber Security (ICCS) European Engagement Summit

AREA member EPRI will be hosting its first European Engagement Summit on April 28 and 29 in Madrid, Spain. Executives from European utility companies will be in attendance at this invite-only conference to learn about a variety of topics in cyber security and information technology.

Presentations on the following utility industry topics will include:

  • Augmented Reality in utility operations
  • Risk management in the electric sector
  • Security posture assessment
  • Network and system management
  • Threat management
  • Advanced metering systems
  • Communications in demand response and distributed energy resources

AREA executive director Christine Perey will be presenting on the state of the art of Augmented Reality in 2015, and what is possible with the available technology. She will examine the macroscopic trends that propel advancements in Augmented Reality today, including how new components introduced in the past six months can contribute to the most powerful solutions ever developed. She will also address the internal and external barriers that remain to be overcome before AR can reach its potential impact in utilities and in all industries.

The conference will be held at the InterContinental Madrid and will be followed by a tour of the Gas Natural Fenosa Control Center.




Events are Beginning to Focus on Enterprise Augmented Reality

Look out! Your travel schedule is already overloaded but there are new events where the topic of enterprise Augmented Reality is front and center. There are also events that in previous years have not treated the topic at all but are now sitting up and paying attention. How do you choose where to put your resources?

Tough Choices

In the long run, Augmented Reality will be part of all industries. In the AREA, our mandate is to make sure that this prediction will come true and the projects of our member organizations, regardless of their industry, are successful and bear fruit.

Customers—the buyers and those who will deploy Augmented Reality in their workflows—are already “in” their industry. They know their suppliers and customers. They also have some use cases where they’re thinking AR will be valuable.

Providers of technologies to be deployed in industrial and enterprise environments, on the other hand, are scattered. Under the guise of trying to be responsive, many companies offering AR-enabling systems fail to become experts in the problems and opportunities of a specific industry.

Automotive. Aviation. Construction. Engineering. Aerospace. Defense. Energy. Utilities. AR introduction and adoption won’t happen at the same speed in all industries. Automotive is probably ahead of all the others, but will it hold that lead? For how long?

Which industries are going to embrace AR in a really serious way soonest?

tech-meeting-crowd

If you’re a provider of AR-enabling systems and have not already developed a sales force affiliated with an industry or just a few related industries, it’s time to do the soul searching you’ve been putting off. This doesn’t mean just looking at the total size of the industry or flipping through your contacts on LinkedIn to find someone that’s prepared to introduce you to the five top CTOs in an industry.

Scanning   

Take the time and in the first half of 2015, invest your resources to better understand industries and domains that you already know as well as those out of your comfort zone. One way to do this is to attend conferences to which an AR topic has recently added to the agenda. For example, the AREA’s calendar of events includes the World Air Traffic Management Congress in Madrid, the Bosch ConnectedWorld conference in Berlin and the CeBIT exhibition in Hannover. 

We’re going to meet people who are gathering in these places. They’ve probably got some major questions about what to expect, some fuzzy areas between AR and VR, and they’re looking for experts. If you are there as well, they may very well find you.

Some companies with a new product to showcase, like AREA member DAQRI, are organizing their own event and inviting their prospects to visit them. This strategy has real benefits because the host can control the message and those to whom the latest developments are revealed. On the other hand, it is unlikely to reach people who aren’t already on your list of prospects. The vendor-hosted event also has the drawback that the conversation isn’t focused on an industry’s pressing needs and greatest opportunities. Finally, those prospects you’ve gathered also sense that they are not sampling the full range of options. By attending one vendor’s event, like Metaio’s InsideAR or DAQRI 4D Expo, customers know that they are only getting what their host wants to put on the menu. 

crowd-tech

Balancing Act

So, before you rush out to the airport to yet another conference or tradeshow, consider the year as a whole and develop a balanced approach: a mixture of horizontal “AR-specific” events and those domain- or industry-specific events. Also consider mixing small events with very big ones. They will yield different types of relationships and your business is likely to benefit from having both.




Augmented Reality at CES 2015 is Better and Bigger Than Ever

There’s something for everyone at CES. Do you need a way to store your earbuds so the cables aren’t tangled? What about printing icing on a cake?

Roger Kay, a technology analyst who writes for Forbes, recommends breaking up the event into ten parts. It’s not about the horrendous taxi lines or other logistical issues of dealing with so many people in a relatively small area. I walk everywhere I go. I leisurely covered twenty-four miles on the flat Las Vegas ground in four days; there are buses to and from the airport. Kay wants his topics served out in concentrated exhibition floor zones.

Like for Kay, many of CES’ themes lie outside my areas of interest and despite the headaches caused by the crowds, having the option to see and sample the developments in a variety of fields is one of the reasons I return each year.

Finding what I need to see isn’t a matter I treat lightly. A month before heading to Las Vegas I begin planning my assault because the CEA’s web site is horrendously inefficient and their new mobile app pathetic. Using brute force, I locate all the providers of head-mounted personal displays, the providers of hardware that is or could be AR enabling, and the “pure” AR firms with whom I already have relationships. I also plan a long, slow visit through the innovation zones, such as Eureka Park. I know another half day will be dedicated to Intel, Samsung, Sony, LG Electronics and Qualcomm. Then I search for outliers by name.

A few days prior to the event I begin following the news feeds on social media and technology trade blogs. While there, I also scan the headlines for surprises. 

Highlights of my CES 2015

For reasons that don’t have to do with Google Glass, vendors are making good progress in the personal display space.  The first reason is that more companies are experimenting with new combinations of familiar technology components, particularly with hardware. Optinvent is recombining their optical technology with a set of headphones. Seebright is adding a remote control to your smartphone. Technical Illusions is combining reflector technology and projectors with new optics. It’s like gene mixing to produce new capabilities and life forms.

Vuzix demonstrated the new waveguide technology in their optical see-through personal displays for Augmented Reality.

Vuzix demonstrated the new waveguide technology in their optical see-through personal displays for Augmented Reality.

That’s not to say that designs for the “traditional” optical see-through display form factor are standing still. Getting new investments, such as Vuzix received from Intel, is a major accelerator. ODG’s sales of patents to Microsoft in 2014 produced sufficient revenues for the company to develop a new model of their device targeting consumers.

The second reason for the significant advances in the personal display product category is the evolution of components. I saw firsthand in many exhibits, the “familiar” components these displays are must include, such as motion and other sensors, eye tracking kits and optics. All are rapidly improving. For these components, “improving” means smaller size packaging and lower power consumption. 

It was good to focus—if only briefly—on the familiar faces of AREA members such as APX Labs and NGRAIN who were participating in the Epson developer ecosystem booth, and to see the latest Epson products, which seems to be increasingly popular in enterprise. I found APX again in the Sony SmartEyewear zone, where I was able to try on the Sony prototype. I also caught up with executives and saw impressive new AR demonstrations by companies whom I don’t often see attending my events. If you’re interested, I encourage you to click on these links to learn about MetaInfinityAR, Occipital, ScopeAR, Technical Illusions, LYTE, XOeye Technologies, FOVE, Jins Company, Elvision Technologies, Avegant  and Augumenta. I’m sorry if I neglected to include others that I saw at CES.

Although they were around and showing AR or AR-enabling technologies, and we may have crossed paths unknowingly, I didn’t have a chance to meet with Metaio, Lumus, Lemoptix or Leap Motion.

I spent more time than expected visiting and observing the booths of Virtual Reality headset providers who were at CES. There were several exhibition zones dedicated to Oculus VR, with the new Cresent Bay device.  The lines waiting to try on the new Razer OSVR (Open Source VR) system were stunningly long. It amazes me that a small company like Sulon could afford such a huge footprint in South Hall to set up private briefing rooms for its Cortex display for AR and VR, and yet exhibit openly outside.

Elsewhere there were hordes swarming at the Samsung Gear VR and the Sony Project Morpheus zones. What good are all these headsets without content? I stopped in at JauntVR, which seems to be getting a lot of attention these days. I’m sure there were dozens more showing VR development software, but VR is peripheral to my focus.

I was impressed by the NVIDIA booth’s focus on Advanced Driver Assistance Systems this year, demonstrating real time processing of six video feeds simultaneously on the Tegra K1 Visual Computing Module. There were also excellent demonstrations of enterprise use of AR in the Hewlett Packard exhibit. Intel dedicated a very significant portion of its footprint to Real Sense. And, similarly, the Vuforia zone in Qualcomm’s booth has expanded by comparison to 2014. The IEEE Standards Association offered an AR demonstration to engage people about their work.

Automotive companies were also showing Augmented Reality. I saw examples in the BMW pavilion, in Daimler’s area, the Bosch booth, and Hyundai’s prototype cars.

At the other end of the spectrum there were many exciting new products in the pico projector category. MicroVision and Celluon were both showing HD pico projectors for use with smartphones; such technology will certainly be considered for projection AR in enterprise. ZTE and Texas Instruments also introduced their latest pico projector models at CES 2015.

Digging in Deeper

Although no longer in Las Vegas and despite my careful advance planning, I continued with my CES homework for at least a week. For example, I watched the archive of the “New Realities” panel and played back other videos that cover AR and VR at CES on CNET, Engadget, Tested and Financial Times

The IEEE published an analysis of AR at CES in Spectrum that reaches the same conclusion I drew:  the “C” in CES is for Consumer but a lot of consumer technology is going into corporate IT.

I hope I will have digested all that I gathered at CES 2015 before I begin preparations for 2016.




CES 2015 Attracts AREA Members and Their Customers

Few trade shows and exhibitions compete with the annual Consumer Electronics Show in sheer magnitude. Over 170,000 people, including representatives of six AREA member companies, gathered between January 6 and 9, 2015, to see and touch the latest real (as well as imaginary) high-technology products first hand.

 Main Attraction

While CES is large in size, the prepared visitor can find and focus on the latest in specific segments. For example wearable technology, fitness, optics, cameras, robotics and automotive gadgets. For AREA members, the primary reason to attend CES is to try on — and, for Augmented Reality providers, to help potential customers to explore — options across the entire gamut of optical see-through hands-free displays for Augmented Reality before ordering prototypes and developer kits.

The growth of the optical see-through hands-free display product category was very rapid in 2014. As a customer, gathering information about products from web pages, brochures and media reports is insufficient. Research must include actually trying on hardware and speaking with product team members. If you’re not the largest automotive or airplane company in the world, these devices and teams do not come to your facilities.

After actually donning more than one optical see-through display it becomes clear that there’s a huge spectrum of experiences possible. Even one model of hardware can “feel” very different and support different use cases. Going from one station to the next in a pavilion such as those organized by Sony and Epson, and using the same device running different software offers a glimpse into the possible range.

Providing this hands-on experience to a wide variety of potential customers in a single place is what makes it important for software developers targeting these platforms and devices to participate and attend CES as well.

AREA members APX Labs and NGRAIN demonstrated in partner booths. Other companies manning stations nearby included Scope, XOEye Technologies and Metaio. Elsewhere at CES, ODG, Optinvent, Atheer Labs, Seebright, InfinityAR, FOVE, and Vuzix demonstrated optical and video see-through AR displays in their own dedicated stands. DAQRI and Technical Illusions, maker of CastAR, hosted guests and conducted demonstrations of their pre-release hardware and software in private suites.

Component Comparisons

For other CES visitors (including those who are considering or already embarking on integration of their own hardware-based solutions) meeting with providers of enabling technologies such as chip sets, power storage and transmission components, sensors and sensor hubs can help define the spectrum of choices before making recommendations or purchasing decisions.

For EPRI, an AREA member attending CES 2015, the challenge was to identify possible wearable computing platforms for field agents. Some field agents will be able to use wrist bands. Others may find efficiencies with 3D scanners and 3D printers.

There was no shortage of booths to visits and companies offering new technology to discover in domains adjacent to Augmented Reality at CES 2015.

AREA Mixer

Las Vegas is the city that never sleeps. After CES exhibition hours, business continues as people gather in the streets and in all the popular entertainment venues. The AREA hosted a reception of members and companies focusing on enterprise Augmented Reality in the Marriott Las Vegas, a short distance from the Las Vegas Convention Center.

All the AREA members at CES had representatives on hand to meet and greet guests including executives and engineers from OPTIS, SAP, Bosch, SmartReality, ZigBee Alliance, Vuzix and Epson. The first AREA case studies were shared with visitors as were AREA plans for growth.

As this organization grows it’s not difficult to imagine having a greater presence at CES and a large group of companies participating in a CES enterprise AR mixer in the future.




Terminology Monsters Alive and Well

Most enterprise IT managers use dozens of acronyms and a large specialized vocabulary for communicating about their projects. The mobile industry is particularly rich with layers of terminology. Last year mobile IT professionals were studying and defining policies for BYOD. Now wearable technology is at the top of every mobile technology portal.  

Confusion in Communication

Ironically, Augmented Reality promises to deliver improved communication to the user but is plagued with a potential for confusion in terminology. The glossaries—yes, there are several—have nearly 40 frequently misused terms (each) with only a few overlapping terms. An analysis of the differences between the AR Community Glossary v 2.2 and the glossary in the Mixed and Augmented Reality Reference Model has been performed by Greg Babb, the AREA editor. This analysis will be discussed with experts during the virtual meeting of the AR Community Glossary Task Force on November 24, 2014.

Who Needs a Glossary?

Simply refer to Milgram’s Continuum. There is a virtual world and a real world. The space between these two extremes is “Mixed Reality.”

B-13-11-14-Terminology

It sounds and looks like a simple concept but debate about the segments within Mixed Reality can consume entire meetings.

BP-13-11-14-Terminology2

Is the 1st & 10  in football Augmented Reality? No, it isn’t according to the debate among experts of the AR Community. And when the details of Mixed Reality need to be spelled out and implemented in a distributed computing architecture by many different people, the definitions are insufficient and the concepts blend together. This is an impediment to enterprise AR introduction and adoption.

Diminished Potential

Speaking of blending together, in early November, Hewlett Packard announced its spectacular plans for 2015 as bringing “Blended Reality” to new personal computing products. The sprout PC replaces a keyboard and mouse with touchscreen, scanner and other features that let users take actual objects and easily “put” them into a PC.

Seeing a connection with Augmented Reality, the author of this Business Insider article tried to define Virtual and Augmented Reality. “That’s what you get when you put on Google Glass and it projects Google-y facts or images on the world. Or you run an app like Star Chart on your smartphone, hold it up to the sky and it superimposes the constellations on your view of the sky,” wrote Julie Bort to hundreds of thousands of readers.

Forget the fact that Google Glass does not really provide Augmented Reality and ask the executive who is running a multi-billion dollar business if they want an app to project constellations on their warehouse or factory ceiling. Augmented Reality’s potential is not only unclear; it actually gets diminished by comparisons of this nature (nevertheless, let’s not confuse this with “diminished reality,” OK?).

The fact that HP is beginning to pay attention to Blended Reality, Mixed Reality or Augmented Reality should not come as a surprise, given the integration of the Aurasma group into the company and the variety of services that could be provided on HP servers for managing and delivering AR experiences. But the new sprout PC looks awfully similar in some ways to demonstrations of Intel’s Real Sense. If these similarities are deep, then perhaps it is time for Intel and HP to invest in educating their target audiences about these new technologies. And a consistent vocabulary would come in handy.

To make sure that people do not jump to the conclusion that Blended Reality is something invented in 2014 by HP, the Business Insider article points out that Blended Reality was first introduced in 2009 by the esteemed Institute for the Future (IFTF). “The IFTF envisioned it as a sort of tech-enabled sixth sense, which will be worn or maybe even implanted into our bodies and interface with our computers,” concludes the Business Insider piece.

If that is how HP is using the term, there are even bigger problems than the definition of Augmented Reality terminology.

Mixed and Augmented Reality Reference Model

One of the solutions for this obstacle to Augmented Reality deployment is the Mixed and Augmented Reality Reference Model. The candidate specification is available for review and will be voted on within ISO/IEC JTC1 SC 29 WG 11 (MPEG) in 2015.

To learn more about the Mixed and Augmented Reality Reference Model, visit this AREA blog post.




Future for Eyewear is Bright (If Enterprise Requirements Can be Met)

The topic of hands-free displays or eyewear for Augmented Reality was popular at InsideAR 2014. It was discussed using many names (e.g., smart glasses, eyewear and HMD, to mention a few) and shown at many of the exhibition stands. On the stage, there were no less than six presentations focused entirely on hands-free displays. Even those speakers not focused on displays mentioned the opportunities they would offer once customer requirements were met.

New Report Forecasts Four Waves

During his InsideAR remarks, Ori Inbar of AugmenedReality.org described the latest addition to an already significant body of market research on the topic of hands-free AR displays. As Ori mentioned in his preface, the other reports to date do not agree on the size of the market, the terminology or how to seize the opportunities they will offer. It is not clear if or how this report compares or addresses the uncertainty.

Entitled simply “Smart Glasses Report,” Ori’s new report compiles findings from tests and interviews conducted with companies providing products and components. The scope does not include devices designed for use with Virtual Reality content.

The purpose of the report is to answer two burning questions: Will smart glasses ever come into their own? And when will this happen? To the first question, the answer is that those contributing to the report felt it was inevitable. As to the second question, it depends.

FutureBright-glasses-1

Ori predicts there will be four waves of technology:

  1. Technology enthusiasts: 10 models of glasses will sell 1 million units within the next year or two
  2. Initial winners will emerge and sell a total of 10 million units by 2016
  3. The early majority market will be composed of fewer competitors and will sell 50-100 million and reach critical mass by 2018
  4. Mainstream adoption will occur between 2019 and 2023 with the shipment of one billion units

FutureBright-glasses-2

Business opportunities will depend on the wave and type of company. Ori predicts that by 2020, there will be one 800 pound gorilla and a few challengers. He also predicts that prior to, and even during 2016, most sales of eyewear will be for enterprise use.

That depends on those devices meeting the requirements of the enterprise customers.

Enterprise Requirements for Head-mounted Displays

In his InsideAR 2014 speech, Dr. Werner Schreiber of Volkswagen provided a very detailed analysis of the requirements that head-mounted display vendors need to meet if they are to achieve traction in enterprise. To set the stage for his analysis, Schreiber began by saying that AR is not going to be popular in production processes until head-mounted displays meet certain requirements. In other words, the use of tablets and smartphones is just not convenient when the tasks people are doing require both hands.

One of the most important requirements described (in fact the first of at least 10) is power consumption. The devices will need to begin with a battery life of at least 10 hours. Another requirement was field of view (FOV). In Schreiber’s analysis, the FOV must be at least 130 degrees, or a moving FOV that is 50 degrees.

Of course, support for corrective lenses is not negotiable nor are systems that minimize wiring. If there must be wiring, it needs to include easy connectors both at the display and other power or computing devices that may be needed.

If the hardware can be designed to meet the minimum requirements, there remain significant software challenges. Schreiber’s ideal platform would permit automatic:

  • Creation of computer data
  • Removal of unused details
  • Creation of workflow
  • Consideration of possible collisions
  • Selection of necessary application tools and materials
  • Publishing of user-generated annotations into the experience

That is a lot of requirements to meet before 2016.

Do you have a product or strategy that will address these needs? Let us know about your product or opinions on these requirements.




The IEEE Standards Association at Inside AR 2014

This is a guest post by the IEEE Standards Association (IEEE-SA), on their participation at the 2014 edition of InsideAR in Munich.

There has been a lot of hype about Augmented Reality, and concrete examples help us all to grasp how far we have come and how much is yet to be done in the field. For this reason, we at IEEE Standards Association (IEEE-SA) were delighted to see all the new technologies showcased at InsideAR 2014. We also enjoyed talking with the diverse crowd of visitors to our booth, which included folks from wearable tech, mobile software and business development, research, academia and marketing.

Many visitors were aware of IEEE-SA’s activities and were interested in knowing more about our “Bringing Standards to Life” AR app experience, showing how IEEE standards (with focus on IEEE 802® standards) impact their daily lives. Some were interested in IEEE-SA’s role in AR, and whether there were any current standards available.

IEEE believes AR is an enabling tool for a number of technologies, including the broad tech that IEEE serves. – Mary Lynne Nielsen, Global Operations and Outreach Program Manager at IEEE Standards Association

Tools for Expanding Augmented Reality Markets

At IEEE we help companies interested in AR to plan for the future. For example, we offer tools for business planning, such as our complimentary copy of IEEE Scenarios for AR in 2020. Also, the standards-development process offers a path for engineers to realize the full potential of Augmented Reality, as the adoption of open standards fosters innovation and market growth through economies of scale and wider interoperability.

https://www.youtube.com/watch?v=OszYuLx_Onk

We lead campaigns and projects to advance open and interoperable AR. This makes sense, given the scope of IEEE expertise across technology areas that contribute to AR and the proven track record of IEEE for serving as a facilitator and catalyst in widely adopted technologies, such as networking communications and the smart grid.

The IEEE-SA offers a platform for developers and users to innovate for open and interoperable AR. For example, the IEEE-SA’s standards-development process is based on broad global participation and consensus—in alignment with the “OpenStand” principles for global, open, market-driven standards. And, indeed, a wide variety of IEEE standards and projects relevant to AR already exists today.

To facilitate participation from emerging AR domains, the IEEE also explores the establishment of new study groups, projects or standards based on requirements for all segments of the AR ecosystem. To that end, an IEEE-SA Industry Connections activity has been launched to, in part, identify use cases, glossaries, and best practices in the AR technology space.

Furthermore, through participating in meetings of the AR Community and conferences like InsideAR, the IEEE-SA proactively engages with other leaders around the world to encourage global AR market growth.

Conclusion

Overall, we found InsideAR 2014 to be a well-organized and very enlightening event, shedding light on the endless opportunities in the AR space, as it relates to technology overall. There were great sessions covering a range of topics that could provide inspiration across many other industries. We’re looking forward to next year’s event.




Reality Creeps into VR

Virtual and Augmented Reality professionals are increasingly finding their projects converging. Augmented Reality projects can overlay 3D data prepared for VR environments onto the viewed physical world. Virtual Reality specialists are discovering that their skills and tools can be applied to many more use cases when they use the real world as the source for models and as the scene for new experiences.

More Realism

The convergence of AR and VR is the result of several trends. The first is the introduction of commercially ready RGB-D devices. The 3D models generated from RGB-D systems can provide 3D objects for VR. In “The Quest to put more reality into Virtual Reality,” an article published in the MIT Technology Review, Philip Rosendale, founder of Linden Labs and the visionary behind Second Life, describes how using the latest systems to “capture” reality can reduce time and costs that used to be required to recreate reality using 3D graphic tools. High Fidelity, Rosendale’s latest startup, is using depth cameras and advanced facial detection and tracking algorithms to simulate the expressions of people on the faces of their avatars.

Another trend that contributes to the bleed over between AR and VR is the re-use of digital assets. Models created for VR and simulation are increasingly useful for recognizing real world objects, especially low-texture objects such as those made from glass and steel. These materials are highly reflective so the surface properties can trick recognition and tracking algorithms. By using the contours and edges of the model as the unique signature and comparing them with the real world properties of an object, Augmented Reality recognition systems are more efficient, less likely to have errors and to need calibration.

Moving About

Another reason that Virtual Reality professionals are increasingly interested in AR is the need for users to have assistive technologies when they are performing tasks in the physical world. With VR in a cave or using a Powerwall, users must stay in a small, confined area. Even with VR goggles, such as Oculus Rift, a user either sits or stands with limited mobility since cables connect the user to a computer and obstacles in the physical world are not dynamically introduced into the scene and can be dangerous.

By reusing procedures designed for simulation and training in Virtual Reality and adapting them to AR, the investments a company has made in high-quality digital assets have a potentially greater return. Conversely, new Augmented Reality projects may enter the test phase and reach performance objectives more quickly when their designers do not have to start from a “blank slate.”

Are you noticing these trends in your projects?

Join AREA members and others working at the convergence of AR and VR at the SAE AR/VR Symposium in Dearborn Michigan on November 18 and 19, 2014.

SAE-banner




It Is All About People

In his presentation on the InsideAR 2014 stage, AREA member Carl Byers of NGRAIN Corporation shared with the audience his conclusion that Augmented Reality is “all about people.” When in the middle of a technology-centric event taking place in the center of the densest AR-populated region of the world (Munich, Germany), it is important to reframe why all activities and investments matter: Augmented Reality helps people to see digital data in context.

The “all about people” guideline applies in medicine as well. Improving patient outcomes is at the heart of Dr. Kavin Andi’s research at St. George’s Hospital at the University of London.

Dr. Andi is an oral and maxillofacial surgery consultant who also practices microvascular reconstructive facial plastic surgery. In his InsideAR presentation Dr. Andi explained how Augmented Reality could provide value to:

  • Designing and communicating tumor removal and reconstructive processes
  • Detecting airway obstruction
  • Planning bone and tissue harvesting

The presentation also introduced some of the many tools surgeons use to achieve positive patient outcomes. Some tools are physical: scalpel, saw, clamps and hoses of many types. And others use software. In addition to the many credentials he has earned in his journey from molecular biology to reconstructive surgery, Dr. Andi has invested heavily in mastering the use of a dozen different software products in a graphics pipeline.

Beginning with scans of patient bodies, the processes he has defined permit surgeons to better prepare for surgery. By studying and planning procedures to be performed in the operating theater in minute detail in advance, the time spent in the actual theater is reduced. 

Patient scanning is highly sophisticated, involving measurements of tumor and bone density, blood flow and other critical factors. But as in other fields where big data is accessible to the expert, the data needs to be accompanied with analytical tools, and in the case of surgery with real time visualization.

The first gap Dr. Andi needs technology to address is advanced segmentation. Better segmentation of the data will separate the volume of the tumor from the surrounding area that is affected. Then, with this data superimposed on the patient, Augmented Reality can help surgeons and assistants—and ultimately the patient—to visualize the proposed treatment.

Leaving diseased tissue in the patient, or removing too much tissue due to low accuracy visualization can impact patient outcomes. That is why surgeons also need (for registration and tracking with hands-free displays) to have sub-millimeter accuracy on deforming surfaces.

When this can be achieved, Dr. Andi envisages that he and other surgeons will be able to perform complex procedures with 3D digital overlay on the patient instead of constantly referring to a display on the side.

To learn more, watch Dr. Andi’s InsideAR 2014 presentation below.




Augmented Reality in the Gigabit Age

Augmented Reality will be ubiquitous in the year 2025, according to one of the predictions shaped from the input of over 1,400 people and described in a new Pew Research Internet Report entitled “Killer Apps in the Gigabit Age,” released on October 9, 2014.

How can We Capitalize on New Bandwidth?

The respondents were asked to share their views on new killer apps in the gigabit age: will there be new, distinctive, and uniquely compelling technology applications that capitalize upon significant increases in bandwidth in the US between now and 2025?

The replies were then distilled into seven themes (Figure 1).

BP-AR-reality-1-10-14
Source: Pew Research Center, Sept. 2014, “Killer Apps in the Gigabit Age”

“In 2025, Augmented Reality will enhance people’s sense and understanding of their real-life surroundings and virtual reality will make some spaces, such as gaming worlds and other simulated environments, even more compelling places to hang out.”

Many of the changes described by the expert respondents will emerge from a decade of maturation of the technologies we currently refer to as the Internet of Things. There will be much more than fast networks involved. In 2025, everything is continually connecting, capturing, storing and transmitting observations, as well as receiving data from other sources.

 Augmented Reality in 2025

The three key components of Augmented Reality—hardware, software and content—are directly impacted, even redefined, by the advance of technology and bandwidth. The biggest trends in hardware for AR-assisted experiences will be miniaturization and use of harvested power. With smaller sensors and processors, there is an increased ability to embed and distribute the components of an AR solution into multiple objects, both on humans and in the environment. With the ability to harvest locally generated or locally stored power, batteries will become smaller and their capacities greater.

Surprisingly, personal display technologies—a necessary hardware component for Augmented Reality experiences—are not often discussed by the respondents of the Pew study. Perhaps there is tacit agreement that there will be personal head-worn displays; the emphasis is greater on the use light and lasers producing high-resolution digital objects and representing physical world features, including people, with real time holography.

BP-AR-reality-2-1-10-14

Respondents frequently describe software, the second key component of AR, as being less distinct and visible as part of computer-assisted systems than in 2014. Many experts predict that the “app economy” will be a distant memory. Software will run in the background, barely reaching the user’s awareness.

Impacts on People

In addition to technology changes, the respondents recognize that there will be enormous societal changes combined with rapidly evolving economic and cultural shifts. The study explores the human elements of life surrounded by sensors and actuators.  Visions converge on many points: improved healthcare services, more engagement between people at a distance and discreet “apps,” such as are prevalent today, will disappear.

Concerning other dimensions of life in 2025, there is controversy. Some describe increased security and privacy and others the opposite.  Perhaps this dichotomy is not reflecting of contradictions, but is rather a reflection of the deepening digital divide, between those who are more digitally empowered having greater privacy and the rest being more exposed.

Aside from how travel behavior will differ, this study does not shed light on the professional side of life in 2025, nor how Augmented Reality and its enablers will impact business due to streamlined commercial transactions, greater human productivity and lower risk to material assets.

How would you respond to the study’s key question? How will your AR-assisted business capitalize upon significant increases in bandwidth over the next decade?