Teledyne FLIR announced it won a $15.7 million contract in December to develop augmented reality software that can pinpoint chemical, biological, radiological and nuclear, or CBRN, threats and map them for the military. The contract was awarded by the U.S. Defense Threat Reduction Agency’s Joint Science and Technology Office.

For reconnaissance and decontamination missions, a remotely operated vehicle would first move through an area where hazardous materials may be present and collect data using sensors, said Jeremy Walker, the director of science and technology for the company’s Pittsburgh location.

That data is then digitally registered and used to create an AR display of the area that highlights dangers, he added.

“As they’re moving through that space, they’re seeing these heat maps of where things were detected and what they are,” Walker said. “Once that data is captured by that tip of the spear reconnaissance mission, then many other subsequent users … can use that data to do their mission better.”

The mapping and AR technology will be integrated into the military’s Tactical Assault Kit suite of tools, which could be a mobile phone or tablet. Mixed reality headsets, like the Integrated Visual Augmentation System, are also an option, Walker said.

“All those people farther back don’t necessarily have to have sensors in their hand to know where the threat is to be able to do their work,” he said. “You’ve got this tool that helps people intuitively interact with it so they can keep their hands free to do other things.”

As it develop the technology, Teledyne FLIR’s Pittsburgh lab will be looking to work with existing and new partners in augmented reality and 3D-mapping spheres to help build the software, he said.

Overall, the solution helped PBC Linear operate and scale more effectively in several areas.

Deliver New Efficiencies and Process Improvements
PBC Linear utilized Taqtile’s Manifest on Magic Leap 1 to reduce training time for workers from almost three weeks to just three days – an 80% reduction in time.

Boost Productivity and Minimize Downtime
Along with reduced training time, PBC Linear saved almost $100,000 (USD) by reducing scrap and minimizing costly errors.

Attract Better Talent and Reduce Employee Turnover
New employees were enthusiastic to use Magic Leap’s augmented reality device to train more effectively and to increase productivity.

Simplify Training Procedures
Magic Leap’s device made PBC Linear’s training more efficient and interactive.

Save on Costs Tied to Training, Down-time and Human Error
PBC Linear realized substantial employee cost savings, including savings of more than $7,000 (USD) per employee across new machinist onboarding.

In case you missed this in-depth discussion of our manufacturing case study with PBC Linear and Taqtile, the webinar is now available for you to view. Watch Magic Leap’s video and resources 

Visit Magic Leap’s AREA member profile

The industry is bracing for major changes as 5G towers continue to pop up across the United States. Said to be up to ten times faster than 4G depending on the carrier, many people are looking forward to the improvements and efficiency 5G will bring to different aspects of connectivity.

Obviously, faster internet speeds will make the millions of people working from home since the pandemic happier and more efficient. Faster connectivity also means great things for the gaming industry, including faster download speeds for streaming and mobile gaming. Other industries will feel this transformation as well, including consumer electronics and smart home security, allowing security cameras to transfer data faster. However, the biggest benefit will be the introduction and acceleration of technological innovations reliant on faster connectivity in order to really take off.

For example, cutting-edge technology like artificial intelligence (AI), virtual reality (VR) and augmented reality (AR) are all emerging innovations that will excel as 5G continues to roll out. Although these tools will become commonplace in the many industries telecoms facilitate, AR will become a common tool to reduce costs and time spent on projects in the field for telecom organizations specifically.

As telecom companies continue to focus on the expansion of their current offerings and services, their technology is becoming increasingly more advanced, requiring highly experienced technicians. Running a talent deficit, the industry is turning to smarter solutions like AR. Wearable smart glasses can allow field workers to collaborate with the appropriate consultants at the organization’s headquarters, using AR to overlay information, training docs and video in the worker’s field of view. Applications that AR can be used for include employee training, field service management, remote support and collaboration, record keeping and inventory.

For example, to ensure uninterrupted telecom service to end users, companies conduct regular equipment inspections. These inspections are time-consuming and expensive, which is why AR is being adopted to help alleviate these pain points, ultimately cutting travel costs and allowing advanced assistance when necessary. Additionally, remote collaboration tools enabled by AR wearables help support telecom organizations’ MRO for complex data centers. Remote expert assistance provides frontline technicians with the ability to diagnose critical equipment issues more efficiently while streamlining repairs. Limiting downtime of equipment such as servers, cooling systems, and various cable arrangements provide cost savings for telecom workforces and their end users.

Currently, the adoption of AR across many industries is being slowed by the lack of high-speed connectivity. 5G will resolve any hiccups holding this technology back, getting rid of lag and stalls and increasing latency. More widespread broadband will result in a larger coverage area as well, enabling less experienced workers to get in the  field faster while communicating with an experienced remote technician. Not to mention, wireless wearables will improve mobility as well, giving workers in more active industries like construction and healthcare the full range of motion they need to complete their tasks.  5G will also allow the transmission of 3D models such as high polygon count CAD and BIM model overlay with more stability as higher amounts of data can be transmitted quicker- this is massive for construction use cases.

5G will also establish larger connectivity networks, unifying platforms such as mobile devices, smart homes and other Internet of Things (IoT) devices. Eventually, this connectivity will also lead to a much broader web of digital connections known as the metaverse.

2022 Predictions

There is no question that the rollout of 5G will cause a global digital transformation like never before. As mentioned, we will start to see technology like AR begin to accelerate with the support of fast broadband connectivity. This will create a ripple effect across multiple industries, promoting the adoption of technology with telecoms at the center

Wireless and mobile tech, such as wearables, will also begin to take off as 5G expands coverage areas — enabling telecom workers and professionals across other industries to enjoy more freedom and widespread mobility.

As a direct result of these emerging technologies, we will also begin to see more money pour into the industry with venture capitalists turning their attention to telecom innovations. With new technology and companies popping up in such a fruitful industry, we will also begin to see partnerships form, consolidating the industry.

Overall, 5G will be the catalyst for the acceleration of advanced technologies across more industries than just telecoms, broadening what’s possible in this digital age with faster connectivity.

Find out more about ThirdEye on their AREA member profile. 

There are three ways that quality inspectors can benefit from augmented reality-equipped headsets:

Real-time Feedback with Computer Vision

Augmented reality-enabled headsets can provide real-time feedback to quality inspectors. By pairing an augmented reality (AR) headset (assuming it has a camera) with the latest computer vision software, an AI algorithm may be able to spot defects or anomalies in real-time. For example, industrial companies could integrate AI with upcoming AR headsets to automatically find flaws in production.

In layman’s terms, computer vision is the process of making sense of digital images. A computer can understand what is in an image and extract information from it. This can be used to detect objects, recognize faces, and track movement. For the industrial sector, computer vision helps find imperfections on surfaces or different pieces of equipment.

With augmented reality, headsets will provide real-time feedback to quality inspectors on the manufacturing floor. More importantly, AR headsets can superimpose graphics in the quality inspector’s field of view. By overlaying labels or annotations on top of the image, the quality inspector can be given feedback on what to look for and where to find it. This technique of defect superimposition will increase the accuracy of visual defect detection and the speed at which human inspectors do it.

Training and Guidance

New augmented reality technologies can also provide training and guidance to quality inspectors. By providing step-by-step interactive instructions, augmented reality can help new quality inspectors learn the ropes of a job quickly and easily. And for experienced quality managers, augmented reality can provide additional guidance on finding specific types of defects.

For example, automotive inspectors could use augmented reality to help them identify defects on a vehicle door. Additionally, augmented reality could guide the best inspection techniques to examine a product for defects. Such a technology would help ensure that all products are visually inspected in the same manner, thus increasing accuracy.

Training is important for all factory workers, but it is vital for people in charge of quality control, as they are the ones who determine whether a particular product is in or out of tolerance. Therefore, making training and on-the-job education more interactive and enjoyable for quality inspectors should be a priority for many manufacturers.

Data Analysis

Finally, augmented reality headsets can also be used for data analysis. After an inspection is complete, the data collected by the augmented reality headset can be analyzed to look for trends or patterns. This historical data could then be used to improve the quality inspection process.

For example, if a specific type of defect is common in one area of the factory compared to another, a manufacturer could take steps to address this. Or, if a quality inspector discovers that a particular product line has many defects, the inspector could take action to improve the manufacturing process.

It may be necessary to integrate multiple data sources to implement these improvements, but augmented reality can serve as a core visual baseline to bring outside data into the fold. By spatially registering machine-readable data, AR headset location, and on-device defect detection, a recommendation engine could suggest optimizations for production processes.

When Can I Expect to See AR In My Factory?

It is still early for augmented reality in the industrial sphere, but we can expect to see more augmented reality applications appearing over the next few years. For example, one of the first augmented reality headsets to be released for industrial use is the Microsoft HoloLens. Still, we expect major tech companies to also compete in this market.

In short, AR headsets may take a little while to become commonplace in factories, but augmented reality is not a technology to ignore. The benefits of augmented reality for quality managers are too great.

How to Get Started

If you are interested in learning more about augmented reality for the industrial sector, you can do a few things. First, attend some digital trade shows and technology conferences throughout the year. We highly recommend the NVIDIA conferences. These events will give you a good overview of the current state of augmented reality and where it is headed in the future.

Second, read some recently published white papers on augmented reality for industrial use. This will help you understand how augmented reality can be used in a manufacturing setting. In addition, white paper authors often include technical applications and guides, which can help develop a practical augmented reality strategy.

Finally, if you are looking for a more hands-on approach, consider hiring an augmented reality developer. They can help you develop an AR application tailored specifically for your needs.

Conclusion

Augmented reality can help quality managers find defects before they cause a problem. By pairing an augmented reality headset with computer vision, these quality managers will get defect-finding assistance on their augmented reality headsets when visually inspecting products. This technology is still in its early stages, but augmented reality will likely revolutionize the quality inspection process.

AR in Marketing 

With the average person being exposed to between 6,000 and 10,000 advertisements per day, a successful ad has to stand out to gain any traction.

Fortunately, marketing mediums can now be brought to life using AR. Using this technology, marketers can utilize 3D animations in brochures, billboards, and even on storefronts. When ads incorporate AR, it’s almost like the viewer is playing a video game, which keeps them engaged and interested in what’s being advertised.

Coca-Cola, for example, created a successful AR ad for its Arctic Home Campaign. This campaign focused on protecting polar bears and maintaining their habitats. Through an interactive ad, visitors could attend an augmented reality event at the Science Museum in London and interact with virtual animals. This innovative event took Coca-Cola’s campaign from mere words on a page explaining why saving polar bears was important to creating a connection between viewers and the cause.

Taco Bell has used AR to advertise itself in sillier ways. Using a Snapchat filter, users were able to turn their face into a Taco Bell taco and share it with friends through the app. Other companies like Starbucks have made a game of getting an iced coffee, designing filters that help consumers decide which Starbucks drink to buy.

AR in Manufacturing

Augmented reality has provided excellent solutions for manufacturing businesses everywhere, from spotting errors to assembling a 3D prototype.

Training 

The great part of augmented reality is that there isn’t a need to waste valuable material when training employees. In the past, when a new factory employee came in and, while being trained, had to conduct a repair on a vehicle or equipment, a mistake could cost time and resources.

With ongoing advancements in tech, AR has become a valuable tool for manufacturers to train less experienced employees to reassemble and repair equipment through a realistic simulation. NASA is actively experimenting with using AR to train employees on doing repairs in outer space. The technology they utilize, Microsoft’s HoloLens headset, allows workers to “see” data that simplifies repairs.

Boeing also uses AR glasses powered by Skylight to guide technicians in wiring hundreds of planes a year.

Maintenance 

Augmented reality can also be used to assess the status of equipment, from temperature, potential points of failure, and even rate of vibration. This is especially useful for preventative maintenance and to avoid costly repairs or even business shutdowns. This also makes tracking whether a piece of equipment is due for service more manageable.

GE Aviation reports that by adding AR into their facilities, they have experienced upward of a 12% increase in efficiency. Meanwhile, Caterpillar created an app that uses AR so that technicians can perform maintenance tasks on CAT machines by following sequential instructions.

Product Development  

When developing a new product, it’s important to assess any potential process problems or quality issues before it makes its way to the consumer. Fortunately, with the integration of augmented reality in product development, AR basically lets you “sit inside your design as you’re creating it,” or, truly visualize its inner and outer workings.

While pen and paper will never go out of style, digital visualizations streamline workflows and also make employee collaboration much easier — this is especially true in a time when meeting in person isn’t always possible.

AR technology also allows engineers and designers to make further design changes or variations to a product in real-time using augmented reality before casting it to the entire team. This means different ideas and designs can be tested before a prototype is actually created.

According to Microsoft, the digitization of sales and manufacturing has also reduced delivery times by as much as four times for companies like Thyssenkrupp. Thyssenkrupp, an industrial engineering and steel production company, has used Microsoft’s HoloLens to develop mobility solutions to “help people overcome physical limitations.”

A few other benefits of AR in product development include:

• Walking inside 3D models
• Examining details from all angles
• Providing live feedback
• Making flexible adjustments

Inventory

Inventory management can benefit greatly from augmented reality, as workers can use AR headsets or tools to receive order picking instructions, the location of products, and other useful information.

Walmart announced plans in 2020 to turn four of its brick and mortar locations into “test stores” to prototype and test solutions for products in real-time.

As well, to enhance internal processes, Walmart developed an app to accelerate the time it takes to get products on the sales floor. “Instead of scanning each box individually, associates just hold up a handheld device, and the app uses augmented reality to highlight the boxes that are ready to go,” said a release from Walmart.

AR in Healthcare 

What if it were possible to see bones and organs without having to physically cut open a patient’s body? With augmented reality, surgeons can determine where to make injections, locate veins for drawing blood, perform low-risk surgeries, and save time in emergency situations.

Using AR, surgeons can enter patient CT scans and MRI data into AR headsets before surgery. This allows them to overlay this information and determine problem areas before any physical procedure takes place.

In February of 2021, Johns Hopkins performed its first augmented reality surgeries in living patients. The first surgery, which required placing multiple screws into a spine to relieve back pain, and the second surgery, one to remove a cancerous tumor, were both successful. The physicians used a headset with see-through eye displays to see images of each patient’s bones and tissue from previous CT scans, “essentially giving the surgeons X-ray vision.”

During the COVID-19 pandemic, doctors in London also utilized AR technology to keep healthcare employees safe. Using HaloLens, a live feed was streamed onto a computer screen in a nearby room, which let healthcare professionals see what the doctor was seeing when treating a patient.

Tools like Curiscope have also created an immersive experience for children to learn about the body. The “Virtuali-tee Human Body T-shirt” and accompanying app by Curiscope displays colorful and realistic human organs for educational purposes.

Where will augmented reality go from here? Maybe Pokémon Go will get its second wind of mass popularity or perhaps the new big thing will be the Metaverse, which mixes augmented and virtual reality into one.

Before 2020, technologies designed for remote work played an important but mostly supporting role. Project teams used simple video conferencing tools to meet over long distances. Digital twin technologies were evolving, guiding teams towards a deeper understanding of their facilities. Project teams who wanted to squeeze more value from their BIM data were turning towards emerging AR and VR applications. No one doubted the momentum behind these advances, but few could have predicted what came next.

As COVID-19 swept the globe, these digital technologies went from nice-to-have to mission-critical almost overnight. That’s when AR and VR started having their moment—a moment that’s quickly become the new way of working.

The article explores what that “new way” looks like, with a particular focus on:

• How BIM data and digital twin technologies drive immersive AR and VR experiences
• How VR drives efficiencies by immersing users in a virtual environment
• How AR supports smart decision-making by integrating real and digital environments
• The future of VR and AR technologies in lean project delivery

Explanations with examples are given on:

• Augmented reality, virtual reality and extended reality
• Relevant tools including digital twin, smart glasses and remote assistance.
• The context of Industry 4.0 and Pharma 4.0

The article goes on to explain how teams build interactive, immersive digital models, and walks through AR in action, as well as providing many of the benefits of AR to industry.

You can read the original article here Augmented Reality and Virtual Reality Improve Project Delivery

In a nutshell, digital twinning is the process of creating a highly realistic model of a device, system, process or product to use for development, testing and validation. Augmented reality (AR) and virtual reality (VR) come into play as well. For example, AR can show a digital twin on top of a physical machine and provide information a technician wouldn’t otherwise see, and technologists can enter the VR of a digital twin to simulate various issues.

Many folks associate the use of digital twins solely with manufacturing. While it is true that manufacturing has pioneered the use of digital twinning, use cases exist in every industry. Additionally, there are digital twinning use cases in cross-industry applications such as infrastructure and automation.

To better understand the potential uses of digital twinning, AR and VR, take a look at the use cases in a handful of industries.

Manufacturing

Aerospace, automotive and general-purpose manufacturing firms use digital twins as part of overall product development. Here are some common uses:

• creating design mock-ups to show how a finished product will work;
• fine-tuning product features and capabilities;
• defining requirements to provide guidance to component suppliers on component specifications, such as bolt size, shape and strength;
• testing and quality assurance;
• creating customer-requested modifications and other design personalization;
• creating operational and performance optimization; and
• predicting future failure modes so maintenance can be preemptively scheduled, and executing on other predictive maintenance goals.

Healthcare, retail and other human-centric industries

Companies that interact with customers can also benefit from digital twinning, which enables them to optimize patient care and customer service. Some examples include the following:

• improving operational efficiency, such as using digital twinning to optimize the flow of patients or customers through a facility;
• improving user experience by using AR and VR focus groups to test how customers or patients experience a physical facility;
• improving layout and design of facilities; and
• refining products and services for optimal appeal to customers and patients.
• Supply chain and logistics industry
• Companies that are heavily reliant on their supply chain or logistics functions can see particular benefits from digital twinning. Examples include the following:
• pre-testing the performance of packaging and packaging materials;
• optimizing routes and delivery processes; and
• improving handoffs between stages in a supply chain.

General applications of digital twins, AR and VR

One often-overlooked use case for digital twins, AR and VR applies to almost every industry: infrastructure performance and automation.

Digital twins of routers, servers, storage appliances and virtual machines can serve as testing grounds to explore performance or security vulnerabilities. The same goes for testing automated processes.

For example, let’s say an organization is rolling out a new automated process for operating system updates and patch management for infrastructure devices. Network engineers can program the automation tool to roll out the update process on the twinned environment first. In this way, they can gather configuration and performance data and share that with technology operations specialists who can revise the process if it results in unforeseen impacts.

Facilities and technology professionals can also use digital twinning to model the physical environments of systems and appliances. For example, if an organization is building out its own data center, a digital twin can model power, heating and cooling systems against rack layout. Facilities professionals can use this to check for hot spots and make sure that all control panels are easily accessible by facility personnel.

While it is true that manufacturing has pioneered the use of digital twinning, use cases exist in every industry.

Finally, organizations can use the digital twin to optimize human operational processes, such as mapping how technicians walk through the data center.

While these applications may seem futuristic, enterprise organizations are deploying them today. The infrastructure lead at a large financial services firm recently told Nemertes Research that the single most important initiative infrastructure engineers can engage in is implementing AR/VR and digital twinning in their infrastructure environments and automation testing.

A digital twin checklist for infrastructure automation

For enterprise technologists looking to get started with infrastructure digital twinning, what are the next steps? The outline below refers to a network digital twin, but the same recommendations can apply to other infrastructure components such as servers, VMs or containers and storage appliances.

Virtualize and automate all changes to the production network; that is, make sure that all changes to the production network happen through scripts and APIs. Stakeholders should allow no manual configuration.

Using this automation, capture all network configurations in a version-controlled repository, such as Git.

Use a tool like Jenkins to develop and deploy a continuous integration/continuous delivery process and workflow that includes forking the repository, proposing changes and having the tool pull down modifications. This creates scripts to implement the changes on the digital twin network, which consists of the configurations in the version-controlled repository. This involves pushing the changes out, testing that the changes are successful and notifying the network engineer that the changes are successful.

Using Jenkins’ capability, merge the repository and implement the changes on the production network.

Review and sign off on the final state — or, if needed, roll back the changes.

Consider conducting predictive maintenance on the digital twin network regularly to get early warning of any performance, security or other concerns. Where appropriate, deploy proactive patching and upgrades.

PwC’s ‘Seeing is believing’ report explores how virtual reality (VR) and augmented reality (AR) may add value to the economy by 2030 as well as the benefits it may bring to industries including manufacturing, healthcare, energy, retail and training and development.

Their findings forecasts that virtual reality and augmented reality (AR) have the potential to add $1.5 trillion to the global economy by 2030.  From creating new customer experiences to speeding up product development, VR and AR can present a broad range of opportunities for businesses.

PwC’s report is enhanced with augmented reality experiences which will provide you with additional insights.  You can visit the PwC website to download your own copy and find out the results of their report, detailing how VR and AR are transforming business and the economy.

Go to: Seeing is Believing 

Also from the PwC website:

We estimate virtual reality (VR) and augmented reality (AR) can bring net economic benefits of $1.5 trillion by 2030. But where did we get that number from? As you can imagine, estimating the potential impacts of new technologies like VR and AR is tricky and uncertain. The task is even more difficult when these technologies are expected to develop rapidly and become more deeply ingrained in our everyday lives. But we feel it’s important to highlight the potential in a way that give our clients the facts to build a business case to act – and that starts with a robust methodology.

If you’re a European stakeholder in the XR industry – particularly an XR solutions provider, academic, or researcher – you can contribute to the study and its findings by completing a survey conducted by private research institute Visionary Analytics.

Click here to complete the survey.

The survey should take approximately 20-30 minutes to complete. As compensation for your time spent, Visionary Analytics will provide you with a statistical summary of the survey results; simply provide your email address when asked. The answers that you provide will not be linked to your name or the organization that you represent.

Please complete the survey by December 14, 2021. If you have questions about this survey or the study, please contact [email protected].

As the world of AR and the Metaverse matures, the ability for software and hardware products to integrate with one another becomes a huge factor in the adoption and use of these technologies.

Dan chats with Christine Perey, the founder and principal analyst of Perey Research & Consulting and founder of The AREA, on how history reflects tech’s tendency to embrace operational and hardware silos, and why siloed products cause significant inefficiencies and increase cost.

Abridged Thoughts:

“[Interoperability in the AR world] is the ability for components, software, hardware, services from any vendor, to be able to exchange data without the user needing to concern themselves with who made that part, and so it’s the ability for multiple vendors to combine parts and their customers also to be able to combine parts into new and unique ways and come up with new, innovative solutions that solve a specific problem.

And so the interoperability also allows the market to go to scale because you’re no longer going to be focusing only on one use case or only on one component of the whole system. You can take your component into many, many different pieces of hardware, for example, something I know a lot about, or software; you could take your content and deliver it on any browser, any player.”

– Christine Perey