Collaboration

Collaboration

This use case pertains to AR assistance for two or more people in proximity or at a distance who are interacting with digital assets for the purpose of collaborative design, creation and review.

Prior to AR Adoption

Collaboration is defined as having one or more of the following characteristics:

  • Two or more people are communicating in real time
  • The participants can see the same information at the same time
  • The participants in a session are able to make comments, annotate and edit the shared digital assets
  • The shared digital assets are stored where they can be retrieved by one or more users during the session and in the future
  • The goals of collaboration include to reach consensus, co-create new digital assets or content or make decisions.

People collaborate in many ways and with a variety of tools. When people in physical proximity collaborate, they use gestures in conjunction with one or more physical models (e.g., scale replicas), or electronic or physical boards (using pens). Collaborating at a distance can be supported through platforms such as WebEx, Google Meet, GoToMeeting or other similar commercial offerings. In these cases, collaborators must use a mouse and/or keyboard to add information or to annotate shared assets. Without AR support, collaborators using shared technological solutions are almost always limited to 2D figures and text. Sometimes video and animations are used to bring a concept “to life” during a session. Alternatively, there are spaces where wearing a Virtual Reality headset, participants can collaborate and co-create using 3D models. In these cases, participants share an entirely digital environment and the objects within it.

Business Challenges AR Introduction Addresses

Collaborative AR use cases address the gap that current collaborative platforms cannot fill if participants in a review, design or problem-solving session need to interact in real time with both the real world and with digital assets. Without AR, users may not be aware of the relative positions of collaborators with respect to the digital assets. With collaborative AR platforms, the participants may be able to reduce or eliminate the time and cost of travel to share a physical place by introducing physical and digital objects into their respective environments.

Use Case with AR

Compared with other use cases, AR for collaboration is a relatively advanced use case, involving not only technologies but users who are trained and have experience with manipulating digital objects in their AR experiences. Prior to a collaborative AR session, digital assets are loaded into a “common” space. The assets that benefit the most from these use cases are 3D models which can be manipulated, modified and annotated in real time. Each participant in a collaborative AR experience is able to interact with the model as well as perceive the live interactions of other participants. The primary addition over using traditional on-line platforms for collaboration is that AR provides “presence” in 3D space. The participants can see where their collaborators are with respect to the digital assets and themselves, offering insights about concerns or new ideas.

Common roles of Users

Any professional who needs to collaborate, review or co-create digital assets

  • Designers
  • Project managers
  • Architects
  • Roles that rely on 3D data visualization

Business Benefits:

The benefits of AR-assisted collaboration can be measured primarily in terms of reducing or eliminating the need for two or more users to travel to be in the same physical space to achieve their goals. In addition, there could be benefits due to lower cognitive load, compared to using traditional collaborative platforms, and higher overall satisfaction. The experience of moving around a digital asset while it is digitally presented to multiple users is similar to that produced when a scale model is in the same physical space as users.

Requirements

AR Hardware Requirements: Visual Tracking – Mobile

Mobile - The device AR object positioning accuracy MUST be within +XXmm. The device MUST be able to scan QR code (of 2 by 2 inches) from a minimum of 5 feet from a + 60 degree off-axis. Note: Optical and/or software zooming maybe utilized.  

AR Hardware Requirements: On-board Storage – Augmented

Augmented - The device MUST have a minimum on-board memory storage of 128GB  to support the OS, advanced perception and applications Augmented - The device MUST have a minimum on-board RAM of 8GB.

AR Hardware Requirements: Inputs / Outputs: Sensors - Augmented

The device SHOULD have an IMU with accelerometer, gyrometer and magnetometer that provides information to the software about gaze, and position. The device SHOULD have a RGB camera to enable see-what-I-see, bar-code scanning and video capture. Augmented - The device MUST have time of flight depth sensor, to measure distance and depth of the world Augmented - The device MUST have two or more world cameras to enable location mapping and world reconstruction. Augmented - The device MUST have two or more eye tracking cameras to enable eye comfort and advanced perception capabilities such as a method of gaze.  

AR Hardware Requirements: Inputs / Outputs: Perception - Augmented

The device SHOULD support voice control as a method for software user interface commands. Augmented - The device COULD support eye tracking as a method of gaze, for software user interface commands. Augmented - The device COULD support gestures as a method for software user interface commands.

AR Hardware Requirements: Inputs / Outputs: Audio - Augmented

Augmented - The device COULD have multiple speakers to enable spatial audio

AR Hardware Requirements: Inputs / Outputs: Augmented

Augmented - The device MUST support a minimum resolution of 1280x960

AR Hardware Requirements: Field of View - Augmented

Augmented - The device MUST provide a 3D view (the images for both eyes are fully overlapping, just offset to provide the perception of 3D).

Augmented - The device MUST provide a minimum 35 degree diagonal field of vision where AR content can be displayed. Augmented - The device SHOULD provide a minimum 50 degree diagonal field of vision where AR content can be displayed.

Augmented - The device SHOULD have a variable range of operation from 40 cm to infinity, with HW support for developers to utilize from 20cm

AR Hardware Requirements: Environmental - Augmented

Augmented -  The device SHOULD work in ambient temperatures 10ºC to 30ºC, 5 to 95% relative humidity Augmented -  The device displays SHOULD provide visible (easy to read) displays while in full ambient light conditions. Augmented - Commercial devices SHOULD work in environmental requirements documented in IP20 or greater Augmented - Industrial devices MUST work in environmental requirements documented in IP53 or greater

AR Hardware Requirements: Battery Life - Generic

Under typical use, battery performance SHOULD not experience degradation Under typical use, the device battery life SHOULD be at a minimum of multiple hours. (standby v usage) Battery life COULD be extended via external battery packs or an integrated swappable battery The device SHOULD charge to 90% of capacity within 110 minutes, full within 180 minutes The device COULD have an external battery level of charge indicator

AR Hardware Requirements: Inputs / Outputs: Controller

Augmented - The device may support connection to a 6DoF controller for high precision control. (1st party)

AR Hardware Requirements: Inputs / Outputs: Mouse / Touchpad

The device COULD support connection to a Bluetooth mouse / Touchpad style device.

AR Hardware Requirements: Inputs / Outputs: Perception

The device SHOULD support voice control as a method for software user interface commands.  

AR Hardware Requirements: Inputs / Outputs: Processing

CPU (per device category) GPU (per device category) To be defined

AR Hardware Requirements: Inputs / Outputs: Sensors

The device SHOULD have an IMU with accelerometer, gyrometer and magnetometer that provides information to the software about gaze, and position. The device SHOULD have a RGB camera to enable see-what-I-see, bar-code scanning and video capture.

AR Hardware Requirements: Safety

Industrial devices MUST be intrinsically safe. The device SHOULD be able to be worn while wearing the required safety headgear (hard hat or bump cap). The device SHOULD meet OSHA and MSHA requirements for safety glasses. The device SHOULD have the option to meet side shield safety requirements. Electromagnetic - to be defined

AR Hardware Requirements: Visual Tracking - Augmented

Augmented - The device SHOULD perform on-board computing of spatial maps Augmented - The device SHOULD allow developers to access the computed spatial maps for application and tracking sdk development Augmented - The device AR object positioning accuracy MUST be within +5mm The device MUST be able to scan QR code (of 2 by 2 inches) from a minimum of 5 feet from a + 60 degree off-axis. Note: Optical and/or software zooming maybe utilized.

AR Hardware Requirements: Wear Ability / Comfort - Augmented

Augmented - The device weight worn on the head shall range between 260 grams and 560 grams The device shall support the addition of prescription lenses or fit over users spectacles The device shall have the ability to automatically adjust to the users Inter Pupillary Distance (IPD) to assist with ensuring eye comfort.

AR Software Requirements: AR Content Support

3D Visual Content
  • The content generation and consumption tool MUST support open 3D model formats.
  • The content generation and consumption tool SHOULD support proprietary 3D model formats.
  • The content generation and consumption tool SHOULD support animations.
2D Visual Content
  • The content generation and consumption tool MUST support open 2D formats.
  • The content generation and consumption tool SHOULD support proprietary 2D formats.
Media Content
  • The content generation and consumption tool SHOULD support open video formats.
  • The content generation and consumption tool SHOULD support open audio formats.

AR Software Requirements: AR Content: SOP

User Privileges The solution SHOULD require acknowledgment a Standard Operating Procedure (SOP)

AR Software Requirements: AR Localization

Matching the user's current environment with a previously mapped environment, along with understanding the user's current placement inside that digital environment. The device MUST support AR localization The platform SHOULD support Fast localization via localization hinting (e.g., QR Code, ArUco, or Assisted GPS) The platform SHOULD support marker-based tracking (e.g., using ArUco, AprilTag, or QR Code) The platform COULD support model-based tracking (e.g., CAD, scanned models) The platform COULD support real-time spatial tracking (e.g. SLAM)

AR Software Requirements: Integration

The solution SHOULD share data across integrated systems (i.e. LMS, MES, ERP, PLM) The solution COULD share data across users (e.g., between users during shift changes, knowledge base repositories, etc.)

AR Software Requirements: Manageability - on device

Embedded The platform SHOULD support 3rd party MDM/UEM agents Embedded The platform SHOULD support virtual private networks (VPNs) Embedded The platform MUST manage or disable device settings Embedded The device COULD support locked task mode which locks user from accessing restricted applications and device settings

AR Software Requirements: Mobile Device Management (MDM) - enterprise control

The platform MUST be able to control the permission to access third-party developers access to sensors and cameras The platform MUST allow MDM to control direct install/side load The platform SHOULD manage or disable device settings The device SHOULD support multi-user logins The platform SHOULD support over-the-air (OTA) or similar device provisioning The platform SHOULD support application management via MDM The platform COULD support remote access via MDM

AR Software Requirements: OS Features

Embedded The device software MUST support a single user accounts per device Embedded The device software SHOULD support multiple user accounts per device Embedded/Application The device software SHOULD support a web browser Embedded The device SHOULD allow third-parties developers the ability to read and write stored digital content Embedded The device MUST support file transfer Embedded The device MUST allow third-party developer access to sensors and cameras Embedded The device SHOULD support direct install/side load Embedded The device SHOULD support GDPR

AR Software Requirements: Production Deployments

Application The application SHOULD be deployable into multiple environments including on-premises (local cloud) and public cloud Application The applications MUST support General Data Protection Regulation (GDPR) requirements Application The application COULD be deployable into the Hybrid Cloud Application/Embedded The device MUST support access while off-network The platform COULD support the requirements of the Open AR Cloud Association

AR Software Requirements: Security

Application - the device SHOULD at least adhere to IEE/UL P2933 Application - the platform SHOULD support 3rd Party VPN Application - the platform SHOULD support Zero Trust configurations Application - the platform SHOULD use X509 certificates Application - the platform COULD support AES 256 device encryption Authentication - the solution SHOULD authenticate the user

AR Software Requirements: Software Developer Kits (SDKs) and Tools

The platform SHOULD support commonly available desktop software development tools The native SDK MUST enable access to device-specific functions The SDK SHOULD support common available AR deployment tools (e.g. Unity, Unreal, etc) The SDK SHOULD support cross-device development (e.g., Windows, MacOS, and Linux) The platform COULD support a cross-platform open AR Cloud SDK (https://github.com/OpenArCloud) Only Augmented - The platform SHOULD be OpenXR compliant The SDK MUST allow third-party developer access to sensors and cameras

AR Software Requirements: Supporting Use Cases: Authoring Augmented Reality Content

The authoring solution MUST support AR localization The authoring tool MUST originate content in the digital environment

Tags

All of the above Augmented Device Tablet / phone 

Settings

Industries

Architecture Automotive Aviation and Aerospace Chemical Commercial Vehicle Construction and Engineering Education Emergency Response Farming Food and Beverage Government Healthcare Industrial Equipment Logistics Manufacturing Marine Medical Metals & Mining Oil & Gas Power & Energy Smart Cities Telecommunications Transportation Utilities