Capture and Reporting of Hazardous Incidents in Augmented Reality

In many industries, corporate, public or industry policies require documenting the circumstances of a hazardous incident and steps taken by an individual or group to reduce or eliminate risks to equipment, employees or others. In order to comply with such policies, it is valuable to have user-worn (user perspective) recording systems automatically triggered and the observations of all sensors encrypted for secure reporting. In some circumstances, a user can self-report incidents by completing an AR-enhanced report form through gestures and auditory commands which are then uploaded and recorded, possibly disseminated to appropriate functions within the organization for corrective actions (Facilities, EHS, etc.)

Alternatively, a constant recording buffer on a user device could be implemented. This could be paired with an artificial intelligence to recognize incidents and/or corrective actions. This may automatically default to an on-premise/centralized or cloud-based management system. For there to be consistent and compliant recording and reporting, AR devices could comply with a capture trigger specification, a capture and encryption protocol and, perhaps, produce reports in standard formats that are acceptable for regulatory and compliance tracing.

This research topic contributes technical requirements and potential solutions to be submitted for standardization in one or more bodies for the purpose of reducing the complexity of integrating AR-assisted automatic incident capture into the IT infrastructure of appropriate authorities.

The topic includes definition of automatic AR-assisted or enabled capture technology types suitable for hazardous incident reporting, resolutions of and compression rates for video and audio, data types to be captured (e.g., location data, temporal parameters, identities of nearby people and other), local and remote security to comply with anti-tampering precautions, and other relevant parameters, regardless of the maker of the AR display devices used.

Stakeholders

Standards bodies, risk managers, safety managers, policy managers, AR developers, IT developers, designers and manufacturers of enterprise AR displays would benefit from there being standards developed in this domain.

Possible Methodologies

The topic requires definition of requirements for automatic, real time, user-perspective, tamper-resistant capture technology that documents situations, user actions and other relevant parameters for compliance purposes. Requirements must then be codified into specifications following industry norms and consensus of group members.

Research Program

This research topic can be combined with industry-specific research projects such as the development of body-worn cameras by law enforcement officers. It can also be an extension to cybersecurity research, research about media encryption and standards pertaining to other methods of incident reporting.

Miscellaneous Notes

Could be an offshoot of UL8400 or BSI IST/31

Keywords

Standards requirements, standard specifications, hazard management, risk management, safety management, data capture, data integration, data encryption, cybersecurity, occupational risks, risk assessment, risk perception, accidents, occupational health, occupational safety, safety, health and safety, health hazards, safety devices, safety factor, safety systems, fault detection, monitoring, system monitoring

Research Agenda Categories

Standards, Technology

Expected Impact Timeframe

Medium

Related Publications

Using the words in this topic description and Natural Language Processing analysis of publications in the AREA FindAR database, the references below have the highest number of matches with this topic:

• Lutz, R. R. (2018). Safe-AR: Reducing Risk While Augmenting Reality. 2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE).
• Speicher, M., Hall, B. D., Yu, A., Zhang, B., Zhang, H., Nebeling, J., & Nebeling, M. (2018). XD-AR. Proceedings of the ACM on Human-Computer Interaction, 2(EICS), 1-24.
• Abdelrazeq, A., Kohlschein, C., & Hees, F. (2019). A Cloud Based Augmented Reality Framework – Enabling User-Centered Interactive Systems Development. Advances in Intelligent Systems and Computing, 417-422
• Lebeck, K., Ruth, K., Kohno, T., & Roesner, F. (2018). Towards Security and Privacy for Multi-user Augmented Reality: Foundations with End Users. 2018 IEEE Symposium on Security and Privacy (SP).
• Mukhametshin, S., Makhmutova, A., & Anikin, I. (2019). Sensor Tag Detection, Tracking and Recognition for AR Application. 2019 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM).

More publications can be explored using the AREA FindAR research tool.

Author

Christine Perey

Last Published (yyyy-mm-dd)

2021-08-31

Go to Enterprise AR Research Topic Interactive Dashboard