The Augmented Reality Response Platform (ARRP) was tested and validated by the INGENIOUS partners during the Small-Scale Test #10 (SST#10) which took place from the 27^th to the 29^th of September 2022, in Bilbao, Spain.

At this test, our partners in CS GROUP had the opportunity to present the latest version of the Augmented Reality Response Platform (ARRP) and to provide the First Responders (FRs) with two types of components:

• An Augmented Reality (AR) application, deployed on a HoloLens, is used to support them in their tasks at hand. During the SST they presented improvements regarding the AR annotations. FR are now able to delete any AR annotations directly from the field, by just pushing an AR button next to the annotation. This feature was expected as it provides them with the capability to remove any annotations that are deprecated or that have been placed by mistake. We are also displaying a short text description above the AR icon. This text, input from the control centre, can then be used to point out a specific annotation in the text of a mission that the FR receives in AR. The annotation description is also visible next to the annotation icon on the AR minimap, helping the FR to identify where he has to go.
• A remote assistance system, with two applications, one deployed on a laptop and dedicated to an operator in the control centre (CC) and one deployed on the HoloLens dedicated to the FR in the field. The system provides the capability to initiate audio and video communication between the FRs. The operator in the CC seeing the point of view of the FR in the field (using the video from the camera of the HoloLens), and the FR in the field seeing the operator using the integrated camera of the laptop. In addition to the communication channel, they are able to annotate, live and in AR, the point of view of the FR in the field. The AR content helps point out specific areas or objects in front of the FR in the field providing him with visual and precise guides.  

FRs appreciated the proposed improvement, confirming the added value of the ARRP.

Read about the results from the 1st round of SSTs and SST#1 for the testing and validation of the ARRP here.

The Small Scale Test #10 (SST#10) of the Helmet, which has been developed by our partners in KIRO, was held in Korea with the participation of the people concerned. The main test item is real-time video transmission of helmet modules of the latest version.

• The final version of the helmet module has improved wearability. Previously, the center of gravity was pushed forward, which made it uncomfortable to wear. In the advanced version, the module is changed to be attached to the side of the helmet to alleviate the leaning phenomenon.

• In addition, a new method was introduced for the convenience of maintenance and battery replacement. Adopting a sliding rail makes it easy to open and close the module. And the magnet catch is installed, so there is no need to use screws, which adds to the convenience of opening and closing.

• The test was conducted with three First Responders wearing helmet modules to locate victims and fire in a smoke environment. First responders enter their respective doorways and begin searching in a counter-clockwise direction. First, a First Responder finds the victim and asks for help to transport him to safety area. Another member of FR who was close to the injured person helps to move him. The other one continues to search and finds the fire and goes into extinguishing work. During all these missions, the control center monitors and coordinates the situation.
• Through this experiment, it was confirmed that there is no problem with the function of simultaneously transmitting and receiving videos acquired from three different modules.

Read about the results from the 1st round of SSTs and SST#1 for the testing and validation of the Helmet here.