Presentation of the CORTEX² Project

Overview of CORTEX²:

As part of my work with Actimage, I contributed to the development of CORTEX², a project aimed at transforming remote collaboration through advanced XR (Extended Reality) technologies. Funded by the European Union, CORTEX² focuses on creating a digital XR platform to support various activities requiring physical interaction with the environment, such as industrial cooperation, technical training, and business meetings.

Our goal is to make remote collaboration easy, efficient, and accessible across diverse industries.

VR Training Component:

In the VR training module of CORTEX², I played a key role in developing a comprehensive training environment. This module leverages Unity, OpenXR, and Mirror Networking for multiplayer capabilities to provide an immersive and interactive experience. We used Strapi in conjunction with RainbowUnity API for efficient backend management and API interaction.

Additionally, we utilize WebRTC (through RainbowUnity API) to stream the video feed of trainees to the trainer, who can monitor the training session from a fixed PC or tablet. The trainer has full administrative control, including the ability to teleport trainees between training sessions or to the lobby, restrict their movements, and more. The lobby features a board that transforms into a webcam or screen sharing display, allowing the trainer to explain concepts interactively.

Key Technologies:

• Unity: Utilized for developing the interactive and immersive training environment.
• OpenXR: Ensures compatibility across various VR hardware. We are able to run our app on Quest2, Quest3, Pico VR, HTC Vive, PC VR.
• Mirror Networking: Facilitates seamless multiplayer training sessions.
• Strapi and RainbowUnity API: Manage backend operations and API interactions efficiently.
• WebRTC: Streams trainee video feeds to the trainer for real-time monitoring and interaction.

Future Prospects

We are continuously working to enhance the VR training module with advanced features and broader use cases. Potential additions include video integration and more interactive elements to further improve the user experience.

For more detailed information, please visit the CORTEX² website.