What is NEM?
NEM (New European Media) is a European deliberative body which maps research and innovation needs in Europe and gets political decision-makers, such as those at the European Commission, talking about them. One of the major achievements of the NEM is the creation of a regularly updated strategic research and innovation program. Additionally, NEM hosts an annual conference to bring the community together and facilitate discussions of current research topics within the media. NEM brings together the world of university research and the innovation needs of industry. This year, the NEM Summit was held at the VRT. The VRT also currently sits on the NEM steering committee.
1. Virtual worlds as a reflection of European values
Anne Bajart from the European Commission highlighted the vision of virtual worlds that must reflect European values such as privacy, transparency and inclusiveness, as an alternative to the large (non-European) platforms that are currently conquering the market. More than 200 European companies and organizations are working on an ecosystem in which 6G technology will play an important role in integrating the physical and virtual worlds through “digital twins”. This innovative network should promote not only technology, but also social standards.
2. Generative AI as a catalyst for XR
According to Giuseppe Amato (CNR ISTI), generative AI can significantly accelerate the process of converting physical environments into digital representations. Thus, virtual worlds can be made more dynamic, allowing physical events to realistically combine physical and digital aspects.
3. AI-Driven Perception for XR Applications
Dr. Jason Rambach from the German Artificial Intelligence Research Center highlighted the importance of AI-based perception to better understand the environment and user interactions. This technology makes it possible to realistically model the world and interactions in XR, considerably expanding the scope of application of XR.
4. The future of always-on AI assistants
A new wave of always-on AI assistants, often worn as wearable devices, has been considered “the third wave of computing” after the PC and the smartphone. These AI applications give users the ability to proactively interact with their environment and even predict and correct errors before they occur.
5. Regulation and ethics in an always-connected world
During a debate, the importance of legislation in striking the balance between innovation and privacy protection was discussed. The growing possibilities of always-connected devices come with privacy challenges that speakers say require a robust policy approach.
6. Research on digital twins for dynamic environments
The DidymosXR project studies how digital representations of the physical world – known as digital twins – can be adjusted in real time. Take changes such as new seasons, objects or buildings. AI and LiDAR technologies are used to ensure digital twins are always accurate, with the aim of improving applications such as location-based data visualization.
7. Cultural heritage in the XR world
The TransmiXR project studies how immersive media can enhance cultural heritage through innovative storytelling formats. Using social XR, design studios and heritage organizations can work together to create innovative experiences that appeal to a wider audience.
8. Innovations in 360° multicam media thanks to 3Cat
Catalan public channel 3Cat presented new technologies for 360° multicam recordings and a special web player, which offers viewers a fully immersive media experience. These technologies enable new forms of content consumption and increase viewer involvement in live events.
9. Accessibility in virtual worlds
Of course, these new forms of content also present many challenges when it comes to making content accessible. Research at various European universities is focusing on this problem and trying to come up with solutions to make 3D content accessible using language technology and other AI tools.
Innovation as the key to future-proof XR
The NEM Summit 2024 made it clear that technological advancements within XR and the metaverse cannot be considered free from ethical issues. Dieter Boen, Head of Innovation at VRT, emphasized that innovation with XR is not only about technological possibilities, but also about supporting human stories: “Innovation in XR is about discovering new knowledge and techniques to bring stories to life in very innovative ways. »
In line with this vision, NEM works collaboratively with various experts and policy makers to explore both the opportunities and challenges related to these emerging technologies. By combining XR, AI and strong ethical guidelines, Europe hopes to play a pioneering role in developing virtual worlds that are not only technologically advanced, but also ethically and socially responsible. The European Commission recently called on companies to also contribute to building a partnership around virtual worlds. The summit ended with an open discussion on how to achieve such a partnership.
