DIDYMOS-XR

Better digital twins to drive the future of cities and industries

The digital transformation and the availability of more diversified and cost-effective means for 3D capture have led to the creation of digital twins also for physical environments. Based on such digital twins, various applications could be built using real-time data from real-world environments, serving as a blueprint for smart cities and for improving performance and efficiency across industries. Currently, creating high-fidelity digital twins is costly, and their update requires manual intervention. Furthermore, data integration from heterogeneous sensors is challenging. The EU-funded DIDYMOS-XR project will implement technology to create improved large-scale digital twins, synchronised with the real world. DIDYMOS-XR will investigate and develop methods for data reconstruction and mapping from heterogeneous inputs, including static and mobile sensors, AI-based data fusion, scene understanding and rendering.

Project domains

Interaction & Enabling Technologies
Digital Twins
Extended Reality
Sensors (not IoT)
Sectors
Smart cities

Publications

Title Type of output
Perception for Connected Autonomous Vehicles under Adverse Weather Conditions Conference proceedings
User-Centric Evaluation Methods for Digital Twin Applications in Extended Reality Conference proceedings
MGSO: Monocular Real-Time Photometric SLAM with Efficient 3D Gaussian Splatting Conference proceedings
HINT-3D: Human-in-the-Loop Interactive Test-Time Adaptation for 3D Segmentation Conference proceedings
Deep 3D Geometric Saliency Estimation from Light Field Images Conference proceedings
HAME-NeRF: High Accuracy Mesh Extraction Leveraging Neural Radiance Fields Conference proceedings
Visual Localization in Complex Environments: Merging Traditional Geometry with Learning-Based Techniques Conference proceedings
Volumetric Video Reconstruction and Communications: Toward a New Era of Interactive and Immersive Social Virtual Reality (VR) Experiences Conference proceedings
Training a Segmentation-Based Visual Anonymization Service for Street Scenes Conference proceedings
GDNeRF: Generalizable Depth-based NeRF for sparse view synthesis Conference proceedings
HAL-NeRF: High Accuracy Localization Leveraging Neural Radiance Fields Conference proceedings
Leveraging Anisotropic Error for Robust Point Cloud Registration Conference proceedings
Urban Scene Removal and Completion Conference proceedings
Visual localization using implicit representations and particle filtering-based pose refinement Peer reviewed articles
ExpPoint-MAE: Better Interpretability and Performance for Self-Supervised Point Cloud Transformers Peer reviewed articles
Interactive digital twins enabling responsible extended reality applications Peer reviewed articles
MaskUno: Switch-Split Block For Enhancing Instance Segmentation Peer reviewed articles
Digital Twins for Extended Reality Tourism: User Experience Evaluation Across User Groups Conference proceedings
Reimagining Historical Exploration: Multi-User Mixed Reality Systems for Cultural Heritage Sites Peer reviewed articles
Cooperative Perception for Digital Twin Reconstruction* Conference proceedings

Do you want to learn more or discuss about this project?
Visit the Openverse Wiki page for DIDYMOS-XR

Disclaimer and intellectual property acknowledgement: the materials showcased on this page have been produced by third parties, and the OPENVERSE consortium accepts no liability for any inaccuracies therein. Responsibility for the content of each asset rests solely with its original creator. The inclusion of these outputs on this page does not, in any way, constitute an endorsement on the part of the OPENVERSE consortium. All intellectual property rights relating to the content published here remain vested in their respective owners. This page should be understood simply as a practical point of access.