SUN

Lifelike social environments in extended reality

Extended reality (XR) is an emerging technology with promising potential in many fields including health, communication and safety. However, overcoming XR’s limitations in providing authentic interactive social environments is key to further developing its applications. The EU-funded SUN project aims to advance the social interactivity of XR technology by establishing scalable models with sustained and convincing virtual environments. The project will also improve the data-processing capability of wearable devices and develop wearable sensors and tactile interfaces to improve user experience. SUN will validate these models in three real-life situations: rehabilitation therapy, improved safety and social interaction among workers, and facilitate interaction for disabled users.

Project domains

Interaction & Enabling Technologies
Extended Reality
Haptics / Senses
Interaction
Sensors (not IoT)
Wearables
Sectors
Healthcare

Publications

Title Type of output
Information Dissimilarity Measures in Decentralized Knowledge Distillation: A Comparative Analysis Conference proceedings
VISIONE 5.0: Enhanced User Interface and AI Models for VBS2024 Conference proceedings
Impact of generative artificial intelligence on workload, efficiency and labour productivity Conference proceedings
A survey on class-agnostic counting: Advancements from reference-based to open-world text-guided approaches Peer reviewed articles
The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-2024 Peer reviewed articles
Training-free sparse representations of dense vectors for scalable information retrieval Peer reviewed articles
The Devil is in the Fine-Grained Details: Evaluating open-Vocabulary Object Detectors for Fine-Grained Understanding Peer reviewed articles
In the Wild Video Violence Detection: An Unsupervised Domain Adaptation Approach Peer reviewed articles
Evaluating Performance and Trends in Interactive Video Retrieval: Insights From the 12th VBS Competition Peer reviewed articles
nSimplex Zen : A Novel Dimensionality Reduction for Euclidean and Hilbert Spaces Peer reviewed articles
Computer-Supported Strategic Decision Making for Ecosystems Creation Peer reviewed articles
Geometric deep learning for statics-aware grid shells Peer reviewed articles
A Learnheuristic Algorithm for the Capacitated Dispersion Problem under Dynamic Conditions Peer reviewed articles
Tokenized Markets Using Blockchain Technology: Exploring Recent Developments and Opportunities Peer reviewed articles
Algorithms Peer reviewed articles
Mind the Prompt: A Novel Benchmark for Prompt-Based Class-Agnostic Counting Conference proceedings
Beyond human imagination: The art of creating prompt-driven 3D scenes with Generative AI Conference proceedings
A Comparative Demonstration of Relevance Feedback Methods for Image Retrieval Conference proceedings
3D Visualization of Biological Data in Ultra High Definition Virtual Reality Conference proceedings
Breaking the 2D Dependency: What Limits 3D-Only Open-Vocabulary Scene Understanding Conference proceedings
Is CLIP the main roadblock for fine-grained open-world perception? Conference proceedings
Skipping Spheres: SDF Scaling & Early Ray Termination for Fast Sphere Tracing Conference proceedings
Comparative Analysis of Relevance Feedback Techniques for Image Retrieval Conference proceedings
Spatio-Temporal 3D Reconstruction from Frame Sequences and Feature Points Conference proceedings
Enhanced real-time motion transfer to 3D avatars using RGB-based human 3D pose estimation Conference proceedings
The Emotions of the Crowd: Learning Image Sentiment from Tweets via Cross-Modal Distillation Conference proceedings
ViSketch-GPT: Collaborative Multi-scale Feature Extraction For Hand-Drawn Sketch Retrieval Conference proceedings
AI-Driven Specular Removal for 3D Asset Creation Conference proceedings
Multimedia Information Retrieval in XR Conference proceedings
Text-to-Motion Retrieval: Towards Joint Understanding of Human Motion Data and Natural Language Conference proceedings
SegmentCodeList: Unsupervised Representation Learning for Human Skeleton Data Retrieval Conference proceedings
Vec2Doc: Transforming Dense Vectors into Sparse Representations for Efficient Information Retrieval Conference proceedings
MC-GTA: A Synthetic Benchmark for Multi-Camera Vehicle Tracking Conference proceedings
An Optimized Pipeline for Image-Based Localization in Museums from Egocentric Images Conference proceedings
Vi-SketchGPT: A Novel Multi-Scale and Context-Aware Representation for Sketch Generation and Classification Peer reviewed articles
Joint-Dataset Learning and Cross-Consistent Regularization for Text-to-Motion Retrieval Peer reviewed articles
ACM Transactions on Graphics Peer reviewed articles
Multimodal fusion of inertial sensors and single RGB camera data for 3D human pose estimation based on a hybrid LSTM-Random forest fusion network Peer reviewed articles
Creating High-quality 3D Assets for Realistic xR Solutions Peer reviewed articles
Texture Inpainting for Photogrammetric Models Peer reviewed articles
A discrete-event simheuristic for enhancing urban mobility Peer reviewed articles
Modeling and Optimization of NO2 Stations in the Smart City of Barcelona Peer reviewed articles
METAVERSE IN HIGHER EDUCATION Conference proceedings
The Wizard Apprentice: A Serious Games System in Immersive VR as a Feasible Rehabilitation Approach in Children With Cerebral Palsy Peer reviewed articles
Procedural generation of geometric patterns for thin shell fabrication Peer reviewed articles
Extended reality and metaverse technologies for industrial training, safety and social interaction Peer reviewed articles
Bridging the Digital Divide: A Human Rights-Based Approach to Digital Literacy and Equity in the EU Book chapters
MusiCityX: Conceptual Tools for Urban Architectural Design through Music Composition Conference proceedings
SUN: Social and hUman ceNtered XR - A Horizon Europe Project Paving the Way for the Widespread Adoption of Extended and Virtual Worlds Monographic books
A biased-randomised iterated local search for the team orienteering arc routing problem allowing different origin and destination Peer reviewed articles
A Learnheuristic Algorithm Based on Thompson Sampling for the Heterogeneous and Dynamic Team Orienteering Problem Peer reviewed articles
Using Reinforcement Learning to Solve a Dynamic Orienteering Problem with Random Rewards Affected by the Battery Status Peer reviewed articles
CONTEXT-GAD: A Context-Aware Gaze Adaptive Dwell model for Gaze-based Selections in XR Environments Conference proceedings
A Direct-Drive, Wearable Armband Device to Experiment Combined Continuous and Vibrotactile Haptic Feedback for Guidance in Motor Tasks Conference proceedings
Effect of Gaze Visualization on Task Efficiency and User Behavior for Guidance Scenarios in Co-Located AR Collaboration Conference proceedings
The Social and hUman CeNtered XR: SUN XR Project Conference proceedings
A Gaze Prediction Model for Task-Oriented Virtual Reality Conference proceedings
A Lightweight Haptic Feedback Glove Employing Normal Indentation, Lateral Skin Stretch and both Softness and Hardness Rendering Conference proceedings
A Miniature Direct-Drive Hydraulic Actuator for Wearable Haptic Devices based on Ferrofluid Magnetohydrodynamic Levitation Conference proceedings
Social and hUman ceNtered XR Conference proceedings
Rendering Fine Tactile Feedback With a Novel Hydraulic Actuation Method for Wearable Haptic Devices Peer reviewed articles
Hardware-Efficient EMG Decoding for Next-Generation Hand Prostheses Conference proceedings
SUN Accessibility Pilot: Extended reality for people with serious mobility and verbal communication diseases Conference proceedings
Enhancing EEG Classification for Motor Imagery Control of a VR Game based on Deep Learning Techniques on Small Datasets Conference proceedings
Embodied Augmented Reality for Lower Limb Rehabilitation Conference proceedings
Optimization frameworks for bespoke sensory encoding in neuroprosthetics Peer reviewed articles
The expanding horizon of neurotechnology: Is multimodal neuromodulation the future? Peer reviewed articles
Replacing Attention with Modality-wise Convolution for Energy-Efficient PPG-based Heart Rate Estimation using Knowledge Distillation Peer reviewed articles
Bridging Bench to Bedside for Brain Health: Non-Invasive Brain Stimulation for Neurodegenerative Diseases Peer reviewed articles
Our research path toward the restoration of natural sensations in hand prostheses Peer reviewed articles
Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills Peer reviewed articles
A Knee Rehabilitation Exercises Dataset for Postural Assessment using Wearable Devices Peer reviewed articles
Remapping Wetness Perception in Upper Limb Amputees Peer reviewed articles
Safety, tolerability and blinding efficiency of non-invasive deep transcranial temporal interference stimulation: first experience from more than 250 sessions Peer reviewed articles
A sensory-motor hand prosthesis with integrated thermal feedback Peer reviewed articles
A Framework for Modeling, Optimization, and Musculoskeletal Simulation of an Elbow–Wrist Exosuit Peer reviewed articles
Restoration of natural thermal sensation in upper-limb amputees Peer reviewed articles
Bibliometric Analysis of Immersive Technologies in Supply Chain Strategy: Knowledge-Based Systems Case Conference proceedings
A Framework for Vision-Based 3D Inspections for Maintenance Activities and Digital Twin Integration Conference proceedings
Wireless Haptic Glove using Nitinol as a Force Feedback Actuator Conference proceedings
Hand Teleoperation with Combined Kinaesthetic and Tactile Feedback: A Full Upper Limb Exoskeleton Interface Enhanced by Tactile Linear Actuators Peer reviewed articles
A Biased-Randomized Discrete Event Algorithm to Improve the Productivity of Automated Storage and Retrieval Systems in the Steel Industry Peer reviewed articles
A Hybrid Simulation and Reinforcement Learning Algorithm for Enhancing Efficiency in Warehouse Operations Peer reviewed articles
Simulation of Heuristics for Automated Guided Vehicle Task Sequencing with Resource Sharing and Dynamic Queues Peer reviewed articles

Do you want to learn more or discuss about this project?
Visit the Openverse Wiki page for SUN

Disclaimer and intellectual property acknowledgement: the materials showcased on this page have been produced by third parties, and the OPENVERSE consortium accepts no liability for any inaccuracies therein. Responsibility for the content of each asset rests solely with its original creator. The inclusion of these outputs on this page does not, in any way, constitute an endorsement on the part of the OPENVERSE consortium. All intellectual property rights relating to the content published here remain vested in their respective owners. This page should be understood simply as a practical point of access.