TransMIXR

Collaborative immersive media experience creation and consumption through social XR

The advancement of extended reality (XR) and artificial intelligence (AI) has given the European creative and cultural sector (CCS) the opportunity to revolutionise digital co-creation, interaction and engagement. The EU-funded TRANSMIXR project will develop human-centred tools for collaborative co-creation and consumption of multi-modal immersive media through social XR. Using the Living Labs methodology, the project will bring together the necessary interdisciplinary skills and domain expertise to design and develop such human-centric tools and immersive media experiences. TRANSMIXR will pilot the technology in news media and broadcasting, performing arts and cultural heritage. It will also establish collaborations to demonstrate the transferability of these experiences to new domains outside the news media, arts and cultural sectors.

Project domains

Interaction & Enabling Technologies
AI / ML
Extended Reality
Virtual Worlds
Sectors
Arts & culture
Entertainment
User & Experience Dimensions
Co-creation and community engagement
Collaborative platforms

Publications

Title Type of output
Enhancing User Control in AI-Based Video Summarization for Social Media Conference proceedings
An Experimental Study on Generating Plausible Textual Explanations for Video Summarization Conference proceedings
ACM Transactions on Multimedia Computing, Communications and Applications Peer reviewed articles
A Comparison of Gender Differences and Performance Metrics in a VR-Based Auditory Conference proceedings
Gaussian Splatting vs. Classical Photogrammetry: A Comparison for Virtual Backdrops Conference proceedings
Enhancing Immersive Experiences through 3D Point Cloud Analysis: A Novel Framework for Applying 2D Visual Saliency Models to 3D Point Clouds Conference proceedings
Exploiting LMM-based knowledge for image classification tasks Conference proceedings
TSalV360: A Method and Dataset for Text-driven Saliency Detection in 360-Degrees Videos Conference proceedings
Disturbing Image Detection Using LMM-Elicited Emotion Embeddings Conference proceedings
Video Shot Discovery Through Text2Video Embeddings in a News Analytics Dashboard Conference proceedings
UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications Peer reviewed articles
MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025 Conference proceedings
Subjective Qality Evaluation of Point Clouds using Remote Testing Conference proceedings
VidCtx: Context-aware Video Question Answering with Image Models Conference proceedings
VERGE in VBS 2026 Conference proceedings
Online Anchor-based Training for Image Classification Tasks Conference proceedings
Auto-summarization of Human Volumetric Videos Conference proceedings
Visual-Saliency Guided Multi-modal Learning for No Reference Point Cloud Quality Assessment Conference proceedings
An LLM Framework for Long-Form Video Retrieval and Audio-Visual Question Answering Using Qwen2/2.5 Conference proceedings
A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods Conference proceedings
LMM-Regularized CLIP Embeddings for Image Classification Conference proceedings
Prototype Anchoring for Image Classification Tasks Conference proceedings
TSV360: A dataset for training and objective evaluation of text-driven 360-degrees video saliency detection methods Other
Gaussian Splatting vs. Classical Photogrammetry: Input Data Other
Gaussian Splatting vs. Classical Photogrammetry: 3D Models Other
Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video Other
PointPCA+: A full-reference Point Cloud Quality Assessment metric with PCA-based features Peer reviewed articles
PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors Peer reviewed articles
Subjective and Objective Quality Assessment for Dynamic Point Cloud with Visual Attention in 6 DoF Peer reviewed articles
Delay Threshold for Social Interaction in Volumetric eXtended Reality Communication Peer reviewed articles
Comparison of Visual Saliency for Dynamic Point Clouds: Task-free vs. Task-dependent Peer reviewed articles
A QoE and Visual Attention Evaluation for 360° videos with non-spatial and spatial audio Peer reviewed articles
UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications Peer reviewed articles
The potential of extended reality in Rural Education’s future–perspectives from rural educators. Education and Information Technologies Peer reviewed articles
Utilizing virtual reality to assist social competence education and social support for children from under-represented backgrounds Peer reviewed articles
Social Density and its Impact on Behaviour in Virtual Environments Conference proceedings
Ethical Considerations in the Production and Consumption of Music in the Metaverse Conference proceedings
Finding Video Shots for Immersive Journalism Through Text-to-Video Search Conference proceedings
VR Planica: Gaussian Splatting Workflows for Immersive Storytelling Conference proceedings
Exploring engagement dynamics between journalists and news consumers in Social XR Conference proceedings
Communication Challenges between Clients and Producers of Immersive Media Applications: can Social XR help? Conference proceedings
Physiological Synchrony: A Novel Approach to Evaluating User Quality of Experience in Collaborative Distributed Virtual Reality Environments Other
Designing and Evaluating a VR Lobby for a socially enriching remote Opera watching experience Peer reviewed articles
Cognitive Representations and Personal Experiences of COVID-19 Using Social Virtual Reality Peer reviewed articles
Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage Peer reviewed articles
Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage Peer reviewed articles
Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis Conference proceedings
Exploring the impact of volumetric graphics on the engagement of broadcast media professionals Conference proceedings
Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis Conference proceedings
Exploring user feedback in VR: the added value of qualitative evaluation methods Conference proceedings
Extending 3-DoF Metrics to Model User Behaviour Similarity in 6-DoF Immersive Applications Conference proceedings
From Individual QoE to Shared Mental Models: A Novel Evaluation Paradigm for Collaborative XR Conference proceedings
Tangible Authoring of Embedded-Object Visualizations in Mixed Reality Conference proceedings
Emerging Telepresence Technologies for Hybrid Meetings: Experiences and Lessons Learned from an Interactive Workshop Conference proceedings
ComPEQ-MR: Compressed Point Cloud Dataset with Eye Tracking and Quality Assessment in Mixed Reality Conference proceedings
Correlation between Entropy and Prediction Error in VR Head Motion Trajectories Conference proceedings
A Volumetric Video Application to Enhance Museum Experiences Conference proceedings
Open-Sourcing VR2Gather: A Collaborative Social VR System for Adaptive Multi-Party Real Time Communication Conference proceedings
Directed Views in Virtual Reality: A Semantic Approach to Volumetric Video Storytelling Conference proceedings
Back to the Virtual Future: Presence in Cinematic Virtual Reality Conference proceedings
Exploring entropy-based solutions for trajectory prediction in virtual reality Conference proceedings
IXR '25: 3rd International Workshop on Interactive eXtended Reality Conference proceedings
A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla Hubs Conference proceedings
Spatial Media Controller: Exploring the Potential of Augmented Reality, Virtual Reality, Volumetric Capture and 360 Videos for News Broadcasting Conference proceedings
TangibleMRCreate: Intuitive Authoring of Mixed Reality Content Other
RCQoEA-360VR: Real-time Continuous QoE Scores for HMD-based 360° VR Dataset Other
Avatar Customization, Personality, and the Perception of Work Group Inclusion in Immersive Virtual Reality Other
QoE Evaluation of Remote Physiotherapy in Volumetric Video and Video-Based Real-Time Communication Conference proceedings
Predicting Quality of Multimedia Experience Using Electrocardiogram and Respiration Signals Peer reviewed articles
VVGLTF: Efficient Streaming of Volumetric Video with GLTF Peer reviewed articles
VVGLTF: Efficient Streaming of Volumetric Video with GLTF Peer reviewed articles

Do you want to learn more or discuss about this project?
Visit the Openverse Wiki page for TransMIXR

Disclaimer and intellectual property acknowledgement: the materials showcased on this page have been produced by third parties, and the OPENVERSE consortium accepts no liability for any inaccuracies therein. Responsibility for the content of each asset rests solely with its original creator. The inclusion of these outputs on this page does not, in any way, constitute an endorsement on the part of the OPENVERSE consortium. All intellectual property rights relating to the content published here remain vested in their respective owners. This page should be understood simply as a practical point of access.