Over Holding Srl - OVER
XR Development Capabilities and Resources:
Below is a detailed breakdown of OVER Holding’s current technical capabilities and resources in the broader fields of Spatial Computing and XR.
AR/XR Publishing
● Web Builder: A browser-based AR editor for publishing geo-localized AR content, supporting Gaussian Splatting and Point Cloud spatial reference systems for scene editing and object anchoring. It includes Marker, VPS, and GPS re-localization systems, as well as Generative AI for creating 3D assets from text prompts.
● Unity SDK: An advanced AR publishing tool featuring Visual Scripting and all functionalities of the Web Builder for enhanced development flexibility.
● Live Editor: An in-app AR publishing tool allowing users to anchor 3D content to physical locations directly from their smartphones, with cross-scene editing capabilities across the Live Editor, Web Builder, and Unity SDK.
AR/XR Browsing
AR content and Digital Twins (3D Maps) created on the Over the Reality platform can be accessed through multiple endpoints:
● Dedicated iOS and Android apps.
● QR code activations for app-less AR browsing via Instant App (Apple) and WebXR (Android).
● Mobile and desktop browsers.
● VR pass-through headsets, including Apple Vision Pro, Meta Quest 3, and Pico XR.
Digital Twins and 3D Map Generation
OVER has developed a comprehensive pipeline to generate 3D maps and Digital Twins using basic smartphones (no LiDAR required). Leveraging a crowdsourced data acquisition approach, OVER has produced over 170,000 3D maps of key global locations. The pipeline includes:
● A dedicated user interface with AR overlays and guidance to capture high-quality, multi-angle images of target areas.
● Custom software to generate 3D maps and Gaussian Splats from raw images.
● In-house hardware infrastructure (GPUs) capable of processing up to 600 3D maps per day.
Visual Data AI Training Dataset
In the process of creating over 170,000 3D maps, OVER Holding has generated one of the largest proprietary geo-localized image datasets in the world. This dataset is significantly larger than currently available imagery open-source datasets and is a valuable resource for training state-of-the-art visual AI models. It continues to grow at a rate of approximately 5 million pictures per month. Below are the current statistics:
● 170,000 3D maps
● 32 million square meters mapped
● 59 TB of raw imagery data, including:
o Pictures
o SLAM position tracking data
o Timestamps
o IMU (Inertial Measurement Unit) data
o Intrinsics and extrinsics
o GPS positioning
o Compass
o Light estimation
● 53 million pictures
● 400-1000 pictures range on 300 sqm area
● A mix of indoor and outdoor pedestrian viewpoints collected from smartphones
At this link it is possible to explore the dataset in the form of real-time Gaussian Splats: https://marketplace.ovr.ai/mappings
Visual Positioning System (VPS)
OVER offers a low-latency VPS active across all 3D-mapped locations, providing centimeter-level precision for AR applications and general device re-localization in space. Additionally, OVER is developing a patent-pending Private VPS pipeline to ensure that end-user positional and visual data remains inaccessible to OVER, enhancing privacy.
Body Tracking and Avatars
The OVER Console enables full-body teleportation into VR and AR scenes through advanced tracking and AI-assisted features. Key capabilities include:
● Full-body tracking via webcam using AI motion tracking.
● Full-body tracking with the Rokoko motion capture suit.
● Facial expression tracking with depth-camera-enabled iOS devices.
● Rigged 3D head reconstruction from a single selfie.
● An optimized WebSocket pipeline supporting up to 50 avatars per room with low latency for position and action state exchange.
● Avatar level-of-detail (LOD) system for performance optimization.
● LLM-powered avatars with integrated speech-to-text and text-to-speech pipelines, including lip-sync functionality.
Other XR Capabilities
OVER enables a shared state between local AR experiences and Digital Twins, ensuring coherent positioning between the physical world and its digital representation. This allows seamless interaction between users in physical locations and those accessing the Digital Twin. For example:
Remote Maintenance and Assistance: A remote operator in the Digital Twin can interact with an on-site operator in the physical location, with both parties maintaining precise spatial awareness of each other’s position in the 3D Space via avatars.
Blockchain Development Capabilities:
By developing its flagship project - Over the Reality - as a platform based on a Web3 tech stack, OVER Holding has also accumulated a relevant hands-on experience on Blockchain development, here below a list of Blockchain related development capabilities:
● General Solidity and RUST Smart contract development
● Substrate Blockchain and node development
● Substrate pallet development
● Off-chain gossiping algorithms
● Decentralized consensus algorithms design
● Tokenomics design
● Cross-chain transaction systems
● Multi-chain relayer
● Decentralized Autonomous Organization (DAO) smart contract development
● NFT marketplace creation (ERC-72, ERC-1155, ERC-6551 standard)
● NFT renting smart contracts
● Automated Market Maker (AMM) creation both based on canonical constant product bonding curves and Bancor Formula
● Threshold Signature Schemes (TSS) implementation both for ECDSA and Schnorr Signatures
● TSS bridge implementation
● Multi Party Computation (MPC) applied to Transport Layer Security (TLS)
● Decentralized verification AI Models inferences
● IPFS data storage