Dynamic Adaptive Mesh Streaming for Real-time 3D Teleimmersion
TypeCommunications avec actes
Recent advances in full body 3D reconstruction methods have lead to the realisation of high quality, real-time, photo realistic capture of users in a range of tele-immersion (TI) contexts including gaming and mixed reality environments. The full body reconstruction (FBR) process is computationally expensive requiring comparatively high CPU, GPU and network resources in order to maintain a shared, virtual reality in which high quality 3D reproductions of users can be rendered in real-time. A significant optimisation of the delivery of FBR content has been achieved through the realtime compression and de-compression of 3D geometry and textures. Here we present a new, adaptive compression methodology that allows a TI system called 3D-LIVE to modify the quality and speed of a FBR TI pipeline based on the data carrying capability of the network. Our rule-based adaptation strategy uses network performance sampling processes and a configurable rule engine to dynamically alter the compression of FBR reconstruction on-the-fly. We demonstrate the efficacy of the approach with an experimental evaluation of system and conclude with a discussion of future directions for adaptive FBR compression.
Showing items related by title, author, creator and subject.
POUSSARD, Benjamin; RICHIR, Simon; VATJUS-ANTTILA, Jukka; ASTERIADIS, Stylianos; ZARPALAS, Dimitrios; DARAS, Petros (2014)3DLive project is developing a user-driven mixed reality platform, intended for augmented sports. Using latest sens-ing techniques, 3DLive will allow remote users to share a three-dimensional sports experience, interacting ...
CROWLE, Simon; BONIFACE, Michael; POUSSARD, Benjamin; ASTERIADIS, Stylianos (Springer International Publishing, 2014-09)Tele-immersive, mixed reality interactive systems bring remote users together to share a common experience in an environment that synthesizes aspects of the real and virtual worlds. The 3D-LIVE platform is an example of ...
CROWLE, Simon; BONIFACE, Michael; POUSSARD, Benjamin; ASTERIADIS, Stylianos (2014)Tele-immersive, mixed reality interactive systems bring remote users together to share a common experience in an environment that synthesizes aspects of the real and virtual worlds. The 3D-LIVE platform is an example of ...
PALLOT, Marc; DARAS, Petros; RICHIR, Simon; LOUP-ESCANDE, Emilie (2012)This paper explores Future Internet (FI) 3D-Media technologies and Internet of Things (IoT) in real and virtual environments in order to sense and experiment Real-Time interaction within live situations. The combination ...
PALLOT, Marc; EYNARD, Rémy; POUSSARD, Benjamin; CHRISTMANN, Olivier; RICHIR, Simon (2013)This paper explores existing theories, frameworks and models for handling collective user experience in the context of Distributed Interactive Multimedia Environments (DIME) and more specifically ...