Immersive Videos

From NMSL
Revision as of 11:36, 4 November 2016 by Kdiab (talk | contribs)

This project addresses next generation video systems, including VR (virtual reality), 360, multiview, and 3D videos. We address problems ranging from content generation to adaptation to different platforms to streaming to heterogeneous receivers.


People

  • Ahmed Hamza
  • Kiana Calagari
  • Khaled Diab
  • Hamed Ahmadi
  • Mohamed Hefeeda

Immersive Content Generation from Standard 2D Videos

sdsd


More info and demo ...

2D to 3D Video Conversion

Video


Adaptive Streaming of Free-viewpoint Videos

abc


More info and demo ...


MASH: Adaptive Streaming of Multiview Videos over HTTP

Abstract

Multiview videos offer unprecedented experience by allowing users to explore scenes from different angles and perspectives. Thus, such videos have been gaining substantial interest from major content providers such as Google and Facebook. Adaptive streaming of multiview videos is, however, challenging because of the Internet dynamics and the diversity of users interests and network conditions. To address this challenge, we propose a novel rate adaptation algorithm for multiview videos (called MASH). Streaming multiview videos is more user centric than single-view videos, because it heavily depends on how users interact with the different views. To efficiently support this interactivity, MASH constructs probabilistic view switching models that capture the switching behavior of the user in the current session, as well as the aggregate switching behavior across all previous sessions of the same video. MASH then utilizes these models to dynamically assign relative importance to different views. Furthermore, MASH uses a new buffer-based approach to request video segments of various views at different qualities, such that the quality of the streamed videos is maximized while the network bandwidth is not wasted. We have implemented a multiview video player and integrated MASH in it.