Difference between revisions of "Immersive Content Generation from Standard 2D Videos"

From NMSL
Line 37: Line 37:
 
{| border="0"
 
{| border="0"
 
|[[Image:Method.png|center|The main steps of our immersive content generation
 
|[[Image:Method.png|center|The main steps of our immersive content generation
technique, and their main components.|500px]]
+
technique, and their main components.|300px]]
 
|-
 
|-
|align="center" width="500pt"|The aim is to create compelling immersive videos using only standard 2D videos.
+
|align="center" width="300pt"|The main steps of our immersive content generation
 +
technique, and their main components.
 
|}
 
|}
 
</center>
 
</center>

Revision as of 13:23, 15 September 2017

People

  • Kiana Calagari
  • Mohamed Hefeeda

Abstract

The aim of this project is to create compelling immersive videos suitable for VR (virtual reality) devices using only standard 2D videos. The focus of the work is on field sports such as soccer, hockey, basketball, etc. Currently the only way to create immersive content is by using multiple cameras and 360 camera rigs. This means that in addition to the already existing standard 2D cameras around the field, an expensive infrastructure should be added and managed in order to shoot and generate immersive content. In this project, however, we propose a more favorable alternative in which we can utilize the content of the already existing standard 2D cameras around the field to generate an immersive video.

The aim is to create compelling immersive videos using only standard 2D videos.
The aim is to create compelling immersive videos using only standard 2D videos.

Details

Setup

We assume a setup in which we have at least 3 cameras as follows. Note that such camera setup is a practical setup in capturing and broadcasting field sports and the following cameras usually exist.

  1. The main camera, located in the middle of the field. This camera is a rotating camera capturing wide views and following the ball around the field. It is usually the main camera used for broadcasting games, and most of the feed that audience view comes from this camera.
  2. A camera on the right side of the field which covers the players on the right that might be missing in the main camera. This camera doesn't necessarily have to be rotating.
  3. A camera on the left side of the field which covers the players on the left that might be missing in the main camera. This camera doesn't necessarily have to be rotating.


Process

The main steps for generating an immersive video from 2D cameras around the field can be described as follows:

  1. Generating a still panorama using the motion of the main camera.
  2. Removing the parallax between cameras.
  3. Overlaying the video frames of the main camera on the panorama, and locating and overlaying the missing players using the left and right cameras.
The main steps of our immersive content generation technique, and their main components.
The main steps of our immersive content generation

technique, and their main components.

The aim is to create compelling immersive videos using only standard 2D videos.
The aim is to create compelling immersive videos using only standard 2D videos.