Difference between revisions of "2D to 3D Video Conversion"

From NMSL
Line 40: Line 40:
 
|[[Image:DGCSoccer2.jpg|center|Results|800px]]
 
|[[Image:DGCSoccer2.jpg|center|Results|800px]]
 
|-
 
|-
|align="left" width="200pt"|The effect of each step in our depth estimation technique: Depth estimation for a wide variety of soccer shots using our method
+
|align="left" width="200pt"|Depth estimation for a wide variety of soccer shots using our method
 
|}
 
|}
 
</center>
 
</center>

Revision as of 18:22, 7 November 2016

People

  • Kiana Calagari
  • Mohamed Hefeeda

Abstract

A wide spread adoption of 3D displays is hindered by the lack of content that matches the user expectations. Producing 3D videos is far more costly and time-consuming than regular 2D videos, which makes it challenging and thus rarely attempted, especially for live events, such as soccer games. In this project we develop a high-quality automated 2D-to-3D conversion method for soccer videos. Our method is data driven, relying on a reference database of 3D videos. Our key insight is that we use computer generated depth from current computer sports games for creating a synthetic 3D database.

Details

The proposed 2D-to-3D conversion system
The proposed 2D-to-3D conversion system


The main components of our depth gradient based conversion
The main components of our depth gradient based conversion


Depth_Phases
The effect of each step in our depth estimation technique: (a) Query, (b) A subset of its K candidates, (c) Created matched image, (d) Object boundary cuts, (e) Depth estimation using Poisson reconstruction, (f) Gradient refinement and Poisson reconstruction, (g) Depth with object boundary cuts, (h) Final depth estimation with smoothness, and (i) The zoomed and amplified version of the yellow block in h.


Results
Depth estimation for a wide variety of soccer shots using our method

Publications

K. Calagari, M. Elgharib, P. Didyk, A. Kaspar, W. Matusik, and M. Hefeeda, “Gradient-based 2D-to-3D Conversion for Soccer Videos”, In Proc. of the ACM Multimedia (MM’15), p 331-340, 2015.