Difference between revisions of "2D to 3D Video Conversion"

From NMSL
Line 13: Line 13:
 
|[[Image:Overview_N.png|center|The proposed 2D-to-3D conversion system|300px]]
 
|[[Image:Overview_N.png|center|The proposed 2D-to-3D conversion system|300px]]
 
|-
 
|-
|align="center" width="200pt"|The proposed conversion system
+
|align="left" width="200pt"|The proposed 2D-to-3D conversion system
 
|}
 
|}
 
</center>
 
</center>
Line 22: Line 22:
 
|[[Image:Depth_Phases_NN.jpg|center|Depth_Phases|600px]]
 
|[[Image:Depth_Phases_NN.jpg|center|Depth_Phases|600px]]
 
|-
 
|-
|align="center" width="200pt"|The effect of each step in our depth estimation technique: (a) Query, (b) A subset of its K candidates, (c) Created matched image, (d) Object boundary cuts, (e) Depth estimation using Poisson reconstruction, (f) Gradient refinement and Poisson reconstruction, (g) Depth with object boundary cuts, (h) Final depth estimation with smoothness, and (i) The zoomed and amplified version of the yellow block in h.
+
|align="left" width="200pt"|The effect of each step in our depth estimation technique: (a) Query, (b) A subset of its K candidates, (c) Created matched image, (d) Object boundary cuts, (e) Depth estimation using Poisson reconstruction, (f) Gradient refinement and Poisson reconstruction, (g) Depth with object boundary cuts, (h) Final depth estimation with smoothness, and (i) The zoomed and amplified version of the yellow block in h.
 
|}
 
|}
 
</center>
 
</center>

Revision as of 18:13, 7 November 2016

People

  • Kiana Calagari
  • Mohamed Hefeeda

Abstract

A wide spread adoption of 3D displays is hindered by the lack of content that matches the user expectations. Producing 3D videos is far more costly and time-consuming than regular 2D videos, which makes it challenging and thus rarely attempted, especially for live events, such as soccer games. In this project we develop a high-quality automated 2D-to-3D conversion method for soccer videos. Our method is data driven, relying on a reference database of 3D videos. Our key insight is that we use computer generated depth from current computer sports games for creating a synthetic 3D database.

Details

The proposed 2D-to-3D conversion system
The proposed 2D-to-3D conversion system


Depth_Phases
The effect of each step in our depth estimation technique: (a) Query, (b) A subset of its K candidates, (c) Created matched image, (d) Object boundary cuts, (e) Depth estimation using Poisson reconstruction, (f) Gradient refinement and Poisson reconstruction, (g) Depth with object boundary cuts, (h) Final depth estimation with smoothness, and (i) The zoomed and amplified version of the yellow block in h.

Publications

K. Calagari, M. Elgharib, P. Didyk, A. Kaspar, W. Matusik, and M. Hefeeda, “Gradient-based 2D-to-3D Conversion for Soccer Videos”, In Proc. of the ACM Multimedia (MM’15), p 331-340, 2015.