TY - GEN
T1 - 2D to 3D conversion implemented in different hardware
AU - Ramos-Diaz, Eduardo
AU - Gonzalez-Huitron, Victor
AU - Ponomaryov, Volodymyr I.
AU - Hernandez-Fragoso, Araceli
N1 - Publisher Copyright:
© 2015 SPIE-IS&T.
PY - 2015
Y1 - 2015
N2 - Conversion of available 2D data for release in 3D content is a hot topic for providers and for success of the 3D applications, in general. It naturally completely relies on virtual view synthesis of a second view given by original 2D video. Disparity map (DM) estimation is a central task in 3D generation but still follows a very difficult problem for rendering novel images precisely. There exist different approaches in DM reconstruction, among them manually and semiautomatic methods that can produce high quality DMs but they demonstrate hard time consuming and are computationally expensive. In this paper, several hardware implementations of designed frameworks for an automatic 3D color video generation based on 2D real video sequence are proposed. The novel framework includes simultaneous processing of stereo pairs using the following blocks: CIE L∗a∗b∗ color space conversions, stereo matching via pyramidal scheme, color segmentation by k-means on an a∗b∗ color plane, and adaptive post-filtering, DM estimation using stereo matching between left and right images (or neighboring frames in a video), adaptive post-filtering, and finally, the anaglyph 3D scene generation. Novel technique has been implemented on DSP TMS320DM648, Matlab€™s Simulink module over a PC with Windows 7, and using graphic card (NVIDIA Quadro K2000) demonstrating that the proposed approach can be applied in real-time processing mode. The time values needed, mean Similarity Structural Index Measure (SSIM) and Bad Matching Pixels (B) values for different hardware implementations (GPU, Single CPU, and DSP) are exposed in this paper..
AB - Conversion of available 2D data for release in 3D content is a hot topic for providers and for success of the 3D applications, in general. It naturally completely relies on virtual view synthesis of a second view given by original 2D video. Disparity map (DM) estimation is a central task in 3D generation but still follows a very difficult problem for rendering novel images precisely. There exist different approaches in DM reconstruction, among them manually and semiautomatic methods that can produce high quality DMs but they demonstrate hard time consuming and are computationally expensive. In this paper, several hardware implementations of designed frameworks for an automatic 3D color video generation based on 2D real video sequence are proposed. The novel framework includes simultaneous processing of stereo pairs using the following blocks: CIE L∗a∗b∗ color space conversions, stereo matching via pyramidal scheme, color segmentation by k-means on an a∗b∗ color plane, and adaptive post-filtering, DM estimation using stereo matching between left and right images (or neighboring frames in a video), adaptive post-filtering, and finally, the anaglyph 3D scene generation. Novel technique has been implemented on DSP TMS320DM648, Matlab€™s Simulink module over a PC with Windows 7, and using graphic card (NVIDIA Quadro K2000) demonstrating that the proposed approach can be applied in real-time processing mode. The time values needed, mean Similarity Structural Index Measure (SSIM) and Bad Matching Pixels (B) values for different hardware implementations (GPU, Single CPU, and DSP) are exposed in this paper..
KW - adaptive post-filtering
KW - disparity map
KW - k-means segmentation
KW - pyramidal structure.
UR - http://www.scopus.com/inward/record.url?scp=84925590283&partnerID=8YFLogxK
U2 - 10.1117/12.2075314
DO - 10.1117/12.2075314
M3 - Contribución a la conferencia
AN - SCOPUS:84925590283
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015
A2 - Kehtarnavaz, Nasser
A2 - Carlsohn, Matthias F.
PB - SPIE
T2 - Real-Time Image and Video Processing 2015
Y2 - 10 February 2015
ER -