CVPG @ NWPU
中文 | English

Project

Acquisition and computing theory and methods of high resolution dynamic light field [Be Ongoing...]

PI: Qing Wang | Code: 62031023 | Support: NSFC | Start/End: 2021-01-01/2025-12-31

Light field imaging has become a new observation technique in the fields of information science, physics, medicine and life sciences. 

Publications

Ray-Space Epipolar Geometry for Light Field Cameras [PDF] [BIB]

Qi Zhang, Qing Wang, Hongdong Li, Jingyi Yu
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, Early Access (2020-09)

State awareness of power grid equipment based on multi-spectrum data analysis [Be Ongoing...]

PI: Qing Wang | Code: | Support: State Grid | Start/End: 2020-01-01/2021-12-31

Local Invariant Feature Extraction and Correspondence in Two-Parallel-Plane Light Field [Be Ongoing...]

PI: Zhaolin Xiao | Code: 61871319 | Support: NSFC | Start/End: 2019-01-01/2022-12-31

Children Social Behavior Understanding in Light Field [Be Ongoing...]

PI: Xue Wang | Code: 61801396 | Support: NSFC | Start/End: 2019-01-01/2021-12-31

Publications

Region-based depth feature descriptor for saliency detection on light field [PDF] [BIB]

Xue Wang, Yingying Dong, Qi Zhang, Qing Wang
Multimedia Tools and Applications, 2020, Early Access (2020-05)

4D Light Field Segmentation from Light Field Super-pixel Hypergraph Representation [PDF] [BIB]

Xianqiang Lv, Xue Wang, Qing Wang, Jingyi Yu
IEEE Transactions on Visualization and Computer Graphics, 2020, Early Access (2020-03)

Accurate 3D Reconstruction from Circular Light Field Using CNN-LSTM [PDF] [BIB]

Zhengxi Song, Hao Zhu, Qi Wu, Xue Wang, Hongdong Li, Qing Wang
IEEE Int. Conf. on Multimedia and Expo (ICME), London, UK, 2020 (2020-05)

DGAN: Disentangled Representation Learning for Anisotropic BRDF Reconstruction [PDF] [BIB]

Zhongyun Hu, Xue Wang, Qing Wang
IEEE ICASSP, Barcelona, Spain, pp. 4397-4401, 2020. (2020-02)

Light Field SLAM Based on Ray-space Projection Model [PDF] [BIB]

Yaning Li, Qi Zhang, Xue Wang, Qing Wang
Photonics Asia 2019, Hangzhou, China (2019-11)

Light Field Planar Homography and Its Application [PDF] [BIB]

Qi Zhang, Xue Wang, Qing Wang
Photonics Asia 2019, Hangzhou, China (2019-11)

Theory and key technologies of multiview light field computing [Be Ongoing...]

PI: Qing Wang | Code: 61531014 | Support: NSFC | Start/End: 2016-01-01/2020-12-31

Publications

Region-based depth feature descriptor for saliency detection on light field [PDF] [BIB]

Xue Wang, Yingying Dong, Qi Zhang, Qing Wang
Multimedia Tools and Applications, 2020, Early Access (2020-05)

4D Light Field Segmentation from Light Field Super-pixel Hypergraph Representation [PDF] [BIB]

Xianqiang Lv, Xue Wang, Qing Wang, Jingyi Yu
IEEE Transactions on Visualization and Computer Graphics, 2020, Early Access (2020-03)

Accurate 3D Reconstruction from Circular Light Field Using CNN-LSTM [PDF] [BIB]

Zhengxi Song, Hao Zhu, Qi Wu, Xue Wang, Hongdong Li, Qing Wang
IEEE Int. Conf. on Multimedia and Expo (ICME), London, UK, 2020 (2020-05)

DGAN: Disentangled Representation Learning for Anisotropic BRDF Reconstruction [PDF] [BIB]

Zhongyun Hu, Xue Wang, Qing Wang
IEEE ICASSP, Barcelona, Spain, pp. 4397-4401, 2020. (2020-02)

Revisiting Spatio-Angular Trade-off in Light Field Cameras and Extended Applications in Super-Resolution [PDF] [BIB]

Hao Zhu, Mantang Guo, Hongdong Li, Qing Wang, Antonio Robles-Kelly
IEEE Transactions on Visualization and Computer Graphics, 2020, Early Access (2019-12)

Full View Optical Flow Estimation Leveraged from Light Field Superpixel [PDF] [BIB]

Hao Zhu, Xiaoming Sun, Qi Zhang, Qing Wang, Antonio Robles-Kelly, Hongdong Li, Shaodi You
IEEE Transactions on Computational Imaging, 6(1):12-23, 2020. (2020-01)

4D Light Field Superpixel and Segmentation [PDF] [BIB]

Hao Zhu, Qi Zhang, Qing Wang, Hongdong Li
IEEE Transactions on Image Processing, 29(1):85-99, 2020. (2020-01)

Ray-Space Projection Model for Light Field Camera [PDF] [BIB]

Qi Zhang, Jinbo Ling, Qing Wang, Jingyi Yu
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, USA, 10121-10129 (2019-06)

A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras [PDF] [BIB]

Qi Zhang, Chunping Zhang, Jinbo Ling, Qing Wang, Jingyi Yu
IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(11):2539-2552, 2019. (2019-11)

Common Self-polar Triangle of Concentric Conics for Light Field Camera Calibration [PDF] [BIB]

Qi Zhang, Qing Wang
2018 Asian Conf. on Computer Vision (ACCV), Perth, Australia (2018-11)

Dense Light Field Reconstruction from Sparse Sampling Using Residual Network [PDF] [BIB]

Mantang Guo, Hao Zhu, Guoqing Zhou, Qing Wang
2018 Asian Conf. on Computer Vision (ACCV), Perth, Australia (2018-11)

Motion-based Temporal Alignment of Independently Moving Cameras [PDF] [BIB]

Xue Wang, Jianbo Shi, Hyun Soo Park, Qing Wang
IEEE Transactions on Circuits and Systems for Video Technology, 27(11):2344-2354, 2017 (2017-11)

High Angular Resolution Light Field Reconstruction with Coded-Aperture Mask [PDF] [BIB]

Wanxin Qu, Guoqing Zhou, Hao Zhu, Zhaolin Xiao, Qing Wang, Rene Vidal
IEEE Int. Conf. on Image Processing (ICIP), Beijing, China, pp.3036-3040 (2017-09)

Extending the FOV from Disparity and Color Consistencies in Multiview Light Fields [PDF] [BIB]

Zhao Ren, Qi Zhang, Hao Zhu, Qing Wang
IEEE Int. Conf. on Image Processing (ICIP), Beijing, China, pp.1157-1161 (2017-09)

Seeing Beyond Foreground Occlusion: A Joint Framework for SAP Based Scene Depth and Appearance Reconstruction [PDF] [BIB]

Zhaolin Xiao, Lipeng Si, Guoqing Zhou
IEEE Journal of Selected Topics in Signal Processing, 11(7):979-991, 2017 (2017-10)

Light Field Imaging: Models, Calibrations, Reconstructions, and Applications [PDF] [BIB]

Hao Zhu, Qing Wang, Jingyi Yu
Frontiers of Information Technology & Electronic Engineering, 18(9):1236-1249, 2017 (2017-09)

Occlusion-Model Guided Anti-Occlusion Depth Estimation in Light Field [PDF] [BIB]

Hao Zhu, Qing Wang, Jingyi Yu
IEEE Journal of Selected Topics in Signal Processing, 11(7):965-978, 2017 (2017-10)

Robust Outlier Removal Using Penalized Linear Regression in Multiview Geometry [PDF] [BIB]

Guoqing Zhou, Qing Wang, Zhaolin Xiao
Neurocomputing, 267:455-465, 2017 (2017-08)

4D Light Field Superpixel and Segmentation [PDF] [BIB]

Hao Zhu, Qi Zhang, Qing Wang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, pp. 6709-6717 (2017-07)

Aliasing Detection and Reduction Scheme on Angularly Undersampled Light Fields [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Guoqing Zhou, Jingyi Yu
IEEE Transactions on Image Processing, 26(5): 2103-2115, 2017 (2017-05)

Dense Depth-map Estimation and Geometry Inference from Light Fields via Global Optimization [PDF] [BIB]

Lipeng Si, Qing Wang
Asian Conference on Computer Vision (ACCV), Taipei, China, pp.83-98, 2017 (2016-11)

An Efficient Anti-occlusion Depth Estimation Using Generalized EPI Representation in Light Field [PDF] [BIB]

Hao Zhu, Qing Wang
SPIE/COS Photonics Asia. 2016. (2016-10)

Rectifying Projective Distortion in 4D Light Field [PDF] [BIB]

Chunping Zhang, Zhe Ji, Qing Wang
IEEE Int. Conf. on Image Processing (ICIP), 2016 (2016-09)

LFHOG: A Discriminative Descriptor for Live Face Detection from Light Field Image [PDF] [BIB]

Zhe Ji, Hao Zhu, Qing Wang
IEEE Int. Conf. on Image Processing (ICIP), 2016 (2016-09)

Survey on Imaging Model and Calibration of Light Field Camera [PDF] [BIB]

Chunping Zhang, Qing Wang
中国激光(Chinese Journal of Lasers), 43(6):0609004, 2016 (2016-06)

Depth estimation and optimization from multiple depth cues based on camera array [Finished]

PI: Qing Wang | Code: 61272287 | Support: NSFC | Start/End: 2013-01-01/2016-12-31

Accurate depth estimation is one of key problems in 3D scene reconstruction and visualization, which can be expanded to many computer vision applications, such as object tracking, scene segmentation, visual navigation and so on. At present, single depth cue based depth estimation is still an open problem in computer vision. To utilize multiple depth cues in a dense of camera array, we explore on the three key aspects, including acquisition of multiple depth cues, multiple cues based depth estimation and accurate depth map optimization. In order to extract multiple depth cues from light field, we have built a camera array system to capture target scene. The elemental cameras are accurately calibrated, which can be used for synthetic imaging with a synthetic 2D or 3D focal plane. Then we have extracted scene depth information related structure cues, parallax cue and focus cue of target scene from light field EPI, refocusing image and confocal image respectively. After that, we have proposed that there is complementary relationship between parallax cue and focus cue. For depth estimation, we have introduced a novel ground control points (GCPs) based method to obtain dense disparity map. Moreover, by focusing on the parallax cue, we have proposed a segmentation-tree based cost aggregation to produce more robust disparity estimation for each pixel. Besides, we have also proposed a multi-occlusion model in light field, which can be performed to deal with the occlusion area in depth estimation. Finally, based on the light field sampling analysis, we have proposed a multi-depth cues fusion algorithm to estimate depth under the framework of Markov Random Field, which can take both advantages of shape from stereo and shape from focus. Our algorithm is more accurate than single cue based depth estimation algorithms. To optimize the result of depth estimation, we have first proposed a method to remove outliers based on penalized linear regression, which can eliminate the distraction of outliers. As for the estimation of occluded area, we have proposed a global optimization based on the surface camera and stereo matching method, which can achieve sub-pixel accuracy for depth estimation. To address the issue of aliasing artifacts in the light field imaging, we have proposed an angular aliasing detection algorithm by shifting the aperture model randomly, and then we introduce a multi-scale anti-aliasing rendering algorithm to stitch different non-aliasing image parts together. Our algorithm can significantly improve the confocal imaging quality. We also carry out several researches on other depth estimation related techniques and applications, such as multi-view video synchronization, light field super-pixel segmentation, local feature extraction of light field and applications in live face detection and so on.

After four year work, we have submitted 4 patent applications in China and published 20 papers, including 2 papers on TIP and TCSVT journals and 2 papers on CCF Rank A conferences ICCV and CVPR. We have also cultivated 2 NSFC young scholar funds, 5 Ph.D. and 10 master students under the support of this NSFC fund.

 

Key words: Depth estimation; Camera array; Multiple depth cues; Global optimization; Depth evaluation model


Publications

Motion-based Temporal Alignment of Independently Moving Cameras [PDF] [BIB]

Xue Wang, Jianbo Shi, Hyun Soo Park, Qing Wang
IEEE Transactions on Circuits and Systems for Video Technology, 27(11):2344-2354, 2017 (2017-11)

Aliasing Detection and Reduction Scheme on Angularly Undersampled Light Fields [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Guoqing Zhou, Jingyi Yu
IEEE Transactions on Image Processing, 26(5): 2103-2115, 2017 (2017-05)

Depth Estimation from Light Field Analysis Based Multiple Cues Fusion [PDF] [BIB]

Degang Yang, Zhaolin Xiao, Heng Yang, Qing Wang
计算机学报 (Chinese Journal of Computers), 38(12):2437-2449 (2015-12)

Aliasing Detection and Reduction in Plenoptic Imaging [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Guoqing Zhou, Jingyi Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, USA, pp. 3326-3333 (2014-06)

Aliasing Detecting of Light Field Images Based on Random Masked Aperture [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Heng Yang, Guoqing Zhou
自动化学报 (ACTA AUTOMATICA SINICA), 40(2):247-254 (2014-02)

A Multi-scale Anti-aliasing Rendering Algorithm for the Light Field Imaging [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Guoqing Zhou, Heng Yang
计算机辅助设计与图形学学报 (Journal of CAD and CG), 26(7):1126-1134 (2014-07)

Sparse Representation with Geometric Configuration Constraint for Line Segment Matching [PDF] [BIB]

Qing Wang, Tingwang Chen, Lipeng Si
Neurocomputing, 134(25):100-110, 2014 (2014-01)

Matching Cost Fusion in Dense Depth Recovery for Camera-array via Global Optimization [PDF] [BIB]

Lipeng Si, Qing Wang, Zhaolin Xiao
ICVRV 2014, 180-185 (2014-08)

Figure-Aware Tracking under Occlusion from Monocular Videos [PDF] [BIB]

Xue Wang, Qing Wang
ICVRV 2014, 116-121 (2014-08)

Reconstructing Scene Depth and Appearance behind Foreground Occlusion Using Camera Array [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Lipeng Si, Guoqing Zhou
ICIP 2014, 41-45 (2014-10)

A Resection Method Based on Enhanced Continuous Taboo Search [PDF] [BIB]

Guoqing Zhou, Qing Wang
电子学报 (ACTA ELECTRONICA SINICA), 42(12):2422-2428 (2014-12)

A Fused Estimation Method of Depth Based on Depth from Stereo and Depth from Focus [PDF] [BIB]

Zhaolin Xiao, Heng Yang, Guoqing Zhou, Qing Wang
西北工业大学学报 (2013-02)

A Novel Depth Recovery Approach from Multi-View Stereo Based Focusing [PDF] [BIB]

Zhaolin Xiao, Heng Yang, Qing Wang, Guoqing Zhou
ICVRV 2013, 169-176 (2013-09)

Enhanced Continuous Tabu Search for Parameter Estimation in Multiview Geometry [PDF] [BIB]

Guoqing Zhou, Qing Wang
ICCV 2013, 3240-3247 (2013-12)

Research on the super-resolution of light field imaging [Finished]

PI: Zhaolin Xiao | Code: 61501370 | Support: NSFC | Start/End: 2016-01-01/2018-12-31

Publications

Seeing Beyond Foreground Occlusion: A Joint Framework for SAP Based Scene Depth and Appearance Reconstruction [PDF] [BIB]

Zhaolin Xiao, Lipeng Si, Guoqing Zhou
IEEE Journal of Selected Topics in Signal Processing, 11(7):979-991, 2017 (2017-10)

Robust Outlier Removal Using Penalized Linear Regression in Multiview Geometry [PDF] [BIB]

Guoqing Zhou, Qing Wang, Zhaolin Xiao
Neurocomputing, 267:455-465, 2017 (2017-08)

Aliasing Detection and Reduction Scheme on Angularly Undersampled Light Fields [PDF] [BIB]

Zhaolin Xiao, Qing Wang, Guoqing Zhou, Jingyi Yu
IEEE Transactions on Image Processing, 26(5): 2103-2115, 2017 (2017-05)

Multiple sensor based physical and interactive attributes sensing and modeling for natural phenomenon simulation [Finished]

PI: Qing Wang | Code: 2012AA011803 | Support: MOST | Start/End: 2012-01-01/2014-12-31

High angular resolution light field acquisition and imaging [Finished]

PI: Guoqing Zhou | Code: 61401359 | Support: NSFC | Start/End: 2015-01-01/2017-12-31

Publications

High Angular Resolution Light Field Reconstruction with Coded-Aperture Mask [PDF] [BIB]

Wanxin Qu, Guoqing Zhou, Hao Zhu, Zhaolin Xiao, Qing Wang, Rene Vidal
IEEE Int. Conf. on Image Processing (ICIP), Beijing, China, pp.3036-3040 (2017-09)

Robust Outlier Removal Using Penalized Linear Regression in Multiview Geometry [PDF] [BIB]

Guoqing Zhou, Qing Wang, Zhaolin Xiao
Neurocomputing, 267:455-465, 2017 (2017-08)

4D Light Field Superpixel and Segmentation [PDF] [BIB]

Hao Zhu, Qi Zhang, Qing Wang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, pp. 6709-6717 (2017-07)

Complicated shape recovery from confocal image sequence [Finished]

PI: Heng Yang | Code: 61103060 | Support: NSFC | Start/End: 2013-01-01/2015-12-31

Dynamic scene depth estimation from confocal image sequence based on camera array [Finished]

PI: Qing Wang | Code: 20116102110031 | Support: MOE | Start/End: 2012-01-01/2015-12-31

Large scale light probing, real-time modeling and rendering [Finished]

PI: Qing Wang | Code: 2009AA01Z332 | Support: MOST | Start/End: 2009-01-01/2010-12-31

High reliable multi-view correspondence and optimization from multiple unordered images [Finished]

PI: Qing Wang | Code: 60873085 | Support: NSFC | Start/End: 2009-01-01/2011-12-31

4D scene modeling and rendering from multiple time-variant and unordered images [Finished]

PI: Qing Wang | Code: 2007AA01Z314 | Support: MOST | Start/End: 2007-07-01/2009-12-31

Adaptation of super-resolution reconstruction approach from low quality video [Finished]

PI: Qing Wang | Code: NCET-06-0882 | Support: MOE | Start/End: 2007-01-01/2009-12-31

Publications

A Comprehensive Evaluation on Non-deterministic Motion Estimation [PDF] [BIB]

Changzhu Wu, Qing Wang
ICPR 2010, 2333-2336 (2010-08)

Motion Estimation Approach Based on Dual-tree Complex Wavelets [PDF] [BIB]

Changzhu Wu, Qing Wang, Hongxiao Wang
ICPR 2008, 1-4 (2008-12)

Recursive neural network based representation and classification for complex structural patterns [Finished]

PI: Qing Wang | Code: 60403008 | Support: NSFC | Start/End: 2005-01-01/2007-12-31