
Conference on Computer Vision and Pattern Recognition (Proceedings of CVPR 2019)
1ETH Zurich 2Shenzhen University 3Tel Aviv University
Figure 1: We develop a deep neural network for 3D point set upsampling. Intuitively, our network learns different levels of detail in multiple steps, where each step focuses on a local patch from the output of the previous step. By progressively training our patch-based network end-to-end, we successfully upsample a sparse set of input points, step by step, to a dense point set with rich geometric details. Here we use circle plates for points rendering, which are color-coded by point normals.
Abstract
Figure 2: Overview of our multi-step patch-based point set upsampling network with 3 levels of detail. Given a sparse point set as input, our network predicts a high-resolution set of points that agree with the ground truth. Instead of training an 8x-upsampling network, we break it into three 2x steps. In each training step, our network randomly selects a local patch as input, upsamples the patch under the guidance of ground truth, and passes the prediction to the next step. During testing, we upsample multiple patches in each step independently, then merge the upsampled results to the next step.
![]() |
![]() |
Figure 4: Illustration of one upsampling network unit. |
Figure 5: Illustration of the feature extraction unit with dense connections. |
Figure 11: Upsampling results from 625 input points (left) and reconstructed mesh (right).
Figure 12: Upsampling results from 5000 input points (left) and reconstructed mesh (right).
Note that the DATA and CODE are free for Research and Education Use ONLY.
Please cite our paper (add the bibtex below) if you use any part of our ALGORITHM, CODE, DATA or RESULTS in any publication.
We thank the anonymous reviewers for their constructive comments. This work was supported in parts by SNF grant 200021 162958, ISF grant 2366/16, NSFC (61761146002), LHTD (20170003), and the National Engineering Laboratory for Big Data System Computing Technology.
Bibtex
@inproceedings{MPU19,
title = {Patch-based Progressive 3D Point Set Upsampling},
author = {Wang Yifan and Shihao Wu and Hui Huang and Daniel Cohen-Or and Olga Sorkine-Hornung},
booktitle = {CVPR},
pages = {5958--5967},
year = {2019},
}