Enhancing Implicit Shape Generators Using Topological Regularizations

PDGen example
An example of the topological regularization effect on the generated shape and its persistence diagram.

A fundamental problem in learning 3D shapes generative models is that when the generative model is simply fitted to the training data, the resulting synthetic 3D models can present various artifacts. Many of these artifacts are topological in nature, e.g., broken legs, unrealistic thin structures, and small holes. In this paper, we introduce a principled approach that utilizes topological regularization losses to rectify topological artifacts. The objectives are two-fold. The first is to align the persistent diagram (PD) distribution of the training shapes with that of synthetic shapes. The second ensures that the PDs are smooth among adjacent synthetic shapes. We show how to achieve these two objectives using two simple but effective formulations. Specifically, distribution alignment is achieved by learning a generative model of PDs and aligning this PD generator with PDs of synthetic shapes. Moreover, we enforce the smoothness of the PDs using a smoothness loss on the PD generator, which further improves the behavior of PD distribution alignment. Experimental results on ShapeNet show that our approach leads to much better generalization behavior than state-of-the-art implicit shape generators.

Links & Resources

Publication

Liyan Chen, Yan Zheng, Yang Li, Lohit A. Jagarapu, Haoxiang Li, Hao Kang, Gang Hua and QixingHuang, Enhancing Implicit Shape Generators Using Topological Regularizations, 2024 InternationalConference on Machine Learning (ICML’24), 2024 pdf ppt
Bibtex
@inproceedings{chen2024enhancing,
  title     = {Enhancing Implicit Shape Generators Using Topological Regularizations},
  author    = {Chen, Liyan and Zheng, Yan and Li, Yang and Jagarapu, Lohit A. and Li, Haoxiang and Kang, Hao and Hua, Gang and Huang, Qixing},
  booktitle = {2024 International Conference on Machine Learning (ICML’24)},
  year      = {2024}
}

Project list