Dissertations and Theses
Date of Award
2019
Document Type
Thesis
Department
Computer Science
First Advisor
Zhigang Zhu
Keywords
3D Computer Vision, Point Cloud, Classification, Unsupervised Deep Learning
Abstract
Recently, deep graph neural networks (GNNs) have attracted significant attention for point cloud understanding tasks, including classification, segmentation, and detection. However, the training of such deep networks still requires a large amount of annotated data, which is both expensive and time-consuming. To alleviate the cost of collecting and annotating large-scale point cloud datasets, we propose an unsupervised learning approach to learn features from unlabeled point cloud ”3D object” dataset by using part contrasting and object clustering with GNNs. In the contrast learning step, all the samples in the 3D object dataset are cut into two parts and put into a ”part” dataset. Then a contrast learning GNN (ContrastNet) is trained to verify whether two randomly sampled parts from the part dataset belong to the same object. In the cluster learning step, the trained ContrastNet is applied to all the samples in the original 3D object dataset to extract features, which are used to group the samples into clusters. Then another GNN for clustering learning (ClusterNet) is trained to predict the cluster IDs of all the training samples. The contrasting learning forces the ContrastNet to learn high-level semantic features of objects but probably ignores low-level features, while the ClusterNet improves the quality of learned features by being trained to discover objects that probably belong to the same semantic categories by using cluster IDs. We have conducted extensive experiments to evaluate the proposed framework on point cloud classification tasks. The proposed unsupervised learning approach obtains comparable performance to the state-of-the-art unsupervised learning methods that used much more complicated network structures. The code of this work is publicly available via: https://github.com/lingzhang1/ContrastNet
Recommended Citation
Zhang, Ling, "Unsupervised Feature Learning for Point Cloud by Contrasting and Clustering with Graph Convolutional Neural Network" (2019). CUNY Academic Works.
https://academicworks.cuny.edu/cc_etds_theses/880