IEEE Transactions on Pattern Analysis and Machine Intelligence

Download PDF

Keywords

Point Cloud Compression, Three Dimensional Displays, Annotations, Laser Radar, Data Models, Task Analysis, Data Augmentation, 3 D Vision, Data Augmentation, Domain Adaptation, Domain Generalization, Domain Transfer, Few Shot Learning, Foundation Model, Label Efficient Learning, Point Cloud, Self Supervised Learning, Semi Supervised Learning, Weakly Supervised Learning, Deep Learning, Point Cloud, 3 D Point Cloud, Network Training, Type Of Approach, Data Augmentation, Point Cloud Data, Problem Setup, Foundation Model, Relevant Challenges, Point Cloud Processing, Annotation Efforts, Point Cloud Dataset, Training Data, Classification Of Samples, Semantic Segmentation, Target Domain, Unlabeled Data, Domain Adaptation, Source Domain, 3 D Object Detection, Few Shot Learning, Pseudo Labels, 3 D Detection, Point Cloud Model, 3 D Segmentation, 3 D Tasks, Domain Generalization, Unseen Domains, Li DAR Point Clouds

Abstract

In the past decade, deep neural networks have achieved significant progress in point cloud learning. However, collecting large-scale precisely-annotated point clouds is extremely laborious and expensive, which hinders the scalability of existing point cloud datasets and poses a bottleneck for efficient exploration of point cloud data in various tasks and applications. Label-efficient learning offers a promising solution by enabling effective deep network training with much-reduced annotation efforts. This paper presents the first comprehensive survey of label-efficient learning of point clouds. We address three critical questions in this emerging research field: i) the importance and urgency of label-efficient learning in point cloud processing, ii) the subfields it encompasses, and iii) the progress achieved in this area. To this end, we propose a taxonomy that organizes label-efficient learning methods based on the data prerequisites provided by different types of labels. We categorize four typical label-efficient learning approaches that significantly reduce point cloud annotation efforts: data augmentation, domain transfer learning, weakly-supervised learning, and pretrained foundation models. For each approach, we outline the problem setup and provide an extensive literature review that showcases relevant progress and challenges. Finally, we share our views on the current research challenges and potential future directions.
Like what you’re reading?
Already a member?
Get this article FREE with a new membership!

Related Articles