Title Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis
Author Tianchang Shen and Jun Gao and Kangxue Yin and Ming-Yu Liu and Sanja Fidler
Conf/Jour NeurIPS
Year 2021
Project Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis (nvidia.com)
Paper Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis (readpaper.com)

image.png|666

输入点云或低分辨率体素,提取特征后利用GAN网络,生成每个顶点的位置和SDF偏移值,得到优化后顶点的位置和SDF
结合显式与隐式表达的表示方法,利用MT,从隐式SDF中重建出显式mesh

Read more »

Title TransHuman: A Transformer-based Human Representation for Generalizable Neural Human Rendering
Author Xiao Pan1,2,∗, Zongxin Yang1, Jianxin Ma2, Chang Zhou2, Yi Yang1,†
Conf/Jour ICCV
Year 2023
Project TransHuman: A Transformer-based Human Representation for Generalizable Neural Human Rendering (pansanity666.github.io)
Paper TransHuman: A Transformer-based Human Representation for Generalizable Neural Human Rendering (readpaper.com)

image.png|666

Read more »

Paper Model Input Parameter/Pnum GPU
DiT-3D Diffusion Transformers Voxelized PC
PointFlow AE flow-based PointCloud 1.61M
FlowGAN GAN flow-based Single Image N = 2500 A40 45GB
BuilDiff Diffusion models Single Image 1024 to 4096 A40 45GB
CCD-3DR CDPM Single Image 8192 3090Ti 24GB
SG-GAN SG-GAN Single Image
HaP Diffusion+SMPL+DepthEstimation Single Image 10000 4x3090Ti
Read more »

Title BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Models
Author Wei, Yao and Vosselman, George and Yang, Michael Ying
Conf/Jour ICCV
Year 2023
Project weiyao1996/BuilDiff: BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Models (github.com)
Paper BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Models (readpaper.com)

image.png|666

  • 关注建筑物的重建,为 3D Diffusion Models 中添加了图片的信息嵌入(预训练了一个图片编码器)
  • 两阶段的点云降噪模型,第一阶段关注全局,第二阶段关注细节
  • 提出了两个自定义的新数据集,并在数据集上验证了本方法的优点
Read more »

Title Flow-based GAN for 3D Point Cloud Generation from a Single Image
Author Yao Wei (University of Twente), George Vosselman (“University of Twente, the Netherlands”), Michael Ying Yang (University of Twente)*
Conf/Jour BMVA
Year 2022
Project Flow-based GAN for 3D Point Cloud Generation from a Single Image (mpg.de)
Paper Flow-based GAN for 3D Point Cloud Generation from a Single Image (readpaper.com)

image.png|555

  • flow-based explicit generative models for sampling point clouds with arbitrary resolutions
  • Improving the detailed 3D structures of point clouds by leveraging the implicit generative adversarial networks (GANs).
Read more »

image.png|666

New 3D Diffusion Transformer Model, 在体素化的点云上运行 DDPM(Denoising diffusion probabilistic models) 的去噪过程

Read more »

Title Challenging universal representation of deep models for 3D point cloud registration
Author Bojani\’{c}, David and Bartol, Kristijan and Forest, Josep and Gumhold, Stefan and Petkovi\’{c}, Tomislav and Pribani\’{c}, Tomislav
Conf/Jour BMVC
Year 2022
Project DavidBoja/greedy-grid-search: [BMVC 2022 workshop] Greedy Grid Search: A 3D Registration Baseline (github.com)
Paper Challenging the Universal Representation of Deep Models for 3D Point Cloud Registration (readpaper.com)

image.png|666

按步长穷举法,粗配准,需要根据ICP进行精配准

Read more »

Title Geometric Transformer for Fast and Robust Point Cloud Registration
Author Zheng Qin1 Hao Yu2 Changjian Wang1 Yulan Guo1,3 Yuxing Peng1 Kai Xu1*
Conf/Jour CVPR
Year 2022
Project qinzheng93/GeoTransformer: [CVPR2022] Geometric Transformer for Fast and Robust Point Cloud Registration (github.com)
Paper Geometric Transformer for Fast and Robust Point Cloud Registration (readpaper.com)

image.png|666

pairwise registration models, only Ubuntu

Read more »

Title Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting
Author Haiping Wang and Yuan Liu and Zhen Dong and Yulan Guo and Yu-Shen Liu and Wenping Wang and Bisheng Yang
Conf/Jour CVPR
Year 2023
Project WHU-USI3DV/SGHR: [CVPR 2023] Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting (github.com)
Paper Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting (readpaper.com)

image.png|666

Issue:
How should I train my dataset? · Issue #4 · WHU-USI3DV/SGHR (github.com)
I think several point clouds of a single statue is not enough for training deep descriptors. I suggest to directly use pairwise registration models such as Geotrainsformer pre-trained on object-level datasets such as ModelNet40 to solve the pairwise registrations.
And adopt SGHR’s transformation synchronization section to solve the global consistent scan poses.

Read more »

Human.png|666

Terminology/Jargon

  • Human Radiance Fields
  • 3D Clothed Human Reconstruction | Digitization

Application

Method

  1. Depth&Normal Estimation(2K2K)
  2. Implicit Function(PIFu or NeRF)
  3. Generative approach Generative Models Reconstruction

Awesome Human Body Reconstruction

Method 泛化 数据集监督 提取 mesh 方式 获得纹理方式
2k2k 比较好 (mesh+texture:)depth、normal、mask、rgb 高质量深度图 —> 点云 —> mesh 图片 rgb 贴图
PIFu 比较好 点云(obj)、rgb(uv)、mask、camera 占用场 —> MC —> 点云,mesh 表面颜色场
NeRF rgb、camera 密度场 —> MC —> 点云,mesh 体积颜色场
NeuS rgb、camera SDF —> MC —> 点云,mesh 体积颜色场
ICON 非常好 rgb+mask、SMPL、法向量估计器 DR 占用场 —> MC —> 点云,mesh 图片 rgb 贴图
ECON 非常好 rgb+mask、SMPL、法向量估计器 DR d-BiNI + SC(shape completion) 图片 rgb 贴图
Read more »