A curious attendee examines a detailed research poster titled "Interactive3D: Create What You Want by Interaction with Gaussian Splatting," presented by researchers from The Chinese University of Hong Kong. The poster, authored by Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, and Tianjia Shao, outlines an innovative 3D generation approach. It consists of two primary stages: interaction with Gaussian splatting and refinement with InstantNGP. The visual elements on the poster include colorful dinosaur models, complex robotic figures, and illustrations of their deformation and transformation processes. The research aims to enable precise controls in 3D object manipulation, providing users with extensive interaction capabilities. A QR code is available for viewers to access an explanatory video, emphasizing the practical applications of the study.
Text transcribed from the image:
GKONG
SITY OF SCIENCE
AND TECHNOLOGY
UNIVERSITY OF
THE CHINESE Interactive3D: Create What You Want by Inter
Shaocong Dong*, Lihe Ding*, Zhanpeng Huang, Zibin Wang, Tia
Overall Architecture
ĐIỆP HONG KONG
Introduction of Interactive3D
Current 3D generation methods cannot offer users precise control.
We propose Interactive3D, granting users precise control over the
generative process through extensive 3D interaction capabilities.
Atwo-stage generation frame-
red fire dragon
Stage-I Interaction with Gaussian Splatting
"make it blu
Add/Remove Part Geometric Transform Rigid Dragging
Deformable Dragging
Semantic
work based on SDS, providing
various tools for precise con-
Stage-II Refinement with InstantNGP
(a) Deformable Drag (b) Stretch (c) Rigid Drag (d) Semantic Editing
rol and guidance of the gen-
on process.
to add wings to enlarge wings to swing wings for burning wings
L. First Stage: Gaussian Splatting
Interactive Hash-Refinement
ctive Hash Refinement
dule for further add details
and optimize the geometry.
(1) Representation
Converter
"A Draven Knight"
Page
Video
Inter e 3D Generation
(2) Interactive
&
Hash Refinement
(e) Combine to
dragon knight
II. Second Stage: InstantNGP
哈
NeRF Distillation
Gaussian
Splatting
InstantNGP
Occupancy Grid
Select Interested Regio
Interactive 3D contains two stages with distinct 3D representations: (i) Gau
for flexible user interactions; (ii) the Gaussian blobs are converted to In
NeRF distillation and fine-tuned by our Interactive Hash Refinement Modul
*
Scan QR code of video for more applicat
Combina (add part)
Rigid Drag
Deformable Drag