A conference attendee closely examines a detailed scientific poster titled "Interactive3D: Create What You Want by Interaction," presented by researchers from the Chinese University of Hong Kong, including Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, and Tianjia Shao. The poster outlines the overall architecture and various stages of their Interactive3D project. Illustrations show different stages of 3D object manipulation, showcasing methods such as Gaussian Splatting, NeRF Distillation, and Interactive Hash-Refinement. High-quality images of dinosaurs, bananas, and robots demonstrate the potential of the method for precise control and extensive 3D interaction capabilities. The vibrant visual aids and clear descriptions aim to communicate the innovative aspects of the research to attendees at the conference.
Text transcribed from the image:
GKONG
SITY OF SCIENCE
AND TECHNOLOGY
UNIVERSITY OF
THE CHINESE Interactive3D: Create What You Want by Inter
Shaocong Dong*, Lihe Ding*, Zhanpeng Huang, Zibin Wang, Tia
Overall Architecture
ĐIỆP HONG KONG
Introduction of Interactive3D
Current 3D generation methods cannot offer users precise control.
We propose Interactive3D, granting users precise control over the
generative process through extensive 3D interaction capabilities.
Atwo-stage generation frame-
red fire dragon
Stage-I Interaction with Gaussian Splatting
"make it blu
Add/Remove Part Geometric Transform Rigid Dragging
Deformable Dragging
Semantic
work based on SDS, providing
various tools for precise con-
Stage-II Refinement with InstantNGP
(a) Deformable Drag (b) Stretch (c) Rigid Drag (d) Semantic Editing
rol and guidance of the gen-
on process.
to add wings to enlarge wings to swing wings for burning wings
L. First Stage: Gaussian Splatting
Interactive Hash-Refinement
ctive Hash Refinement
dule for further add details
and optimize the geometry.
(1) Representation
Converter
"A Draven Knight"
Page
Video
Inter e 3D Generation
(2) Interactive
&
Hash Refinement
(e) Combine to
dragon knight
II. Second Stage: InstantNGP
哈
NeRF Distillation
Gaussian
Splatting
InstantNGP
Occupancy Grid
Select Interested Regio
Interactive 3D contains two stages with distinct 3D representations: (i) Gau
for flexible user interactions; (ii) the Gaussian blobs are converted to In
NeRF distillation and fine-tuned by our Interactive Hash Refinement Modul
*
Scan QR code of video for more applicat
Combina (add part)
Rigid Drag
Deformable Drag