The image showcases an academic poster presentation titled "Interactive3D: Create What You Want by Interaction," by researchers Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, and Tianjia Shao from The Chinese University of Hong Kong. The poster outlines a novel approach to 3D generation that emphasizes user interaction, highlighting a dual-stage process involving Gaussian splatting and InstantNGP for refinement. Various illustrations exhibit the system's capabilities, including transforming 3D models such as dinosaurs and bananas through techniques like Rigid Drag and Deformable Drag. Attendees are engaging with the content, signifying interest in the interactive features and applications demonstrated. The research aims to advance 3D creation by providing precise control and flexible user interactions.
Text transcribed from the image:
GKONG
SITY OF SCIENCE
AND TECHNOLOGY
UNIVERSITY OF
THE CHINESE Interactive3D: Create What You Want by Inter
Shaocong Dong*, Lihe Ding*, Zhanpeng Huang, Zibin Wang, Tia
Overall Architecture
ĐIỆP HONG KONG
Introduction of Interactive3D
Current 3D generation methods cannot offer users precise control.
We propose Interactive3D, granting users precise control over the
generative process through extensive 3D interaction capabilities.
Atwo-stage generation frame-
red fire dragon
Stage-I Interaction with Gaussian Splatting
"make it blu
Add/Remove Part Geometric Transform Rigid Dragging
Deformable Dragging
Semantic
work based on SDS, providing
various tools for precise con-
Stage-II Refinement with InstantNGP
(a) Deformable Drag (b) Stretch (c) Rigid Drag (d) Semantic Editing
rol and guidance of the gen-
on process.
to add wings to enlarge wings to swing wings for burning wings
L. First Stage: Gaussian Splatting
Interactive Hash-Refinement
ctive Hash Refinement
dule for further add details
and optimize the geometry.
(1) Representation
Converter
"A Draven Knight"
Page
Video
Inter e 3D Generation
(2) Interactive
&
Hash Refinement
(e) Combine to
dragon knight
II. Second Stage: InstantNGP
哈
NeRF Distillation
Gaussian
Splatting
InstantNGP
Occupancy Grid
Select Interested Regio
Interactive 3D contains two stages with distinct 3D representations: (i) Gau
for flexible user interactions; (ii) the Gaussian blobs are converted to In
NeRF distillation and fine-tuned by our Interactive Hash Refinement Modul
*
Scan QR code of video for more applicat
Combina (add part)
Rigid Drag
Deformable Drag