Generating Digital Twins from Images and Videos

In this workshop, we focus on 3D models enriched with processes and semantic connections, similar to those in computer game and robotic environments. These models can range in fidelity from simplified 3D representations (Digital Cousins) to highly accurate reconstructions of real-world counterparts (Digital Twins). 3D Gaussian Splatting and Diffusion Models, have demonstrated impressive success in generating 3D representations from images and video. The next frontier in 3D representation is enriching models by integrating both physical and semantic object properties through generative AI and retrieval-based approaches.

Digital Twin Generation from Visual Data: A Survey https://arxiv.org/abs/2504.13159