Toon3D is a groundbreaking method that aims to recover the 3D structure of hand-drawn scenes from cartoons and anime. While human perception can easily understand 3D scenes from inconsistent images, machines struggle with this task. Toon3D uses a piecewise-rigid deformable optimization approach to recover camera poses and dense geometry, allowing for novel-view synthesis and smooth transitions between different viewpoints in a scene. The method involves a user-friendly annotation tool, camera pose estimation, and image deformation to align images based on a perspective camera model. This innovative technique opens up the possibility to experience cartoons from perspectives never before drawn.
https://toon3d.studio/