ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models

ARC Lab
2023

Overview

  • ID-Pose estimates camera poses of sparse-view images of a 3D object (overlaps not required).
  • ID-Pose inversely uses the off-the-shelf Zero123 to estimate camera poses by iteratively minimizing denoising errors given input images.
  • ID-Pose is a zero-shot method that requires NO additional model training or finetuning.
  • ID-Pose exhibits strong generalization ability on open-world images as the method effectively leverages the image priors from Zero123 (StableDiffusion).
  • Daily Objects

    Anchor Estimated Pose

    NAVI Objects (2 Views)

    Anchor Estimated Pose GT Pose

    NAVI Objects (3 Views)

    Anchor Estimated Pose GT Pose

    👉 Open Interactive Examples.