Three-dimensional shape knowledge for joint image segmentation and pose estimation

Thomas Brox, B. Rosenhahn, J. Weickert
Pattern Recognition (Proc. DAGM), Springer, LNCS, Vol.3663: 109-116, Aug. 2005
Abstract: This paper presents the integration of 3D shape knowledge into a variational model for level set based image segmentation and tracking. Having a 3D surface model of an object that is visible in the image of a calibrated camera, the object contour stemming from the segmentation is applied to estimate the 3D pose parameters, whereas the object model projected to the image plane helps in a top-down manner to improve the extraction of the contour and the region statistics. The present approach clearly states all model assumptions in a single energy functional. This keeps the model manageable and allows further extensions for the future. While common alternative segmentation approaches that integrate 2D shape knowledge face the problem that an object can look very different from various viewpoints, a 3D free form model ensures that for each view the model can perfectly fit the data in the image. Moreover, one solves the higher level problem of determining the object pose including its distance to the camera. Experiments demonstrate the performance of the method.

Other associated files : brox_dagm05.pdf [1.7MB]  

Images and movies


BibTex reference

  author       = "T. Brox and B. Rosenhahn and J. Weickert",
  title        = "Three-dimensional shape knowledge for joint image segmentation and pose estimation",
  booktitle    = "Pattern Recognition (Proc. DAGM)",
  series       = "Lecture Notes in Computer Science",
  volume       = "3663",
  pages        = "109-116",
  month        = "Aug.",
  year         = "2005",
  publisher    = "Springer",
  url          = "http://lmb.informatik.uni-freiburg.de/Publications/2005/Bro05a"

Other publications in the database