Markerless motion capture of man-machine interaction

B. Rosenhahn, C. Schmaltz, Thomas Brox, D. Cremers, J. Weickert, H. Seidel
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2008
Abstract: This work deals with modeling and markerless tracking of athletes interacting with sports gear. In contrast to classical markerless tracking, the interaction with sports gear comes along with joint movement restrictions due to additional constraints: while humans can generally use all their joints, interaction with the equipment imposes a coupling between certain joints. A cyclist who performs a cycling pattern is one example: The feet are supposed to stay on the pedals, which are again restricted to move along a circular trajectory in 3D-space. In this paper, we present a markerless motion capture system that takes the lowerdimensional pose manifold into account by modeling the motion restrictions via soft constraints during pose optimization. Experiments with two different models, a cyclist and a snowboarder, demonstrate the applicability of the method. Moreover, we present motion capture results for challenging outdoor scenes including shadows and strong illumination changes.

Other associated files : rosenhahn_cvpr08.pdf [1.2MB]  

Images and movies


BibTex reference

  author       = "B. Rosenhahn and C. Schmaltz and T. Brox and D. Cremers and J. Weickert and H.-P. Seidel",
  title        = "Markerless motion capture of man-machine interaction",
  booktitle    = "IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)",
  month        = "Jun.",
  year         = "2008",
  url          = "http://lmb.informatik.uni-freiburg.de/Publications/2008/Bro08c"

Other publications in the database