Home
Uni-Logo
 

Video and 3D Analysis for Visual Learning

Starting Grant 279401 Videolearn

January 2012 - December 2016

Project members

Funded members:
Prof. Dr. Thomas Brox
Dr. Alexey Dosovitskiy
Dr. Margret Keuper
Nikolaus Mayer
Nima Sedaghat

Mohammadreza Zolfaghari
Benjamin Drayer
Gabriel Leivas Oliveira

Co-workers:
Maxim Tatarchenko
Benjamin Ummenhofer

Former members:
Philipp Fischer

A major challenge in computer vision these days is how to learn effective visual representations of the environment that can be used for decision making and planning. In this project, we focused particularly on learning representations from videos. We investigated how to obtain large amounts of annotated data and developed efficient interactive video segmentation solutions for manual annotation. Moreover, we found an effective way via automated rendering of images and annotation from synthetic scene models. We investigated how representations for motion and 3D structure can be learned end-to-end from training data and found very effective solutions that generalize to images that are very different from the training data. The project established deep learning methods for motion estimation, for 3D object modeling, and for two-frame structure from motion.

Publications enabled by this ERC Grant

A. Nguyen, Alexey Dosovitskiy, J. Yosinski, Thomas Brox, J. Clune
Advances in Neural Information Processing Systems (NIPS), 2016


IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016


IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016

Gabriel Leivas Oliveira, A. Valada, C. Bollen, W. Burgard, Thomas Brox
IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2016

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2016

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016

Alexey Dosovitskiy, Philipp Fischer, J. Springenberg, M. Riedmiller, Thomas Brox
IEEE Transactions on Pattern Analysis and Machine Intelligence, 38(9): 1734-1747, Oct 2016


Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, P. Häusser, C. Hazırbaş, V. Golkov, P. Smagt, D. Cremers, Thomas Brox
IEEE International Conference on Computer Vision (ICCV), Dec 2015

IEEE International Conference on Computer Vision (ICCV), Dec 2015

IEEE International Conference on Computer Vision (ICCV), 2015

IEEE International Conference on Computer Vision (ICCV), 2015

Margret Keuper, E. Levinkov, N. Bonneel, G. Lavoue, Thomas Brox, B. Andres
IEEE International Conference on Computer Vision (ICCV), 2015


German Conference on Pattern Recognition (GCPR), Springer, 2015

Alexey Dosovitskiy, J. Springenberg, Thomas Brox
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2015

Alexey Dosovitskiy, J.T. Springenberg, M. Riedmiller, Thomas Brox
Advances in Neural Information Processing Systems 27 (NIPS), 2014



German Conference on Pattern Recognition (GCPR), Springer, 2014.

F. Galasso, Margret Keuper, Thomas Brox, B. Schiele
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2014

F. Galasso, Naveen Shankar Nagaraja, T.J. Cardenas, Thomas Brox, B. Schiele
IEEE International Conference on Computer Vision (ICCV), Dec 2013

IEEE International Conference on Computer Vision (ICCV), Dec 2013

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013



Pattern Recognition (Proc. DAGM), Springer, LNCS, 2012