Uni-Logo
 

A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2016
Download the publication : MIFDB16-poster.pdf [37.7Mo]   MIFDB16-supp.pdf [9Mo]   MIFDB16.pdf [3Mo]  

Abstract: Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated dataset. The present paper extends the concept of optical flow estimation via convolutional networks to disparity and scene flow estimation. To this end, we propose three synthetic stereo video datasets with sufficient realism, variation, and size to successfully train large networks. Our datasets are the first large-scale datasets to enable training and evaluating scene flow methods. Besides the datasets, we present a convolutional network for real-time disparity estimation that provides state-of-the-art results. By combining a flow and disparity estimation network and training it jointly, we demonstrate the first scene flow estimation with a convolutional network.

Images and movies

 

See also

To download the datasets, please follow this link to our datasets page!


For more information on the dataset, see our supplementary material [PDF].


BibTex references

@InProceedings{MIFDB16,
  author       = "N.Mayer and E.Ilg and P.H{\"a}usser and P.Fischer and D.Cremers and A.Dosovitskiy and T.Brox",
  title        = "A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation",
  booktitle    = "IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)",
  year         = "2016",
  note         = "arXiv:1512.02134",
  url          = "http://lmb.informatik.uni-freiburg.de//Publications/2016/MIFDB16"
}

Other publications in the database