DeepUSPS: deep robust unsupervised saliency prediction via self-supervision

Tam Nguyen, M. Dax, C. Mummadi, N. Ngo, Tam Nguyen, Z. Lou, Thomas Brox
Advances in Neural Information Processing Systems (NeurIPS), 2019
Abstract: Deep neural network (DNN) based salient object detection in images based on high-quality labels is expensive. Alternative unsupervised approaches rely on careful selection of multiple handcrafted saliency methods to generate noisy pseudoground-truth labels. In this work, we propose a two-stage mechanism for robust unsupervised object saliency prediction, where the first stage involves refinement of the noisy pseudo-labels generated from different handcrafted methods. Each handcrafted method is substituted by a deep network that learns to generate the pseudo-labels. These labels are refined incrementally in multiple iterations via our proposed self-supervision technique. In the second stage, the refined labels produced from multiple networks representing multiple saliency methods are used to train the actual saliency detection network. We show that this self-learning procedure outperforms all the existing unsupervised methods over different datasets. Results are even comparable to those of fully-supervised state-of-the-art approaches.

Other associated files : nguyen_nips19.pdf [2.7MB]  

Images and movies


BibTex reference

  author       = "T. Nguyen and M. Dax and C. K. Mummadi and N. Ngo and T. H. P. Nguyen and Z. Lou and T. Brox",
  title        = "DeepUSPS: deep robust unsupervised saliency prediction via self-supervision",
  booktitle    = "Advances in Neural Information Processing Systems (NeurIPS)",
  month        = " ",
  year         = "2019",
  url          = "http://lmb.informatik.uni-freiburg.de/Publications/2019/NB19"

Other publications in the database