Deep Part-Based Generative Shape Model with Latent Variables

P. 1–12.

Kirillov A., Gavrikov M., Lobacheva E., Osokin A., Vetrov D.

The Shape Boltzmann Machine (SBM) and its multilabel version MSBM have been recently introduced as deep generative models that capture the variations of an object shape. While being more flexible MSBM requires datasets with labeled parts of the objects for training. In the paper we present an algorithm for training MSBM using binary masks of objects and the seeds which approximately correspond to the locations of objects parts. The latter can be obtained from part-based detectors in an unsupervised manner. We derive a latent variable model and an EM-like training procedure for adjusting the weights of MSBM using a deep learning framework. We show that the model trained by our method outperforms SBM in the tasks related to binary shapes and is very close to the original MSBM in terms of quality of multilabel shapes.

Keywords: компьютерное зрение, EM Algorithm, computer vision, сегментация изображений, probabilistic graphical models, вероятностные графические модели, image segmentation, EM алгоритм, Shape Boltzmann machine, модель формы Больцмана

In book

Proceedings of the 27th British Machine Vision Conference

-, 2016.