Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLI-B3, 789-796, 2016
http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLI-B3/789/2016/
doi:10.5194/isprs-archives-XLI-B3-789-2016
© Author(s) 2016. This work is distributed
under the Creative Commons Attribution 3.0 License.
 
10 Jun 2016
SHAPELEARNER: TOWARDS SHAPE-BASED VISUAL KNOWLEDGE HARVESTING
Zheng Wang and Ti Liang School of Computer Science and Technology, Shandong University
Keywords: Shape Knowledge Harvesting, Shape Matching, Shape Segmentation, Shape Synthesis Abstract. The explosion of images on the Web has led to a number of efforts to organize images semantically and compile collections of visual knowledge. While there has been enormous progress on categorizing entire images or bounding boxes, only few studies have targeted fine-grained image understanding at the level of specific shape contours. For example, given an image of a cat, we would like a system to not merely recognize the existence of a cat, but also to distinguish between the cat’s legs, head, tail, and so on. In this paper, we present ShapeLearner, a system that acquires such visual knowledge about object shapes and their parts. ShapeLearner jointly learns this knowledge from sets of segmented images. The space of label and segmentation hypotheses is pruned and then evaluated using Integer Linear Programming. ShapeLearner places the resulting knowledge in a semantic taxonomy based on WordNet and is able to exploit this hierarchy in order to analyze new kinds of objects that it has not observed before. We conduct experiments using a variety of shape classes from several representative categories and demonstrate the accuracy and robustness of our method.
The conference paper was formally withdrawn as justified in the editorial note.
Please read the editorial note before accessing the paper.

Conference paper (PDF, 6947 KB)
Editorial note


Citation: Wang, Z. and Liang, T.: SHAPELEARNER: TOWARDS SHAPE-BASED VISUAL KNOWLEDGE HARVESTING, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLI-B3, 789-796, doi:10.5194/isprs-archives-XLI-B3-789-2016, 2016.

BibTeX EndNote Reference Manager XML