Adding Semantics to Image-Region Annotations with the Name-It-Game J. Steggink, C. G. M. Snoek In Multimedia Systems 2011. [bibtex] [pdf] [url]

In this paper we present the Name-It-Game, an interactive multimedia game fostering the swift creation of a large data set of region-based image annotations. Compared to existing annotation games, we consider an added semantic structure, by means of the WordNet ontology, the main innovation of the Name-It-Game. Using an ontology-powered game, instead of the more traditional annotation tools, potentially makes region-based image labeling more fun and accessible for every type of user. However, the current games often present the players with hard-to-guess objects. To prevent this from happening in the Name-It-Game, we successfully identify WordNet categories which filter out hard-to-guess objects. To verify the speed of the annotation process, we compare the online Name-It-Game with a desktop tool with similar features. Results show that the Name-It-Game outperforms this tool for semantic region-based image labeling. Lastly, we measure the accuracy of the produced segmentations and compare them with carefully created LabelMe segmentations. Judging from the quantitative and qualitative results, we believe the segmentations are competitive to those of LabelMe, especially when averaged over multiple games. By adding semantics to region-based image annotations, using the Name-It-Game, we have opened up an efficient means to provide precious labels in a playful manner.

@Article{StegginkMS2011,
  author       = "Steggink, J. and Snoek, C. G. M.",
  title        = "Adding Semantics to Image-Region Annotations with the Name-It-Game",
  journal      = "Multimedia Systems",
  number       = "5",
  volume       = "17",
  pages        = "367--378",
  year         = "2011",
  url          = "https://ivi.fnwi.uva.nl/isis/publications/2011/StegginkMS2011",
  pdf          = "https://ivi.fnwi.uva.nl/isis/publications/2011/StegginkMS2011/StegginkMS2011.pdf",
  has_image    = 1
}