The MediaMill TRECVID 2008 Semantic Video Search Engine C. G. M. Snoek, K. E. A. van de Sande, O. de Rooij, B. Huurnink, J. C. van Gemert, J. R. R. Uijlings, J. He, X. Li, I. Everts, V. Nedovic, M. van Liempt, R. van Balen, F. Yan, M. A. Tahir, K. Mikolajczyk, J. Kittler, M. de Rijke, J. M. Geusebroek, T. Gevers, M. Worring, A. W. M. Smeulders, D. C. Koelma In TRECVID Workshop 2008. [bibtex] [pdf] [url]

In this paper we describe our TRECVID 2008 video retrieval experiments. The MediaMill team participated in three tasks: concept detection, automatic search, and interactive search. Rather than continuing to increase the number of concept detectors available for retrieval, our TRECVID 2008 experiments focus on increasing the robustness of a small set of detectors using a bag-of-words approach. To that end, our concept detection experiments emphasize in particular the role of visual sampling, the value of color invariant features, the influence of codebook construction, and the effectiveness of kernel-based learning parameters. For retrieval, a robust but limited set of concept detectors necessitates the need to rely on as many auxiliary information channels as possible. Therefore, our automatic search experiments focus on predicting which information channel to trust given a certain topic, leading to a novel framework for predictive video retrieval. To improve the video retrieval results further, our interactive search experiments investigate the roles of visualizing preview results for a certain browse-dimension and active learning mechanisms that learn to solve complex search topics by analysis from user browsing behavior. The 2008 edition of the TRECVID benchmark has been the most successful MediaMill participation to date, resulting in the top ranking for both concept detection and interactive search, and a runner-up ranking for automatic retrieval. Again a lot has been learned during this year’s TRECVID campaign; we highlight the most important lessons at the end of this paper.

@InProceedings{SnoekPTRECVID2008,
  author       = "Snoek, C. G. M. and van de Sande, K. E. A. and de Rooij, O. and Huurnink, B.
                  and van Gemert, J. C. and Uijlings, J. R. R. and He, J. and Li, X.
                  and Everts, I. and Nedovic, V. and van Liempt, M. and van Balen, R.
                  and Yan, F. and Tahir, M. A. and Mikolajczyk, K. and Kittler, J.
                  and de Rijke, M. and Geusebroek, J. M. and Gevers, T. and Worring, M.
                  and Smeulders, A. W. M. and Koelma, D. C.",
  title        = "The MediaMill TRECVID 2008 Semantic Video Search Engine",
  booktitle    = "TRECVID Workshop",
  year         = "2008",
  url          = "https://ivi.fnwi.uva.nl/isis/publications/2008/SnoekPTRECVID2008",
  pdf          = "https://ivi.fnwi.uva.nl/isis/publications/2008/SnoekPTRECVID2008/SnoekPTRECVID2008.pdf",
  has_image    = 1
}