The results of a study are presented, in which people queried a news archive using an
interactive video retrieval system. 242 search sessions by 39 participants on 24 topics were
assessed. Before, during and after the study, participants filled in questionnaires about their
expectations of a search. The questionnaire data, logged user actions on the system, queries
formulated by users, and a quality measure of each search were studied. The results of the study
show that topics concerning ‘specific’ people or objects were better retrieved than topics
concerning ‘general’ objects and scenes. Users were able to estimate the overall quality of a search
but did not know when the optimal result was reached within the search process. Analysis of the
results at various stages in the retrieval process suggests that retrieval based on transcriptions of the
speech in video data adds more to the average precision of the result than content-based image
retrieval based on low-level visual features. The latter is particularly useful in providing the user
with an overview of the dataset and thus an indication of the success of a search. Based on the
results, implications for the design of user interfaces of video retrieval systems are discussed.
@Article{HollinkVISP2005,
author = "Hollink, L. and Nguyen, G. P. and Koelma, D. C. and Schreiber, G.
and Worring, M.",
title = "Assessing User Behaviour in News Video Retrieval",
journal = "IEE on Vision, Image and Signal Processing",
number = "6",
volume = "152",
pages = "911--918",
year = "2005",
url = "https://ivi.fnwi.uva.nl/isis/publications/2005/HollinkVISP2005",
pdf = "https://ivi.fnwi.uva.nl/isis/publications/2005/HollinkVISP2005/HollinkVISP2005.pdf"
}