Interactive Learning for Multimedia at Large

Khan, Omar Shahbaz; Jónsson, Björn Þór; Rudinac, Stevan; Zahálka, Jan; Ragnarsdóttir, Hanna; Þorleiksdóttir, Þórhildur; Guðmundsson, Gylfi Þór; Amsaleg, Laurent; Worring, Marcel

Interactive learning has been suggested as a key method for addressing analytic multimedia tasks arising in several domains. Until recently, however, methods to maintain interactive performance at the scale of today’s media collections have not been addressed. We propose an interactive learning approach that builds on and extends the state of the art in user relevance feedback systems and high-dimensional indexing for multimedia. We report on a detailed experimental study using the ImageNet and YFCC100M collections, containing 14 million and 100 million images respectively. The proposed approach outperforms the relevant state-of-the-art approaches in terms of interactive performance, while improving suggestion relevance in some cases. In particular, even on YFCC100M, our approach requires less than 0.3 s per interaction round to generate suggestions, using a single computing core and less than 7 GB of main memory.