mediaeval 2015 - usemp: finding diverse images at mediaeval 2015
TRANSCRIPT
MediaEval 2015 Workshop, Retrieving Diverse Social Images Task
14-15 September 2015, Wurzen, Germany
USEMP: Finding Diverse Images at MediaEval 2015
Eleftherios Spyromitros-Xioufis1, Adrian Popescu2,
Symeon Papadopoulos1, Yiannis Kompatsiaris1
1 CERTH-ITI, Thermi-Thessaloniki, Greece, {espyromi,papadop,ikom}@iti.gr 2 CEA, LIST, 91190 Gif-sur-Yvette, France, [email protected]
Summary of our participation
• supervised Maximal Marginal Relevance (sMMR) [1]:
– A supervised diversification method that jointly optimizes relevance and diversity
• The runs
– Fully automated, no external data*
– Each run corresponds to a different instantiation of sMMR
#2
Run id Run Type Relevance Features Diversity Features
1 visual-only CNN* [1] VLAD+CSURF [2]
2 text-only BOW BOW
3 & 5 visual+textual CNN, BOW, META VLAD+CSURF
[1] E. Spyromitros-Xioufis et al., “Improving diversity in image search via supervised relevance scoring”, ICMR 2015 [2] E. Spyromitros-Xioufis et al., “A comprehensive study over VLAD and Product Quantization in large-scale image retrieval”, IEEE Transactions on Multimedia, 2014
Overview of our approach
#3
Overview of our approach
#4
Relevance to the query output of a task and query specific classifier
Overview of our approach
#5
Relevance to the query output of a task and query specific classifier
Learning relevance from ground truth
#6
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#7
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#8
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#9
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#10
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
Learning relevance from ground truth
#11
devset queries test query, e.g. “Eiffel Tower”
Wikipedia images
Flickr images ? ?
? ?
?
Flic
kr im
ages
#12
This work was supported by the USEMP FP7 project
More details at the poster session!