MLIA at imageCLFE 2014 scalable concept image annotation challenge

Research output: Contribution to journalConference articlepeer-review

1 Citation (Scopus)


In this paper, we propose a large-scale image annotation system for the ImageCLEF 2014 Scalable Concept Image Annotation task. The annotation task, of this year, concentrated on developing annotation algorithms that rely only on data obtained automatically from the web. Since the sophisticated SVM based annotation techniques had been widely applied in the task last year (ImageCLEF 2013), for the task this year, we also adopt the SVM based annotation techniques and put our effort mainly on obtaining more accurate concepts assignment for training images. More specifically, we proposed a two-fold scheme to assign concepts to unlabeled training images: (1) A traditional process which stems the extracted web data of each training image from textual aspect, and make concepts assignment based on the appearance of each concept. (2) An additional process which leverages the deep convolutional network toolbox Overfeat to predict labels (in ImageNet nouns) for each training image from visual aspect, then the predicted tags are mapped to concepts in ImageCLEF based on WordNet synonyms and hyponyms with semantic relations. Finally, the allocated concepts for each training image are generated based on a fusion step of the two-fold concepts assignment processes. Experimental results show that the proposed concepts assignment scheme is efficient to improve the assignment results of traditional textual processing and to allocate reasonable concepts for training images. Consequently, with an efficient SVMs solver based on S-tochastic Gradient Descent, our annotation systems achieves competitive performance in the annotation task.

Original languageEnglish
Pages (from-to)411-420
Number of pages10
JournalCEUR Workshop Proceedings
Publication statusPublished - 2014
Event2014 Cross Language Evaluation Forum Conference, CLEF 2014 - Sheffield, United Kingdom
Duration: Sept 15 2014Sept 18 2014

All Science Journal Classification (ASJC) codes

  • General Computer Science


Dive into the research topics of 'MLIA at imageCLFE 2014 scalable concept image annotation challenge'. Together they form a unique fingerprint.

Cite this