Journal of Software, Vol 6, No 10 (2011), 1898-1905, Oct 2011
doi:10.4304/jsw.6.10.1898-1905

Exploiting User-supplied Tags for Flickr Photos Annotation

Zheng Liu, Hua Yan

Abstract


The popularity of photo-sharing websites like Flickr give us a chance to observe what ordinary users do in their daily life. Particularly, Flickr allows the users to provide personalized tags when uploading photos, and then we can annotate Flickr photos using user-supplied tags. This paper proposes an approach to automatically annotate Flickr photos by exploiting user-supplied tags. User-supplied tags are submitted to Wikipedia to prune noisy tags, and then the reserved tags are denoted as initial tags. Afterwards, the initial tags are ranked using manifold-ranking algorithm, by which regions of the photo to be annotated are served as queries to launch the manifold-ranking algorithm which ranks the initial tags according to their relevance to the queries. Next, using Flickr API, top ranked initial annotations are expanded by a weighted voting scheme. Finally, we combine top ranked initial tags with expanding tags to construct final annotations. Experiments conducted on Flickr photos show the effectiveness of the proposed approach.


Keywords


Manifold-ranking, Flickr Photos Annotation, SIFT, Locality-Sensitive Hashing

References


D. Liu, X. S. Hua, L. Yang, et al. “Tag ranking,” In Proceedings of the 18th international conference on World Wide Web, pp.351-360, 2009.

Börkur Sigurbjörnsson and Roelof van Zwol. “Flickr tag recommendation based on collective knowledge,” In Proc. ACM WWW 2008, pp.327-336.

H. Xu, X. Zhou, M Wang, et al. “Exploring Flickr’s related tags for semantic annotation of web images,” Proceeding of the ACM CIVR, 2009.

L. Wu, X.-S. Hua, N. Yu, et al. “Flickr distance,” ACM MM, pp.31-40, 2008.

P. Schmitz. “Inducing ontology from flickr tags,” WWW 2006.

M. Chen, M. H. Chang, P. C. Chang, et al. “SheepDog-Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning,” In Proceeding of ACM MM, 2008. L. Wu, L. J. Yang, N. H. Yu and X. S. Hua. “Learning to Tag,” In Proceeding of ACM WWW 2009.

M. Ames and M. Naaman. “Why We Tag: Motivations for Annotation in Mobile and Online Media,” In Proceeding of ACM SIGCHI 2007. L. S. Kennedy, S. F. Chang, and I. V. Kozintsev. “To Search or To Label? Precdicting the Performance of Search-Based Automatic Image Classifiers,” In Proceedings of ACM MIR 2006.

Duygulu, P., Barnard, K., de Freitas, J., Forsyth, D.A. “Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary,” Proc. ECCV 2002, pp.97-112.

J. Shi and J. Malik. “Normalized cuts and image segmentation,” In Proc. CVPR 1997, pp.731-743.

D. Zhou, O. Bousquet, T. N. Lal, J. Weston and B. SchÖlkopf. “Learning with local and global consistency,” In Proceedings of NIPS 2003.

D. Zhou, J. Weston, A. Gretton, O. Bousquet and B. SchÖlkopf. “Ranking on data manifolds,” In Proceedings of NIPS 2003.

K. Jarvelin, and J. Kekalainen. “IR evaluation methods for retrieving highly relevant documents,” In Proc. ACM SIGIR 2000.

Rudi L. Cilibrasi, Paul M.B. Vitányi. “The Google Similarity Distance,” IEEE Trans. on Knowledge and Data Engineering. 19(3), pp.370-383, 2007.
http://dx.doi.org/10.1109/TKDE.2007.48

D. Lowe. “Distinctive Image Features from Scale-Invariant Keypoints,” International Journal of Computer Vision, 60(2), pp.91-110, 2004.
http://dx.doi.org/10.1023/B:VISI.0000029664.99615.94

Linde, Y., Buzo, A., Gray, R. “An Algorithm for Vector Quantizer Design,” IEEE Trans. on Communications, 28, pp.84-94, 1980.
http://dx.doi.org/10.1109/TCOM.1980.1094577

P. Indyk, R. Motwani, P. Raghavan, and S. Vempala, “Approximate Nearest Neighbor: Towards Removing the Curse of Dimensionality,” Proc. 30th ACM Symp. Computational Theory, pp.604-613, 1998.

M. Datar, N. Immorlica, P. Indyk, and V.S. Mirrokni, “Locality-Sensitive Hashing Scheme Based on p-Stable Distributions,” Proc.20th Symp. Computational Geometry, pp.253-262, 2004.

Sung-Hyuk Cha, Sargur N. Srihari, “On measuring the distance between histograms,” Pattern Recognition, Volume 35, Issue 6, June 2002, pp.1355-1370.
http://dx.doi.org/10.1016/S0031-3203(01)00118-2

Chang, T., and Kuo, C.C.J. “Texture analysis and classification with tree-structured wavelet transform,” IEEE Trans. on Image Processing, vol. 2, no. 4, pp.429-441, 1993.
http://dx.doi.org/10.1109/83.242353
PMid:18296228


Full Text: PDF


Journal of Software (JSW, ISSN 1796-217X)

Copyright @ 2006-2013 by ACADEMY PUBLISHER – All rights reserved.