Journal of Multimedia, Vol 7, No 2 (2012), 193-204, Apr 2012
doi:10.4304/jmm.7.2.193-204

Improving Semantic Search in Digital Libraries Using Multimedia Analysis

Ilianna Kollia, Yannis Kalantidis, Kostas Rapantzikos, Andreas Stafylopatis

Abstract


Semantic search of cultural content is of major importance in current digital libraries, such as in Europeana. Content metadata constitute the main features of cultural items that are analysed, mapped and used to interpret users' queries, so that the most appropriate content is selected and presented to the users. Multimedia, especially visual, analysis, has not been a main component in these developments. This paper presents a new semantic search methodology, including a query answering mechanism which meets the semantics of users' queries and enriches the answers by exploiting appropriate visual features, both local and MPEG-7, through an interweaved knowledge and machine learning based approach. An experimental study is presented, using content from the Europeana digital library, and involving both thematic knowledge and extracted visual features from Europeana images, illustrating the improved performance of the proposed semantic search approach.


Keywords


semantic search; content based search; digital libraries; multimedia analysis; europeana

References


 

[1] F. Baader, D. Calvanese, D. McGuinness, D. Nardi, and P. F. Patel-Schneider, editors. The Description Logic Handbook: Theory, Implementation, and Applications. Cambridge University Press (2007).

[2] Perez-Urbina, H., Motik, B., Horrocks, I.: Tractable query answering and rewriting under description logic constraints. Journal of Applied Logic 8(2), 186-209 (2010).
http://dx.doi.org/10.1016/j.jal.2009.09.004

[3] Ilianna Kollia, Birte Glimm and Ian Horrocks, SPARQL Query Answering over OWL Ontologies. In: Proceedings of the 8th Extended Semantic Web Conference (ESWC 2011). Springer Verlag (2011).

[4] Rob Shearer, Boris Motik and Rob Shearer and Ian Horrocks, HermiT: A Highly-Ecient OWL Reasoner, Proc. of the 5th Int. Workshop on OWL: Experiences and Directions (OWLED 2008 EU) (2008).

[5] Frank Manola and Eric Miller, editors. Resource Description Framework (RDF): Primer. W3C Recommendation (2004).

[6] Boris Motik, Peter F. Patel-Schneider and Bijan Parsia, editors. OWL 2 Web Ontology Language: Structural Specification and Functional-Style Syntax. W3C Recommendation (2009).

[7] B. Motik, P.F. Patel-Schneider, B. Guenca Grau (eds.): OWL 2 Web Ontology Language Direct Semantics. W3C Recommendation (27 October 2009), available at http://www.w3.org/TR/owl2-direct-semantics/

[8] H. J. Horst. Completeness, decidability and complexity of entailment for RDF Schema and a semantic extension involving the OWL vocabulary. Journal of Web Semantics, 3(2-3):79-115, (2005).
http://dx.doi.org/10.1016/j.websem.2005.06.001

[9] Bernhard Schoelkopf and Alexander. J. Smola. Learning with Kernels. The MIT Press, Cambridge, Massachusetts, 2002.

[10] Richard Duda, Peter Hart, David Stork. Pattern Classification. John Wiley & Sons, Inc, 2001.

[11] Simon Haykin. Neural Networks A Comprehensive Foundation. Prentice Hall International, Inc., 1999.

[12] Ilianna Kollia, Nikolaos Simou, Andreas Stafylopatis and Stefanos Kollias. Semantic Image Analysis using a Symbolic Neural Architecture. Journal of Image Analysis and Stereology.2010.

[13] N. Fanizzi, C. d’Amato, F. Esposito. Learning to Rank Individuals in Description Logics Using Kernel Perceptrons.


Full Text: PDF


Journal of Multimedia (JMM, ISSN 1796-2048)

Copyright @ 2006-2013 by ACADEMY PUBLISHER – All rights reserved.