Conference proceeding
Semantically relevant image retrieval by combining image and linguistic analysis
ADVANCES IN VISUAL COMPUTING, PT 2, Vol.4292, pp.770-779
Lecture Notes in Computer Science
01/01/2006
DOI: 10.1007/11919629_77
Abstract
In this paper, we introduce a novel approach to image-based information retrieval by combining image analysis with linguistic analysis of associated annotation information. While numerous Content Based Image Retrieval (CBIR) systems exist, most of them are constrained to use images as the only source of information. In contrast, recent research, especially in the area of web-search has also used techniques that rely purely on textual information associated with an image. The proposed research adopts a conceptually different philosophy. It utilizes the information at both the image and annotation level, if it detects a strong semantic coherence between them. Otherwise, depending on the quality of information available, either of the media is selected to execute the search. Semantic similarity is defined through the use of linguistic relationships in WordNet as well as through shape, texture, and color. Our investigations lead to results that are of significance in designing multimedia information retrieval systems. These include technical details on designing cross-media retrieval strategies as well as the conclusion that combining information modalities during retrieval not only leads to more semantically relevant performance but can also help capture highly complex issues such as the emergent semantics associated with images.
Details
- Title: Subtitle
- Semantically relevant image retrieval by combining image and linguistic analysis
- Creators
- Tony Lam - San Francisco State UniversityRahul Singh - San Francisco State University
- Contributors
- G Bebis (Editor)R Boyle (Editor)B Parvin (Editor)D Koracin (Editor)P Remagnino (Editor)A Nefian (Editor)G Meenakshisundaram (Editor)V Pascucci (Editor)J Zara (Editor)J Molineros (Editor)H Theisel (Editor)T Malzbender (Editor)
- Resource Type
- Conference proceeding
- Publication Details
- ADVANCES IN VISUAL COMPUTING, PT 2, Vol.4292, pp.770-779
- Publisher
- Springer Nature
- Series
- Lecture Notes in Computer Science
- DOI
- 10.1007/11919629_77
- ISSN
- 0302-9743
- eISSN
- 1611-3349
- Number of pages
- 3
- Language
- English
- Date published
- 01/01/2006
- Academic Unit
- Computer Science
- Record Identifier
- 9984446520602771
Metrics
2 Record Views