Journal article
Deep Cross-Modal Face Naming for People News Retrieval
IEEE transactions on knowledge and data engineering, Vol.33(5), pp.1891-1905
05/01/2021
DOI: 10.1109/TKDE.2019.2948875
Abstract
How to integrate multimodal information sources for face naming in multimodal news is a hot and yet challenging problem. A novel deep cross-modal face naming scheme is developed in this paper to facilitate more effective people news retrieval for large-scale multimodal news. This scheme integrates deep multimodal analysis, cross-modal correlation learning, and multimodal information mining, in which the efficient naming mechanism aims to cluster the deep features of different modalities into a common space to explore their inter-related correlations, and a special Web mining pattern is designed to optimize the name-face matching for rare non-celebrity. Such a cross-modal face naming model can be treated as a problem of bi-media semantic mapping and modeled as an inter-related correlation distribution over deep representations of multimodal news, in which the most important is to create more effective cross-modal name-face correlation and measure to what degree they are correlated. The experiments on a large number of public data from Yahoo! News have obtained very positive results and demonstrated the effectiveness of the proposed model.
Details
- Title: Subtitle
- Deep Cross-Modal Face Naming for People News Retrieval
- Creators
- Yong Tian - Fudan UniversityLian Zhou - Fudan UniversityYuejie Zhang - Fudan UniversityTao Zhang - Shanghai University of Finance and EconomicsWeiguo Fan - University of Iowa
- Resource Type
- Journal article
- Publication Details
- IEEE transactions on knowledge and data engineering, Vol.33(5), pp.1891-1905
- Publisher
- IEEE
- DOI
- 10.1109/TKDE.2019.2948875
- ISSN
- 1041-4347
- eISSN
- 1558-2191
- Number of pages
- 15
- Grant note
- 61976057; 61572140 / National Natural Science Foundation of China; National Natural Science Foundation of China (NSFC) 17DZ1100504; 16JC1420401 / Shanghai Municipal RD Foundation 19ZR1417200 / Shanghai Natural Science Foundation; Natural Science Foundation of Shanghai 19YJA630116 / Humanities and Social Sciences Planning Fund of Ministry of Education of China Henry Tippie Endowed Chair Fund from the University of Iowa
- Language
- English
- Date published
- 05/01/2021
- Academic Unit
- Business Analytics
- Record Identifier
- 9984380455602771
Metrics
9 Record Views