Fan, Tao; Wang, Hao; Hodel, Tobias (2023). CICHMKG: a large-scale and comprehensive Chinese intangible cultural heritage multimodal knowledge graph. Heritage Science, 11(1) Springer 10.1186/s40494-023-00927-2
|
Text
s40494-023-00927-2.pdf - Published Version Available under License Creative Commons: Attribution (CC-BY). Download (3MB) | Preview |
Intangible Cultural Heritage (ICH) witnesses human creativity and wisdom in long histories, composed of a variety of immaterial manifestations. The rapid development of digital technologies accelerates the record of ICH, generating a sheer number of heterogenous data but in a state of fragmentation. To resolve that, existing studies mainly adopt approaches of knowledge graphs (KGs) which can provide rich knowledge representation. However, most KGs are text-based and text-derived, and incapable to give related images and empower downstream multimodal tasks, which is also unbeneficial for the public to establish the visual perception and comprehend ICH completely especially when they do not have the related ICH knowledge. Hence, aimed at that, we propose to, taking the Chinese nation-level ICH list as an example, construct a large-scale and comprehensive Multimodal Knowledge Graph (CICHMKG) combining text and image entities from multiple data sources and give a practical construction framework. Additionally, in this paper, to select representative images for ICH entities, we propose a method composed of the denoising algorithm (CNIFA) and a series of criteria, utilizing global and local visual features of images and textual features of captions. Extensive empirical experiments demonstrate its effectiveness. Lastly, we construct the CICHMKG, consisting of 1,774,005 triples, and visualize it to facilitate the interactions and help the public dive into ICH deeply.
Item Type: |
Journal Article (Original Article) |
---|---|
Division/Institute: |
06 Faculty of Humanities > Other Institutions > Walter Benjamin Kolleg (WBKolleg) > Digital Humanities 06 Faculty of Humanities > Other Institutions > Walter Benjamin Kolleg (WBKolleg) |
UniBE Contributor: |
Fan, Tao, Hodel, Tobias Mathias |
Subjects: |
100 Philosophy 800 Literature, rhetoric & criticism 900 History 000 Computer science, knowledge & systems |
ISSN: |
2050-7445 |
Publisher: |
Springer |
Language: |
English |
Submitter: |
Tobias Mathias Hodel |
Date Deposited: |
02 Oct 2023 08:54 |
Last Modified: |
02 Oct 2023 08:54 |
Publisher DOI: |
10.1186/s40494-023-00927-2 |
BORIS DOI: |
10.48350/186785 |
URI: |
https://boris.unibe.ch/id/eprint/186785 |