CICHMKG: a large-scale and comprehensive Chinese intangible cultural heritage multimodal knowledge graph

Fan, Tao; Wang, Hao; Hodel, Tobias (2023). CICHMKG: a large-scale and comprehensive Chinese intangible cultural heritage multimodal knowledge graph. Heritage Science, 11(1) Springer 10.1186/s40494-023-00927-2

[img]
Preview
Text
s40494-023-00927-2.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (3MB) | Preview

Intangible Cultural Heritage (ICH) witnesses human creativity and wisdom in long histories, composed of a variety of immaterial manifestations. The rapid development of digital technologies accelerates the record of ICH, generating a sheer number of heterogenous data but in a state of fragmentation. To resolve that, existing studies mainly adopt approaches of knowledge graphs (KGs) which can provide rich knowledge representation. However, most KGs are text-based and text-derived, and incapable to give related images and empower downstream multimodal tasks, which is also unbeneficial for the public to establish the visual perception and comprehend ICH completely especially when they do not have the related ICH knowledge. Hence, aimed at that, we propose to, taking the Chinese nation-level ICH list as an example, construct a large-scale and comprehensive Multimodal Knowledge Graph (CICHMKG) combining text and image entities from multiple data sources and give a practical construction framework. Additionally, in this paper, to select representative images for ICH entities, we propose a method composed of the denoising algorithm (CNIFA) and a series of criteria, utilizing global and local visual features of images and textual features of captions. Extensive empirical experiments demonstrate its effectiveness. Lastly, we construct the CICHMKG, consisting of 1,774,005 triples, and visualize it to facilitate the interactions and help the public dive into ICH deeply.

Item Type:

Journal Article (Original Article)

Division/Institute:

06 Faculty of Humanities > Other Institutions > Walter Benjamin Kolleg (WBKolleg) > Digital Humanities
06 Faculty of Humanities > Other Institutions > Walter Benjamin Kolleg (WBKolleg)

UniBE Contributor:

Fan, Tao, Hodel, Tobias Mathias

Subjects:

100 Philosophy
800 Literature, rhetoric & criticism
900 History
000 Computer science, knowledge & systems

ISSN:

2050-7445

Publisher:

Springer

Language:

English

Submitter:

Tobias Mathias Hodel

Date Deposited:

02 Oct 2023 08:54

Last Modified:

02 Oct 2023 08:54

Publisher DOI:

10.1186/s40494-023-00927-2

BORIS DOI:

10.48350/186785

URI:

https://boris.unibe.ch/id/eprint/186785

Actions (login required)

Edit item Edit item
Provide Feedback