叙事型图像语义标注模型研究  

Narrative Image Annotation Ontology for Semantic Web

作　　者：徐雷[1] 王晓光[1] 

机构地区：[1]武汉大学信息资源研究中心,讲师湖北武汉430072

出　　处：《中国图书馆学报》2017年第5期70-83,共14页Journal of Library Science in China

基　　金：教育部人文社科重点研究基地重大项目"大数据资源语义表示与组织--面向文化遗产领域"(项目编号:16JJD870002);教育部"新世纪优秀人才"基金项目"文献信息结构与语义组织方法研究"资助成果之一~~

摘　　要：由于叙事型图像对时空语义信息表达的特殊性,目前叙事相关的语义模型并不适合直接用于该类型图像的语义标注。针对这一问题,本文设计了一个适用于叙事型图像的深度语义标注本体模型。该模型借助模块化本体设计思想,结合开放标注协同框架(OAC),以情节、实体、活动、情境为核心,解决了叙事型图像时空信息组织表达以及叙事模型和标注信息映射的问题。使用嵌入该标注模型的图像语义标注工具,对敦煌壁画进行语义标注实验,验证了该模型的可靠性和可用性。但是叙事型图像中情节的划分存在不同的见解,给情节提取和标注带来了不确定性,这是图像深度语义标注面临的挑战。Narrative image is one type of visual literature resources that intends to tell stories. In face of its obscure and abstract nature, existing narrative-relevant semantic models appear inadequate for its semantic annotation and description. To address the issue, this paper designs an ontology model for deep semantic annotation applicable for narrative images. The model resorts to the design thought as in modular ontology, integrates with Open Annotation Collaboration（OAC） framework, and takes plot, entity, dynamics and context as its core. The model addresses issues such as the organization and representation of spatio-temporal information in narrative images, and the mapping between narrative model and annotation information. Plot lies at the core of the framework. Each plot takes place in a specific context and involves some entities, while different plots are semantically related in terms of sequence or overlap. In a specific plot annotation area within an image, a dynamics is normally used to present dynamic features of the plot. The descriptive framework, as a whole, is an abstract semantic annotation model and accomplishes the semantic description and annotation by mapping annotated objects onto the abstract model. Plot constitutes the core of the annotation framework and corresponds to the Body of OAC in image annotation. In detail, temporal semantic relations between plots contain nextplot, lastplot, overlaps, meets, starts, during, finishes, equal. In addition to the above relations, other obscure and abstract spatio-temporal semantic relations can also be identified in plots. This paper places TemporalSpatialEntity under the category of Entity. To meet the need for annotation of spatio-temporal information in narrative images, this paper divides TemporalSpatialEntity into Place and TemporalThing, which are respectively further divided into two types-Concrete （ ConcretePlace, ConcreteTemporalThing ） and Abstract （ AbstractPlace, AhstractTemporalThing）. Dynamics is another indispensable elem

关 键 词：叙事型图像 故事情节 语义描述 图像标注 

分 类 号：G254[文化科学—图书馆学]