基于颜色–耳标参数映射的时空信息可听化方法  

A method for sonification of spatiotemporal information based on color-earcon parameter mapping

作　　者：杨乃[1] 连晓娜 袁玥 黄明仁 李乔石 林鑫 YANG Nai;LIAN Xiaona;YUAN Yue;HUANG Mingren;LI Qiaoshi;LIN Xin(School of Geography and Information Engineering,China University of Geosciences,Wuhan 430078,China;School of Arts and Communication,China University of Geosciences,Wuhan 430074,China)

机构地区：[1]中国地质大学(武汉)地理与信息工程学院,武汉430078 [2]中国地质大学(武汉)艺术与传媒学院,武汉430074

出　　处：《时空信息学报》2024年第4期469-481,共13页JOURNAL OF SPATIO-TEMPORAL INFORMATION

基　　金：2023年“美丽中国宜居地球”文化精品创作培育项目(2023WHJP17);2024年“湖北省高校人文社科重点研究基地——大学生发展与创新教育研究中心”科研开放基金项目(DXS2024006)。

摘　　要：随着时空信息的爆炸式增长,如何在保留地图可视化传统优势的基础上实现时空信息可听化是一个值得研究的方向。因此,首先以2022年纽约市PM_(2.5)污染情况为例,采用通用克里金法对PM_(2.5)污染浓度数据进行插值,得到纽约市2022年365幅PM_(2.5)浓度专题地图;其次,提取每张专题地图的色相、饱和度、明度平均值,并将它们与PM_(2.5)浓度数据的标准差分别映射为音色、音高、音强、音长四个维度的耳标参数,使用Sibelius编排创建乐曲,实现纽约市2022年PM_(2.5)数据的可听化;最后,对可听化的污染意象信息传递效果进行评估。结果显示:(1)污染浓度最严重比最不严重和不严重信息的传递效果好;(2)污染浓度变化最大和变化较大比变化最小信息的传递效果好;(3)污染浓度地域差异变化最大比变化最小信息的传递效果好;(4)音强和音高传递污染浓度信息的效果最佳,被试者的认可度也最高,而音长传递污染地域差异的效果最差;(5)被试者对于使用以上可听化形式来传递污染信息的态度持中立到同意的态度,但在理解上存在一定难度。实验拓展了时空信息可听化的研究内容,丰富了对于地图可听化技术的探索。As modern technology advances and information explodes,how to effectively express and convey spatio-temporal information has become a significant research topic.Traditional map visualization possesses significant advantages in intuitively expressing geographic information,yet it also faces undeniable issues such as visual overload caused by complex symbols,difficulties in rapid information acquisition,and inapplicability to visually impaired populations.These challenges prompt us to explore new forms of expression aiming to achieve an audible representation of spatio-temporal information while preserving the traditional strengths of map visualization,thereby compensating for the deficiencies of visual expression.This paper takes the PM_(2.5)pollution situation in New York City in 2022 as a case study to investigate the implementation methods of spatio-temporal information sonification.First,Ordinary Kriging interpolation was utilized to process the PM_(2.5)pollution concentration data.The altitude tinting method was employed to represent different levels of concentration values with varying colors,generating 365 thematic maps of PM_(2.5)concentrations for New York City over the 12 months of 2022.This provided foundational data support for the subsequent sonification conversion.In the sonification process,the average hue(H),saturation(S),and value(V)of each thematic map were extracted and mapped to the earcon parameters of timbre,pitch,volume,and length,respectively,by correlating them with the standard deviation of the PM_(2.5)concentration data.This transformation converted static map information into dynamic sound information.Using Sibelius to arrange and create music,the sonification expression of New York City’s 2022 PM_(2.5)data was successfully achieved.To evaluate the effectiveness of this sonification expression,a series of experiments were designed,and participants were invited to take part.The experiment consisted of three parts:the first part evaluated the effectiveness of conveying the severity and

关 键 词：可听化 时空信息 PM_(2.5) 耳标参数 HSV颜色空间 分层设色 映射模型 

分 类 号：X513[环境科学与工程—环境工程]