图形用户界面自动生成技术的现状与挑战  

Opportunities and challenges:automatic generation technologies for graphical user interfaces

作　　者：厉向东 夏涵飞 单逸飞 阴凯琳 耿卫东[1] LI Xiangdong;XIA Hanfei;SHAN Yifei;YIN Kailin;GENG Weidong(College of Computer Science and Technology,Zhejiang University,Hangzhou Zhejiang 310000,China)

机构地区：[1]浙江大学计算机科学与技术学院,浙江杭州310000

出　　处：《图学学报》2024年第3期409-421,共13页Journal of Graphics

基　　金：国家自然科学基金重点项目(61972346);国家自然科学基金项目(92148205);浙江省重点研发计划项目(2021C03128,2022C03103);浙江省“尖兵”计划项目(2023C01045)。

摘　　要：随着大数据、人工智能等新兴技术的不断发展和应用,算法模型驱动的图形用户界面自动化和智能化趋势正以前所未有的速度改变着传统的依赖人工绘制的图形用户界面设计方式。用户界面自动生成不仅是解决人机交互设备多样化、功能复杂化、需求个性化等挑战的必然选择,也为人机协同的智能用户界面设计提供了新范式。为了进一步拓展开发人员和研究人员对图形用户界面自动生成前沿技术方法和应用案例的理解及应用,阐述了当前人机交互和人工智能交叉领域下的图形用户界面自动生成及智能评估相关技术的现状,分析了目前图形用户界面自动生成的技术路径、算法模型、设计方法以及评估框架,特别介绍了基于人工智能内容生成技术(AIGC)的图形用户界面自动生成技术进展及其对现有用户界面设计范式带来的新挑战,并总结了图形用户界面自动生成技术的发展趋势和机遇。As emerging technologies like big data and artificial intelligence continue to evolve and find applications,a trend towards algorithm-driven automation and intelligent graphical user interface(GUI)design is rapidly transforming traditional manual methods.The need for automated GUI generation arises from the diversity of human-computer interaction devices,increasing functional complexity,and the demand for personalization.This approach not only addresses these challenges but also establishes a new paradigm in intelligent,collaborative human-computer interface design.To further expand developers’and researchers’understanding and application of cutting-edge technology methods and application cases in automatic GUI generation,this paper delved into the intersection of human-computer interaction and artificial intelligence,shedding light on the latest advancements in automated GUI generation and intelligent evaluation methods.The current technological approaches,algorithmic models,design methods,and evaluation frameworks for automatic GUI generation were analyzed.Advancements in GUI auto-generation technology based on artificial intelligence generated content(AIGC)were specifically highlighted,along with the new challenges posed to existing user interface design paradigms.Furthermore,the development trends and opportunities in the field of automatic GUI generation were summarized.

关 键 词：人机交互 智能用户界面设计 图形用户界面自动生成 界面设计规范 界面评估方法 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]