Object-to-Manipulation Graph for Affordance Navigation  

作　　者：Xinhang Song Bohan Wang Liye Dong Gongwei Chen Xinyun Hu Shuqiang Jiang 

机构地区：[1]Key Lab of Intelligent Information Processing of Chinese Academy of Sciences(CAS),Institute of Computing Technology,CAS,Beijing 100190,China [2]University of Chinese Academy of Sciences,Beijing 100049,China

出　　处：《CAAI Artificial Intelligence Research》2024年第1期178-186,共9页CAAI人工智能研究(英文)

基　　金：supported by the Beijing Natural Science Foundation(No.JQ22012);in part by the National Natural Science Foundation of China(Nos.62125207,62032022,62272443,and U23B2012).

摘　　要：Object navigation,whose goal is to let the agent to reach some places(or objects),has been a popular topic in embodied Artificial Intelligence(AI)researches.However,in our real-world applications,it is more practical to find the targets with particular goals,raising the new requirements of finding the places to achieve the particular functions.In this paper,we define a new task of affordance navigation,whose goal is to find possible places to accomplish the required functions,achieving some particular effects.We first introduce a new dataset for affordance navigation,collected by the proposed affordance algorithm.In order to avoid the high cost of labor,the groundtruth of each episode which is annotated with the interaction data provided by the AI2-THOR simulator.In addition,we also propose an affordance navigation framework,where an Object-to-Manipulation Graph(OMG)is constructed and optimized to emphasize the corresponding nodes(including object nodes and manipulation nodes).Finally,a navigation policy is implemented(trained by reinforcement learning)to guide the navigation to the target places.Experimental results on AI2-THOR simulator illustrate the effectiveness of the proposed approach,which achieves significant gains of 14.0%and 11.7%(on success rate and Success weighted by Path Length(SPL),respectively)over the baseline model.

关 键 词：NAVIGATION AFFORDANCE MANIPULATION graph neural network 

分 类 号：TB4[一般工业技术]