单幅植物叶片图像的3维重建  

3D reconstruction of a single plant leaf image

作　　者：任非儿 刘通 杨龙[1] Ren Feier;Liu Tong;Yang Long(College of Information Engineering,Northwest A&F University,Yangling 712100,China)

机构地区：[1]西北农林科技大学信息工程学院,杨凌712100

出　　处：《中国图象图形学报》2021年第11期2713-2722,共10页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61702422);中央高校基本科研业务费专项资金资助(2452018146)。

摘　　要：目的植物叶片形态复杂,在虚拟场景中很难真实表现。为了从信息量有限的单幅图像中恢复植物叶片的3维形状,本文基于从明暗恢复形状(shape from shading,SFS)的方法,利用亮度统计规律和植物形态特征恢复叶片的3维形状。方法在SFS的基础上,设计基于图像骨架的距离场偏置加强表面细节;针对SFS对恢复宏观几何形状的不足,提出根据图像亮度统计分布选取控制点控制表面宏观形状变化,并利用叶片中轴的距离场约束恢复宏观几何形状,每种方法对于表面宏观几何形状恢复的权重基于恢复的反射图和输入图像间的相似度设定;将表面细节添加到宏观几何形状上得到目标对象的3维形状。结果选取植物叶片图像进行实验,并与其他方法进行比较,实验结果表明本文方法增强了表面细节显示,并有明显的宏观几何形状变化。同时为了验证本文方法对其他物体表面细节恢复的适用性,分别对硬币和恐龙恢复表面细节,实验结果表明提出的增强表面细节的方法同样适用于其他物体。结论针对单幅植物叶片图像的3维重建,在SFS的基础上提出了根据骨架特征加强表面细节,根据图像亮度统计分布和叶片中轴距离场约束共同恢复表面宏观几何形状的算法,实验结果验证了本文方法的可行性。Objective In recent years,with the continuous improvement of computer hardware performance and the continuous in depth research of virtual plant modeling and landscape design in the fields of film and television and games,plant shape modeling has become possible and necessary.As one of the important organs of plants,leaves have complex physiological and morphological characteristics,which are difficult to represent in virtual scenes.Therefore,3D reconstruction of plant leaves is a very challenging subject.Current 3D reconstruction methods have two main types.1)External equipment such as laser or radar are used to measure the distance of the target by transmitting signals and then receiving the signals reflected by the target object to obtain the 3D shape of the surface.2)Using the principle of binocular vision,two or more images are obtained from different perspectives in the same scene,then the 3D shape of the object is obtained according to the parallax between the images.The former requires the introduction of external equipment,which is costly and difficult to operate,whereas the latter needs to detect and match the feature points between the acquired image sequences due to the reconstruction based on multiple images.The acquisition of a single image is simple,and the problem of feature matching of multiple images is eliminated.However,due to the less information contained in a single image and to recover the 3D shape of plant leaves from the limited information,this paper is based on the method of the shape from shading(SFS)and preprocesses the image to add a priori to the 3D shape estimation.The brightness statistic information obtained from the image and the prior information of plant morphological characteristics are used to recover the final 3D shape of the leaf.Method When restoring the 3D shape of a single plant leaf image,the restoration of the surface shape is divided into two aspects:surface detail and surface macroscopic geometric shape.First,based on SFS,a distance field offset algorithm is design

关 键 词：3维重建 从明暗恢复形状(SFS) 单幅图像 图像骨架 图像亮度统计 距离场约束 

分 类 号：Q944[生物学—植物学] TP391.41[自动化与计算机技术—计算机应用技术]