摘要
针对果树三维重构中存在建模精度低、成本高、拓扑结构差等问题,提出一种基于Kinect v2传感器的果树表型三维重建与骨架提取方法。首先,使用Kinect v2传感器采集不同视角下的果树点云数据;其次,对植株点云进行尺度不变特征变换的特征点检测,对关键点使用快速点特征直方图算法进行特征向量计算,通过随机抽样一致性方法提纯点云的初始位置,经初始变换后使用改进的迭代最近点算法进行精配准、拼接形成完整点云;最后,使用Delaunay三角剖分解构点云数据对缺失点云进行填充,使用Dijkstra最短路径算法对最小生成树进行求取,通过迭代去除冗余分量对骨架进行简化,使用圆柱拟合算法估算枝干骨架,将枝干骨架变为封闭凸包多面体,实现果树的枝干三维重建。实验结果表明:采用本文所提建模方法点云平均配准误差为0.52 cm,枝干平均重构误差不超过3.52%,重建效果良好。研究成果可为果园评估作物状态、智能化修剪等研究提供数据支持。
Aiming at the problems of low modeling accuracy,high cost and poor topology structure in the three-dimensional(3D)reconstruction of fruit trees,a 3D reconstruction method of fruit tree phenotype and skeleton extraction based on Kinect v2 sensor was proposed.Firstly,the Kinect v2 sensor was used to collect fruit tree point cloud data from different perspectives.Secondly,the characteristic point detection of scale invariant feature transformation was carried out on the plant point cloud,the eigenvector vector calculation was carried out by using the fast point feature histogram algorithm,the initial position of the point cloud was purified by the random sampling consistency method,and the improved iterative nearest point algorithm was used to finely register and stitch to form a complete point cloud after the initial transformation.Finally,the Delaunay triangulation of the point cloud data was used to fill the missing point cloud,the Dijkstra shortest path algorithm was used to obtain the minimum spanning tree,the skeleton was simplified by iteratively removing redundant components,the tree skeleton was estimated by the cylindrical fitting algorithm,and the tree skeleton was transformed into a closed convex polyhedron,and the 3D reconstruction of the branches of the fruit tree was realized.The experimental results showed that the average error of point cloud registration was 0.52 cm,and the average error of branch reconstruction was not more than 3.52%,and the reconstruction effect was good.The research results can provide data support for orchard assessment of crop status,intelligent pruning and other research.
作者
任栋宇
李晓娟
林涛
熊明明
许贞辉
崔高建
REN Dongyu;LI Xiaojuan;LIN Tao;XIONG Mingming;XU Zhenhui;CUI Gaojian(School of Mechanical Engineering,Xinjiang University,Urumqi 830017,China;Institute of Cash Crops,Xinjiang Academy of Agricultural Sciences,Urumqi 830091,China)
出处
《农业机械学报》
EI
CAS
CSCD
北大核心
2022年第S02期197-203,共7页
Transactions of the Chinese Society for Agricultural Machinery
基金
新疆维吾尔自治区创新团队机器人及智能装备技术科技创新团队项目(2022D14002)
机械制造系统工程国家重点实验室开放课题基金项目(sklms2022023)
新疆维吾尔自治区科学技术协会科技咨询重点项目(xjkj-2021-019)
关键词
果树
三维重建
Kinect
v2
点云
配准
fruit tree
3D reconstruction
Kinect v2
point clouds
registration
作者简介
任栋宇(1997—),男,硕士生,主要从事智能修剪机器人研究,E⁃mail:610327815@qq.com;通信作者:李晓娟(1987—),女,副教授,主要从事农牧特种机器人研究,E⁃mail:lxj_xj903@163.com