The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor ...The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor for DRL-CCL.And it verifies the function and performance in space target monitoring scene by the carrying experiment of Tianzhou-3 cargo spacecraft(TZ-3).The PMGD image segmentation method can segment the image into highly discrete and simple point tar-gets quickly,which reduces the generation of equivalences greatly and improves the real-time performance for DRL-CCL.Through parallel pipeline design,the storage of the streaming processor is optimized by 55%with no need for external me-mory,the logic is optimized by 60%,and the energy efficiency ratio is 12 times than that of the graphics processing unit,62 times than that of the digital signal proccessing,and 147 times than that of personal computers.Analyzing the results of 8756 images completed on-orbit,the speed is up to 5.88 FPS and the target detection rate is 100%.Our algorithm and implementation method meet the requirements of lightweight,high real-time,strong robustness,full-time,and stable operation in space irradia-tion environment.展开更多
针对现有三维目标检测算法对存在遮挡及距离较远目标检测效果差的问题,以基于点云的三维目标检测算法(3D object proposal generation and detection from point cloud,PointRCNN)为基础,对网络进行改进,提高三维目标检测精度。对区域...针对现有三维目标检测算法对存在遮挡及距离较远目标检测效果差的问题,以基于点云的三维目标检测算法(3D object proposal generation and detection from point cloud,PointRCNN)为基础,对网络进行改进,提高三维目标检测精度。对区域生成网络(region proposal network,RPN)获取的提议区域(region of interest,ROI)体素化处理,同时构建不同尺度的区域金字塔来捕获更加广泛的兴趣点;加入点云Transformer模块来增强对网格中心点局部特征的学习;在网络中加入球查询半径预测模块,使得模型可以根据点云密度自适应调整球查询的范围。最后,对所提算法的有效性进行了试验验证,在KITTI数据集下对模型的性能进行评估测试,同时设计相应的消融试验验证模型中各模块的有效性。展开更多
在自动驾驶感知系统中视觉传感器与激光雷达是关键的信息来源,但在目前的3D目标检测任务中大部分纯点云的网络检测能力都优于图像和激光点云融合的网络,现有的研究将其原因总结为图像与雷达信息的视角错位以及异构特征难以匹配,单阶段...在自动驾驶感知系统中视觉传感器与激光雷达是关键的信息来源,但在目前的3D目标检测任务中大部分纯点云的网络检测能力都优于图像和激光点云融合的网络,现有的研究将其原因总结为图像与雷达信息的视角错位以及异构特征难以匹配,单阶段融合算法难以充分融合二者的特征.为此,本文提出一种新的多层多模态融合的3D目标检测方法:首先,前融合阶段通过在2D检测框形成的锥视区内对点云进行局部顺序的色彩信息(Red Green Blue,RGB)涂抹编码;然后将编码后点云输入融合了自注意力机制上下文感知的通道扩充PointPillars检测网络;后融合阶段将2D候选框与3D候选框在非极大抑制之前编码为两组稀疏张量,利用相机激光雷达对象候选融合网络得出最终的3D目标检测结果.在KITTI数据集上进行的实验表明,本融合检测方法相较于纯点云网络的基线上有了显著的性能提升,平均mAP提高了6.24%.展开更多
海洋石油单点系泊(Single Point Mooring,SPM)系统被广泛应用于海洋油气田开发,是海上石油运输的中转终端,采用合理的检测方案以保障其安全性是海洋石油工程领域备受关注的问题。声学探测、目视检测是常用的单点系泊系统外检测技术。本...海洋石油单点系泊(Single Point Mooring,SPM)系统被广泛应用于海洋油气田开发,是海上石油运输的中转终端,采用合理的检测方案以保障其安全性是海洋石油工程领域备受关注的问题。声学探测、目视检测是常用的单点系泊系统外检测技术。本研究基于EdgeTech 6205组合式双频侧扫声呐与条带式多波束测深系统、Innomar SES 2000参量阵浅地层剖面仪、国产FIFISH PRO W6水下机器人等调查装备,介绍了声学探测技术和目视检测技术在国内某单点系泊系统外检测中的应用实例。探测结果表明,该单点系泊区域地形整体平坦,局部受侵蚀冲刷影响,区域内有6条锚链沟发育,锚链沟深度为1.0-4.5 m,锚链摆动小,浮筒稳定性较好;管道埋藏类型分为完全埋藏型、浅埋藏型、裸露型3类。通过综合分析对比,查明了锚链被大量生物附着、腐蚀速度加快的具体位置,提出了定期进行防腐蚀除锈维护的有效建议。展开更多
文摘The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor for DRL-CCL.And it verifies the function and performance in space target monitoring scene by the carrying experiment of Tianzhou-3 cargo spacecraft(TZ-3).The PMGD image segmentation method can segment the image into highly discrete and simple point tar-gets quickly,which reduces the generation of equivalences greatly and improves the real-time performance for DRL-CCL.Through parallel pipeline design,the storage of the streaming processor is optimized by 55%with no need for external me-mory,the logic is optimized by 60%,and the energy efficiency ratio is 12 times than that of the graphics processing unit,62 times than that of the digital signal proccessing,and 147 times than that of personal computers.Analyzing the results of 8756 images completed on-orbit,the speed is up to 5.88 FPS and the target detection rate is 100%.Our algorithm and implementation method meet the requirements of lightweight,high real-time,strong robustness,full-time,and stable operation in space irradia-tion environment.
文摘针对现有三维目标检测算法对存在遮挡及距离较远目标检测效果差的问题,以基于点云的三维目标检测算法(3D object proposal generation and detection from point cloud,PointRCNN)为基础,对网络进行改进,提高三维目标检测精度。对区域生成网络(region proposal network,RPN)获取的提议区域(region of interest,ROI)体素化处理,同时构建不同尺度的区域金字塔来捕获更加广泛的兴趣点;加入点云Transformer模块来增强对网格中心点局部特征的学习;在网络中加入球查询半径预测模块,使得模型可以根据点云密度自适应调整球查询的范围。最后,对所提算法的有效性进行了试验验证,在KITTI数据集下对模型的性能进行评估测试,同时设计相应的消融试验验证模型中各模块的有效性。
文摘在自动驾驶感知系统中视觉传感器与激光雷达是关键的信息来源,但在目前的3D目标检测任务中大部分纯点云的网络检测能力都优于图像和激光点云融合的网络,现有的研究将其原因总结为图像与雷达信息的视角错位以及异构特征难以匹配,单阶段融合算法难以充分融合二者的特征.为此,本文提出一种新的多层多模态融合的3D目标检测方法:首先,前融合阶段通过在2D检测框形成的锥视区内对点云进行局部顺序的色彩信息(Red Green Blue,RGB)涂抹编码;然后将编码后点云输入融合了自注意力机制上下文感知的通道扩充PointPillars检测网络;后融合阶段将2D候选框与3D候选框在非极大抑制之前编码为两组稀疏张量,利用相机激光雷达对象候选融合网络得出最终的3D目标检测结果.在KITTI数据集上进行的实验表明,本融合检测方法相较于纯点云网络的基线上有了显著的性能提升,平均mAP提高了6.24%.
文摘海洋石油单点系泊(Single Point Mooring,SPM)系统被广泛应用于海洋油气田开发,是海上石油运输的中转终端,采用合理的检测方案以保障其安全性是海洋石油工程领域备受关注的问题。声学探测、目视检测是常用的单点系泊系统外检测技术。本研究基于EdgeTech 6205组合式双频侧扫声呐与条带式多波束测深系统、Innomar SES 2000参量阵浅地层剖面仪、国产FIFISH PRO W6水下机器人等调查装备,介绍了声学探测技术和目视检测技术在国内某单点系泊系统外检测中的应用实例。探测结果表明,该单点系泊区域地形整体平坦,局部受侵蚀冲刷影响,区域内有6条锚链沟发育,锚链沟深度为1.0-4.5 m,锚链摆动小,浮筒稳定性较好;管道埋藏类型分为完全埋藏型、浅埋藏型、裸露型3类。通过综合分析对比,查明了锚链被大量生物附着、腐蚀速度加快的具体位置,提出了定期进行防腐蚀除锈维护的有效建议。
