Augmented solar images were used to research the adaptability of four representative image extraction and matching algorithms in space weather domain.These include the scale-invariant feature transform algorithm,speed...Augmented solar images were used to research the adaptability of four representative image extraction and matching algorithms in space weather domain.These include the scale-invariant feature transform algorithm,speeded-up robust features algorithm,binary robust invariant scalable keypoints algorithm,and oriented fast and rotated brief algorithm.The performance of these algorithms was estimated in terms of matching accuracy,feature point richness,and running time.The experiment result showed that no algorithm achieved high accuracy while keeping low running time,and all algorithms are not suitable for image feature extraction and matching of augmented solar images.To solve this problem,an improved method was proposed by using two-frame matching to utilize the accuracy advantage of the scale-invariant feature transform algorithm and the speed advantage of the oriented fast and rotated brief algorithm.Furthermore,our method and the four representative algorithms were applied to augmented solar images.Our application experiments proved that our method achieved a similar high recognition rate to the scale-invariant feature transform algorithm which is significantly higher than other algorithms.Our method also obtained a similar low running time to the oriented fast and rotated brief algorithm,which is significantly lower than other algorithms.展开更多
在基于增强现实装配引导的复杂零/部件装配场景中,由于手部对零/部件的遮挡,导致零件位姿解算时产生较大的误差,甚至造成求解失败。目前针对手工装配零件的位姿估计算法在解决零件遮挡问题时没有考虑手部信息,使得位姿估计精度难以满足...在基于增强现实装配引导的复杂零/部件装配场景中,由于手部对零/部件的遮挡,导致零件位姿解算时产生较大的误差,甚至造成求解失败。目前针对手工装配零件的位姿估计算法在解决零件遮挡问题时没有考虑手部信息,使得位姿估计精度难以满足增强装配实际应用的要求。针对上述问题,提出了融合手部姿态的零件6D位姿估计算法,即HandICG算法。该算法将手部的姿态信息与迭代对应几何(Iterative Corresponding Geometry,ICG)算法进行融合,当发生手部遮挡时,将手部的姿态信息应用到零件姿态的求解中,从而显著提高手部遮挡情况下零件位姿估计的精度,实验表明,平均模型点距离(Average Distance of Model points,ADD)相关评价指标达到74.73%,是ICG算法的2.61倍。该算法显著提升了增强装配场景中零件位姿解算的准确性和鲁棒性。展开更多
针对当前主流增强现实显示设备中的光学组合器存在的光效低,或系统复杂,或不便携带等问题,提出了直投式视网膜投影增强现实近眼显示光学系统的设计方案。光学系统自像面至物面之间依次包括视网膜投影透镜、平行光像源和补偿透镜组三个...针对当前主流增强现实显示设备中的光学组合器存在的光效低,或系统复杂,或不便携带等问题,提出了直投式视网膜投影增强现实近眼显示光学系统的设计方案。光学系统自像面至物面之间依次包括视网膜投影透镜、平行光像源和补偿透镜组三个部分。在仿真过程中,使用玻璃平板替代平行光像源,视网膜投影透镜选择双胶合透镜作为初始结构进行仿真和优化,在设计和仿真补偿透镜组时引入偶次非球面进行设计,同时仿真过程中使用人眼模型进行辅助优化,以模拟实际应用情况。最后,光学系统中的平行光像源使用激光光源及相关光学器件,并使用几何透镜搭建了该光学系统的实物样机以验证系统的显示效果。经过仿真和优化,所设计的光学系统工作在486~656 nm波段,对平行的像源光线进行成像时,点列图均方根(Root Mean Square,RMS)半径为9.59μm,在截止频率处的调制传递函数(Modulation Transfer Function,MTF)大于0.8;加入补偿透镜组后,整个系统对环境光成像时,在0°、3.75°和7.5°的三个半视场的点列图RMS半径分别为3.28μm、4.44μm和5.36μm,且全视场在截止频率处的MTF大于0.6,所设计的光学系统对显示像源和环境光的功率衰减分别在10%以下及30%以下。该系统可实现视网膜投影成像同时对环境光进行补偿,所搭建的样机可实现增强现实显示效果,系统有好的成像质量、高光效和结构简单等优点。展开更多
基金Supported by the Key Research Program of the Chinese Academy of Sciences(ZDRE-KT-2021-3)。
文摘Augmented solar images were used to research the adaptability of four representative image extraction and matching algorithms in space weather domain.These include the scale-invariant feature transform algorithm,speeded-up robust features algorithm,binary robust invariant scalable keypoints algorithm,and oriented fast and rotated brief algorithm.The performance of these algorithms was estimated in terms of matching accuracy,feature point richness,and running time.The experiment result showed that no algorithm achieved high accuracy while keeping low running time,and all algorithms are not suitable for image feature extraction and matching of augmented solar images.To solve this problem,an improved method was proposed by using two-frame matching to utilize the accuracy advantage of the scale-invariant feature transform algorithm and the speed advantage of the oriented fast and rotated brief algorithm.Furthermore,our method and the four representative algorithms were applied to augmented solar images.Our application experiments proved that our method achieved a similar high recognition rate to the scale-invariant feature transform algorithm which is significantly higher than other algorithms.Our method also obtained a similar low running time to the oriented fast and rotated brief algorithm,which is significantly lower than other algorithms.
文摘在基于增强现实装配引导的复杂零/部件装配场景中,由于手部对零/部件的遮挡,导致零件位姿解算时产生较大的误差,甚至造成求解失败。目前针对手工装配零件的位姿估计算法在解决零件遮挡问题时没有考虑手部信息,使得位姿估计精度难以满足增强装配实际应用的要求。针对上述问题,提出了融合手部姿态的零件6D位姿估计算法,即HandICG算法。该算法将手部的姿态信息与迭代对应几何(Iterative Corresponding Geometry,ICG)算法进行融合,当发生手部遮挡时,将手部的姿态信息应用到零件姿态的求解中,从而显著提高手部遮挡情况下零件位姿估计的精度,实验表明,平均模型点距离(Average Distance of Model points,ADD)相关评价指标达到74.73%,是ICG算法的2.61倍。该算法显著提升了增强装配场景中零件位姿解算的准确性和鲁棒性。
文摘针对当前主流增强现实显示设备中的光学组合器存在的光效低,或系统复杂,或不便携带等问题,提出了直投式视网膜投影增强现实近眼显示光学系统的设计方案。光学系统自像面至物面之间依次包括视网膜投影透镜、平行光像源和补偿透镜组三个部分。在仿真过程中,使用玻璃平板替代平行光像源,视网膜投影透镜选择双胶合透镜作为初始结构进行仿真和优化,在设计和仿真补偿透镜组时引入偶次非球面进行设计,同时仿真过程中使用人眼模型进行辅助优化,以模拟实际应用情况。最后,光学系统中的平行光像源使用激光光源及相关光学器件,并使用几何透镜搭建了该光学系统的实物样机以验证系统的显示效果。经过仿真和优化,所设计的光学系统工作在486~656 nm波段,对平行的像源光线进行成像时,点列图均方根(Root Mean Square,RMS)半径为9.59μm,在截止频率处的调制传递函数(Modulation Transfer Function,MTF)大于0.8;加入补偿透镜组后,整个系统对环境光成像时,在0°、3.75°和7.5°的三个半视场的点列图RMS半径分别为3.28μm、4.44μm和5.36μm,且全视场在截止频率处的MTF大于0.6,所设计的光学系统对显示像源和环境光的功率衰减分别在10%以下及30%以下。该系统可实现视网膜投影成像同时对环境光进行补偿,所搭建的样机可实现增强现实显示效果,系统有好的成像质量、高光效和结构简单等优点。
