摘要
是快速获取视频关键信息的有效途径,现有的视频摘要方法通常计算复杂度高,在计算资源受限的场景下难以实际应用。为此,提出了一种高效的顾及方向信息的时空联合监控视频摘要方法。该方法首先采用水平切片获得目标时空运动轨迹;其次去除时空轨迹背景并计算直线轨迹斜率,依据目标时空轨迹斜率完成目标运动方向判定;然后检测采样域运动片段以确定目标在视频中的时序位置;最后依据目标时序位置及其运动方向自适应构建视频摘要。实验结果表明,所提方法的帧平均处理时间(average frame processing time,AFPT)达到了0.374 s,明显优于对比方法,且所生成的视频摘要简洁高效、用户体验好。
Video summarization is an effective way to quickly obtain the key information of video.Existing video summarization methods usually have high computational complexity and are difficult to be applied in the scene with limited computing resources.Therefore,a spatiotemporal joint method for surveillance video summarization via the direction information is proposed.This method first uses the horizontal slice to obtain the object spatiotemporal motion trajectory.Secondly,the spatiotemporal trajectory background is eliminated and the linear trajectory slope is calculated,and the object motion direction is determined according to the object spatiotemporal trajectory slope.Thirdly,the motion segment in the sampling domain is detected to determine the timing position of the object in the video.Finally,the video summarization is constructed adaptively according to the object timing position and motion direction.Experimental results show that the average frame processing time(AFPT)of the proposed method reaches 0.374 s,which has obvious advantages over those of the comparison methods.In addition,the generated video summarization is concise and efficient,and the user experience is good.
作者
张云佐
郭亚宁
蔡昭权
张嘉煜
ZHANG Yunzuo;GUO Yaning;CAI Zhaoquan;ZHANG Jiayu(School of Information Science and Technology,Shijiazhuang Tiedao University,Shijiazhuang,Hebei 050043,China;Shanwei Institute of Technology,Shanwei,Guangdong 516600,China)
出处
《光电子．激光》
CAS
CSCD
北大核心
2022年第9期992-1000,共9页
Journal of Optoelectronics·Laser
基金
国家自然科学基金(61702347,62027801)
广东省重点领域研发计划项目(2019B010137002)
河北省自然科学基金(F2022210007,F2017210161)
河北省高等学校科学技术研究项目(ZD2022100,QN2017132)
中央引导地方科技发展资金项目(226Z0501G)资助项目
关键词
算法
时空联合域
时空切片
自适应
目标运动方向
视频摘要
algorithms
spatiotemporal joint domain
spatiotemporal slice
self-adaption
object motion direction
video summarization
作者简介
张云佐(1984-),男,博士,副教授,博士生导师,主要从事智能视频分析、图像处理、大数据方面的研究,E-mail:zhangyunzuo888@sina.com
