This paper proposes a universal framework,termed as Multi-Task Hybrid Convolutional Neural Network(MHCNN),for joint face detection,facial landmark detection,facial quality,and facial attribute analysis.MHCNN consists ...This paper proposes a universal framework,termed as Multi-Task Hybrid Convolutional Neural Network(MHCNN),for joint face detection,facial landmark detection,facial quality,and facial attribute analysis.MHCNN consists of a high-accuracy single stage detector(SSD)and an efficient tiny convolutional neural network(T-CNN)for joint face detection refinement,alignment and attribute analysis.Though the SSD face detectors achieve promising results,we find that applying a tiny CNN on detections further boosts the detected face scores and bounding boxes.By multi-task training,our T-CNN aims to provide five facial landmarks,facial quality scores,and facial attributes like wearing sunglasses and wearing masks.Since there is no public facial quality data and facial attribute data as we need,we contribute two datasets,namely FaceQ and FaceA,which are collected from the Internet.Experiments show that our MHCNN achieves face detection performance comparable to the state of the art in face detection data set and benchmark(FDDB),and gets reasonable results on AFLW,FaceQ and FaceA.展开更多
For face detection under complex background and illumination, a detection method that combines the skin color segmentation and cost-sensitive Adaboost algorithm is proposed in this paper. First, by using the character...For face detection under complex background and illumination, a detection method that combines the skin color segmentation and cost-sensitive Adaboost algorithm is proposed in this paper. First, by using the characteristic of human skin color clustering in the color space, the skin color area in YC b C r color space is extracted and a large number of irrelevant backgrounds are excluded; then for remedying the deficiencies of Adaboost algorithm, the cost-sensitive function is introduced into the Adaboost algorithm; finally the skin color segmentation and cost-sensitive Adaboost algorithm are combined for the face detection. Experimental results show that the proposed detection method has a higher detection rate and detection speed, which can more adapt to the actual field environment.展开更多
Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance manag...Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance management such as multiple cards for one person, and swiping one's cards by others in China at present. Therefore, the research introduces a uniqueness detection system and method for in-pit coal-mine personnel integrated into the in-pit coal mine personnel positioning system, establishing a system mode based on face recognition + recognition of personnel positioning card + release by automatic detection. Aiming at the facts that the in-pit personnel are wearing helmets and faces are prone to be stained during the face recognition, the study proposes the ideas that pre-process face images using the 2D-wavelet-transformation-based Mallat algorithm and extracts three face features: miner light, eyes and mouths, using the generalized symmetry transformation-based algorithm. This research carried out test with 40 clean face images with no helmets and 40 lightly-stained face images, and then compared with results with the one using the face feature extraction method based on grey-scale transformation and edge detection. The results show that the method described in the paper can detect accurately face features in the above-mentioned two cases, and the accuracy to detect face features is 97.5% in the case of wearing helmets and lightly-stained faces.展开更多
The skewed symmetry detection plays an improtant role in three-dimensional（3-D） reconstruction. The skewed symmetry depicts a real symmetry viewed from some unknown viewing directions. And the skewed symmetry detect...The skewed symmetry detection plays an improtant role in three-dimensional（3-D） reconstruction. The skewed symmetry depicts a real symmetry viewed from some unknown viewing directions. And the skewed symmetry detection can decrease the geometric constrains and the complexity of 3-D reconstruction. The detection technique for the quadric curve ellipse proposed by Sugimoto is improved to further cover quadric curves including hyperbola and parabola. With the parametric detection, the 3-D quadric curve projection matching is automatical- ly accomplished. Finally, the skewed symmetry surface of the quadric surface solid is obtained. Several examples are used to verify the feasibility of the algorithm and satisfying results can be obtained.展开更多
The automatic detection of faces is a very important problem. The effectiveness of biometric authentication based on face mainly depends on the method used to locate the face in the image. This paper presents a hybrid...The automatic detection of faces is a very important problem. The effectiveness of biometric authentication based on face mainly depends on the method used to locate the face in the image. This paper presents a hybrid system for faces detection in unconstrained cases in which the illumination, pose, occlusion, and size of the face are uncontrolled. To do this, the new method of detection proposed in this paper is based primarily on a technique of automatic learning by using the decision of three neural networks, a technique of energy compaction by using the discrete cosine transform, and a technique of segmentation by the color of human skin. A whole of pictures （faces and no faces） are transformed to vectors of data which will be used for learning the neural networks to separate between the two classes. Discrete cosine transform is used to reduce the dimension of the vectors, to eliminate the redundancies of information, and to store only the useful information in a minimum number of coefficients while the segmentation is used to reduce the space of research in the image. The experimental results have shown that this hybridization of methods will give a very significant improvement of the rate of the recognition, quality of detection, and the time of execution.展开更多
人脸识别技术广泛应用于考勤管理、移动支付等智慧建设中。伴随着常态化的口罩干扰,传统人脸识别算法已无法满足实际应用需求,为此,本文利用深度学习模型SSD以及FaceNet模型对人脸识别系统展开设计。首先,为消除现有数据集中亚洲人脸占...人脸识别技术广泛应用于考勤管理、移动支付等智慧建设中。伴随着常态化的口罩干扰,传统人脸识别算法已无法满足实际应用需求,为此,本文利用深度学习模型SSD以及FaceNet模型对人脸识别系统展开设计。首先,为消除现有数据集中亚洲人脸占比小造成的类内间距变化差距不明显的问题,在CAS-IA Web Face公开数据集的基础上对亚洲人脸数据进行扩充;其次,为解决不同口罩样式对特征提取的干扰,使用SSD人脸检测模型与DLIB人脸关键点检测模型提取人脸关键点,并利用人脸关键点与口罩的空间位置关系,额外随机生成不同的口罩人脸,组成混合数据集;最后,在混合数据集上进行模型训练并将训练好的模型移植到人脸识别系统中,进行检测速度与识别精度验证。实验结果表明,系统的实时识别速度达20 fps以上,人脸识别模型准确率在构建的混合数据集中达到97.1%,在随机抽取的部分LFW数据集验证的准确率达99.7%,故而该系统可满足实际应用需求,在一定程度上提高人脸识别的鲁棒性与准确性。展开更多
Tunneling machines, or excavators, are large and good conductors and affect the reliability of data gathering and interpretation in advanced detection using transient electromagnetic methods. In our experiment, we use...Tunneling machines, or excavators, are large and good conductors and affect the reliability of data gathering and interpretation in advanced detection using transient electromagnetic methods. In our experiment, we used a coincident-loop and central loop type of configuration, where the coil plane l） vertical to and 2） parallel to the working face. A SIROTEM instrument at different locations was used to observe the transient electromagnetic responses of the excavator and to analyze the response amplitudes. The result shows that the tunneling machine affects the advanced detection data and is related to the way the coil is coupled. When the excavator is 6 m from the observatory, the interference of tunneling machine can be ignored.展开更多
针对在现有人脸静态识别过程中被识别人需等待配合的问题,文中提出了一种动态人脸识别系统。该系统采用了基于RetinaFace与FaceNet算法的动态人脸检测和识别方法,并进行了优化,以达到高识别精度和实时性的目标。其中,RetinaFace检测采用...针对在现有人脸静态识别过程中被识别人需等待配合的问题,文中提出了一种动态人脸识别系统。该系统采用了基于RetinaFace与FaceNet算法的动态人脸检测和识别方法,并进行了优化,以达到高识别精度和实时性的目标。其中,RetinaFace检测采用GhostNet作为骨干网络,使用Adaptive-NMS(Non Max Suppression)非极大值抑制用于人脸框的回归,FaceNet识别采用MobileNetV1作为骨干网络,使用Triplet损失与交叉熵损失结合的联合损失函数用以人脸分类。优化后的算法在检测与识别上具有良好表现,改进RetinaFace算法在WiderFace数据集下检测精度为93.35%、90.84%和80.43%,FPS(Frames Per Second)可达53 frame·s^(-1)。动态人脸检测平均检测精度为96%,FPS为21 frame·s^(-1)。当FaceNet阈值设为1.15时,识别率最高达到98.23%。动态识别系统平均识别精度98%,FPS可达20 frame·s^(-1)。实验结果表明,该系统解决了人脸静态识别中需等待配合的问题,具有较高的识别精度与实时性。展开更多
Technological advances in computer science and their application in our daily life allow us to improve our understanding of problems and solve them effectively.A system design to detect people with fever and determine...Technological advances in computer science and their application in our daily life allow us to improve our understanding of problems and solve them effectively.A system design to detect people with fever and determine highrisk areas using infrared thermography and big data is presented.In order to detect people with fever,face detection algorithms of Viola-Jones and Kanade-Lucas are investigated,and comparison between them is presented using a training set of 406 thermal images and a test set of 2072 thermal images.Thermography analysis is performed on detected faces to obtain the temperature level on Celsius scale.With this information a sample database is created.To perform big data experimental analysis,Power Bi tool is used to determine the high-risk area.The experimental results show that Viola-Jones algorithm has a higher performance recognizing faces of thermal images than KanadeLucas,having a high detection rate,less false-positives rate and false-negatives rate.展开更多
基金supported by ZTE Corporation and State Key Laboratory of Mobile Network and Mobile Multimedia Technology
文摘This paper proposes a universal framework,termed as Multi-Task Hybrid Convolutional Neural Network(MHCNN),for joint face detection,facial landmark detection,facial quality,and facial attribute analysis.MHCNN consists of a high-accuracy single stage detector(SSD)and an efficient tiny convolutional neural network(T-CNN)for joint face detection refinement,alignment and attribute analysis.Though the SSD face detectors achieve promising results,we find that applying a tiny CNN on detections further boosts the detected face scores and bounding boxes.By multi-task training,our T-CNN aims to provide five facial landmarks,facial quality scores,and facial attributes like wearing sunglasses and wearing masks.Since there is no public facial quality data and facial attribute data as we need,we contribute two datasets,namely FaceQ and FaceA,which are collected from the Internet.Experiments show that our MHCNN achieves face detection performance comparable to the state of the art in face detection data set and benchmark(FDDB),and gets reasonable results on AFLW,FaceQ and FaceA.
基金supported by the National Basic Research Program of China(973 Program)under Grant No.2012CB215202the National Natural Science Foundation of China under Grant No.51205046
文摘For face detection under complex background and illumination, a detection method that combines the skin color segmentation and cost-sensitive Adaboost algorithm is proposed in this paper. First, by using the characteristic of human skin color clustering in the color space, the skin color area in YC b C r color space is extracted and a large number of irrelevant backgrounds are excluded; then for remedying the deficiencies of Adaboost algorithm, the cost-sensitive function is introduced into the Adaboost algorithm; finally the skin color segmentation and cost-sensitive Adaboost algorithm are combined for the face detection. Experimental results show that the proposed detection method has a higher detection rate and detection speed, which can more adapt to the actual field environment.
基金financial supports from the National Natural Science Foundation of China (No. 51134024)the National High Technology Research and Development Program of China (No. 2012AA062203)are gratefully acknowledged
文摘Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance management such as multiple cards for one person, and swiping one's cards by others in China at present. Therefore, the research introduces a uniqueness detection system and method for in-pit coal-mine personnel integrated into the in-pit coal mine personnel positioning system, establishing a system mode based on face recognition + recognition of personnel positioning card + release by automatic detection. Aiming at the facts that the in-pit personnel are wearing helmets and faces are prone to be stained during the face recognition, the study proposes the ideas that pre-process face images using the 2D-wavelet-transformation-based Mallat algorithm and extracts three face features: miner light, eyes and mouths, using the generalized symmetry transformation-based algorithm. This research carried out test with 40 clean face images with no helmets and 40 lightly-stained face images, and then compared with results with the one using the face feature extraction method based on grey-scale transformation and edge detection. The results show that the method described in the paper can detect accurately face features in the above-mentioned two cases, and the accuracy to detect face features is 97.5% in the case of wearing helmets and lightly-stained faces.
基金Supported by the National Natural Science Foundation of China(10377007)~~
文摘The skewed symmetry detection plays an improtant role in three-dimensional（3-D） reconstruction. The skewed symmetry depicts a real symmetry viewed from some unknown viewing directions. And the skewed symmetry detection can decrease the geometric constrains and the complexity of 3-D reconstruction. The detection technique for the quadric curve ellipse proposed by Sugimoto is improved to further cover quadric curves including hyperbola and parabola. With the parametric detection, the 3-D quadric curve projection matching is automatical- ly accomplished. Finally, the skewed symmetry surface of the quadric surface solid is obtained. Several examples are used to verify the feasibility of the algorithm and satisfying results can be obtained.
基金supported by the Laboratory of Inverses Problems, Modeling, Information and Systems (PI:MIS), Department of Electronic and Telecommunication, University of 08 Mai 1945, Guelma, Algériathe Laboratory of Computer Research (LRI), Department of Computer Sciences, University of Badji Mokhtar, Annaba, Algéria
文摘The automatic detection of faces is a very important problem. The effectiveness of biometric authentication based on face mainly depends on the method used to locate the face in the image. This paper presents a hybrid system for faces detection in unconstrained cases in which the illumination, pose, occlusion, and size of the face are uncontrolled. To do this, the new method of detection proposed in this paper is based primarily on a technique of automatic learning by using the decision of three neural networks, a technique of energy compaction by using the discrete cosine transform, and a technique of segmentation by the color of human skin. A whole of pictures （faces and no faces） are transformed to vectors of data which will be used for learning the neural networks to separate between the two classes. Discrete cosine transform is used to reduce the dimension of the vectors, to eliminate the redundancies of information, and to store only the useful information in a minimum number of coefficients while the segmentation is used to reduce the space of research in the image. The experimental results have shown that this hybridization of methods will give a very significant improvement of the rate of the recognition, quality of detection, and the time of execution.
文摘人脸识别技术广泛应用于考勤管理、移动支付等智慧建设中。伴随着常态化的口罩干扰,传统人脸识别算法已无法满足实际应用需求,为此,本文利用深度学习模型SSD以及FaceNet模型对人脸识别系统展开设计。首先,为消除现有数据集中亚洲人脸占比小造成的类内间距变化差距不明显的问题,在CAS-IA Web Face公开数据集的基础上对亚洲人脸数据进行扩充;其次,为解决不同口罩样式对特征提取的干扰,使用SSD人脸检测模型与DLIB人脸关键点检测模型提取人脸关键点,并利用人脸关键点与口罩的空间位置关系,额外随机生成不同的口罩人脸,组成混合数据集;最后,在混合数据集上进行模型训练并将训练好的模型移植到人脸识别系统中,进行检测速度与识别精度验证。实验结果表明,系统的实时识别速度达20 fps以上,人脸识别模型准确率在构建的混合数据集中达到97.1%,在随机抽取的部分LFW数据集验证的准确率达99.7%,故而该系统可满足实际应用需求,在一定程度上提高人脸识别的鲁棒性与准确性。
基金support received from the National Basic Research Program of China (No2007CB209400)the National Natural Science Foundation of China (No50774085)the Young Scientists Fund of the School Science Foundation of CUMT (No2008A046)
文摘Tunneling machines, or excavators, are large and good conductors and affect the reliability of data gathering and interpretation in advanced detection using transient electromagnetic methods. In our experiment, we used a coincident-loop and central loop type of configuration, where the coil plane l） vertical to and 2） parallel to the working face. A SIROTEM instrument at different locations was used to observe the transient electromagnetic responses of the excavator and to analyze the response amplitudes. The result shows that the tunneling machine affects the advanced detection data and is related to the way the coil is coupled. When the excavator is 6 m from the observatory, the interference of tunneling machine can be ignored.
文摘针对在现有人脸静态识别过程中被识别人需等待配合的问题,文中提出了一种动态人脸识别系统。该系统采用了基于RetinaFace与FaceNet算法的动态人脸检测和识别方法,并进行了优化,以达到高识别精度和实时性的目标。其中,RetinaFace检测采用GhostNet作为骨干网络,使用Adaptive-NMS(Non Max Suppression)非极大值抑制用于人脸框的回归,FaceNet识别采用MobileNetV1作为骨干网络,使用Triplet损失与交叉熵损失结合的联合损失函数用以人脸分类。优化后的算法在检测与识别上具有良好表现,改进RetinaFace算法在WiderFace数据集下检测精度为93.35%、90.84%和80.43%,FPS(Frames Per Second)可达53 frame·s^(-1)。动态人脸检测平均检测精度为96%,FPS为21 frame·s^(-1)。当FaceNet阈值设为1.15时,识别率最高达到98.23%。动态识别系统平均识别精度98%,FPS可达20 frame·s^(-1)。实验结果表明,该系统解决了人脸静态识别中需等待配合的问题,具有较高的识别精度与实时性。
文摘Technological advances in computer science and their application in our daily life allow us to improve our understanding of problems and solve them effectively.A system design to detect people with fever and determine highrisk areas using infrared thermography and big data is presented.In order to detect people with fever,face detection algorithms of Viola-Jones and Kanade-Lucas are investigated,and comparison between them is presented using a training set of 406 thermal images and a test set of 2072 thermal images.Thermography analysis is performed on detected faces to obtain the temperature level on Celsius scale.With this information a sample database is created.To perform big data experimental analysis,Power Bi tool is used to determine the high-risk area.The experimental results show that Viola-Jones algorithm has a higher performance recognizing faces of thermal images than KanadeLucas,having a high detection rate,less false-positives rate and false-negatives rate.
