Newton's learning algorithm of NN is presented and realized. In theory, the convergence rate of learning algorithm of NN based on Newton's method must be faster than BP's and other learning algorithms, because the ...Newton's learning algorithm of NN is presented and realized. In theory, the convergence rate of learning algorithm of NN based on Newton's method must be faster than BP's and other learning algorithms, because the gradient method is linearly convergent while Newton's method has second order convergence rate. The fast computing algorithm of Hesse matrix of the cost function of NN is proposed and it is the theory basis of the improvement of Newton's learning algorithm. Simulation results show that the convergence rate of Newton's learning algorithm is high and apparently faster than the traditional BP method's, and the robustness of Newton's learning algorithm is also better than BP method' s.展开更多
针对日趋严重的电网谐波污染亟需大量谐波数据支撑分析和治理及电网谐波监测能力不足的问题,提出一种改进减法平均优化(subtraction average based optimizer, SABO)算法优化反向传播(back-propagation, BP)神经网络实现谐波预测,以缓...针对日趋严重的电网谐波污染亟需大量谐波数据支撑分析和治理及电网谐波监测能力不足的问题,提出一种改进减法平均优化(subtraction average based optimizer, SABO)算法优化反向传播(back-propagation, BP)神经网络实现谐波预测,以缓解当前谐波数据匮乏的问题。为了克服现有SABO算法易于陷入局部最优解,初始化时使用Logistic混沌映射替代随机数,同时迭代搜索中利用黄金正弦优化算法辅助SABO跳出局部最优,从而提高BP神经网络预测准确率。最后,以某省实际运行数据验证所提改进SABAO-BP模型在谐波电压畸变率及单次谐波电压含有率预测中均具有较高准确性。展开更多
文摘Newton's learning algorithm of NN is presented and realized. In theory, the convergence rate of learning algorithm of NN based on Newton's method must be faster than BP's and other learning algorithms, because the gradient method is linearly convergent while Newton's method has second order convergence rate. The fast computing algorithm of Hesse matrix of the cost function of NN is proposed and it is the theory basis of the improvement of Newton's learning algorithm. Simulation results show that the convergence rate of Newton's learning algorithm is high and apparently faster than the traditional BP method's, and the robustness of Newton's learning algorithm is also better than BP method' s.
文摘针对日趋严重的电网谐波污染亟需大量谐波数据支撑分析和治理及电网谐波监测能力不足的问题,提出一种改进减法平均优化(subtraction average based optimizer, SABO)算法优化反向传播(back-propagation, BP)神经网络实现谐波预测,以缓解当前谐波数据匮乏的问题。为了克服现有SABO算法易于陷入局部最优解,初始化时使用Logistic混沌映射替代随机数,同时迭代搜索中利用黄金正弦优化算法辅助SABO跳出局部最优,从而提高BP神经网络预测准确率。最后,以某省实际运行数据验证所提改进SABAO-BP模型在谐波电压畸变率及单次谐波电压含有率预测中均具有较高准确性。