This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hype...This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.展开更多
This paper mainly focuses on the development of a learning-based controller for a class of uncertain mechanical systems modeled by the Euler-Lagrange formulation.The considered system can depict the behavior of a larg...This paper mainly focuses on the development of a learning-based controller for a class of uncertain mechanical systems modeled by the Euler-Lagrange formulation.The considered system can depict the behavior of a large class of engineering systems,such as vehicular systems,robot manipulators and satellites.All these systems are often characterized by highly nonlinear characteristics,heavy modeling uncertainties and unknown perturbations,therefore,accurate-model-based nonlinear control approaches become unavailable.Motivated by the challenge,a reinforcement learning(RL)adaptive control methodology based on the actor-critic framework is investigated to compensate the uncertain mechanical dynamics.The approximation inaccuracies caused by RL and the exogenous unknown disturbances are circumvented via a continuous robust integral of the sign of the error(RISE)control approach.Different from a classical RISE control law,a tanh(·)function is utilized instead of a sign(·)function to acquire a more smooth control signal.The developed controller requires very little prior knowledge of the dynamic model,is robust to unknown dynamics and exogenous disturbances,and can achieve asymptotic output tracking.Eventually,co-simulations through ADAMS and MATLAB/Simulink on a three degrees-of-freedom(3-DOF)manipulator and experiments on a real-time electromechanical servo system are performed to verify the performance of the proposed approach.展开更多
The PD-type iterative learning control design of a class of affine nonlinear time-delay systems with external disturbances is considered. Sufficient conditions guaranteeing the convergence of the n-norm of the trackin...The PD-type iterative learning control design of a class of affine nonlinear time-delay systems with external disturbances is considered. Sufficient conditions guaranteeing the convergence of the n-norm of the tracking error are derived. It is shown that the system outputs can be guaranteed to converge to desired trajectories in the absence of external disturbances and output measurement noises. And in the presence of state disturbances and measurement noises, the tracking error will be bounded uniformly. A numerical simulation example is presented to validate the effectiveness of the proposed scheme.展开更多
A new kind of volume control hydraulic press that combines the advantages of both hydraulic and SRM(switched reluctance motor) driving technology is developed.Considering that the serious dead zone and time-variant no...A new kind of volume control hydraulic press that combines the advantages of both hydraulic and SRM(switched reluctance motor) driving technology is developed.Considering that the serious dead zone and time-variant nonlinearity exist in the volume control electro-hydraulic servo system,the ILC(iterative learning control) method is applied to tracking the displacement curve of the hydraulic press slider.In order to improve the convergence speed and precision of ILC,a fuzzy ILC algorithm that utilizes the fuzzy strategy to adaptively adjust the iterative learning gains is put forward.The simulation and experimental researches are carried out to investigate the convergence speed and precision of the fuzzy ILC for hydraulic press slider position tracking.The results show that the fuzzy ILC can raise the iterative learning speed enormously,and realize the tracking control of slider displacement curve with rapid response speed and high control precision.In experiment,the maximum tracking error 0.02 V is achieved through 12 iterations only.展开更多
The iterative learning control （ILC） has been demon-strated to be capable of considerably improving the tracking perfor-mance of systems which are affected by the iteration-independent disturbance. However, the achi...The iterative learning control （ILC） has been demon-strated to be capable of considerably improving the tracking perfor-mance of systems which are affected by the iteration-independent disturbance. However, the achievable performance is greatly degraded when iteration-dependent, stochastic disturbances are pre-sented. This paper considers the robustness of the ILC algorithm for the nonlinear system in presence of stochastic measurement disturbances. The robust convergence of the P-type ILC algorithm is firstly addressed, and then an improved ILC algorithm with a decreasing gain is proposed. Theoretical analyses show that the proposed algorithm can guarantee that the tracking error of the nonlinear system tends to zero in presence of measurement dis-turbances. The analysis is also supported by a numerical example.展开更多
Batch to batch temperature control of a semi-batch chemical reactor with heating/cooling system was discussed in this study. Without extensive modeling investigations, a two-dimensional(2D) general predictive iterativ...Batch to batch temperature control of a semi-batch chemical reactor with heating/cooling system was discussed in this study. Without extensive modeling investigations, a two-dimensional(2D) general predictive iterative learning control(2D-MGPILC) strategy based on the multi-model with time-varying weights was introduced for optimizing the tracking performance of desired temperature profile. This strategy was modeled based on an iterative learning control(ILC) algorithm for a 2D system and designed in the generalized predictive control(GPC) framework. Firstly, a multi-model structure with time-varying weights was developed to describe the complex operation of a general semi-batch reactor. Secondly, the 2 D-MGPILC algorithm was proposed to optimize simultaneously the dynamic performance along the time and batch axes. Finally, simulation for the controller design of a semi-batch reactor with multiple reactions was involved to demonstrate that the satisfactory performance could be achieved despite of the repetitive or non-repetitive disturbances.展开更多
This paper presents an Iterative Learning Control design applied to homing guidance of missiles against maneuvering targets. According to numerical experiments, although an increase of the control energies is apprecia...This paper presents an Iterative Learning Control design applied to homing guidance of missiles against maneuvering targets. According to numerical experiments, although an increase of the control energies is appreciated with respect to a previous published base controller for comparison, this strategy, which is simple to realize, is able to reduce the time to reach the head-on condition to target destruction. This fact is important to minimize the missile lateral force-level to fulfill engaging in hyper-sonic target persecutions.展开更多
For the robustness problem of open-loop P-type iterative learning control under the influence of measurement noise which is inevitable in actual systems, an adaptive adjustment algorithm of iterative learning nonlinea...For the robustness problem of open-loop P-type iterative learning control under the influence of measurement noise which is inevitable in actual systems, an adaptive adjustment algorithm of iterative learning nonlinear gain matrix based on error amplitude is proposed and two nonlinear gain functions are given. Then with the help of Bellman-Gronwall lemma, the robustness proof is derived. At last, an example is simulated and analyzed. The results show that when there exists measurement noise, the proposed learning law adjusts the learning gain matrix on line based on error amplitude, thus can make a compromise between learning convergence rate and convergence accuracy to some extent： the fast convergence rate is achieved with high gain in initial learning stage, the strong robustness and high convergence accuracy are achieved at the same time with small gain in the end learning stage, thus better learning results are obtained.展开更多
A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of ...A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.展开更多
This paper presents a deep reinforcement learning(DRL)-based motion control method to provide unmanned aerial vehicles(UAVs)with additional flexibility while flying across dynamic unknown environments autonomously.Thi...This paper presents a deep reinforcement learning(DRL)-based motion control method to provide unmanned aerial vehicles(UAVs)with additional flexibility while flying across dynamic unknown environments autonomously.This method is applicable in both military and civilian fields such as penetration and rescue.The autonomous motion control problem is addressed through motion planning,action interpretation,trajectory tracking,and vehicle movement within the DRL framework.Novel DRL algorithms are presented by combining two difference-amplifying approaches with traditional DRL methods and are used for solving the motion planning problem.An improved Lyapunov guidance vector field(LGVF)method is used to handle the trajectory-tracking problem and provide guidance control commands for the UAV.In contrast to conventional motion-control approaches,the proposed methods directly map the sensorbased detections and measurements into control signals for the inner loop of the UAV,i.e.,an end-to-end control.The training experiment results show that the novel DRL algorithms provide more than a 20%performance improvement over the state-ofthe-art DRL algorithms.The testing experiment results demonstrate that the controller based on the novel DRL and LGVF,which is only trained once in a static environment,enables the UAV to fly autonomously in various dynamic unknown environments.Thus,the proposed technique provides strong flexibility for the controller.展开更多
This paper proposes a liner active disturbance rejection control(LADRC) method based on the Q-Learning algorithm of reinforcement learning(RL) to control the six-degree-of-freedom motion of an autonomous underwater ve...This paper proposes a liner active disturbance rejection control(LADRC) method based on the Q-Learning algorithm of reinforcement learning(RL) to control the six-degree-of-freedom motion of an autonomous underwater vehicle(AUV).The number of controllers is increased to realize AUV motion decoupling.At the same time, in order to avoid the oversize of the algorithm, combined with the controlled content, a simplified Q-learning algorithm is constructed to realize the parameter adaptation of the LADRC controller.Finally, through the simulation experiment of the controller with fixed parameters and the controller based on the Q-learning algorithm, the rationality of the simplified algorithm, the effectiveness of parameter adaptation, and the unique advantages of the LADRC controller are verified.展开更多
This paper studied a supervisory control system for a hybrid off-highway electric vehicle under the chargesustaining(CS)condition.A new predictive double Q-learning with backup models(PDQL)scheme is proposed to optimi...This paper studied a supervisory control system for a hybrid off-highway electric vehicle under the chargesustaining(CS)condition.A new predictive double Q-learning with backup models(PDQL)scheme is proposed to optimize the engine fuel in real-world driving and improve energy efficiency with a faster and more robust learning process.Unlike the existing“model-free”methods,which solely follow on-policy and off-policy to update knowledge bases(Q-tables),the PDQL is developed with the capability to merge both on-policy and off-policy learning by introducing a backup model(Q-table).Experimental evaluations are conducted based on software-in-the-loop(SiL)and hardware-in-the-loop(HiL)test platforms based on real-time modelling of the studied vehicle.Compared to the standard double Q-learning(SDQL),the PDQL only needs half of the learning iterations to achieve better energy efficiency than the SDQL at the end learning process.In the SiL under 35 rounds of learning,the results show that the PDQL can improve the vehicle energy efficiency by 1.75%higher than SDQL.By implementing the PDQL in HiL under four predefined real-world conditions,the PDQL can robustly save more than 5.03%energy than the SDQL scheme.展开更多
In this paper,the optimal control of non-linear switching system is investigated without knowing the system dynamics.First,the Hamilton-Jacobi-Bellman(HJB)equation is derived with the consideration of hybrid action sp...In this paper,the optimal control of non-linear switching system is investigated without knowing the system dynamics.First,the Hamilton-Jacobi-Bellman(HJB)equation is derived with the consideration of hybrid action space.Then,a novel data-based hybrid Q-learning(HQL)algorithm is proposed to find the optimal solution in an iterative manner.In addition,the theoretical analysis is provided to illustrate the convergence and optimality of the proposed algorithm.Finally,the algorithm is implemented with the actor-critic(AC)structure,and two linear-in-parameter neural networks are utilized to approximate the functions.Simulation results validate the effectiveness of the data-driven method.展开更多
This paper introduces a self-learning control approach based on approximate dynamic programming. Dynamic programming was introduced by Bellman in the 1950's for solving optimal control problems of nonlinear dynami...This paper introduces a self-learning control approach based on approximate dynamic programming. Dynamic programming was introduced by Bellman in the 1950's for solving optimal control problems of nonlinear dynamical systems. Due to its high computational complexity, the applications of dynamic programming have been limited to simple and small problems. The key step in finding approximate solutions to dynamic programming is to estimate the performance index in dynamic programming. The optimal control signal can then be determined by minimizing (or maximizing) the performance index. Artificial neural networks are very efficient tools in representing the performance index in dynamic programming. This paper assumes the use of neural networks for estimating the performance index in dynamic programming and for generating optimal control signals, thus to achieve optimal control through self-learning.展开更多
In this paper we review the recent advances in three sub-areas of iterative learning control (ILC): 1) linear ILC for linear processes, 2) linear ILC for nonlinear processes which are global Lipschitz continuous (GLC)...In this paper we review the recent advances in three sub-areas of iterative learning control (ILC): 1) linear ILC for linear processes, 2) linear ILC for nonlinear processes which are global Lipschitz continuous (GLC), and 3) nonlinear ILC for general nonlinear processes. For linear processes, we focus on several basic configurations of linear ILC. For nonlinear processes with linear ILC, we concentrate on the design and transient analysis which were overlooked and missing for a long period. For general classes of nonlinear processes, we demonstrate nonlinear ILC methods based on Lyapunov theory, which is evolving into a new control paradigm.展开更多
Some typical structural schemes of learning control have been investigated.The schemes involve the pattern recognitionbased learning control,iterative learning control,repetitive learning control,and connectionist lea...Some typical structural schemes of learning control have been investigated.The schemes involve the pattern recognitionbased learning control,iterative learning control,repetitive learning control,and connectionist learning control,etc.This study focuses on the control mechanism and provides a basis for potential applications.Most of the structural schemes have been applied to various control fields.展开更多
基金supported by the National Natural Science Foundation of China(12072090).
文摘This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.
基金supported in part by the National Key R&D Program of China under Grant 2021YFB2011300the National Natural Science Foundation of China under Grant 52075262。
文摘This paper mainly focuses on the development of a learning-based controller for a class of uncertain mechanical systems modeled by the Euler-Lagrange formulation.The considered system can depict the behavior of a large class of engineering systems,such as vehicular systems,robot manipulators and satellites.All these systems are often characterized by highly nonlinear characteristics,heavy modeling uncertainties and unknown perturbations,therefore,accurate-model-based nonlinear control approaches become unavailable.Motivated by the challenge,a reinforcement learning(RL)adaptive control methodology based on the actor-critic framework is investigated to compensate the uncertain mechanical dynamics.The approximation inaccuracies caused by RL and the exogenous unknown disturbances are circumvented via a continuous robust integral of the sign of the error(RISE)control approach.Different from a classical RISE control law,a tanh(·)function is utilized instead of a sign(·)function to acquire a more smooth control signal.The developed controller requires very little prior knowledge of the dynamic model,is robust to unknown dynamics and exogenous disturbances,and can achieve asymptotic output tracking.Eventually,co-simulations through ADAMS and MATLAB/Simulink on a three degrees-of-freedom(3-DOF)manipulator and experiments on a real-time electromechanical servo system are performed to verify the performance of the proposed approach.
基金This project was supported by the National Natural Science Foundation of China (60074001) and the Natural ScienceFoundation of Shandong Province (Y2000G02)
文摘The PD-type iterative learning control design of a class of affine nonlinear time-delay systems with external disturbances is considered. Sufficient conditions guaranteeing the convergence of the n-norm of the tracking error are derived. It is shown that the system outputs can be guaranteed to converge to desired trajectories in the absence of external disturbances and output measurement noises. And in the presence of state disturbances and measurement noises, the tracking error will be bounded uniformly. A numerical simulation example is presented to validate the effectiveness of the proposed scheme.
基金Project(2007AA04Z144) supported by the National High-Tech Research and Development Program of ChinaProject(2007421119) supported by the China Postdoctoral Science Foundation
文摘A new kind of volume control hydraulic press that combines the advantages of both hydraulic and SRM(switched reluctance motor) driving technology is developed.Considering that the serious dead zone and time-variant nonlinearity exist in the volume control electro-hydraulic servo system,the ILC(iterative learning control) method is applied to tracking the displacement curve of the hydraulic press slider.In order to improve the convergence speed and precision of ILC,a fuzzy ILC algorithm that utilizes the fuzzy strategy to adaptively adjust the iterative learning gains is put forward.The simulation and experimental researches are carried out to investigate the convergence speed and precision of the fuzzy ILC for hydraulic press slider position tracking.The results show that the fuzzy ILC can raise the iterative learning speed enormously,and realize the tracking control of slider displacement curve with rapid response speed and high control precision.In experiment,the maximum tracking error 0.02 V is achieved through 12 iterations only.
基金supported by the National Natural Science Foundation of China (61203065 60834001)the Program of Open Laboratory Foundation of Control Engineering Key Discipline of Henan Provincial High Education (KG 2011-10)
文摘The iterative learning control （ILC） has been demon-strated to be capable of considerably improving the tracking perfor-mance of systems which are affected by the iteration-independent disturbance. However, the achievable performance is greatly degraded when iteration-dependent, stochastic disturbances are pre-sented. This paper considers the robustness of the ILC algorithm for the nonlinear system in presence of stochastic measurement disturbances. The robust convergence of the P-type ILC algorithm is firstly addressed, and then an improved ILC algorithm with a decreasing gain is proposed. Theoretical analyses show that the proposed algorithm can guarantee that the tracking error of the nonlinear system tends to zero in presence of measurement dis-turbances. The analysis is also supported by a numerical example.
基金Projects(61673205,21727818,61503180)supported by the National Natural Science Foundation of ChinaProject(2017YFB0307304)supported by National Key R&D Program of ChinaProject(BK20141461)supported by the Natural Science Foundation of Jiangsu Province,China
文摘Batch to batch temperature control of a semi-batch chemical reactor with heating/cooling system was discussed in this study. Without extensive modeling investigations, a two-dimensional(2D) general predictive iterative learning control(2D-MGPILC) strategy based on the multi-model with time-varying weights was introduced for optimizing the tracking performance of desired temperature profile. This strategy was modeled based on an iterative learning control(ILC) algorithm for a 2D system and designed in the generalized predictive control(GPC) framework. Firstly, a multi-model structure with time-varying weights was developed to describe the complex operation of a general semi-batch reactor. Secondly, the 2 D-MGPILC algorithm was proposed to optimize simultaneously the dynamic performance along the time and batch axes. Finally, simulation for the controller design of a semi-batch reactor with multiple reactions was involved to demonstrate that the satisfactory performance could be achieved despite of the repetitive or non-repetitive disturbances.
基金partially supported by the Spanish Ministry of Economy and Competitiveness under grant number DPI2015-64170-R(MINECO/FEDER)
文摘This paper presents an Iterative Learning Control design applied to homing guidance of missiles against maneuvering targets. According to numerical experiments, although an increase of the control energies is appreciated with respect to a previous published base controller for comparison, this strategy, which is simple to realize, is able to reduce the time to reach the head-on condition to target destruction. This fact is important to minimize the missile lateral force-level to fulfill engaging in hyper-sonic target persecutions.
基金supported by the Specialized Research Fund for the Doctoral Program of Higher Education(20106102110032)
文摘For the robustness problem of open-loop P-type iterative learning control under the influence of measurement noise which is inevitable in actual systems, an adaptive adjustment algorithm of iterative learning nonlinear gain matrix based on error amplitude is proposed and two nonlinear gain functions are given. Then with the help of Bellman-Gronwall lemma, the robustness proof is derived. At last, an example is simulated and analyzed. The results show that when there exists measurement noise, the proposed learning law adjusts the learning gain matrix on line based on error amplitude, thus can make a compromise between learning convergence rate and convergence accuracy to some extent： the fast convergence rate is achieved with high gain in initial learning stage, the strong robustness and high convergence accuracy are achieved at the same time with small gain in the end learning stage, thus better learning results are obtained.
基金This project was supported by the research foundation of China Education Ministry for the scholars from abroad (2002247).
文摘A learning-based control approach is presented for force servoing of a robot with vision in an unknown environment. Firstly, mapping relationships between image features of the servoing object and the joint angles of the robot are derived and learned by a neural network. Secondly, a learning controller based on the neural network is designed for the robot to trace the object. Thirdly, a discrete time impedance control law is obtained for the force servoing of the robot, the on-line learning algorithms for three neural networks are developed to adjust the impedance parameters of the robot in the unknown environment. Lastly, wiping experiments are carried out by using a 6 DOF industrial robot with a CCD camera and a force/torque sensor in its end effector, and the experimental results confirm the effecti veness of the approach.
基金supported by the National Natural Science Foundation of China(62003267)the Natural Science Foundation of Shaanxi Province(2020JQ-220)the Open Project of Science and Technology on Electronic Information Control Laboratory(JS20201100339)。
文摘This paper presents a deep reinforcement learning(DRL)-based motion control method to provide unmanned aerial vehicles(UAVs)with additional flexibility while flying across dynamic unknown environments autonomously.This method is applicable in both military and civilian fields such as penetration and rescue.The autonomous motion control problem is addressed through motion planning,action interpretation,trajectory tracking,and vehicle movement within the DRL framework.Novel DRL algorithms are presented by combining two difference-amplifying approaches with traditional DRL methods and are used for solving the motion planning problem.An improved Lyapunov guidance vector field(LGVF)method is used to handle the trajectory-tracking problem and provide guidance control commands for the UAV.In contrast to conventional motion-control approaches,the proposed methods directly map the sensorbased detections and measurements into control signals for the inner loop of the UAV,i.e.,an end-to-end control.The training experiment results show that the novel DRL algorithms provide more than a 20%performance improvement over the state-ofthe-art DRL algorithms.The testing experiment results demonstrate that the controller based on the novel DRL and LGVF,which is only trained once in a static environment,enables the UAV to fly autonomously in various dynamic unknown environments.Thus,the proposed technique provides strong flexibility for the controller.
基金supported by the National Natural Science Foundation of China (6197317561973172)Tianjin Natural Science Foundation (19JCZDJC32800)。
文摘This paper proposes a liner active disturbance rejection control(LADRC) method based on the Q-Learning algorithm of reinforcement learning(RL) to control the six-degree-of-freedom motion of an autonomous underwater vehicle(AUV).The number of controllers is increased to realize AUV motion decoupling.At the same time, in order to avoid the oversize of the algorithm, combined with the controlled content, a simplified Q-learning algorithm is constructed to realize the parameter adaptation of the LADRC controller.Finally, through the simulation experiment of the controller with fixed parameters and the controller based on the Q-learning algorithm, the rationality of the simplified algorithm, the effectiveness of parameter adaptation, and the unique advantages of the LADRC controller are verified.
基金Project(KF2029)supported by the State Key Laboratory of Automotive Safety and Energy(Tsinghua University),ChinaProject(102253)supported partially by the Innovate UK。
文摘This paper studied a supervisory control system for a hybrid off-highway electric vehicle under the chargesustaining(CS)condition.A new predictive double Q-learning with backup models(PDQL)scheme is proposed to optimize the engine fuel in real-world driving and improve energy efficiency with a faster and more robust learning process.Unlike the existing“model-free”methods,which solely follow on-policy and off-policy to update knowledge bases(Q-tables),the PDQL is developed with the capability to merge both on-policy and off-policy learning by introducing a backup model(Q-table).Experimental evaluations are conducted based on software-in-the-loop(SiL)and hardware-in-the-loop(HiL)test platforms based on real-time modelling of the studied vehicle.Compared to the standard double Q-learning(SDQL),the PDQL only needs half of the learning iterations to achieve better energy efficiency than the SDQL at the end learning process.In the SiL under 35 rounds of learning,the results show that the PDQL can improve the vehicle energy efficiency by 1.75%higher than SDQL.By implementing the PDQL in HiL under four predefined real-world conditions,the PDQL can robustly save more than 5.03%energy than the SDQL scheme.
基金supported by the National Key R&D Program of China(2018AAA0101400)the Natural Science Foundation of Jiangsu Province of China(BK20202006)the National Natural Science Foundation of China(61921004,62173251).
文摘In this paper,the optimal control of non-linear switching system is investigated without knowing the system dynamics.First,the Hamilton-Jacobi-Bellman(HJB)equation is derived with the consideration of hybrid action space.Then,a novel data-based hybrid Q-learning(HQL)algorithm is proposed to find the optimal solution in an iterative manner.In addition,the theoretical analysis is provided to illustrate the convergence and optimality of the proposed algorithm.Finally,the algorithm is implemented with the actor-critic(AC)structure,and two linear-in-parameter neural networks are utilized to approximate the functions.Simulation results validate the effectiveness of the data-driven method.
基金Supported by National Natural Science Foundation of P.R.China(60474038)Science Research Foundation of Beijing Jiaotong University(2005SM005)Specialized Research Fund for the Doctoral Program of Higher Education(20060004002)
基金Supported by the National Science Foundation (U.S.A.) under Grant ECS-0355364
文摘This paper introduces a self-learning control approach based on approximate dynamic programming. Dynamic programming was introduced by Bellman in the 1950's for solving optimal control problems of nonlinear dynamical systems. Due to its high computational complexity, the applications of dynamic programming have been limited to simple and small problems. The key step in finding approximate solutions to dynamic programming is to estimate the performance index in dynamic programming. The optimal control signal can then be determined by minimizing (or maximizing) the performance index. Artificial neural networks are very efficient tools in representing the performance index in dynamic programming. This paper assumes the use of neural networks for estimating the performance index in dynamic programming and for generating optimal control signals, thus to achieve optimal control through self-learning.
基金Supported by the Scientific Research Foundation for the Returned 0verseas Chinese Scholars, State Education Ministry, and National Natural Science Foundation of China （60474005）
文摘In this paper we review the recent advances in three sub-areas of iterative learning control (ILC): 1) linear ILC for linear processes, 2) linear ILC for nonlinear processes which are global Lipschitz continuous (GLC), and 3) nonlinear ILC for general nonlinear processes. For linear processes, we focus on several basic configurations of linear ILC. For nonlinear processes with linear ILC, we concentrate on the design and transient analysis which were overlooked and missing for a long period. For general classes of nonlinear processes, we demonstrate nonlinear ILC methods based on Lyapunov theory, which is evolving into a new control paradigm.
基金Supported by National Natural science Foundation-of P.R.Chlna （60474038, 60774022）, Specialized Research Fund for the Doctoral Program of Higher Educatlon（20060004002）
文摘Some typical structural schemes of learning control have been investigated.The schemes involve the pattern recognitionbased learning control,iterative learning control,repetitive learning control,and connectionist learning control,etc.This study focuses on the control mechanism and provides a basis for potential applications.Most of the structural schemes have been applied to various control fields.
基金Supported by National Natural Science Foundation ot China （61203065, 61120106009）, the Program of Natural Science of Henan Provincial Education Department （12A510013）, and the Program of Open Laboratory Foundation of Control Engineering Key Discipline of Henan Provincial High Education （KG 2011-10）
文摘在这份报纸，反复的学习控制(ILC ) 与任意的切换的信号为线性分离时间的交换系统的一个类被考虑。交换系统重复地在有限时间间隔期间被操作，这被假定，然后第一个顺序 P 类型 ILC 计划能被用来完成完美的追踪在上自始至终间隔。由超级向量途径，为在重复领域的如此的 ILC 系统的一个集中条件能被给。理论分析被模拟支持。
