The network performance and the unmanned aerial vehicle(UAV)number are important objectives when UAVs are placed as communication relays to enhance the multi-agent information exchange.The problem is a non-determinist...The network performance and the unmanned aerial vehicle(UAV)number are important objectives when UAVs are placed as communication relays to enhance the multi-agent information exchange.The problem is a non-deterministic polynomial hard(NP-hard)multi-objective optimization problem,instead of generating a Pareto solution,this work focuses on considering both objectives at the same level so as to achieve a balanced solution between them.Based on the property that agents connected to the same UAV are a cluster,two clustering-based algorithms,M-K-means(MKM)and modified fast search and find density of peaks(MFSFDP)methods,are first proposed.Since the former algorithm requires too much computational time and the latter one requires too many relays,an algorithm for the balanced network performance and relay number(BPN)is proposed by discretizing the area to avoid missing the optimal relay positions and defining a new local density function to reflect the network performance metric.Simulation results demonstrate that the proposed algorithms are feasible and effective.Comparisons between these algorithms show that the BPN algorithm uses fewer relay UAVs than the MFSFDP and classic set-covering based algorithm,and its computational time is far less than the MKM algorithm.展开更多
In this paper, we propose a joint waveform selection and power allocation(JWSPA) strategy based on chance-constraint programming(CCP) for manned/unmanned aerial vehicle hybrid swarm(M/UAVHS) tracking a single target. ...In this paper, we propose a joint waveform selection and power allocation(JWSPA) strategy based on chance-constraint programming(CCP) for manned/unmanned aerial vehicle hybrid swarm(M/UAVHS) tracking a single target. Accordingly,the low probability of intercept(LPI) performance of system can be improved by collaboratively optimizing transmit power and waveform. For target radar cross section(RCS) prediction, we design a random RCS prediction model based on electromagnetic simulation(ES) of target. For waveform selection, we build a waveform library to adaptively manage the frequency modulation slope and pulse width of radar waveform. For power allocation,the CCP is employed to balance tracking accuracy and power resource. The Bayesian Cramér-Rao lower bound(BCRLB) is adopted as a criterion to measure target tracking accuracy. The hybrid intelli gent algorithms, in which the stochastic simulation is integrated into the genetic algorithm(GA), are used to solve the stochastic optimization problem. Simulation results demonstrate that the proposed JWSPA strategy can save more transmit power than the traditional fixed waveform scheme under the same target tracking accuracy.展开更多
To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on...To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on long shortterm memory(RPP-LSTM)network is proposed,which combines the memory characteristics of recurrent neural network(RNN)and the deep reinforcement learning algorithm.LSTM networks are used in this algorithm as Q-value networks for the deep Q network(DQN)algorithm,which makes the decision of the Q-value network has some memory.Thanks to LSTM network,the Q-value network can use the previous environmental information and action information which effectively avoids the problem of single-step decision considering only the current environment.Besides,the algorithm proposes a hierarchical reward and punishment function for the specific problem of UAV real-time path planning,so that the UAV can more reasonably perform path planning.Simulation verification shows that compared with the traditional feed-forward neural network(FNN)based UAV autonomous path planning algorithm,the RPP-LSTM proposed in this paper can adapt to more complex environments and has significantly improved robustness and accuracy when performing UAV real-time path planning.展开更多
基金the National Natural Science Foundation of China(61573285)。
文摘The network performance and the unmanned aerial vehicle(UAV)number are important objectives when UAVs are placed as communication relays to enhance the multi-agent information exchange.The problem is a non-deterministic polynomial hard(NP-hard)multi-objective optimization problem,instead of generating a Pareto solution,this work focuses on considering both objectives at the same level so as to achieve a balanced solution between them.Based on the property that agents connected to the same UAV are a cluster,two clustering-based algorithms,M-K-means(MKM)and modified fast search and find density of peaks(MFSFDP)methods,are first proposed.Since the former algorithm requires too much computational time and the latter one requires too many relays,an algorithm for the balanced network performance and relay number(BPN)is proposed by discretizing the area to avoid missing the optimal relay positions and defining a new local density function to reflect the network performance metric.Simulation results demonstrate that the proposed algorithms are feasible and effective.Comparisons between these algorithms show that the BPN algorithm uses fewer relay UAVs than the MFSFDP and classic set-covering based algorithm,and its computational time is far less than the MKM algorithm.
基金This work was supported by the National Natural Science Foundation of China(62071440,61671241).
文摘In this paper, we propose a joint waveform selection and power allocation(JWSPA) strategy based on chance-constraint programming(CCP) for manned/unmanned aerial vehicle hybrid swarm(M/UAVHS) tracking a single target. Accordingly,the low probability of intercept(LPI) performance of system can be improved by collaboratively optimizing transmit power and waveform. For target radar cross section(RCS) prediction, we design a random RCS prediction model based on electromagnetic simulation(ES) of target. For waveform selection, we build a waveform library to adaptively manage the frequency modulation slope and pulse width of radar waveform. For power allocation,the CCP is employed to balance tracking accuracy and power resource. The Bayesian Cramér-Rao lower bound(BCRLB) is adopted as a criterion to measure target tracking accuracy. The hybrid intelli gent algorithms, in which the stochastic simulation is integrated into the genetic algorithm(GA), are used to solve the stochastic optimization problem. Simulation results demonstrate that the proposed JWSPA strategy can save more transmit power than the traditional fixed waveform scheme under the same target tracking accuracy.
基金supported by the Natural Science Basic Research Prog ram of Shaanxi(2022JQ-593)。
文摘To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on long shortterm memory(RPP-LSTM)network is proposed,which combines the memory characteristics of recurrent neural network(RNN)and the deep reinforcement learning algorithm.LSTM networks are used in this algorithm as Q-value networks for the deep Q network(DQN)algorithm,which makes the decision of the Q-value network has some memory.Thanks to LSTM network,the Q-value network can use the previous environmental information and action information which effectively avoids the problem of single-step decision considering only the current environment.Besides,the algorithm proposes a hierarchical reward and punishment function for the specific problem of UAV real-time path planning,so that the UAV can more reasonably perform path planning.Simulation verification shows that compared with the traditional feed-forward neural network(FNN)based UAV autonomous path planning algorithm,the RPP-LSTM proposed in this paper can adapt to more complex environments and has significantly improved robustness and accuracy when performing UAV real-time path planning.
