This paper presents a novel approach to dynamic pricing and distributed energy management in virtual power plant(VPP)networks using multi-agent reinforcement learning(MARL).As the energy landscape evolves towards grea...This paper presents a novel approach to dynamic pricing and distributed energy management in virtual power plant(VPP)networks using multi-agent reinforcement learning(MARL).As the energy landscape evolves towards greater decentralization and renewable integration,traditional optimization methods struggle to address the inherent complexities and uncertainties.Our proposed MARL framework enables adaptive,decentralized decision-making for both the distribution system operator and individual VPPs,optimizing economic efficiency while maintaining grid stability.We formulate the problem as a Markov decision process and develop a custom MARL algorithm that leverages actor-critic architectures and experience replay.Extensive simulations across diverse scenarios demonstrate that our approach consistently outperforms baseline methods,including Stackelberg game models and model predictive control,achieving an 18.73%reduction in costs and a 22.46%increase in VPP profits.The MARL framework shows particular strength in scenarios with high renewable energy penetration,where it improves system performance by 11.95%compared with traditional methods.Furthermore,our approach demonstrates superior adaptability to unexpected events and mis-predictions,highlighting its potential for real-world implementation.展开更多
Pipeline integrity is a cornerstone of the operation of many industrial systems, and maintaining pipeline integrity is essential for preventing economic losses and ecological damage caused by oil and gas leaks. Based ...Pipeline integrity is a cornerstone of the operation of many industrial systems, and maintaining pipeline integrity is essential for preventing economic losses and ecological damage caused by oil and gas leaks. Based on integritymanagement data published by the US Pipeline and Hazardous Materials Safety Administration, this study applied the k-means clustering and data envelopment analysis(DEA) methods to both explore the characteristics of pipeline-integrity management and evaluate its efficiency. The k-means clustering algorithm was found to be scientifically valid for classifying pipeline companies as either low-, medium-, or high-difficulty companies according to their integrity-management requirements. Regardless of a pipeline company's classification, equipment failure was found to be the main cause of pipeline failure. In-line inspection corrosion and dent tools were the two most-used tools for pipeline inspection. Among the types of repair, 180-day condition repairs were a key concern for pipeline companies. The results of the DEA analysis indicate that only three out of 34 companies were deemed to be DEA-effective. To improve the effectiveness of pipeline integrity management, we propose targeted directions and scales of improvement for non-DEA-effective companies.展开更多
基金supported by the Science and Technology Project of State Grid Sichuan Electric Power Company Chengdu Power Supply Company under Grant No.521904240005.
文摘This paper presents a novel approach to dynamic pricing and distributed energy management in virtual power plant(VPP)networks using multi-agent reinforcement learning(MARL).As the energy landscape evolves towards greater decentralization and renewable integration,traditional optimization methods struggle to address the inherent complexities and uncertainties.Our proposed MARL framework enables adaptive,decentralized decision-making for both the distribution system operator and individual VPPs,optimizing economic efficiency while maintaining grid stability.We formulate the problem as a Markov decision process and develop a custom MARL algorithm that leverages actor-critic architectures and experience replay.Extensive simulations across diverse scenarios demonstrate that our approach consistently outperforms baseline methods,including Stackelberg game models and model predictive control,achieving an 18.73%reduction in costs and a 22.46%increase in VPP profits.The MARL framework shows particular strength in scenarios with high renewable energy penetration,where it improves system performance by 11.95%compared with traditional methods.Furthermore,our approach demonstrates superior adaptability to unexpected events and mis-predictions,highlighting its potential for real-world implementation.
基金funded by the National Natural Science Foundation of China (Grant No. 71871018)。
文摘Pipeline integrity is a cornerstone of the operation of many industrial systems, and maintaining pipeline integrity is essential for preventing economic losses and ecological damage caused by oil and gas leaks. Based on integritymanagement data published by the US Pipeline and Hazardous Materials Safety Administration, this study applied the k-means clustering and data envelopment analysis(DEA) methods to both explore the characteristics of pipeline-integrity management and evaluate its efficiency. The k-means clustering algorithm was found to be scientifically valid for classifying pipeline companies as either low-, medium-, or high-difficulty companies according to their integrity-management requirements. Regardless of a pipeline company's classification, equipment failure was found to be the main cause of pipeline failure. In-line inspection corrosion and dent tools were the two most-used tools for pipeline inspection. Among the types of repair, 180-day condition repairs were a key concern for pipeline companies. The results of the DEA analysis indicate that only three out of 34 companies were deemed to be DEA-effective. To improve the effectiveness of pipeline integrity management, we propose targeted directions and scales of improvement for non-DEA-effective companies.
