loading page

Destabilizing Attack and Robust Defense for Multi-Inverter Distribution Systems by Adversarial Deep Reinforcement Learning
  • Yu Wang ,
  • Bikash Pal
Bikash Pal
Author Profile


The droop controllers of inverter based resources (IBRs) can be adjustable by grid operators to facilitate regulation services. Considering the increasing integration of IBRs in distribution systems, cyber-security is becoming a major concern. This paper investigates the data-driven destabilizing attack and robust defense strategy based on deep reinforcement learning for inverter-integrated distribution systems. Firstly, the full-order high-fidelity model and reduced-order small-signal model of typical multi-inverter systems are derived. Then the destabilizing attack on the droop control gains is analyzed, which reveals its impact to system stability. Finally, the attack and defense problems are formulated as Markov decision process (MDP) and adversarial MDP (AMDP). The problems are solved by twin delayed deep deterministic policy gradient (TD3) algorithm to find the least effort attack path of the system and obtain the corresponding robust defense strategy. The simulation studies are conducted in a multi-inverter microgrid system with 4 IBRs and IEEE 123-bus system with 10 IBRs to evaluate the proposed method.
Nov 2023Published in IEEE Transactions on Smart Grid volume 14 issue 6 on pages 4839-4850. 10.1109/TSG.2023.3263243