A Two-Stage PPO–RLMPA Framework for Dynamic Economic Dispatch with Renewable Energy and Storage Integration
Biomimetics, cilt.11, sa.6, 2026 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 11 Sayı: 6
- Basım Tarihi: 2026
- Doi Numarası: 10.3390/biomimetics11060400
- Dergi Adı: Biomimetics
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Compendex, Directory of Open Access Journals, Academic Search Ultimate (EBSCO), Natural Science Collection (ProQuest), Biological Science Database (ProQuest)
- Anahtar Kelimeler: Deep Q-Network, deep reinforcement learning, dynamic economic dispatch, Hybrid Optimization, Marine Predators Algorithm, Proximal Policy Optimization, pumped-storage hydro, Renewable Energy Integration, RLMPA
- Eskişehir Osmangazi Üniversitesi Adresli: Evet
Özet
The Dynamic Economic Dispatch (DED) problem underpins the cost-efficient and reliable operation of modern power systems, yet valve-point loading, ramp-rate coupling, and the growing share of intermittent wind, photovoltaic, and pumped-storage hydro (PSH) resources render it highly non-convex. Metaheuristic methods typically require large computational budgets and hand-crafted constraint-handling rules, whereas deep reinforcement learning agents rarely guarantee the feasibility of the schedules they produce. To address both limitations, this paper proposes a Two-Stage PPO–RLMPA framework that couples data-driven policy learning with a biomimetic metaheuristic search inspired by marine predator–prey dynamics. In the first stage, a Proximal Policy Optimization (PPO) agent is trained on a Markov Decision Process reformulation of DED in which a deterministic Safety Layer projects every raw action onto the feasible set defined by capacity, ramp-rate, and power-balance constraints, so the policy only observes physically viable transitions. In the second stage, the PPO dispatch is refined by the RLMPA module, a Marine Predators Algorithm (MPA) whose exploration–exploitation balance, Lévy-flight foraging, and Fish Aggregating Devices (FADs) attraction mechanisms emulate strategies documented in marine ecosystems; its step-size factor and FADs probability are further adapted online by a Deep Q-Network. This biomimetics-informed refinement translates predator–prey foraging intelligence into economically efficient thermal dispatch under valve-point non-convexity. Across 30 independent runs on ten- and twenty-unit benchmark systems with wind, PV, and PSH integration, the framework attains best costs of USD 368,763 and USD 737,348 on Test Systems 1 and 2, corresponding to reductions of approximately (Formula presented.) and (Formula presented.) over the CFCEP baseline, with zero post-repair constraint violations in every run.