An Online Home Energy Management System using Q-Learning and Deep Q-Learning


İzmitligil H., KARAMANCIOĞLU A.

Sustainable Computing: Informatics and Systems, cilt.43, 2024 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 43
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1016/j.suscom.2024.101005
  • Dergi Adı: Sustainable Computing: Informatics and Systems
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Compendex, INSPEC
  • Anahtar Kelimeler: Appliances, Electric vehicle, Energy management, Reinforcement learning, User dissatisfaction cost
  • Eskişehir Osmangazi Üniversitesi Adresli: Evet

Özet

The users of home energy management systems schedule their real-time energy consumption thanks to advancements in communication technology and smart metering infrastructures. In this paper, a data-driven strategy is proposed, which is an Online Home Energy Management System (ON-HEM) that uses reinforcement learning algorithms (Q-Learning and Deep Q-Learning) to control the optimal energy consumption of a smart home system. The proposed system comprises power resources (grid, photovoltaic), communication networks, and appliances with their agents classified into four groups: deferrable, non-deferrable, power level controllable, and electric vehicle. The system reduces electricity costs and high peak demands while considering the cost of user dissatisfaction with real-life data. Simulations are performed on the proposed ON-HEM considering different pricing approaches (Real Time Pricing and Time of Use Pricing) with Q-Learning and Deep Q-Learning (DQL) algorithms using PyCharm Professional Edition software. The findings demonstrate both the superiority of DQL over Q-Learning and the efficiency of the proposed ON-HEM in decreasing high peak demand, electricity costs, and customer dissatisfaction costs. The efficiency and dependability of the proposed system were verified by utilizing simulation-based findings with real-life data using IBM SPSS Statistics software.