Qashqai, Pouria, Babaie, Mohammad, Zgheib, Rawad and Al-Haddad, Kamal.
2025.
« Implementation of deep reinforcement learning for model-free switching and control of a 23-level single DC source hybrid packed U-cell (HPUC) ».
IEEE Access, vol. 13.
pp. 172293-172305.
Preview |
PDF
AlHaddad-K-2025-31925.pdf - Published Version Use licence: Creative Commons CC BY. Download (2MB) | Preview |
Abstract
This paper proposes a novel Deep Reinforcement Learning (DRL) method for controlling a 23-level Single DC Source Hybrid Packed U-Cell (HPUC) converter. The HPUC topology generates a high number of voltage levels with minimal components but presents control challenges due to its numerous switching states and dynamic charging behavior. Unlike conventional control methods, which require accurate models and are sensitive to noise and parameter mismatches, DRL offers a model-free and resilient approach to the non-linear control of such complex systems. A Deep Q-Network (DQN) agent which is inherently model-free and suited for high-dimensional state spaces and discrete action spaces, is employed to address these issues. To validate the proposed method, simulations were conducted in the MATLAB/Simulink environment. The obtained results demonstrated the satisfactory performance of the proposed DRL method, achieving a Total Harmonic Distortion (THD) of 2.71% in the output current under steady-state, maintaining stable capacitor voltage balancing, and exhibiting rapid dynamic response (e.g., settling within approximately 40 ms for current step changes). Furthermore, its resilience was highlighted by its ability to maintain control despite a 25dB SNR noise condition and up to 15% variations in capacitor values.
| Item Type: | Peer reviewed article published in a journal |
|---|---|
| Professor: | Professor Al Haddad, Kamal |
| Affiliation: | Génie électrique |
| Date Deposited: | 18 Sep 2025 13:35 |
| Last Modified: | 23 Oct 2025 14:08 |
| URI: | https://espace2.etsmtl.ca/id/eprint/31925 |
Actions (login required)
 |
View Item |