Contributo in atti di convegno, 2022, ENG

Deep Reinforcement Learning for Closed-Loop Blood Glucose Control: Two Approaches

F. Di Felice, A. Borri, M. D. Di Benedetto

Scuola Superiore Sant'Anna, Pisa; CNR-IASI, University of L'Aquila

Reinforcement learning, thanks to the observation-action approach, represents a useful control tool, in particular when the dynamics are characterized by strong non-linearity and complexity. In this sense, it has a natural application in the biological systems field where the complexity of the dynamics makes the automatic control particularly challenging. This paper presents a combined application of neural networks and reinforcement learning, in the so-called field of deep reinforcement learning, for the glucose regulation problem in patients with diabetes mellitus. The glucose control problem is solved through the Deep Deterministic Policy Gradient (DDPG) and the Soft Actor-Critic (SAC) algorithms, where the environment exploited for the agent's interactions is represented by a glucose model that is completely unknown to agents. Preliminary results show that the DDPG and SAC agents can suitably control the glucose dynamics, making the proposed approach promising for further investigations. The comparison between the two agents shows a better behaviour of SAC algorithm.

1st IFAC Workshop on Control of Complex Systems (COSY 2022), Bologna, 24-25/11/2022

Keywords

Adaptive and Learning Systems, Modelling and Control of Biomedical Systems, Reinforcement learning control, Numerical simulation

CNR authors

Di Benedetto Maria Domenica, Borri Alessandro

CNR institutes

IASI – Istituto di analisi dei sistemi ed informatica "Antonio Ruberti"