Personalized Tuning of a Reinforcement Learning Control Algorithm for Glucose Regulation

Daskalaki, Eleni; Diem, Peter; Mougiakakou, Stavroula (July 2013). Personalized Tuning of a Reinforcement Learning Control Algorithm for Glucose Regulation. IEEE Engineering in Medicine and Biology Society conference proceedings, 2013, pp. 3487-3490. IEEE Service Center 10.1109/EMBC.2013.6610293

Full text not available from this repository. (Request a copy)

Artificial pancreas is in the forefront of research towards the automatic insulin infusion for patients with type 1 diabetes. Due to the high inter- and intra-variability of the diabetic population, the need for personalized approaches has been raised. This study presents an adaptive, patient-specific control strategy for glucose regulation based on reinforcement learning and more specifically on the Actor-Critic (AC) learning approach. The control algorithm provides daily updates of the basal rate and insulin-to-carbohydrate (IC) ratio in order to optimize glucose regulation. A method for the automatic and personalized initialization of the control algorithm is designed based on the estimation of the transfer entropy (TE) between insulin and glucose signals. The algorithm has been evaluated in silico in adults, adolescents and children for 10 days. Three scenarios of initialization to i) zero values, ii) random values and iii) TE-based values have been comparatively assessed. The results have shown that when the TE-based initialization is used, the algorithm achieves faster learning with 98%, 90% and 73% in the A+B zones of the Control Variability Grid Analysis for adults, adolescents and children respectively after five days compared to 95%, 78%, 41% for random initialization and 93%, 88%, 41% for zero initial values. Furthermore, in the case of children, the daily Low Blood Glucose Index reduces much faster when the TE-based tuning is applied. The results imply that automatic and personalized tuning based on TE reduces the learning period and improves the overall performance of the AC algorithm.

Item Type:	Conference or Workshop Item (Paper)
Division/Institute:	10 Strategic Research Centers > ARTORG Center for Biomedical Engineering Research > ARTORG Center - AI in Health and Nutrition 04 Faculty of Medicine > Department of Gynaecology, Paediatrics and Endocrinology (DFKE) > Clinic of Endocrinology, Diabetology and Clinical Nutrition
Graduate School:	Graduate School for Cellular and Biomedical Sciences (GCB)
UniBE Contributor:	Daskalaki, Eleni, Diem, Peter, Mougiakakou, Stavroula
Subjects:	600 Technology > 610 Medicine & health 600 Technology > 620 Engineering
ISSN:	1557-170X
Publisher:	IEEE Service Center
Language:	English
Submitter:	Stavroula Mougiakakou
Date Deposited:	11 Jun 2014 11:11
Last Modified:	05 Dec 2022 14:34
Publisher DOI:	10.1109/EMBC.2013.6610293
PubMed ID:	24110480
URI:	https://boris.unibe.ch/id/eprint/52911