您好,欢迎访问中国农业科学院 机构知识库!

Control of Type 1 Diabetes Mellitus using direct reinforcement learning based controller

文献类型: 会议论文

第一作者: Lehel Dénes-Fazakas

作者: Lehel Dénes-Fazakas 1 ; Máté Siket 2 ; Gábor Kertész 3 ; László Szilágyi 4 ; Levente Kovács 4 ; Gyórgy Eigner 4 ;

作者机构: 1.Physiological Controls Research Center, óbuda University, H-1034, Budapest|Biomatics and Applied Artificial Intelligence Institute, John von Neumann Faculty of Informatics, óbuda University, H-1034, Budapest|Applied Informatics and Applied Mathematics Doctoral School, óbuda University, H-1034, Budapest

2.Physiological Controls Research Center, óbuda University, H-1034, Budapest|Applied Informatics and Applied Mathematics Doctoral School, óbuda University, H-1034, Budapest|Institute for Computer Science and Control, H-1111, Budapest, Hungary

3.Software Engineering Institute, John von Neumann Faculty of Informatics, óbuda University, H-1034, Budapest|Institute for Computer Science and Control, H-1111, Budapest, Hungary

4.Physiological Controls Research Center, óbuda University, H-1034, Budapest|Biomatics and Applied Artificial Intelligence Institute, John von Neumann Faculty of Informatics, óbuda University, H-1034, Budapest

关键词: Training;Medical treatment;Virtual environments;Reinforcement learning;Mathematical models;Glucose;Diabetes

会议名称: IEEE International Conference on Systems, Man, and Cybernetics

主办单位:

页码: 1512-1517

摘要: One of the most challenging area of diabetes research is to provide such automated insulin delivery systems – so called artificial pancreas systems – that have robust and adaptive capabilities in a highly sophysticated way. I.e. they are able to provide robust insulin delivery actions at the beginning of the therapy to satisfy the requirements of the patients without knowing the users daily lifestyle and preferences however adaptive on the short-term to learn these patient specifics to increase the quality of the therapy. One possible solution is the closed-loop systems that have self-learning features. In the present study, we have examined a glucose regulatory problem using direct reinforcement learning based controller. The approach represents the fully automatic insulin administration as the timepoint and the carbohydrate content of the meals were unknown and randomized. We constructed a virtual environment of the patient with type 1 diabetes by applying a mathematical model. Proximal policy optimization learning model with continuous action space was used. Furthermore, we evaluated the effect of different training lengths on the test scenario.

分类号: tp13-53

  • 相关文献

[1]Investigation of reward functions for controlling blood glucose level using reinforcement learning. Dénes-Fazakas Lehel,Máté Siket,László Szilágyi,Gyorgy Eigner,Levente Kovács. 2023

[2]Review of Reinforcement Learning-Based Control Algorithms in Artificial Pancreas Systems for Diabetes Mellitus Management. Lehel Dénes-Fazakas,Gy?z? Dénes Fazakas,Gy?rgy Eigner,Levente Kovács,László Szilágyi. 2024

[3]Effect of Hyperparameters of Reinforcement Learning in Blood Glucose Control. Máté Siket,László Szilágyi,Gy?rgy Eigner,Levente Kovács,Dénes-Fazakas Lehel. 2023

[4]Impulsive Model Predictive Control in Type 1 Diabetes Mellitus Applications. Kamilla Novák,Máté Siket,Levente Kovács,Dániel András Drexler,Gy?rgy Eigner. 2023

[5]Data Collection Studies for the Better Understanding of Factors in Type 1 Diabetes Management. Barbara Simon,Ádám Hartveg,Máté Siket,Lehel Dénes-Fazakas,Gyórgy Eigner,Levente Kovács,László Szilágyi. 2024

[6]Mobile Application Development for Diabetes Patient. Lehel Dénes-Fazakas,Gy?rgy Eigner,Milán Balázs,Levente Kovács,László Szilágyi,Csaba Potyok,Barbara Simon,ádám Hartveg,Máté Siket. 2024

[7]Web Application Development for Diabetes Patients. Miklos Nagy,Barbara Simon,László Szász,Máté Siket,Lehel Dénes-Fazakas,Gy?rgy Eigner,Patrik Péter Süli,Levente Kovács,László Szilágyi. 2024

[8]Model Predictive Control with Dynamic Positive Input Extension for Artificial Pancreas Applications. Gy?rgy Eigner,Kamilla Novák,Máté Siket,Levente Kovács,Dániel András Drexler,Imre Rudas. 2023

[9]Parameter estimation of T1DM models with a particular focus on endogenous glucose production. Máté Siket,Rebeka Tóth,Imre Rudas,Gy?rgy Eigner,Levente Kovács. 2022

[10]Electroencephalographic assessment in patients with Rett syndrome during cognitive stimulation by means of eye tracking technology and alternative and augmentative communication systems. Ana Tost,Alejandro Bachiller,ángeles García-Cazorla,Inés Medina-Rivera,Sergio Romero,Miguel A. Ma?anas. 2023

[11]Which Activation Function Works Best for Training Artificial Pancreas: Empirical Fact and Its Theoretical Explanation. Lehel Dénes-Fazakas,László Szilágyi,Gy?rgy Eigner,Olga Kosheleva,Martine Ceberio,Vladik Kreinovich. 2023

[12]Assessment of grassland degradation in Guinan county, Qinghai Province, China, in the past 30 years. Feng, Y.,Lu, Q.,Wang, X.,Tokola, T.,Liu, H..

[13]Effects of flaxseed oil on anti-oxidative system and membrane deformation of human peripheral blood erythrocytes in high glucose level. Huang, Qingde,Xu, Jiqu,Deng, Qianchun,Huang, Fenghong,Yang, Wei,Fu, Juan,Yu, Miao,Wang, Di,Yao, Ping,Liu, Liegang,Yang, Wei,Fu, Juan,Yu, Miao,Wang, Di,Yao, Ping,Liu, Liegang. 2012

[14]Protective effect of Schisandrae chinensis oil on pancreatic beta-cells in diabetic rats. An, Liping,Wang, Chunmei,Han, Xiao,Xu, Guangyu,Yuan, Guangxin,Li, Hongyu,Sheng, Yu,Wang, Manli,Sun, Jingbo,Zhan, Jinzhuo,Sun, Hui,Li, Na,Du, Peige,Wang, Yingping,Fan, Meizhen,Ding, Fuxiang. 2015

[15]Antibacterial Activity of Polyphenols: Structure-Activity Relationship and Influence of Hyperglycemic Condition. Xie, Yixi,Chen, Jing,Xiao, Aiping,Liu, Liangliang,Xie, Yixi. 2017

[16]Therapeutic Strategies of Plant-derived Compounds for Diabetes Via Regulation of Monocyte Chemoattractant Protein-1. Czemplik, Magdalena,Kulma, Anna,Szopa, Jan,Wang, Yu Fu,Szopa, Jan,Szopa, Jan.

[17]Improved method for quantitative analysis of methylated phosphatidylethanolamine species and its application for analysis of diabetic-mouse liver samples. Wang, Miao,Kim, Geun Hyang,Altarejos, Judith,Han, Xianlin,Wei, Fang,Chen, Hong.

[18]Effect of streptozocin-induced diabetes mellitus on expression of methionine sulfoxide reductases and accumulation of their substrates in mouse lenses. Li, Yi,Huang, Kaixun,Zhang, Wen,Li, Peiwu. 2011

[19]Multi-transgenic minipig models exhibiting potential for hepatic insulin resistance and pancreatic apoptosis. Kong, Siyuan,Ruan, Jinxue,Xin, Leilei,Fan, Junhua,Xia, Jihan,Liu, Zhiguo,Mu, Yulian,Yang, Shulin,Li, Kui.

[20]Effects on the bones of vanadyl acetylacetonate by oral administration: a comparison study in diabetic rats. Zhang, Shuang-Qing,Chen, Guo-Hua,Lu, Wan-Liang,Zhang, Qiang. 2007

作者其他论文 更多>>