您好,欢迎访问中国农业科学院 机构知识库!

Deep Learning based sEMG decoding for TelePresence device control

文献类型: 会议论文

第一作者: ádám Gyula Nemes

作者: ádám Gyula Nemes 1 ; Levente Kovács 2 ; Gy?rgy Eigner 2 ; Gergely Márton 3 ; Béla Weiss 4 ;

作者机构: 1.Physiological Controls Research Center, óbuda University|Biomatics and Applied Artificial Intelligence Institute, John von Neumann Faculty of Informatics, óbuda University|Applied Informatics and Applied Mathematics Doctoral School, óbuda University, Bécsi út 96/B, Budapest, Hungary

2.Physiological Controls Research Center, óbuda University|Biomatics and Applied Artificial Intelligence Institute, John von Neumann Faculty of Informatics, óbuda University

3.Integrative Neuroscience Research Group, Institute of Cognitive Neuroscience and Physiology, Research Centre for Natural Sciences

4.Physiological Controls Research Center, óbuda University|Brain Imaging Centre, Research Centre for Natural Sciences, Magyar tudósok k?rútja 2., Budapest, Hungary

关键词: Headphones;Visualization;Telepresence;Recurrent neural networks;Robot vision systems;Process control;Virtual reality

会议名称: International Conference on Process Control

主办单位:

页码: 192-197

摘要: TelePresence devices enable their users to appear and move at distant locations. In this work, to achieve TelePresence, we installed a 360° camera on a mobile robot and streamed the video feed to a virtual reality headset. The user’s view field is outsourced, which is disadvantageous for traditional control methods. To overcome this issue, here we designed an sEMG-based control paradigm, enabling users to control a robot with hand gestures. We created a dataset of the necessary control commands, by recording the visual representation of the hand and the corresponding sEMG activity. The final dataset consisted of 5200 train and 400 validation samples. We investigated several neural network architectures to decode the biosignals and finally applied a CNN + LSTM Recurrent Neural Network to control a mobile robot by hand sEMG signals.

分类号: tp27-53

  • 相关文献

[1]Development and Experimental Testing of a Robot-Assisted Positioning System for Brachytherapy. Jie Liang,Jing Wang,Xiao-Jing Liu,Sanmiao Zhao. 2022

[2]Robotic Forceps without Position Sensors using Visual SLAM. Takuya Iwai,Takahiro Kanno,Tetsuro Miyazaki,Toshihiro Kawase,Kenji Kawashima. 2019

[3]Study on linear move irrigation synchronization control system in virtual scene. Yuan Yanwei,Zhang Xiaochao,Zhao Huaping. 2009

[4]Visualization of Protein in Peanut Using Hyperspectral Image with Chemometrics. Liu Hong-zhi. 2017

[5]GFF3sort: a novel tool to sort GFF3 files for tabix indexing. Zhu, Tao,Liang, Chengzhen,Meng, Zhigang,Guo, Sandui,Zhang, Rui. 2017

[6]Development of loop-mediated isothermal amplification for rapid detection of avian leukosis virus subgroup A. Wang, Yongqiang,Kang, Zhonghui,Gao, Yulong,Qin, Liting,Chen, Lei,Wang, Qi,Li, Jiukuan,Gao, Honglei,Qi, Xiaole,Lin, Huan,Wang, Xiaomei. 2011

[7]Study on the rice growth visualization system. Yan, Dingchun,Zhu, Yeping. 2007

[8]RESEARCH ON CROP SIMULATION MODEL BASED ON PDA. Zhang, Jianbing,Zhu, Yeping. 2009

[9]Human Body Motion Tracking for Rehabilitation. Moraru Andrei,Eva-H. Dulf,Lehel Dénes-Fazakas,Levente Kovacs. 2024

[10]Translating Hungarian language dialects using natural language processing models. Barbara Simon,ádám Hartveg,Lehel Dénes-Fazakas,Gy?rgy Eigner,László Szilágyi. 2023

[11]Wordle User Prediction and Analysis Based on SARIMA Algorithm, LSTM Recurrent Neural Network, and XGBoost Model. Muhao Shi,Yilong Huang,Lejian Zhang,Zetong Jin,Yuhan Zhang. 2024

[12]Analysis of Quality Inspection and Reliability Evaluation Methods for TSV Silicon Interposers. Yingying Liu,Yu Fu,Likang Zhang,Zhihui Wang,Ke Shi,Pei Liu,Zhipeng Mei. 2023

[13]Enhancing X-ray Image Quality for Improved Medical Diagnosis: A Novel Filtering Algorithm. Miguel Bustamante,Antonio Rienzo,Gastón Lefranc. 2024

[14]ADVANCED CONTROL OF GLYCOSYLATION AND TITER IN FED-BATCH MONOCLONAL ANTIBODY PRODUCTION. Anne Skaja Robinson,Yu Luo,Devesh Radhakrishnan,Evan A. Wells,Liqing Song,Varghese Kurian,Babatunde A. Ogunnaike. 2023

[15]Recognition of Tobacco Leaf Curing Stage Based on Deep Learning. Panzhen Zhao,Songfeng Wang,Hao Xia,Yingpeng Dai. 2024

[16]Comparison of Unscented Kalman Filter Design for Agricultural Anaerobic Digestion Model. Simon Hellmann,Terrance Wilms,Stefan Streif,S?ren Weinrich. 2024

[17]Centimeter-Scale Submarine Robot for Monitoring Coral Reef Ecosystem. Zongze Li,Yi Zhang,Shujing He,Xiyu Zhu,Tanyong Wei,Chengzhi Hu. 2024

[18]Observability and Identifiability Analyses of Process Models for Agricultural Anaerobic Digestion Plants. Simon Hellmann,Arne-Jens Hempel,Stefan Streif,S?ren Weinrich. 2023

[19]Fractional order control of the cyber-physical cryogenic isotope separation columns cascade system. Levente Kovacs,Eva-H. Dulf. 2018

[20]STUDY ON THE RICE GROWTH VISUALIZATION SYSTEM. Dingchun Yan,Yeping Zhu. 2007

作者其他论文 更多>>