Instruct: Identify the main category of Biorxiv papers based on the titles and abstracts
Query: Real-time decoding of 5 finger movements from 2 EMG channels for mixed reality human-computer interaction The search for optimized forms of human-computer interaction (HCI) has intensified alongside the growing potential for the combination of biosignals with virtual reality (VR) and augmented reality (AR) to enable the next generation of personal computing. At the core, this requires decoding the users biosignals into digital commands. Electromyography (EMG) is a biosensor of particular interest due to the ease of data collection, the relatively high signal-to-noise-ratio, its non-invasiveness, and the ability to interpret the signal as being generated by (intentional) muscle activity. Here, we investigate the potential of using data taken from a simple 2-channel EMG setup to differentiate 5 distinct movements. In particular, EMG was recorded from two bipolar sensors over small hand muscles (extensor digitorum, flexor digitorum profundus) while a subject performed 50 trials of dorsal extension and return for each of the five digits. The maximum and the mean values across the trial were determined for each channel and used as features. A k-nearest neighbors (kNN) classification was performed and overall 5-class classification accuracy reached 94% when using the full trials time window, while simulated real-time classification reached 90.4% accuracy when using the constructed kNN model (k=3) with a 280ms sliding window. Additionally, unsupervised learning was performed and a homogeneity of 85% was achieved. This study demonstrates that reliable decoding of different natural movements is possible with fewer than one channel per class, even without taking into account temporal features of the signal. The technical feasibility of this approach in a real-time setting was validated by sending real-time EMG data to a custom Unity3D VR application through a Lab Streaming Layer to control a user interface. Further use-cases of gamification and rehabilitation were also examined alongside the integration of eye-tracking and gesture recognition for a sensor fusion approach to HCI and user intent.
5
The categories of this paper are: cell
25
The categories of this paper are: bioengineering
22
The categories of this paper are: physiology
31
The categories of this paper are: paleontology
13
The categories of this paper are: animal
12
The categories of this paper are: behavior
29
The categories of this paper are: education
18
The categories of this paper are: systems
14
The categories of this paper are: biophysics
20
The categories of this paper are: pharmacology
7
The categories of this paper are: ecology
3
The categories of this paper are: evolutionary
23
The categories of this paper are: immunology
28
The categories of this paper are: communication
8
The categories of this paper are: genomics
16
The categories of this paper are: microbiology