Actor-Critic Reinforcement Learning Based Algorithm for Contaminant Type Identification in Surface Electromyography Data.

This paper aims to present an innovative approach based on Reinforcement Learning (RL) concept to detect contaminants' type and minimize their effect on surface electromyography signal (sEMG). An agent-environment model was created based on the following elements: environment (muscle electrical activity), state (set of six features extracted from the signal), actions (application of filters/procedures to reduce the impact of each interference), and agent (controller, which will identify the type of contamination and take the appropriate action). The learning was conducted with Actor-Critic method. An average accuracy of 92.96% was achieved in an off-line experiment when detecting four contaminant types (electrocardiography (ECG) interference, movement artifact, power line interference, and additive white Gaussian noise).