Shojaedini Seyed Vahab, Morabbi Sajedeh, Keyvanpour MohammadReza
Department of Biomedical Engineering, Iranian Research Organization for Science and Technology, Tehran, Iran.
Department of Computer Engineering, Alzahra University, Tehran, Iran.
J Med Signals Sens. 2018 Oct-Dec;8(4):205-214. doi: 10.4103/jmss.JMSS_7_18.
P300 signal detection is an essential problem in many fields of Brain-Computer Interface (BCI) systems. Although deep neural networks have almost ubiquitously used in P300 detection, in such networks, increasing the number of dimensions leads to growth ratio of saddle points to local minimums. This phenomenon results in slow convergence in deep neural network. Hyperparameter tuning is one of the approaches in deep learning, which leads to fast convergence because of its ability to find better local minimums. In this paper, a new adaptive hyperparameter tuning method is proposed to improve training of Convolutional Neural Networks (CNNs).
The aim of this paper is to introduce a novel method to improve the performance of deep neural networks in P300 signal detection. To reach this purpose, the proposed method transferred the non-convex error function of CNN) into Lagranging paradigm, then, Newton and dual active set techniques are utilized for hyperparameter tuning in order to minimize error of objective function in high dimensional space of CNN.
The proposed method was implemented on MATLAB 2017 package and its performance was evaluated on dataset of Ecole Polytechnique Fédérale de Lausanne (EPFL) BCI group. The obtained results depicted that the proposed method detected the P300 signals with 95.34% classification accuracy in parallel with high True Positive Rate (i.e., 92.9%) and low False Positive Rate (i.e., 0.77%).
To estimate the performance of the proposed method, the achieved results were compared with the results of Naive Hyperparameter (NHP) tuning method. The comparisons depicted the superiority of the proposed method against its alternative, in such way that the best accuracy by using the proposed method was 6.44%, better than the accuracy of the alternative method.
P300信号检测是脑机接口(BCI)系统众多领域中的一个关键问题。尽管深度神经网络几乎已普遍应用于P300检测,但在这类网络中,维度数量的增加会导致鞍点与局部最小值的增长比率上升。这种现象导致深度神经网络收敛缓慢。超参数调整是深度学习中的一种方法,因其能够找到更好的局部最小值而能实现快速收敛。本文提出了一种新的自适应超参数调整方法,以改进卷积神经网络(CNN)的训练。
本文旨在引入一种新颖的方法来提高深度神经网络在P300信号检测中的性能。为实现这一目的,所提出的方法将CNN的非凸误差函数转换为拉格朗日范式,然后利用牛顿法和对偶活动集技术进行超参数调整,以便在CNN的高维空间中最小化目标函数的误差。
所提出的方法在MATLAB 2017软件包上实现,并在洛桑联邦理工学院(EPFL)BCI组的数据集上评估其性能。所得结果表明,所提出的方法以95.34%的分类准确率检测P300信号,同时具有较高的真阳性率(即92.9%)和较低的假阳性率(即0.77%)。
为评估所提出方法的性能,将所得结果与朴素超参数(NHP)调整方法的结果进行比较。比较结果表明所提出的方法优于其替代方法,使用所提出方法的最佳准确率比替代方法高6.44%。