You are viewing a javascript disabled version of the site. Please enable Javascript for this site to function properly.
Go to headerGo to navigationGo to searchGo to contentsGo to footer
In content section. Select this link to jump to navigation

An improved method for recognizing pediatric epileptic seizures based on advanced learning and moving window technique

Abstract

In this work, advanced learning and moving window-based methods have been used for epileptic seizure detection. Epilepsy is a disorder of the central nervous system and roughly affects 50 million people worldwide. The most common non-invasive tool for studying the brain activity of an epileptic patient is the electroencephalogram. Accurate detection of seizure onset is still an elusive work. Electroencephalogram signals belonging to pediatric patients from Children’s Hospital Boston, Massachusetts Institute of Technology have been used in this work to validate the proposed method. For determining between seizure and non-seizure signals, feature extraction techniques based on time-domain, frequency domain, time-frequency domain have been used. Four different methods (decision tree, random forest, artificial neural network, and ensemble learning) have been studied and their performances have been compared using different statistical measures. The test sample technique has been used for the validation of all seizure detection methods. The results show better performance by random forest among all the four classifiers with an accuracy, sensitivity, and specificity of 91.9%, 94.1%, and 89.7% respectively. The proposed method is suggested as an improved method because it is not channel specific, not patient specific and has a promising accuracy in detecting epileptic seizure.

1.Introduction

Epilepsy is a chronic disease of the brain that is not transmissible directly from one person to another but is known to have affected nearly 50 million people around the globe including children [6]. Even though antiepileptic drugs are available for treatment but roughly 20–30% of patients are impervious to the medication [21]. A seizure is a sudden event, thus monitoring and identification of seizure is significant for decision making and designing of efficient automated seizure detection models. Over the years, to understand the neuronal activity of the brain, electroencephalogram (EEG) has been referred to by authors and researchers be it long EEG recordings [7], or short-term EEG videos [13]. In the investigation of EEG recordings for epileptic seizures, automatic seizure detection systems can assist as a valuable tool in a computationally effective and unbiased way. The foremost purpose of such automated systems lies in discerning seizure data from non-seizure data recordings. These automated seizure detection systems when implemented with sensors will increase the quality of life of patients suffering from intractable epilepsy [38]. Generally, the inputs given to such systems are features extracted from raw EEG signals. Feature extraction constitutes a major part of the signal processing of EEG recordings [1,4,14,28,35,40]. Optimization of the feature extraction process [27] is necessary for application in real-life scenarios [11,26] as a substantial amount of time is required to extract relevant features.

Most of the work suggested for epilepsy detection revolves around epilepsy instead of pediatric epilepsy. Detection of pediatric epileptic seizure is difficult in nature and studies tend to concentrate on patient specific approach [8,17,32,34,37,41]. Few works focused on channel specific approach [8,39] instead of generalized approach. In other suggested literatures, the accuracy of detection is not as promising [34,41]. Hence the objective of this study is to design an improved method to overcome the above-mentioned drawbacks and to make the work more comprehensive in nature. The proposed method is improved in terms of generalized approach which is not patient specific, not channel specific and with better accuracy and lower false detection rate.

A complete epileptic seizure detection system requires advance machine learning algorithms apart from feature extraction techniques. Different literature [2,3,5,10,12,20,36] have discussed the use of traditional as well as deep learning methods [16] for designing EEG-based seizure detection systems. As features play an integral part in seizure detection, therefore mean, standard deviation, energy [22], discrete Fourier transform [31], and discrete wavelet transformation [25] have been used in this work to obtain relevant features from the original EEG signals. These features have been linked to four different machine learning methods – artificial neural network, decision tree, random forest, and ensemble learning for distinguishing seizure data from non-seizure data. The performance of individual features, as well as classifiers, has been statistically evaluated and analyzed. This analysis helped in determining the most effective and reliable method for seizure detection. The proposed method has been analyzed on the Children’s Hospital Boston, Massachusetts Institute of Technology (CHB-MIT) dataset as well as validated using the Sleep-Wake-Epilepsy-Center (SWEC) of the University Department of Neurology at the Inselspital Bern and the Integrated Systems Laboratory of the ETH Zurich. The structure of the paper is as follows; Section 2 covers the general overview of the proposed comparison study along with different feature extraction methods and classifiers used along with their complexity analysis, Section 3 contains the results obtained for patient-specific as well as a generalized approach for CHB-MIT dataset. In Section 4, results of seizure detection method with SWEC dataset have been discussed. A detailed discussion and comparison study are presented in Section 5 followed by the conclusion in Section 6.

2.The proposed method for epileptic seizure detection

As the objective of the work is to improve the pediatric epileptic seizure detection method, it is important to select suitable techniques and design the method appropriately to achieve good performance in seizure detection. The proposed seizure detection framework is divided into different stages as shown in Fig. 1. The first stage of the proposed method is the selection of input and input data acquisition. Two suitable datasets have been chosen for the proposed work – CHB-MIT and SWEC dataset. The second stage is extraction of suitable features and finally the selection of appropriate features that help in decision-making. In this regard, five suitable methods such as mean, standard deviation, energy, DWT and DFT has been chosen. The last stage is the use of the obtained features for the process of classification as the main aim of epilepsy seizure detection is to differentiate between non-seizure and seizure. Four classifiers such as ANN, DT, RF and ensemble learning have been chosen for detection of seizure. Each step has been described in detail in subsequent sub-sections given below.

Fig. 1.

Schematic diagram of various stages of the proposed method.

Schematic diagram of various stages of the proposed method.

2.1.Using CHB-MIT dataset

2.1.1.Selection of input

The first step of any type of detection method is to select the inputs that will be used for detection. It is presumed that right from the early stage, brain activity continues lifelong and they are representative of not only the brain function but of the condition of the entire body. An electroencephalogram (EEG) helps in measuring and understanding brain activity during an epilepsy seizure attack. In this work, EEG signals have been chosen as input for the detection of epilepsy. The data set considered in this work consist of scalp EEG recordings of 10 pediatric patients between the ages of 1.5 years to 15 years suffering from intractable seizures. The data set belongs to patients from the Children’s Hospital Boston Massachusetts (CHB-MIT) [24] and Table 1 shows the details of the dataset. This work used EEG signals of 10 patients (chb01, chb02, chb03, chb05, chb06, chb07, chb08, chb10, chb23, and chb24) out of the 24 patients for substantiating the proposed method. The goal here is to develop a generalized EEG seizure detector that is not patient-specific or channel-specific. The 10 patients as suggested above have 23 channels with the same electrode placement throughout the recording. Hence, EEG recordings of these patients are considered for validation of the proposed method. Each file contained one to a maximum of four seizures that were recorded using the bipolar placement of electrodes according to the 10–20 international electrode placement and were sampled at 256 Hz at 16-bit resolution. The onset of seizure recorded a paroxysmal burst of 4 Hz in different channels. The location or type of seizure has not been labeled in the files distinctly but has been mentioned in the recordings. Artifacts such as eye movements, head, and body movements are present in the recordings. The recording time of brain activity varied between the patients and lasted from one to few hours. The total EEG recording time of 10 subjects was 53 hours and contained 51 seizures. EEG signal of a single channel with normal and epileptic conditions are shown in Fig. 2. From Fig. 2, it can be observed that differentiating epileptic signals from non-epileptic signals to make a clear decision is difficult. So, there is a need for processing the EEG signals and finding appropriate features to make a correct decision when given as input to a classifier.

Table 1

Details of CHB-MIT dataset patients

Patient IdGenderAge (years)Channels (Signal)
chb01Female1123 (EEG)
chb02Male1123 (EEG)
chb03Female1423 (EEG)
chb04Male2224 (EEG and ECG)
chb05Female723 (EEG)
chb06Female1.523 (EEG)
chb07Female14.523 (EEG)
chb08Male3.523 (EEG)
chb09Female1024 (EEG)
chb10Male323 (EEG)
chb11Female1228 (EEG)
chb12Female228 (EEG and EKG)
chb13Female318 (EEG and EKG)
chb14Female928 (EEG)
chb15Female1632 (EEG)
chb16Female728 (EEG)
chb17Female1228 (EEG)
chb18Female1822 (EEG)
chb19Female1922 (EEG)
chb20Female628 (EEG)
chb21Female1328 (EEG)
chb22Female928 (EEG)
chb23Male323 (EEG)
chb2423 (EEG)
Fig. 2.

Samples of (a) normal EEG signal (b) EEG signal with epileptic seizure.

Samples of (a) normal EEG signal (b) EEG signal with epileptic seizure.

2.1.2.Feature extraction from the selected input

To design an efficient seizure detection unit, extracting relevant features is necessary to capture the information embedded in the EEG signals for better classification accuracy and sensitivity. In this work, different feature-extraction techniques have been used to extract significant features from the original signals. Significant features denote the features which are contributing in discriminating between normal and epileptic condition. In this work, using an overlapping moving-window of 1 second, methods like mean, standard deviation (STD), energy [22], discrete Fourier transform (DFT) [31] and discrete wavelet transformation (DWT) [25] subsequent features are extracted from the original EEG signals. To extract statistical information related to the EEG signals, mean and standard deviation have been used, for time-frequency analysis wavelet transformation has been chosen and finally to understand the spectral estimation of the signal during a seizure attack, Fourier transformation has been applied. The moving window of specific size is moved over the data and the moving distance is equal to the width of the window. This has been done to statistically summarize all data located within the window section over a particular time. The main reason behind using a moving window is to understand the pattern of the EEG signals over a time and how the signal changes in the particular time frame. Figure 3 shows the feature extraction from the EEG signal in the moving window of 256 samples based on the mean of the window. Figure 3 (a) shows the original signal from one EEG channel with different window containing 256 samples. Three windows are shown in dotted lines which are window 1 to 256, window of 2 to 257 and window of 3 to 258. Figure 3 (b) shows that up to 256 samples, mean feature are of zero magnitudes as it takes 256 samples to generate first sample. In Fig. 3 (b), sample number 257 has amplitude which is generated by taking the mean from the window of 1 to 256 samples. Figure 3 (b) shows sample number 258 which are generated by taking the mean from the window of 2 to 257 samples. Figure 3 (b) shows sample number 259 which are generated by taking the mean from the window of 3 to 258 samples. In this similar approach, mean of the EEG signals is obtained by moving the window and taking the mean of samples in that particular window. This is the reason for which it is called as overlapping moving window as shown in Fig. 3(a). This identical method has been used for the rest of the four techniques (standard deviation, energy, DFT, and DWT) to extract the features from the EEG recordings.

Fig. 3.

Mean feature extraction from EEG signal using overlapping moving window of 256 samples.

Mean feature extraction from EEG signal using overlapping moving window of 256 samples.

The EEG signals are processed with discrete Fourier transform (DFT) where equal spaced samples in a finite sequence are converted into equal spaced sample having same length. Then features are extracted from the DFT processed EEG signal with moving window of 256 samples using standard deviation of the window. For discrete wavelet transform (DWT), Daubechies wavelet has been used and DB8 wavelet has been used for decomposition of the signal. The EEG signals have been decomposed up to level 4 and approximate coefficients have been considered. Then standard deviation of the approximate coefficients is taken. Finally features are extracted from the DWT processed EEG signal with moving window of 256 samples. These aforementioned extracted features from the EEG signals are then given to the classifiers for detecting epileptic seizures as described in the next section.

2.1.3.Epileptic seizure detection using learning techniques

The classification model designed should efficiently distinguish between seizure and normal data. To achieve that, a traditional classifier such as artificial neural network [29,30] has been used as it is widely used for seizure detection. Apart from that tree-based classifier has been considered (decision tree) [19], along with newer method of ensemble learning [23]. Random forest [15,18] has been chosen as it works well with imbalanced data, and in seizure detection there is always a chance that the signal being analyzed may have class imbalance. The proposed method has been designed such that it will be first trained with a certain amount of data. The designed training module has been tested with data that has not been used previously in training. The test data is entirely different from the training data. For both the training phase as well as the testing phase, completely different EEG signals have been used to determine the performance accuracy of the classifiers. The main goal lies in creating boundaries between the data, label the classes, and maintain a threshold value for the features. From each patient, one seizure recording and one non-seizure recording are taken. The total seizure samples used is 844,336 and the total non-seizure samples used is 844,439. Hence, the total number of samples used in this work is 1,688,775. From the total samples, 70% of the original EEG recordings have been used for training the module while the remaining 30% have been used for testing. Here, the random sample division method has been used for dividing the training and testing samples into 70% and 30%. The random sample division has been carried out using the random sample selection method in MATLAB. The total number of samples used for training is 1,178,599 and testing contained 505,097 samples.

  • A. Design of the training module

The training seizure detection framework comprises of different steps that have been followed in this work. The elementary step consists of data acquisition, which here is a collection of pediatric EEG signals with a history of intractable epilepsy. This is followed by the extraction of suitable features. Different features have been extracted with the help of signal decomposition and a moving window of 1 sec. The obtained features are then trained to differentiate between non-seizure and seizure data using four different methods such as artificial neural network, decision tree, random forest, and ensemble learning. The schematic diagram of the proposed method for the training module is presented in Fig. 4.

Fig. 4.

Schematic diagram of training module of the proposed method.

Schematic diagram of training module of the proposed method.
Fig. 5.

Final structure of the trained artificial neural network.

Final structure of the trained artificial neural network.

Before finalizing the final architecture of the artificial neural network (ANN), different network structures have been considered. As deducing the working architecture for neural network is a trial-and-error method, the error goal, layers and neurons have been changed and performance is evaluated before the final structure of the ANN is decided. In the ANN, the final network configuration consisted of three layers with each hidden layer containing 20 neurons, and the last layer contained a single neuron. Figure 5 shows the final network structure of the trained module. As mentioned in Fig. 5, the input layer has 23 neurons representing the input signals from 23 EEG channels. The activation (transfer) function used is tan-sig and 500 epochs have been used for training the neural network. The error goal for the network is kept at 0.001 and the initialization of the weights and biases has been done using the Nguyen–Widrow method. The training function used by the neural network for all the features has been Levenberg–Marquardt optimization. Similarly, for decision tree and random forest, the classifier specification has been maintained for all the features. In the decision tree, different splitting criteria are used for splitting and building the tree. In this work, the Gini impurity index has been used for the decision tree. Meanwhile, in the random forest, the number of learning cycles has been varied to check the accuracy before maintaining at 100 cycles for training the data. The number of trees in the random forest is 100. For partitioning the tree, interaction-curvature has been used as the predictor selector. In random forest, maximum depth is 25, minimum sample split is 5, minimum sample leaf is 2 and alpha is 0.0. This method reduces the p-value of the chi-square test between the predictor and response. Although, this method is slower than the standard classification and regression trees but has the capability of producing better predictor estimates. Figure 6 shows the pruned structure of the first trained tree of random forest. Finally, for the ensemble learning technique generative ensemble with the re-sampling method has been used where various boosting methods have been trained with a varying number of learning cycles before selecting the most efficient method. Out of all the boosting method, Gentle-Boost has shown better performance with the training data for 300 learning cycles. This specification has been maintained throughout the work for all the features. Table 2 mentions the configuration of all the four classifiers used in this work. After the training network is designed, it is tested with unknown samples as given in next section.

Fig. 6.

Final structure of the first tree of trained pruned random forest.

Final structure of the first tree of trained pruned random forest.
Table 2

Optimal parameters used in different methods during training

ClassifierSpecifications
Artificial Neural Network (ANN)Activation Function: Tan-sig, Epochs: 500, Error Goal: 0.001, Network: 3 layers (20-20-1), Normalization: Min-Max, Training Function: Levenberg–Marquardt Optimization, Weight and Biases: Nguyen–Widrow Method
Decision Tree (DT)Splitting Criterion: Gini Impurity Index, Number of Levels: 446
Random Forest (RF)Learning Cycles: 100, Splitting Criterion: Gini-Index, Number of trees: 100, Maximum depth: 25, Minimum sample split: 5, Minimum sample leaf: 2, Maximum features: Auto, Maximum leaf node: None, Bootstrap: True, Alpha: 0.0
Ensemble learningLearning Cycles: 300, Method: Generative Ensemble (Re-sampling Method), Boosting: Gentle Boost
  • B. Testing of the trained module

For testing the performance of the methods, a completely different set of test samples have been used as input. Features are extracted from the test samples using the same feature extraction techniques. The extracted features are then given as input to the already trained classifiers. Each of the classifiers is tested individually and the results obtained are compared to analyze the performance of all four classifiers. After testing of seizure detection modules, the results are analyzed which is discussed in the next section.

2.2.Using SWEC dataset

Another dataset that has been used for the validation of the proposed method is taken from the Sleep-Wake-Epilepsy-Center (SWEC) of the University Department of Neurology at the Inselspital Bern and the Integrated Systems Laboratory of the ETH Zurich [9,33]. The database consisted of a total of 16 patients having 99 recordings with 100 seizures. The intracranial EEG signals have been recorded using strip, depth, and grid electrodes. Localized between the 10/20 position of Fz and Cz, an extracranial electrode has been used as a reference for the recording. The sampling frequency of the signals is 512 Hz and a fourth-order Butterworth filter between 0.5 Hz and 150 Hz has been used to filter the recorded signals. Each of the EEG recordings comprised of interictal segments of 3 minutes followed by ictal segments ranging between 10 s and 1002 s and postictal segments of 3 minutes. Features, as suggested in the previous section, have been extracted from the EEG signals. These extracted features are then given to the four machine learning algorithms for detection as discussed in previous sections. The splitting of the dataset is similar to the first dataset i.e. 70% of the EEG recordings have been used for training the module while the remaining 30% have been used for testing. For this dataset, Table 2 mentions the configuration of all the four classifiers used. After the training network is designed, it is tested with unknown samples as given in Section 4.

3.Results obtained for CHB-MIT dataset

Different learning method have been validated and tested on pediatric patients and the performance has been assessed for patient-specific raw EEG signals and processed signals having features. Statistical parameters such as accuracy, sensitivity, and specificity have been used to evaluate the obtained results. In this work, Matthew’s correlation coefficient (MCC), kappa analysis, and F1 score have been used to study the performance of the different classifiers. The mathematical formulas used to calculate the performance indicators are shown in Eqs (1) to (7).

(1)Accuracy(ACC)=(TP+TN)/(TP+TN+FP+FN)(2)Sensitivity(TPR)=TPP=TP(TP+FN)(3)Specificity(TNR)=TNN=TN(FP+TN)(4)Falsepositiverate(FPR)=FPN=FP(FP+TN)=1TNR(5)KappaAnalysis(k)=pope1pe=11po1pe
where, po is the relative observed agreement and pe is the hypothetical probability of chance agreement.
(6)F1Score=2TP2TP+FP+FN(7)MCC=TP×TNFP×FN(TP+FP)(TP+FN)(TN+FP)(TN+FN)
where, TP = True positive (correctly classified as positive), FP = False positive (falsely classified as positive), TN = True negative (correctly classified as negative), FN = False negative (falsely classified as negative).

3.1.Performance of different methods with raw EEG signal

The performance of the learning-based methods has been first tested with raw EEG signals. This has been done in a patient-specific approach where an individual patient has been considered for testing the accuracy of the classifier. The statistical analysis of the method is presented in Table 3. It can be seen from Table 3 that the accuracy of all the classifiers for each patient ranged from 75% to 99% with the only exception of a patient where the accuracy is recorded below 70% for all the four classifiers. The sensitivity and specificity also varied from 75% to 95% and 70% to 100% respectively. It is noticed from the results that one of the patient’s file consistently recorded a higher accuracy among all the patient data set for all the classifiers and obtained the highest accuracy of 99.7% for the random forest. Figure 7 shows the individual accuracy of each patient recorded for each classifier. In addition, it can be seen from Table 3 and Fig. 8 that the average accuracy of each classifier for signals has been calculated. The average accuracy obtained from 10 patients for decision tree is 81.7% with sensitivity and specificity of 85.7% and 79.4% respectively. Ensemble learning edged ahead with an accuracy of 85.6% while ANN has an average accuracy of 85.0%. The highest average accuracy of 87.0% is observed for random forest classifier.

Table 3

Performance of various method using raw signals

Methods usedPatientAccuracy (%)Sensitivity (%)Specificity (%)F1 scoreMatthew’s correlation coefficientKappa
Decision Tree183.490.478.50.8470.6790.745
288.489.087.80.8850.7670.768
389.787.592.30.8940.7960.796
484.292.378.60.8560.6960.681
561.961.961.90.6190.2390.238
698.599.497.60.9850.9700.970
779.977.882.40.7920.6000.600
874.182.669.10.7710.5000.482
980.693.473.60.8310.6410.612
1076.682.772.40.7860.5390.533
Overall81.785.779.40.8270.6430.643
Ensemble Learning188.686.690.80.8890.7730.772
291.993.190.80.9180.8390.838
392.594.690.60.9230.8510.850
491.588.994.40.9170.8310.830
562.864.561.40.6050.2580.256
699.699.2100.00.9960.9920.992
782.186.678.60.8100.6480.642
878.075.181.60.7920.5640.560
985.078.196.40.8660.7220.700
1083.681.286.40.8420.6740.672
Overall85.684.887.10.8560.7150.711
ANN182.376.092.70.8420.6660.647
293.493.893.10.9430.8690.868
395.195.494.80.9510.9020.902
489.885.196.00.9050.8040.796
563.963.164.70.6490.2780.278
699.599.499.60.9950.9900.990
786.089.283.30.8540.7230.720
874.467.889.20.7850.5280.488
984.377.097.00.8620.7130.686
1081.380.182.50.8160.6260.628
Overall85.082.789.30.8600.7100.700
RF186.981.095.40.8800.7500.740
294.093.194.90.9400.8790.880
396.294.198.40.9630.9250.924
489.383.797.10.9010.7970.786
567.566.568.70.6850.3520.350
699.799.4100.00.9970.9940.990
786.189.883.10.8550.7260.722
878.872.988.90.8120.5960.576
982.574.498.70.8500.6890.650
1089.085.992.70.8950.7830.780
Overall87.084.191.80.8780.7490.740
Fig. 7.

Patient-specific accuracy achieved with raw data using different classifiers.

Patient-specific accuracy achieved with raw data using different classifiers.
Fig. 8.

Average accuracy achieved with raw data using different classifiers.

Average accuracy achieved with raw data using different classifiers.

3.2.Performance with extracted features from EEG signals

The performance of different methods is studied based on the five different features that have been obtained using feature extraction techniques from the original EEG recordings. The features used in this work are mean, standard deviation, energy of the signal, discrete Fourier transform, and discrete wavelet transform. Table 4 presents the performance analysis of decision tree, ensemble learning, artificial neural network, and random forest classifier with respect to various features. As seen from Table 4, the accuracy of all the four classifiers is mentioned for each of the features along with sensitivity and specificity. Figure 9 (a) and (b) represent the accuracy plot of artificial neural network and random forest. Figure 9 (c) and (d) present the accuracy plot of the decision tree and ensemble learning for all the five features used in this work. Standard deviation is seen to have obtained the highest accuracy for three out of the four classifiers, while for ensemble learning, mean has given the highest accuracy rate. Among the four classifiers, random forest has given the highest accuracy of 91.9% for standard deviation. Therefore, after comparing all the four classifiers against the five features, standard deviation with a moving window of 1 sec stands out to be the preferred choice among the features. Moreover, among the classifiers, random forest outdid the other three classifiers in providing the lowest amount of misclassified data. The false detection rate is 0.07/h, 0.1/h, 0.1/h, and 0.06/h for neural network, decision tree, ensemble learning and random forest method respectively.

Table 4

Performance of different methods using different features

Type of classifierFeaturesAccuracy (%)Sensitivity (%)Specificity (%)
Decision TreeMean85.491.579.3
Standard Deviation85.791.779.7
Energy71.673.469.7
DFT85.791.979.5
DWT76.279.572.9
Ensemble (Gentle-Boost)Mean86.692.081.3
Standard Deviation85.791.280.1
Energy78.078.777.3
DFT85.691.779.5
DWT84.087.580.4
Artificial Neural NetworkMean88.692.784.4
Standard Deviation89.094.084.0
Energy76.081.370.6
DFT87.493.281.5
DWT84.787.382.1
Random ForestMean91.593.989.1
Standard Deviation91.994.189.7
Energy80.184.775.4
DFT91.594.189.0
DWT85.991.880.0
Fig. 9.

Accuracy plot of (a) artificial neural network (b) random forest (c) decision tree (d) ensemble learning.

Accuracy plot of (a) artificial neural network (b) random forest (c) decision tree (d) ensemble learning.

To have a threshold-free assessment of the classifiers, the receiver operating characteristics curve (ROC) is used where the area under the curve (AUC) is taken as a measure of classification performance. For each classifier, the AUC value is obtained for all the features and is presented in Fig. 10. As seen from Table 5, irrespective of the classifier, an AUC score of 0.7 is acquired when energy is considered as the chosen feature for classification. When mean and standard deviation is used, the AUC score improved to 0.9 across all the classifiers while it varied slightly for both discrete wavelet transform (DWT) and discrete Fourier transform (DFT). The decision tree recorded the lowest value when energy is used as the chosen feature. Along with this, another metric called Cohen’s kappa has been used. All the classifiers showed almost perfect agreement with few exceptions. While ensemble leaning and ANN displayed substantial agreement for almost all the features except energy. When energy is used, irrespective of the classifier, the performance accuracy is reduced. Hence the reliability measure is in moderate agreement. The decision tree presented a substantial agreement for three of the five features. While the random forest has an almost perfect agreement for the features, except for energy and DWT where it showed substantial agreement. The F1 score or F1 measure has also been calculated for all the classifiers as mentioned in Table 5 and shown in Fig. 11. Figure 12 presents the receiver-operating curve (ROC) of all four methods for standard deviation features. The confusion matrix of different methods with standard deviation feature is given in Table 6.

Table 5

Performance of different methods using different features

Type of classifierFeaturesAUCKappaMatthew’s correlation coefficientF1-score
Decision TreeMean0.9140.7080.7130.862
Standard Deviation0.9170.7110.7190.865
Energy0.7340.4320.4310.721
DFT0.9190.7140.7200.868
DWT0.7950.5240.5250.770
Ensemble (Gentle-Boost)Mean0.9130.7320.7370.873
Standard Deviation0.9120.7140.7180.864
Energy0.7870.5600.5110.781
DFT0.9170.7120.7170.864
DWT0.8750.6800.6810.845
Artificial Neural NetworkMean0.9280.8380.8010.890
Standard Deviation0.9230.7800.7840.895
Energy0.7960.5200.5220.772
DFT0.9200.7480.7520.880
DWT0.9030.7000.7000.851
Random ForestMean0.9390.8300.8310.917
Standard Deviation0.9410.8380.8380.921
Energy0.8470.6020.6040.790
DFT0.9410.8300.8320.917
DWT0.9180.7200.7240.867
Table 6

Confusion matrix of different methods with standard deviation features

Methods usedConfusion matrix
DTTraining Confusion MatrixTarget Class
01
Output Class058924688
171589156
Testing Confusion MatrixTarget Class
01
Output Class020138020971
151182231561
ANNTraining Confusion MatrixTarget Class
01
Output Class05872448598
12073580246
Testing Confusion MatrixTarget Class
01
Output Class021212915138
140433237398
ENSTraining Confusion MatrixTarget Class
01
Output Class053478166079
154536523165
Testing Confusion MatrixTarget Class
01
Output Class020228722151
150275230381
RFTraining Confusion MatrixTarget Class
01
Output Class05893170
10589244
Testing Confusion MatrixTarget Class
01
Output Class022651414974
126048237558
Fig. 10.

AUC score of classifiers using the different features.

AUC score of classifiers using the different features.
Fig. 11.

F1 measure of all four classifiers for different features.

F1 measure of all four classifiers for different features.

One of the test results of the proposed method using standard deviation as a feature has been shown in Fig. 13. Figure 13 (a) shows the output of the DT method in which the first 1000 samples are taken from the normal condition and the next 1000 samples are for the epileptic condition. Hence the first 1000 samples output should be ‘0’ to represent normal condition and the next 1000 samples output should be ‘1’ to represent the epileptic condition. But Fig. 13 (a) shows the output becomes ‘1’ much later around 1400 sample number and some samples become 1 and again become zero which is incorrect. Figure 13 (b) shows the output of the ensemble learning method and here also some samples become 1 after sample number 1100 and again become zero which is incorrect. Figure 13 (c) represents the output of the ANN method where output becomes one after sample number 1000. But output comes to zero at sample number 1400 which is wrong. Figure 13 (d) represents the output of the RF method where output becomes one after sample number 1000. Although the RF-based method does not have an accuracy of 100%, it detects the outputs correctly for a prolonged amount of time which will be helpful for monitoring epilepsy.

Fig. 12.

ROC of ANN, DT, ensemble learning and RF for standard deviation the feature.

ROC of ANN, DT, ensemble learning and RF for standard deviation the feature.
Fig. 13.

Output of different methods with standard deviation as feature.

Output of different methods with standard deviation as feature.

3.3.Performance with data splitting in terms of patients using extracted features

The proposed method has been validated by dividing the data in terms of patients. The training and testing split is done in terms of patients i.e. 70% patients are used for training and 30% patients are used for testing. Few instances of the split have been presented in Fig. 14. As seen from the Fig. 14, data from different patients has been taken into consideration while creating the two subsets. Out of different combinations that have been tested, 3 cases have been shown in the Fig. 14. Table 7 shows the performance of all four classifiers for each of the 3 cases for standard deviation feature. Random forest has recorded the highest accuracy for the proposed work. Table 7 also shows the accuracy reached by random forest is highest for arbitrarily selected test cases. It can be seen from the Table 7, that the accuracy lies within ±2% percent of the accuracy achieved by the classifier. The classifier has been able to distinguish between seizure and non-seizure recordings but the consistency varied among the test cases which posed as slight limitation for the proposed method. Hence, this paves way for future work where more efficient and robust classifier is needed that can detect seizure with more finesse.

Fig. 14.

Few instances of splitting of training set and testing set in terms of patients.

Few instances of splitting of training set and testing set in terms of patients.
Table 7

Performance for different test cases using standard deviation input features

Test caseMethodAccuracy (%)Sensitivity (%)Specificity (%)
Case 1DT85.595.079.7
ANN86.995.181.5
ENS85.289.682.0
RF92.092.592.2
Case 2DT84.385.583.3
ANN86.686.984.5
ENS84.084.983.2
RF91.291.990.5
Case 3DT84.684.784.5
ANN87.188.785.6
ENS84.684.784.2
RF91.593.289.9

4.Results obtained for SWEC dataset

The validation result of SWEC dataset is given in Table 8 for all types of algorithms and features as used in the proposed method. It is seen that the average accuracy is from 81% to 96.9%. While sensitivity and specificity ranged from 76% to 96% and 86% to 99% respectively. Random forest and ensemble learning (ENS) have performed well among the four classifiers even for the validation dataset. The highest accuracy obtained is 96.9% for the random forest for the feature standard deviation. Figure 15 shows the F1-measure plot of all four classifiers for the feature standard deviation with respect to both the dataset. It can be realized from the graph that the performance of the proposed method for the validation dataset is at par with the obtained results (CHB-MIT dataset) and have accomplished significantly improved results.

Table 8

Performance of SWEC dataset in epileptic seizure detection

ClassifierFeaturesAccuracy (%)Sensitivity (%)Specificity (%)F1 scoreMCC
Decision Tree (DT)STD92.994.691.20.9290.872
Mean90.587.493.80.8920.824
DFT92.091.592.50.9150.856
Energy89.387.290.70.8820.859
DWT82.177.686.50.8220.661
Random Forest (RF)STD96.996.698.60.9630.945
Mean95.191.099.10.9360.913
DFT96.195.798.10.9540.929
Energy96.196.694.90.9580.918
DWT88.885.292.40.8930.791
Ensemble Learning (ENS)STD93.991.496.30.9170.889
Mean93.390.096.60.9190.878
DFT94.792.896.30.9380.904
Energy94.394.693.90.9430.890
DWT87.282.491.90.8730.764
Artificial neural network (ANN)STD90.584.396.60.8780.828
Mean91.388.494.30.8940.842
DFT91.089.592.50.9030.834
Energy91.590.492.60.9120.841
DWT81.676.686.60.8210.649
Fig. 15.

F1-measure of all four classifiers for the standard deviation (STD) feature for CHB-MIT data set and SWEC dataset.

F1-measure of all four classifiers for the standard deviation (STD) feature for CHB-MIT data set and SWEC dataset.

5.Discussion

Considering the aim of the work, an improved method has been proposed for epileptic seizure detection which is independent of channel, independent of patient and has a better accuracy. The results of the proposed method have been discussed in Section 3 and Section 4 from which it can be observed that the accuracy in detecting epileptic seizure is promising. In this work, a comparison study is presented based on the seizure detection capability of different methods to find a suitable method. Feature extraction techniques have been used that included time-domain feature, frequency-domain feature and time-frequency domain feature. Table 9 represents the comparative study of the existing work with previous works based on the same dataset. [8] used 18 channels out of the 23 channels for seizure detection for the same data set. But in the proposed method all the channels are used to propose a channel independent method. When sensitivity is compared for the same data set, the proposed method achieved the highest sensitivity of 94% in comparison to 82% of the mentioned work for neural network. As seen in seizure detection, a patient-specific approach [17,34] is applied most of the time along with k- fold cross-validation method to test and validate the performance of the classifier. In this work, generalized approach have been used to study and analyze all the classifiers. When the generalized approach for seizure detection is compared to traditional machine learning methods, it has shown improved accuracy than the patient-specific approach [34]. The proposed method also suggests patient independent approach with better accuracy. In [17], authors have used db6 while in this work db8 has been used that contained eight vanishing moments. Spectral density using Fourier transform has been used in the patient-specific approach but these methods are based on the frequency domain and lack time-related information associated with the EEG signals. Although approximate energy has been used as a feature [17], in the present study using the test sample method energy has given the lowest accuracy across all the classifiers. When compared with prior works, the proposed approach performed well except for few works [8,17,32]. Justification can be given as all the above-mentioned works used the patient-specific approach whereas for the present work a generalized seizure detection framework has been maintained for each classifier so that seizures pertaining to any type or location can be detected with maximum sensitivity. Thus, inclusive seizure detection capability of the proposed method is analyzed. The present work also included all the EEG channels such that essential features from each of the channels could be extracted and applied for training the classifier modules. Moreover, the conventional approach of cross-validation has not been used for validation. Instead, a more realistic approach of the test sample method has been tried and tested such that the shortcomings and pitfalls can be acknowledged. This would pave the way for more refined and re-defined frameworks for pediatric seizure detection with minimum delay and maximum accuracy that would be seemingly beneficial in real scenarios. Apart from traditional supervised learning techniques, convolutional neural network [41] has been used for seizure detection. When the comparison is made in the time domain analysis, the proposed method progressed to provide a better result than the average accuracy reached with deep learning technique.

Though neural network is widely used in the seizure detection framework and has been used in [10], the processing power of the neural network has a direct dependency on the network configuration. With a more intricate network structure, the time complexity also increases. In the prior work by the authors [10], discrete wavelet transformation has been used as the lone feature and 10-fold cross-validation has been used for validation of the neural network framework which is the notable difference from the present work. To reduce the computational complexity and duration of developing a classifier, decision tree, random forest, and ensemble-learning algorithms have been used with all the features for determining seizure from non-seizure data. Therefore, the present work is not only directed towards analyzing the performance of different classifiers but also understanding the underlying nuances such that depending on the complexities at hand, proper selection of classifiers can be done for hardware implementation that would be cost and energy-efficient. The method will fail if the signal is not correctly recorded by the EEG channel or in a situation where any of the channels is missing. Also, data from more patients are needed to develop a more robust classification model. Advantages of the proposed method can be outlined as follows:

  • A generalized method has been designed that would be suitable for detecting epileptic seizures with precision.

  • The proposed method has been designed in a way such that features are generated simultaneously with respect to the EEG signals.

  • As the features are generated from EEG samples, it will be given to the classifier to produce the output concurrently as multiple computational resources are used to calculate all of these features.

  • In the present work, a generalized seizure detection framework has been maintained for each method instead of a patient-specific approach so that seizures pertaining to any type or location can be detected with maximum sensitivity. Thus, inclusive seizure detection capability of the proposed method is analyzed.

  • The present work also included all the EEG channels such that essential features from each of the channels could be extracted and applied for training the classifier modules.

  • Instead of the conventional approach of cross-validation, a more realistic approach of the test sample method has been tried and tested such that the shortcomings and pitfalls can be acknowledged. This would pave way for more refined and re-defined frameworks for pediatric seizure detection with maximum accuracy that would be seemingly beneficial in real scenarios.

  • Accuracy of the proposed seizure detection method is promising.

Table 9

Comparison study of the present work with other existing methods on CHB-MIT dataset

AuthorsFeaturesAlgorithmNumber of patientsNumber of samplesPatient specificChannel specificAccuracy (%)
Kaleem et al. [17]Wavelet transformSupport vector machine, Linear Discriminant Analysis231,024 samples per segmentYesNo99.6
Siddiqui et al. [32]Mean. Entropy, energy, etc.Support vector machine, Ensemble, Decision tree22,520; 1,440 (10 s epoch)YesNo99.5
50,400; 28,800 (0.5 s epoch)
Boonyakitanont et al. [8]Bayesian error rateArtificial neural network, Convolutional neural network241,889 (Artificial neural network)YesYes98.6
7,945 (Convolutional neural network)
Chakrabarti et al. [10]Wavelet transformArtificial neural network101,688,775 samplesNoNo95.3
Yuan et al. [39]EEG embeddingWavelet transform – CtxEEG94,302 EEG fragmentsYes92.2
Tsiouris et al. [34]Statistical moments, energy spectrum, etc.Neural Network, Support vector machine24121,062 samples each in pre-ictal &inter-ictal phaseYesNo86.7
Usman et al. [37]Convolutional neural networkSupport vector machine2432,576 (Training phase)YesNo
Zhou et al. [41]Convolutional neural network24YesNo59.5
This workMoving window of Standard deviationRandom Forest101,178,599 (Training phase)NoNo91.9
505,097 (Testing phase)

*‘-’means not specified clearly

6.Conclusion

The main aim of this work is to suggest a method which is channel independent, does not depend on patients and has a better accuracy for the detection of pediatric epileptic seizures. Features belonging to different domains namely, time, frequency, and time-frequency have been used for extracting suitable features from the EEG signals. Each classifier has been analyzed using each feature to find the most appropriate classifier that can be used for seizure detection. In this work, a generalized approach has been used for all the classifiers to present a detailed analysis regarding seizure detection. Although the decision tree has taken the least computational time for training the model but has shown the least accuracy when it came to seizure detection. While the random forest has been the most computationally exhausting model for training the dataset but presented the best accuracy in detecting seizure signals from non-seizure signals. Therefore, the present comparison study not only provides a brief idea about selecting a classifier for seizure detection but also leaves room for improvement in enhancing the performance of the classifiers. The epileptic seizure detection techniques have challenges like selecting appropriate classifiers and features. However, in this work, the random forest method has been chosen out of four methods because it has advantages over others. Random forest classifiers are efficient for imbalanced data and high-dimensional datasets than neural network, and decision tree methods. The random forest method can generate more logic rules compared to the decision tree which will provide good accuracy. The method will fail if the signal is not correctly recorded by the EEG channel or in a situation where any of the channels is missing. The next step is to validate the proposed method with a real-time setup in a hospital where EEG signals from the patient will be given to the proposed framework and output will be displayed in the monitor. It will be analyzed that if the proposed method is working in real time or not. If not, then further work will be done on feature extraction and the classifier will be modified accordingly to provide a good detection rate. The future direction lies in designing an energy and cost-efficient model that would be effective for seizure detection. As the random forest has shown to work well for seizure detection, tree-based techniques can be considered for hardware implementation, as they are portable, lightweight, and suitable to be integrated on a chip.

Conflict of interest

The authors have no conflict of interest to report.

References

[1] 

E. Abdulhay, M. Alafeef, A. Abdelhay and A. Al-Bashir, Classification of normal, ictal and inter-ictal EEG via direct quadrature and random forest tree, Journal of Medical and Biological Engineering 37: (6) ((2017) ), 843–857. doi:10.1007/s40846-017-0239-z.

[2] 

R. Abiyev, M. Arslan, J.B. Idoko, B. Sekeroglu and A. Ilhan, Identification of epileptic eeg signals using convolutional neural networks, Applied Sciences 10: (12) ((2020) ), 4089. doi:10.3390/app10124089.

[3] 

K. Abualsaud, M. Mahmuddin, M. Saleh and A. Mohamed, Ensemble classifier for epileptic seizure detection for imperfect EEG data, The Scientific World Journal (2015).

[4] 

E. Alickovic, J. Kevric and A. Subasi, Performance evaluation of empirical mode decomposition, discrete wavelet transform, and wavelet packed decomposition for automated epileptic seizure detection and prediction, Biomedical Signal Processing and Control 39: ((2018) ), 94–102. doi:10.1016/j.bspc.2017.07.022.

[5] 

S.A. Alshebeili, A. Sedik, B. Abd El-Rahiem, T.N. Alotaiby, G.M. El Banby, H.A. El-Khobby, M.A. Ali, A.A. Khalaf and F.E. Abd El-Samie, Inspection of EEG signals for efficient seizure prediction, Applied Acoustics 166: ((2020) ), 107327. doi:10.1016/j.apacoust.2020.107327.

[6] 

S. Amiri, J. Mehvari-Habibabadi, N. Mohammadi-Mobarakeh, S.S. Hashemi-Fesharaki, M.M. Mirbagheri, K. Elisevich and M.R. Nazem-Zadeh, Graph theory application with functional connectivity to distinguish left from right temporal lobe epilepsy, Epilepsy Research 167: ((2020) ), 106449. doi:10.1016/j.eplepsyres.2020.106449.

[7] 

I. Beheshti, D. Sone, N. Maikusa, Y. Kimura, Y. Shigemoto, N. Sato and H. Matsuda, Pattern analysis of glucose metabolic brain data for lateralization of MRI-negative temporal lobe epilepsy, Epilepsy Research 167: ((2020) ), 106474. doi:10.1016/j.eplepsyres.2020.106474.

[8] 

P. Boonyakitanont, A. Lek-uthai, K. Chomtho and J. Songsiri, A Comparison of Deep Neural Networks for Seizure Detection in EEG Signals, bioRxiv (2019), 702654.

[9] 

A. Burrello, K. Schindler, L. Benini and A. Rahimi, Hyperdimensional computing with local binary patterns: One-shot learning of seizure onset and identification of ictogenic brain regions using short-time ieeg recordings, IEEE Transactions on Biomedical Engineering 67: (2) ((2019) ), 601–613. doi:10.1109/TBME.2019.2919137.

[10] 

S. Chakrabarti, A. Swetapadma, A. Ranjan and P.K. Pattnaik, Time domain implementation of pediatric epileptic seizure detection system for enhancing the performance of detection and easy monitoring of pediatric patients, Biomedical Signal Processing and Control 59: ((2020) ), 101930. doi:10.1016/j.bspc.2020.101930.

[11] 

J.E. da Rosa Tavares and J.L. Victória Barbosa, Ubiquitous healthcare on smart environments: A systematic mapping study, Journal of Ambient Intelligence and Smart Environments Preprint (2020), 1–17.

[12] 

H. Daoud and M.A. Bayoumi, Efficient epileptic seizure prediction based on deep learning, IEEE Transactions on Biomedical Circuits and Systems 13: (5) ((2019) ), 804–813. doi:10.1109/TBCAS.2019.2929053.

[13] 

H. Gao, X. Du, W. Li, W. Liu and D. Zhou, Seizure description accuracy and seizure classification results from patient histories, Epilepsy Research 167: ((2020) ), 106413. doi:10.1016/j.eplepsyres.2020.106413.

[14] 

H. Göksu, EEG based epileptiform pattern recognition inside and outside the seizure states, Biomedical Signal Processing and Control 43: ((2018) ), 204–215. doi:10.1016/j.bspc.2018.03.004.

[15] 

I. Gryech, M. Ghogho, H. Elhammouti, N. Sbihi and A. Kobbane, Machine learning for air quality prediction using meteorological and traffic related features, Journal of Ambient Intelligence and Smart Environments (Preprint) (2020), 1–13.

[16] 

W. Hussain, M.T. Sadiq, S. Siuly and A.U. Rehman, Epileptic seizure detection using 1 D-convolutional long short-term memory neural networks, Applied Acoustics 177: ((2021) ), 107941. doi:10.1016/j.apacoust.2021.107941.

[17] 

M. Kaleem, A. Guergachi and S. Krishnan, Patient-specific seizure detection in long-term EEG using wavelet decomposition, Biomedical Signal Processing and Control 46: ((2018) ), 157–165. doi:10.1016/j.bspc.2018.07.006.

[18] 

G. Louppe, Understanding random forests: From theory to practice, 2014, preprint, arXiv:1407.7502.

[19] 

O. Maimon and L. Rokach (eds), Data Mining and Knowledge Discovery Handbook, (2005) .

[20] 

F. Manzouri, S. Heller, M. Dümpelmann, P. Woias and A. Schulze-Bonhage, A comparison of machine learning classifiers for energy-efficient implementation of seizure detection, Frontiers in systems neuroscience 12: ((2018) ), 43. doi:10.3389/fnsys.2018.00043.

[21] 

H. Niknazar, S.R. Mousavi, M. Niknazar, V. Mardanlou and B.N. Coelho, Performance analysis of EEG seizure detection features, Epilepsy Research 167: ((2020) ), 106483. doi:10.1016/j.eplepsyres.2020.106483.

[22] 

I. Omerhodzic, S. Avdakovic, A. Nuhanovic, K. Dizdarevic and K. Rotim, Energy distribution of EEG signal components, by wavelet transform (Vol. 2). Chapter (2012).

[23] 

D. Opitz and R. Maclin, Popular ensemble methods: An empirical study, Journal of artificial intelligence research 11: ((1999) ), 169–198. doi:10.1613/jair.614.

[24] 

Physionet CHB-MIT Scalp EEG Databse Boston, https://www.physionet.org/pn6/chbmit, dataset.

[25] 

R. Polikar, The Wavelet Tutorial, (1996) .

[26] 

A. Prati, C. Shan and K.I.-K. Wang, Sensors, vision and networks: From video surveillance to activity recognition and health monitoring, Journal of Ambient Intelligence and Smart Environments 11: (1) ((2019) ), 5–22.

[27] 

M.A. Rahman, M.F. Hossain, M. Hossain and R. Ahmmed, Employing PCA and t-statistical approach for feature extraction and classification of emotion from multichannel EEG signal, Egyptian Informatics Journal 21: (1) ((2020) ), 23–35. doi:10.1016/j.eij.2019.10.002.

[28] 

M.M. Rahman, M.I.H. Bhuiyan and A.B. Das, Classification of focal and non-focal EEG signals in VMD-DWT domain using ensemble stacking, Biomedical Signal Processing and Control 50: ((2019) ), 72–82. doi:10.1016/j.bspc.2019.01.012.

[29] 

A. Rehman, A. Athar, M.A. Khan, S. Abbas, A. Fatima and A. Saeed, Modelling, simulation, and optimization of diabetes type II prediction using deep extreme learning machine, Journal of Ambient Intelligence and Smart Environments 12: (2) ((2020) ), 125–138. doi:10.3233/AIS-200554.

[30] 

J.L.G. Rosa, Biologically plausible artificial neural networks, in: Artificial Neural Networks-Architectures and Applications, K. Suzuki, ed., IntechOpen, (2013) .

[31] 

M.M. Shaker, EEG waves classifier using wavelet transform and Fourier transform, Brain 2(3) (2006).

[32] 

M.K. Siddiqui, M.Z. Islam and M.A. Kabir, Analyzing performance of classification techniques in detecting epileptic seizure, in: International Conference on Advanced Data Mining and Applications, Springer, Cham, (2017) , pp. 386–398. doi:10.1007/978-3-319-69179-4_27.

[33] 

S.W.E.C. Sleep-Wake-Epilepsy-Center, University Department of Neurology at the Inselspital Bern and the Integrated Systems Laboratory of the ETH Zurich, http://ieeg-swez.ethz.ch/, dataset.

[34] 

K.M. Tsiouris, V.C. Pezoulas, D.D. Koutsouris, M. Zervakis and D.I. Fotiadis, Discrimination of preictal and interictal brain states from long-term EEG data, in: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS), IEEE, (2017) , pp. 318–323. doi:10.1109/CBMS.2017.33.

[35] 

T. Tuncer, A new stable nonlinear textural feature extraction method based EEG signal classification method using substitution Box of the Hamsi hash function: Hamsi pattern, Applied Acoustics 172: ((2021) ), 107607. doi:10.1016/j.apacoust.2020.107607.

[36] 

K.D. Tzimourta, L.G. Astrakas, A.M. Gianni, A.T. Tzallas, N. Giannakeas, I. Paliokas and D.T.M. Tsipouras, Evaluation of window size in classification of epileptic short-term EEG signals using a Brain Computer Interface software, Engineering, Technology & Applied Science Research 8: (4) ((2018) ), 3093–3097. doi:10.48084/etasr.2031.

[37] 

S.M. Usman, S. Khalid and M.H. Aslam, Epileptic seizures prediction using deep learning techniques, IEEE Access 8: ((2020) ), 39998–40007. doi:10.1109/ACCESS.2020.2976866.

[38] 

Y. Wang, A. Yalcin and C. VandeWeerd, Health and wellness monitoring using ambient sensor networks, Journal of Ambient Intelligence and Smart Environments 12: (2) ((2020) ), 139–151. doi:10.3233/AIS-200553.

[39] 

Y. Yuan, G. Xun, K. Jia and A. Zhang, A multi-context learning approach for EEG epileptic seizure detection, BMC systems biology 12: (6) ((2018) ), 47–57.

[40] 

T. Zhang, W. Chen and M. Li, Generalized Stockwell transform and SVD-based epileptic seizure detection in EEG using random forest, Biocybernetics and Biomedical Engineering 38: (3) ((2018) ), 519–534. doi:10.1016/j.bbe.2018.03.007.

[41] 

M. Zhou, C. Tian, R. Cao, B. Wang, Y. Niu, T. Hu, H. Guo and J. Xiang, Epileptic seizure detection based on EEG signals and CNN, Frontiers in neuroinformatics 12: ((2018) ), 95. doi:10.3389/fninf.2018.00095.