Submission Evaluation
For the evaluation of the submitted online-methods, the methods have been executed on a dataset unknown to the participants. The quality of the detector is then calculated using the F1 score, the harmonic mean of precision and recall, which is defined as:
F1 = 2 · (PPV · TPR) / (PPV + TPR)
with
PPV = ∑ TruePositive / ∑ PredictionPositive
and
TPR = ∑ TruePositive / ∑ConditionPositive ,
so that PPV describes the ration between the number of true positive predictions and the number of all positive predictions while TPR the ratio between the number of true positive predictions and the number of actual events. Per definition this score ranges from values from 0 to 1, with 1 being the best achievable score.
Detailed Results
Submission | F1 Score |
---|---|
Minh Nguyen, Affan Hamdani, Kalaichelvi Rajendran | 0.56123041 |
Fitore Muharremi | 0.47693977 |
Victor H. A. Ribeiro (SVM) | 0.45098039 |
Victor H. A. Ribeiro (DT) | 0.39030920 |
Abdul_Rasheeq, Jagadesh_Devan, Jithi_Varghese | 0.35265018 |
Abdul_Rasheeq, Jagadesh_Devan, Jithi_Varghese | 0.31148135 |
Xingguo Chen, Fan Feng, Jikai Wu, Yushuang Wu, and Wenyu Liu | 0.27644055 |
Valerie Fehst (LSTM) | 0.2687546 |
Valerie Fehst (SVM) | 0.12497675 |
Lam Gia Thuan | 0.09470433 |
Alabbas Alhaj Ali | 0.04021720 |
Thomas Belser, Pooja Patel | 0.03034088 |
Gozde, Nikitha and Vijaymurali | 0.02925610 |
Additional Downloads
Download the GECCO 2018 test data set as RDS File.