///////////////////////////////////////////
// Running CTAB-GAN on folding_kr-vs-k-three_vs_eleven
///////////////////////////////////////////

Load 'data_input/folding_kr-vs-k-three_vs_eleven'
from pickle file
Data loaded.
-> Shuffling data
### Start exercise for synthetic point generator

====== Step 1/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 1/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:04,  1.92it/s]
 20%|██        | 2/10 [00:00<00:03,  2.16it/s]
 30%|███       | 3/10 [00:03<00:10,  1.50s/it]
 40%|████      | 4/10 [00:04<00:07,  1.18s/it]
 50%|█████     | 5/10 [00:05<00:05,  1.04s/it]
 60%|██████    | 6/10 [00:07<00:06,  1.51s/it]
 70%|███████   | 7/10 [00:08<00:03,  1.24s/it]
 80%|████████  | 8/10 [00:09<00:02,  1.11s/it]
 90%|█████████ | 9/10 [00:09<00:01,  1.01s/it]
100%|██████████| 10/10 [00:10<00:00,  1.03it/s]
100%|██████████| 10/10 [00:10<00:00,  1.08s/it]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 555, 16
LR fn, tp: 0, 17
LR f1 score: 0.680
LR cohens kappa score: 0.667
LR average precision score: 1.000

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 557, 14
KNN fn, tp: 0, 17
KNN f1 score: 0.708
KNN cohens kappa score: 0.697


------ Step 1/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.09it/s]
 20%|██        | 2/10 [00:01<00:06,  1.23it/s]
 30%|███       | 3/10 [00:02<00:05,  1.27it/s]
 40%|████      | 4/10 [00:03<00:05,  1.20it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.19it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.23it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.29it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.26it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.12it/s]
100%|██████████| 10/10 [00:08<00:00,  1.09it/s]
100%|██████████| 10/10 [00:08<00:00,  1.17it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 565, 6
LR fn, tp: 0, 17
LR f1 score: 0.850
LR cohens kappa score: 0.845
LR average precision score: 0.987

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 567, 4
KNN fn, tp: 0, 17
KNN f1 score: 0.895
KNN cohens kappa score: 0.891


------ Step 1/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.26it/s]
 20%|██        | 2/10 [00:01<00:05,  1.35it/s]
 30%|███       | 3/10 [00:02<00:05,  1.31it/s]
 40%|████      | 4/10 [00:03<00:04,  1.29it/s]
 50%|█████     | 5/10 [00:03<00:03,  1.31it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.27it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.23it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.21it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.18it/s]
100%|██████████| 10/10 [00:08<00:00,  1.21it/s]
100%|██████████| 10/10 [00:08<00:00,  1.24it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 559, 12
LR fn, tp: 0, 17
LR f1 score: 0.739
LR cohens kappa score: 0.729
LR average precision score: 0.994

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 566, 5
KNN fn, tp: 0, 17
KNN f1 score: 0.872
KNN cohens kappa score: 0.867


------ Step 1/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:06,  1.42it/s]
 20%|██        | 2/10 [00:01<00:05,  1.33it/s]
 30%|███       | 3/10 [00:02<00:05,  1.31it/s]
 40%|████      | 4/10 [00:03<00:04,  1.26it/s]
 50%|█████     | 5/10 [00:03<00:03,  1.25it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.23it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.19it/s]
 80%|████████  | 8/10 [00:08<00:02,  1.42s/it]
 90%|█████████ | 9/10 [00:09<00:01,  1.30s/it]
100%|██████████| 10/10 [00:10<00:00,  1.16s/it]
100%|██████████| 10/10 [00:10<00:00,  1.02s/it]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 554, 17
LR fn, tp: 0, 17
LR f1 score: 0.667
LR cohens kappa score: 0.653
LR average precision score: 0.991

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 566, 5
KNN fn, tp: 1, 16
KNN f1 score: 0.842
KNN cohens kappa score: 0.837


------ Step 1/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:01<00:09,  1.01s/it]
 20%|██        | 2/10 [00:01<00:07,  1.09it/s]
 30%|███       | 3/10 [00:02<00:06,  1.06it/s]
 40%|████      | 4/10 [00:03<00:05,  1.09it/s]
 50%|█████     | 5/10 [00:05<00:06,  1.21s/it]
 60%|██████    | 6/10 [00:06<00:04,  1.09s/it]
 70%|███████   | 7/10 [00:07<00:03,  1.06s/it]
 80%|████████  | 8/10 [00:08<00:01,  1.01it/s]
 90%|█████████ | 9/10 [00:08<00:00,  1.07it/s]
100%|██████████| 10/10 [00:09<00:00,  1.09it/s]
100%|██████████| 10/10 [00:09<00:00,  1.02it/s]
-> create 2216 synthetic samples
-> test with 'LR'
LR tn, fp: 563, 7
LR fn, tp: 0, 13
LR f1 score: 0.788
LR cohens kappa score: 0.782
LR average precision score: 0.980

-> test with 'GB'
GB tn, fp: 568, 2
GB fn, tp: 0, 13
GB f1 score: 0.929
GB cohens kappa score: 0.927

-> test with 'KNN'
KNN tn, fp: 565, 5
KNN fn, tp: 0, 13
KNN f1 score: 0.839
KNN cohens kappa score: 0.834


====== Step 2/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 2/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.10it/s]
 20%|██        | 2/10 [00:01<00:06,  1.17it/s]
 30%|███       | 3/10 [00:02<00:06,  1.10it/s]
 40%|████      | 4/10 [00:03<00:05,  1.16it/s]
 50%|█████     | 5/10 [00:05<00:06,  1.28s/it]
 60%|██████    | 6/10 [00:06<00:04,  1.08s/it]
 70%|███████   | 7/10 [00:07<00:03,  1.06s/it]
 80%|████████  | 8/10 [00:08<00:02,  1.00s/it]
 90%|█████████ | 9/10 [00:08<00:00,  1.05it/s]
100%|██████████| 10/10 [00:09<00:00,  1.08it/s]
100%|██████████| 10/10 [00:09<00:00,  1.02it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 555, 16
LR fn, tp: 0, 17
LR f1 score: 0.680
LR cohens kappa score: 0.667
LR average precision score: 1.000

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 564, 7
KNN fn, tp: 1, 16
KNN f1 score: 0.800
KNN cohens kappa score: 0.793


------ Step 2/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:01<00:10,  1.14s/it]
 20%|██        | 2/10 [00:02<00:08,  1.01s/it]
 30%|███       | 3/10 [00:02<00:06,  1.03it/s]
 40%|████      | 4/10 [00:03<00:05,  1.08it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.14it/s]
 60%|██████    | 6/10 [00:05<00:04,  1.01s/it]
 70%|███████   | 7/10 [00:06<00:02,  1.06it/s]
 80%|████████  | 8/10 [00:07<00:01,  1.10it/s]
 90%|█████████ | 9/10 [00:08<00:00,  1.11it/s]
100%|██████████| 10/10 [00:09<00:00,  1.10it/s]
100%|██████████| 10/10 [00:09<00:00,  1.07it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 551, 20
LR fn, tp: 0, 17
LR f1 score: 0.630
LR cohens kappa score: 0.614
LR average precision score: 0.994

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 562, 9
KNN fn, tp: 0, 17
KNN f1 score: 0.791
KNN cohens kappa score: 0.783


------ Step 2/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.21it/s]
 20%|██        | 2/10 [00:01<00:06,  1.28it/s]
 30%|███       | 3/10 [00:02<00:05,  1.20it/s]
 40%|████      | 4/10 [00:03<00:04,  1.22it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.20it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.13it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.10it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.16it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.11it/s]
100%|██████████| 10/10 [00:09<00:00,  1.07s/it]
100%|██████████| 10/10 [00:09<00:00,  1.08it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 551, 20
LR fn, tp: 0, 17
LR f1 score: 0.630
LR cohens kappa score: 0.614
LR average precision score: 0.984

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 563, 8
KNN fn, tp: 0, 17
KNN f1 score: 0.810
KNN cohens kappa score: 0.803


------ Step 2/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.18it/s]
 20%|██        | 2/10 [00:01<00:06,  1.29it/s]
 30%|███       | 3/10 [00:02<00:05,  1.29it/s]
 40%|████      | 4/10 [00:03<00:04,  1.33it/s]
 50%|█████     | 5/10 [00:03<00:03,  1.25it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.25it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.25it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.18it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.22it/s]
100%|██████████| 10/10 [00:09<00:00,  1.22s/it]
100%|██████████| 10/10 [00:09<00:00,  1.07it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 563, 8
LR fn, tp: 1, 16
LR f1 score: 0.780
LR cohens kappa score: 0.773
LR average precision score: 0.980

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 567, 4
KNN fn, tp: 3, 14
KNN f1 score: 0.800
KNN cohens kappa score: 0.794


------ Step 2/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.26it/s]
 20%|██        | 2/10 [00:01<00:06,  1.26it/s]
 30%|███       | 3/10 [00:02<00:05,  1.20it/s]
 40%|████      | 4/10 [00:03<00:04,  1.24it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.23it/s]
 60%|██████    | 6/10 [00:05<00:04,  1.15s/it]
 70%|███████   | 7/10 [00:06<00:03,  1.06s/it]
 80%|████████  | 8/10 [00:07<00:02,  1.03s/it]
 90%|█████████ | 9/10 [00:08<00:01,  1.05s/it]
100%|██████████| 10/10 [00:09<00:00,  1.07s/it]
100%|██████████| 10/10 [00:09<00:00,  1.01it/s]
-> create 2216 synthetic samples
-> test with 'LR'
LR tn, fp: 555, 15
LR fn, tp: 0, 13
LR f1 score: 0.634
LR cohens kappa score: 0.623
LR average precision score: 0.995

-> test with 'GB'
GB tn, fp: 570, 0
GB fn, tp: 0, 13
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 563, 7
KNN fn, tp: 0, 13
KNN f1 score: 0.788
KNN cohens kappa score: 0.782


====== Step 3/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 3/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.22it/s]
 20%|██        | 2/10 [00:01<00:06,  1.23it/s]
 30%|███       | 3/10 [00:02<00:05,  1.17it/s]
 40%|████      | 4/10 [00:03<00:05,  1.20it/s]
 50%|█████     | 5/10 [00:04<00:03,  1.26it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.25it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.20it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.26it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.22it/s]
100%|██████████| 10/10 [00:08<00:00,  1.18it/s]
100%|██████████| 10/10 [00:08<00:00,  1.21it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 554, 17
LR fn, tp: 0, 17
LR f1 score: 0.667
LR cohens kappa score: 0.653
LR average precision score: 0.990

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 563, 8
KNN fn, tp: 0, 17
KNN f1 score: 0.810
KNN cohens kappa score: 0.803


------ Step 3/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.06it/s]
 20%|██        | 2/10 [00:01<00:06,  1.22it/s]
 30%|███       | 3/10 [00:02<00:05,  1.26it/s]
 40%|████      | 4/10 [00:03<00:04,  1.35it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.25it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.09it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.09it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.09it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.07it/s]
100%|██████████| 10/10 [00:08<00:00,  1.10it/s]
100%|██████████| 10/10 [00:08<00:00,  1.13it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 550, 21
LR fn, tp: 0, 17
LR f1 score: 0.618
LR cohens kappa score: 0.602
LR average precision score: 0.997

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 561, 10
KNN fn, tp: 0, 17
KNN f1 score: 0.773
KNN cohens kappa score: 0.764


------ Step 3/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.09it/s]
 20%|██        | 2/10 [00:01<00:07,  1.10it/s]
 30%|███       | 3/10 [00:02<00:06,  1.15it/s]
 40%|████      | 4/10 [00:03<00:05,  1.11it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.18it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.20it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.17it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.19it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.14it/s]
100%|██████████| 10/10 [00:08<00:00,  1.18it/s]
100%|██████████| 10/10 [00:08<00:00,  1.16it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 558, 13
LR fn, tp: 0, 17
LR f1 score: 0.723
LR cohens kappa score: 0.713
LR average precision score: 0.985

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 568, 3
KNN fn, tp: 0, 17
KNN f1 score: 0.919
KNN cohens kappa score: 0.916


------ Step 3/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.05it/s]
 20%|██        | 2/10 [00:01<00:07,  1.13it/s]
 30%|███       | 3/10 [00:02<00:06,  1.13it/s]
 40%|████      | 4/10 [00:03<00:05,  1.14it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.14it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.15it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.18it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.18it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.11it/s]
100%|██████████| 10/10 [00:08<00:00,  1.16it/s]
100%|██████████| 10/10 [00:08<00:00,  1.15it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 562, 9
LR fn, tp: 0, 17
LR f1 score: 0.791
LR cohens kappa score: 0.783
LR average precision score: 0.997

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 568, 3
KNN fn, tp: 1, 16
KNN f1 score: 0.889
KNN cohens kappa score: 0.885


------ Step 3/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.18it/s]
 20%|██        | 2/10 [00:01<00:06,  1.18it/s]
 30%|███       | 3/10 [00:02<00:06,  1.09it/s]
 40%|████      | 4/10 [00:03<00:05,  1.06it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.16it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.20it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.13it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.18it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.21it/s]
100%|██████████| 10/10 [00:08<00:00,  1.19it/s]
100%|██████████| 10/10 [00:08<00:00,  1.17it/s]
-> create 2216 synthetic samples
-> test with 'LR'
LR tn, fp: 558, 12
LR fn, tp: 0, 13
LR f1 score: 0.684
LR cohens kappa score: 0.675
LR average precision score: 0.990

-> test with 'GB'
GB tn, fp: 570, 0
GB fn, tp: 0, 13
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 562, 8
KNN fn, tp: 0, 13
KNN f1 score: 0.765
KNN cohens kappa score: 0.758


====== Step 4/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 4/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.25it/s]
 20%|██        | 2/10 [00:01<00:06,  1.27it/s]
 30%|███       | 3/10 [00:02<00:05,  1.24it/s]
 40%|████      | 4/10 [00:04<00:06,  1.15s/it]
 50%|█████     | 5/10 [00:04<00:05,  1.04s/it]
 60%|██████    | 6/10 [00:05<00:03,  1.01it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.09it/s]
 80%|████████  | 8/10 [00:07<00:01,  1.16it/s]
 90%|█████████ | 9/10 [00:08<00:00,  1.17it/s]
100%|██████████| 10/10 [00:09<00:00,  1.18it/s]
100%|██████████| 10/10 [00:09<00:00,  1.11it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 555, 16
LR fn, tp: 0, 17
LR f1 score: 0.680
LR cohens kappa score: 0.667
LR average precision score: 0.994

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 562, 9
KNN fn, tp: 0, 17
KNN f1 score: 0.791
KNN cohens kappa score: 0.783


------ Step 4/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:01<00:11,  1.31s/it]
 20%|██        | 2/10 [00:02<00:07,  1.03it/s]
 30%|███       | 3/10 [00:02<00:06,  1.09it/s]
 40%|████      | 4/10 [00:03<00:05,  1.19it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.18it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.18it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.16it/s]
 80%|████████  | 8/10 [00:07<00:01,  1.15it/s]
 90%|█████████ | 9/10 [00:08<00:00,  1.11it/s]
100%|██████████| 10/10 [00:08<00:00,  1.15it/s]
100%|██████████| 10/10 [00:08<00:00,  1.13it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 554, 17
LR fn, tp: 0, 17
LR f1 score: 0.667
LR cohens kappa score: 0.653
LR average precision score: 0.991

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 562, 9
KNN fn, tp: 1, 16
KNN f1 score: 0.762
KNN cohens kappa score: 0.753


------ Step 4/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.15it/s]
 20%|██        | 2/10 [00:01<00:05,  1.37it/s]
 30%|███       | 3/10 [00:02<00:05,  1.26it/s]
 40%|████      | 4/10 [00:03<00:04,  1.32it/s]
 50%|█████     | 5/10 [00:03<00:03,  1.36it/s]
 60%|██████    | 6/10 [00:04<00:02,  1.36it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.32it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.31it/s]
 90%|█████████ | 9/10 [00:06<00:00,  1.34it/s]
100%|██████████| 10/10 [00:07<00:00,  1.33it/s]
100%|██████████| 10/10 [00:07<00:00,  1.32it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 554, 17
LR fn, tp: 0, 17
LR f1 score: 0.667
LR cohens kappa score: 0.653
LR average precision score: 1.000

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 564, 7
KNN fn, tp: 0, 17
KNN f1 score: 0.829
KNN cohens kappa score: 0.823


------ Step 4/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.25it/s]
 20%|██        | 2/10 [00:01<00:06,  1.24it/s]
 30%|███       | 3/10 [00:02<00:05,  1.18it/s]
 40%|████      | 4/10 [00:03<00:05,  1.01it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.01it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.08it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.14it/s]
 80%|████████  | 8/10 [00:07<00:01,  1.05it/s]
 90%|█████████ | 9/10 [00:08<00:00,  1.10it/s]
100%|██████████| 10/10 [00:09<00:00,  1.14it/s]
100%|██████████| 10/10 [00:09<00:00,  1.11it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 561, 10
LR fn, tp: 0, 17
LR f1 score: 0.773
LR cohens kappa score: 0.764
LR average precision score: 0.990

-> test with 'GB'
GB tn, fp: 569, 2
GB fn, tp: 0, 17
GB f1 score: 0.944
GB cohens kappa score: 0.943

-> test with 'KNN'
KNN tn, fp: 567, 4
KNN fn, tp: 0, 17
KNN f1 score: 0.895
KNN cohens kappa score: 0.891


------ Step 4/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.07it/s]
 20%|██        | 2/10 [00:01<00:06,  1.15it/s]
 30%|███       | 3/10 [00:02<00:06,  1.11it/s]
 40%|████      | 4/10 [00:03<00:04,  1.22it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.19it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.13it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.13it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.19it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.22it/s]
100%|██████████| 10/10 [00:08<00:00,  1.24it/s]
100%|██████████| 10/10 [00:08<00:00,  1.19it/s]
-> create 2216 synthetic samples
-> test with 'LR'
LR tn, fp: 558, 12
LR fn, tp: 0, 13
LR f1 score: 0.684
LR cohens kappa score: 0.675
LR average precision score: 0.995

-> test with 'GB'
GB tn, fp: 570, 0
GB fn, tp: 0, 13
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 567, 3
KNN fn, tp: 0, 13
KNN f1 score: 0.897
KNN cohens kappa score: 0.894


====== Step 5/5 =======
-> Shuffling data
-> Spliting data to slices

------ Step 5/5: Slice 1/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:08,  1.05it/s]
 20%|██        | 2/10 [00:01<00:07,  1.00it/s]
 30%|███       | 3/10 [00:02<00:06,  1.06it/s]
 40%|████      | 4/10 [00:03<00:05,  1.17it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.15it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.21it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.25it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.25it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.28it/s]
100%|██████████| 10/10 [00:08<00:00,  1.23it/s]
100%|██████████| 10/10 [00:08<00:00,  1.19it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 556, 15
LR fn, tp: 0, 17
LR f1 score: 0.694
LR cohens kappa score: 0.682
LR average precision score: 1.000

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 560, 11
KNN fn, tp: 1, 16
KNN f1 score: 0.727
KNN cohens kappa score: 0.717


------ Step 5/5: Slice 2/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.27it/s]
 20%|██        | 2/10 [00:01<00:06,  1.30it/s]
 30%|███       | 3/10 [00:02<00:05,  1.22it/s]
 40%|████      | 4/10 [00:03<00:04,  1.24it/s]
 50%|█████     | 5/10 [00:03<00:03,  1.25it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.21it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.23it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.17it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.18it/s]
100%|██████████| 10/10 [00:08<00:00,  1.14it/s]
100%|██████████| 10/10 [00:08<00:00,  1.19it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 566, 5
LR fn, tp: 0, 17
LR f1 score: 0.872
LR cohens kappa score: 0.867
LR average precision score: 0.975

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 564, 7
KNN fn, tp: 1, 16
KNN f1 score: 0.800
KNN cohens kappa score: 0.793


------ Step 5/5: Slice 3/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.25it/s]
 20%|██        | 2/10 [00:01<00:06,  1.18it/s]
 30%|███       | 3/10 [00:02<00:05,  1.21it/s]
 40%|████      | 4/10 [00:03<00:04,  1.21it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.24it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.25it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.27it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.30it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.32it/s]
100%|██████████| 10/10 [00:07<00:00,  1.35it/s]
100%|██████████| 10/10 [00:07<00:00,  1.28it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 550, 21
LR fn, tp: 0, 17
LR f1 score: 0.618
LR cohens kappa score: 0.602
LR average precision score: 1.000

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 562, 9
KNN fn, tp: 0, 17
KNN f1 score: 0.791
KNN cohens kappa score: 0.783


------ Step 5/5: Slice 4/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:07,  1.21it/s]
 20%|██        | 2/10 [00:01<00:07,  1.11it/s]
 30%|███       | 3/10 [00:02<00:06,  1.09it/s]
 40%|████      | 4/10 [00:03<00:05,  1.10it/s]
 50%|█████     | 5/10 [00:04<00:04,  1.15it/s]
 60%|██████    | 6/10 [00:05<00:03,  1.17it/s]
 70%|███████   | 7/10 [00:06<00:02,  1.18it/s]
 80%|████████  | 8/10 [00:07<00:01,  1.12it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.17it/s]
100%|██████████| 10/10 [00:08<00:00,  1.17it/s]
100%|██████████| 10/10 [00:08<00:00,  1.15it/s]
-> create 2219 synthetic samples
-> test with 'LR'
LR tn, fp: 556, 15
LR fn, tp: 0, 17
LR f1 score: 0.694
LR cohens kappa score: 0.682
LR average precision score: 0.990

-> test with 'GB'
GB tn, fp: 571, 0
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 563, 8
KNN fn, tp: 0, 17
KNN f1 score: 0.810
KNN cohens kappa score: 0.803


------ Step 5/5: Slice 5/5 -------
-> Reset the GAN
-> Train generator for synthetic samples

  0%|          | 0/10 [00:00<?, ?it/s]
 10%|█         | 1/10 [00:00<00:06,  1.29it/s]
 20%|██        | 2/10 [00:01<00:06,  1.15it/s]
 30%|███       | 3/10 [00:02<00:06,  1.16it/s]
 40%|████      | 4/10 [00:03<00:04,  1.22it/s]
 50%|█████     | 5/10 [00:04<00:03,  1.27it/s]
 60%|██████    | 6/10 [00:04<00:03,  1.23it/s]
 70%|███████   | 7/10 [00:05<00:02,  1.20it/s]
 80%|████████  | 8/10 [00:06<00:01,  1.23it/s]
 90%|█████████ | 9/10 [00:07<00:00,  1.21it/s]
100%|██████████| 10/10 [00:08<00:00,  1.26it/s]
100%|██████████| 10/10 [00:08<00:00,  1.23it/s]
-> create 2216 synthetic samples
-> test with 'LR'
LR tn, fp: 556, 14
LR fn, tp: 0, 13
LR f1 score: 0.650
LR cohens kappa score: 0.639
LR average precision score: 1.000

-> test with 'GB'
GB tn, fp: 570, 0
GB fn, tp: 0, 13
GB f1 score: 1.000
GB cohens kappa score: 1.000

-> test with 'KNN'
KNN tn, fp: 564, 6
KNN fn, tp: 0, 13
KNN f1 score: 0.813
KNN cohens kappa score: 0.807

### Exercise is done.

-----[ LR ]-----
maximum:
LR tn, fp: 566, 21
LR fn, tp: 1, 17
LR f1 score: 0.872
LR cohens kappa score: 0.867
LR average precision score: 1.000


average:
LR tn, fp: 556.76, 14.04
LR fn, tp: 0.04, 16.16
LR f1 score: 0.702
LR cohens kappa score: 0.691
LR average precision score: 0.992


minimum:
LR tn, fp: 550, 5
LR fn, tp: 0, 13
LR f1 score: 0.618
LR cohens kappa score: 0.602
LR average precision score: 0.975


-----[ GB ]-----
maximum:
GB tn, fp: 571, 2
GB fn, tp: 0, 17
GB f1 score: 1.000
GB cohens kappa score: 1.000


average:
GB tn, fp: 570.64, 0.16
GB fn, tp: 0.0, 16.2
GB f1 score: 0.995
GB cohens kappa score: 0.995


minimum:
GB tn, fp: 568, 0
GB fn, tp: 0, 13
GB f1 score: 0.929
GB cohens kappa score: 0.927


-----[ KNN ]-----
maximum:
KNN tn, fp: 568, 14
KNN fn, tp: 3, 17
KNN f1 score: 0.919
KNN cohens kappa score: 0.916


average:
KNN tn, fp: 563.88, 6.92
KNN fn, tp: 0.36, 15.84
KNN f1 score: 0.816
KNN cohens kappa score: 0.810


minimum:
KNN tn, fp: 557, 3
KNN fn, tp: 0, 13
KNN f1 score: 0.708
KNN cohens kappa score: 0.697