folding_car-vgood.log 30 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726
  1. ///////////////////////////////////////////
  2. // Running CTAB-GAN on folding_car-vgood
  3. ///////////////////////////////////////////
  4. Load 'data_input/folding_car-vgood'
  5. from pickle file
  6. Data loaded.
  7. -> Shuffling data
  8. ### Start exercise for synthetic point generator
  9. ====== Step 1/5 =======
  10. -> Shuffling data
  11. -> Spliting data to slices
  12. ------ Step 1/5: Slice 1/5 -------
  13. -> Reset the GAN
  14. -> Train generator for synthetic samples
  15. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.08it/s] 20%|██ | 2/10 [00:01<00:06, 1.17it/s] 30%|███ | 3/10 [00:02<00:05, 1.21it/s] 40%|████ | 4/10 [00:03<00:04, 1.28it/s] 50%|█████ | 5/10 [00:04<00:03, 1.27it/s] 60%|██████ | 6/10 [00:04<00:03, 1.26it/s] 70%|███████ | 7/10 [00:05<00:02, 1.25it/s] 80%|████████ | 8/10 [00:06<00:01, 1.26it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.26it/s] 100%|██████████| 10/10 [00:08<00:00, 1.26it/s] 100%|██████████| 10/10 [00:08<00:00, 1.25it/s]
  16. -> create 1278 synthetic samples
  17. -> test with 'LR'
  18. LR tn, fp: 295, 38
  19. LR fn, tp: 0, 13
  20. LR f1 score: 0.406
  21. LR cohens kappa score: 0.368
  22. LR average precision score: 0.325
  23. -> test with 'GB'
  24. GB tn, fp: 333, 0
  25. GB fn, tp: 0, 13
  26. GB f1 score: 1.000
  27. GB cohens kappa score: 1.000
  28. -> test with 'KNN'
  29. KNN tn, fp: 321, 12
  30. KNN fn, tp: 0, 13
  31. KNN f1 score: 0.684
  32. KNN cohens kappa score: 0.668
  33. ------ Step 1/5: Slice 2/5 -------
  34. -> Reset the GAN
  35. -> Train generator for synthetic samples
  36. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.11it/s] 20%|██ | 2/10 [00:01<00:06, 1.27it/s] 30%|███ | 3/10 [00:02<00:05, 1.36it/s] 40%|████ | 4/10 [00:02<00:04, 1.39it/s] 50%|█████ | 5/10 [00:03<00:03, 1.39it/s] 60%|██████ | 6/10 [00:04<00:02, 1.43it/s] 70%|███████ | 7/10 [00:05<00:02, 1.35it/s] 80%|████████ | 8/10 [00:06<00:01, 1.23it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.21it/s] 100%|██████████| 10/10 [00:07<00:00, 1.15it/s] 100%|██████████| 10/10 [00:07<00:00, 1.25it/s]
  37. -> create 1278 synthetic samples
  38. -> test with 'LR'
  39. LR tn, fp: 286, 47
  40. LR fn, tp: 2, 11
  41. LR f1 score: 0.310
  42. LR cohens kappa score: 0.265
  43. LR average precision score: 0.294
  44. -> test with 'GB'
  45. GB tn, fp: 333, 0
  46. GB fn, tp: 0, 13
  47. GB f1 score: 1.000
  48. GB cohens kappa score: 1.000
  49. -> test with 'KNN'
  50. KNN tn, fp: 314, 19
  51. KNN fn, tp: 0, 13
  52. KNN f1 score: 0.578
  53. KNN cohens kappa score: 0.554
  54. ------ Step 1/5: Slice 3/5 -------
  55. -> Reset the GAN
  56. -> Train generator for synthetic samples
  57. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:01<00:09, 1.02s/it] 20%|██ | 2/10 [00:01<00:07, 1.13it/s] 30%|███ | 3/10 [00:02<00:06, 1.10it/s] 40%|████ | 4/10 [00:03<00:05, 1.19it/s] 50%|█████ | 5/10 [00:04<00:04, 1.17it/s] 60%|██████ | 6/10 [00:05<00:03, 1.14it/s] 70%|███████ | 7/10 [00:06<00:02, 1.20it/s] 80%|████████ | 8/10 [00:06<00:01, 1.15it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.22it/s] 100%|██████████| 10/10 [00:08<00:00, 1.24it/s] 100%|██████████| 10/10 [00:08<00:00, 1.18it/s]
  58. -> create 1278 synthetic samples
  59. -> test with 'LR'
  60. LR tn, fp: 276, 57
  61. LR fn, tp: 0, 13
  62. LR f1 score: 0.313
  63. LR cohens kappa score: 0.267
  64. LR average precision score: 0.378
  65. -> test with 'GB'
  66. GB tn, fp: 333, 0
  67. GB fn, tp: 1, 12
  68. GB f1 score: 0.960
  69. GB cohens kappa score: 0.959
  70. -> test with 'KNN'
  71. KNN tn, fp: 323, 10
  72. KNN fn, tp: 0, 13
  73. KNN f1 score: 0.722
  74. KNN cohens kappa score: 0.708
  75. ------ Step 1/5: Slice 4/5 -------
  76. -> Reset the GAN
  77. -> Train generator for synthetic samples
  78. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:06, 1.32it/s] 20%|██ | 2/10 [00:01<00:05, 1.35it/s] 30%|███ | 3/10 [00:02<00:04, 1.45it/s] 40%|████ | 4/10 [00:02<00:04, 1.47it/s] 50%|█████ | 5/10 [00:03<00:03, 1.48it/s] 60%|██████ | 6/10 [00:04<00:02, 1.39it/s] 70%|███████ | 7/10 [00:05<00:02, 1.34it/s] 80%|████████ | 8/10 [00:05<00:01, 1.33it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.30it/s] 100%|██████████| 10/10 [00:07<00:00, 1.36it/s] 100%|██████████| 10/10 [00:07<00:00, 1.37it/s]
  79. -> create 1278 synthetic samples
  80. -> test with 'LR'
  81. LR tn, fp: 284, 49
  82. LR fn, tp: 0, 13
  83. LR f1 score: 0.347
  84. LR cohens kappa score: 0.303
  85. LR average precision score: 0.394
  86. -> test with 'GB'
  87. GB tn, fp: 333, 0
  88. GB fn, tp: 0, 13
  89. GB f1 score: 1.000
  90. GB cohens kappa score: 1.000
  91. -> test with 'KNN'
  92. KNN tn, fp: 315, 18
  93. KNN fn, tp: 1, 12
  94. KNN f1 score: 0.558
  95. KNN cohens kappa score: 0.534
  96. ------ Step 1/5: Slice 5/5 -------
  97. -> Reset the GAN
  98. -> Train generator for synthetic samples
  99. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.12it/s] 20%|██ | 2/10 [00:01<00:06, 1.28it/s] 30%|███ | 3/10 [00:02<00:05, 1.33it/s] 40%|████ | 4/10 [00:03<00:04, 1.32it/s] 50%|█████ | 5/10 [00:03<00:03, 1.38it/s] 60%|██████ | 6/10 [00:04<00:02, 1.39it/s] 70%|███████ | 7/10 [00:05<00:02, 1.39it/s] 80%|████████ | 8/10 [00:05<00:01, 1.39it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.38it/s] 100%|██████████| 10/10 [00:07<00:00, 1.37it/s] 100%|██████████| 10/10 [00:07<00:00, 1.36it/s]
  100. -> create 1280 synthetic samples
  101. -> test with 'LR'
  102. LR tn, fp: 286, 45
  103. LR fn, tp: 0, 13
  104. LR f1 score: 0.366
  105. LR cohens kappa score: 0.324
  106. LR average precision score: 0.388
  107. -> test with 'GB'
  108. GB tn, fp: 329, 2
  109. GB fn, tp: 0, 13
  110. GB f1 score: 0.929
  111. GB cohens kappa score: 0.926
  112. -> test with 'KNN'
  113. KNN tn, fp: 322, 9
  114. KNN fn, tp: 0, 13
  115. KNN f1 score: 0.743
  116. KNN cohens kappa score: 0.730
  117. ====== Step 2/5 =======
  118. -> Shuffling data
  119. -> Spliting data to slices
  120. ------ Step 2/5: Slice 1/5 -------
  121. -> Reset the GAN
  122. -> Train generator for synthetic samples
  123. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.17it/s] 20%|██ | 2/10 [00:01<00:06, 1.30it/s] 30%|███ | 3/10 [00:02<00:05, 1.33it/s] 40%|████ | 4/10 [00:03<00:04, 1.33it/s] 50%|█████ | 5/10 [00:03<00:03, 1.27it/s] 60%|██████ | 6/10 [00:04<00:03, 1.27it/s] 70%|███████ | 7/10 [00:05<00:02, 1.16it/s] 80%|████████ | 8/10 [00:06<00:01, 1.18it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.23it/s] 100%|██████████| 10/10 [00:08<00:00, 1.16it/s] 100%|██████████| 10/10 [00:08<00:00, 1.22it/s]
  124. -> create 1278 synthetic samples
  125. -> test with 'LR'
  126. LR tn, fp: 316, 17
  127. LR fn, tp: 8, 5
  128. LR f1 score: 0.286
  129. LR cohens kappa score: 0.250
  130. LR average precision score: 0.286
  131. -> test with 'GB'
  132. GB tn, fp: 332, 1
  133. GB fn, tp: 0, 13
  134. GB f1 score: 0.963
  135. GB cohens kappa score: 0.961
  136. -> test with 'KNN'
  137. KNN tn, fp: 309, 24
  138. KNN fn, tp: 0, 13
  139. KNN f1 score: 0.520
  140. KNN cohens kappa score: 0.492
  141. ------ Step 2/5: Slice 2/5 -------
  142. -> Reset the GAN
  143. -> Train generator for synthetic samples
  144. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.22it/s] 20%|██ | 2/10 [00:01<00:05, 1.42it/s] 30%|███ | 3/10 [00:02<00:04, 1.42it/s] 40%|████ | 4/10 [00:03<00:04, 1.30it/s] 50%|█████ | 5/10 [00:03<00:03, 1.26it/s] 60%|██████ | 6/10 [00:04<00:03, 1.24it/s] 70%|███████ | 7/10 [00:05<00:02, 1.20it/s] 80%|████████ | 8/10 [00:06<00:01, 1.19it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.22it/s] 100%|██████████| 10/10 [00:07<00:00, 1.25it/s] 100%|██████████| 10/10 [00:07<00:00, 1.26it/s]
  145. -> create 1278 synthetic samples
  146. -> test with 'LR'
  147. LR tn, fp: 272, 61
  148. LR fn, tp: 0, 13
  149. LR f1 score: 0.299
  150. LR cohens kappa score: 0.251
  151. LR average precision score: 0.397
  152. -> test with 'GB'
  153. GB tn, fp: 333, 0
  154. GB fn, tp: 0, 13
  155. GB f1 score: 1.000
  156. GB cohens kappa score: 1.000
  157. -> test with 'KNN'
  158. KNN tn, fp: 316, 17
  159. KNN fn, tp: 3, 10
  160. KNN f1 score: 0.500
  161. KNN cohens kappa score: 0.473
  162. ------ Step 2/5: Slice 3/5 -------
  163. -> Reset the GAN
  164. -> Train generator for synthetic samples
  165. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.11it/s] 20%|██ | 2/10 [00:01<00:06, 1.21it/s] 30%|███ | 3/10 [00:02<00:05, 1.18it/s] 40%|████ | 4/10 [00:03<00:04, 1.22it/s] 50%|█████ | 5/10 [00:04<00:04, 1.24it/s] 60%|██████ | 6/10 [00:04<00:03, 1.23it/s] 70%|███████ | 7/10 [00:05<00:02, 1.25it/s] 80%|████████ | 8/10 [00:06<00:01, 1.27it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.25it/s] 100%|██████████| 10/10 [00:08<00:00, 1.22it/s] 100%|██████████| 10/10 [00:08<00:00, 1.23it/s]
  166. -> create 1278 synthetic samples
  167. -> test with 'LR'
  168. LR tn, fp: 291, 42
  169. LR fn, tp: 1, 12
  170. LR f1 score: 0.358
  171. LR cohens kappa score: 0.317
  172. LR average precision score: 0.355
  173. -> test with 'GB'
  174. GB tn, fp: 332, 1
  175. GB fn, tp: 0, 13
  176. GB f1 score: 0.963
  177. GB cohens kappa score: 0.961
  178. -> test with 'KNN'
  179. KNN tn, fp: 321, 12
  180. KNN fn, tp: 0, 13
  181. KNN f1 score: 0.684
  182. KNN cohens kappa score: 0.668
  183. ------ Step 2/5: Slice 4/5 -------
  184. -> Reset the GAN
  185. -> Train generator for synthetic samples
  186. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.12it/s] 20%|██ | 2/10 [00:01<00:06, 1.21it/s] 30%|███ | 3/10 [00:02<00:06, 1.11it/s] 40%|████ | 4/10 [00:03<00:05, 1.07it/s] 50%|█████ | 5/10 [00:04<00:04, 1.11it/s] 60%|██████ | 6/10 [00:05<00:03, 1.18it/s] 70%|███████ | 7/10 [00:06<00:02, 1.21it/s] 80%|████████ | 8/10 [00:06<00:01, 1.18it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.12it/s] 100%|██████████| 10/10 [00:08<00:00, 1.14it/s] 100%|██████████| 10/10 [00:08<00:00, 1.14it/s]
  187. -> create 1278 synthetic samples
  188. -> test with 'LR'
  189. LR tn, fp: 318, 15
  190. LR fn, tp: 7, 6
  191. LR f1 score: 0.353
  192. LR cohens kappa score: 0.321
  193. LR average precision score: 0.355
  194. -> test with 'GB'
  195. GB tn, fp: 333, 0
  196. GB fn, tp: 1, 12
  197. GB f1 score: 0.960
  198. GB cohens kappa score: 0.959
  199. -> test with 'KNN'
  200. KNN tn, fp: 321, 12
  201. KNN fn, tp: 0, 13
  202. KNN f1 score: 0.684
  203. KNN cohens kappa score: 0.668
  204. ------ Step 2/5: Slice 5/5 -------
  205. -> Reset the GAN
  206. -> Train generator for synthetic samples
  207. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.05it/s] 20%|██ | 2/10 [00:01<00:06, 1.15it/s] 30%|███ | 3/10 [00:02<00:05, 1.21it/s] 40%|████ | 4/10 [00:03<00:04, 1.24it/s] 50%|█████ | 5/10 [00:04<00:04, 1.17it/s] 60%|██████ | 6/10 [00:05<00:03, 1.18it/s] 70%|███████ | 7/10 [00:06<00:02, 1.09it/s] 80%|████████ | 8/10 [00:07<00:01, 1.10it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.18it/s] 100%|██████████| 10/10 [00:08<00:00, 1.23it/s] 100%|██████████| 10/10 [00:08<00:00, 1.18it/s]
  208. -> create 1280 synthetic samples
  209. -> test with 'LR'
  210. LR tn, fp: 319, 12
  211. LR fn, tp: 4, 9
  212. LR f1 score: 0.529
  213. LR cohens kappa score: 0.506
  214. LR average precision score: 0.433
  215. -> test with 'GB'
  216. GB tn, fp: 331, 0
  217. GB fn, tp: 0, 13
  218. GB f1 score: 1.000
  219. GB cohens kappa score: 1.000
  220. -> test with 'KNN'
  221. KNN tn, fp: 326, 5
  222. KNN fn, tp: 6, 7
  223. KNN f1 score: 0.560
  224. KNN cohens kappa score: 0.543
  225. ====== Step 3/5 =======
  226. -> Shuffling data
  227. -> Spliting data to slices
  228. ------ Step 3/5: Slice 1/5 -------
  229. -> Reset the GAN
  230. -> Train generator for synthetic samples
  231. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.15it/s] 20%|██ | 2/10 [00:01<00:06, 1.31it/s] 30%|███ | 3/10 [00:02<00:05, 1.22it/s] 40%|████ | 4/10 [00:03<00:04, 1.27it/s] 50%|█████ | 5/10 [00:03<00:03, 1.29it/s] 60%|██████ | 6/10 [00:04<00:03, 1.27it/s] 70%|███████ | 7/10 [00:05<00:02, 1.20it/s] 80%|████████ | 8/10 [00:06<00:01, 1.19it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.21it/s] 100%|██████████| 10/10 [00:08<00:00, 1.16it/s] 100%|██████████| 10/10 [00:08<00:00, 1.21it/s]
  232. -> create 1278 synthetic samples
  233. -> test with 'LR'
  234. LR tn, fp: 302, 31
  235. LR fn, tp: 1, 12
  236. LR f1 score: 0.429
  237. LR cohens kappa score: 0.394
  238. LR average precision score: 0.291
  239. -> test with 'GB'
  240. GB tn, fp: 333, 0
  241. GB fn, tp: 2, 11
  242. GB f1 score: 0.917
  243. GB cohens kappa score: 0.914
  244. -> test with 'KNN'
  245. KNN tn, fp: 321, 12
  246. KNN fn, tp: 0, 13
  247. KNN f1 score: 0.684
  248. KNN cohens kappa score: 0.668
  249. ------ Step 3/5: Slice 2/5 -------
  250. -> Reset the GAN
  251. -> Train generator for synthetic samples
  252. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.10it/s] 20%|██ | 2/10 [00:01<00:06, 1.33it/s] 30%|███ | 3/10 [00:02<00:04, 1.40it/s] 40%|████ | 4/10 [00:03<00:05, 1.17it/s] 50%|█████ | 5/10 [00:04<00:04, 1.17it/s] 60%|██████ | 6/10 [00:05<00:03, 1.15it/s] 70%|███████ | 7/10 [00:05<00:02, 1.24it/s] 80%|████████ | 8/10 [00:06<00:01, 1.27it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.24it/s] 100%|██████████| 10/10 [00:08<00:00, 1.25it/s] 100%|██████████| 10/10 [00:08<00:00, 1.24it/s]
  253. -> create 1278 synthetic samples
  254. -> test with 'LR'
  255. LR tn, fp: 298, 35
  256. LR fn, tp: 0, 13
  257. LR f1 score: 0.426
  258. LR cohens kappa score: 0.390
  259. LR average precision score: 0.446
  260. -> test with 'GB'
  261. GB tn, fp: 331, 2
  262. GB fn, tp: 0, 13
  263. GB f1 score: 0.929
  264. GB cohens kappa score: 0.926
  265. -> test with 'KNN'
  266. KNN tn, fp: 321, 12
  267. KNN fn, tp: 0, 13
  268. KNN f1 score: 0.684
  269. KNN cohens kappa score: 0.668
  270. ------ Step 3/5: Slice 3/5 -------
  271. -> Reset the GAN
  272. -> Train generator for synthetic samples
  273. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.02it/s] 20%|██ | 2/10 [00:01<00:06, 1.16it/s] 30%|███ | 3/10 [00:02<00:05, 1.23it/s] 40%|████ | 4/10 [00:03<00:04, 1.21it/s] 50%|█████ | 5/10 [00:04<00:04, 1.18it/s] 60%|██████ | 6/10 [00:04<00:03, 1.25it/s] 70%|███████ | 7/10 [00:05<00:02, 1.28it/s] 80%|████████ | 8/10 [00:06<00:01, 1.35it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.41it/s] 100%|██████████| 10/10 [00:07<00:00, 1.41it/s] 100%|██████████| 10/10 [00:07<00:00, 1.30it/s]
  274. -> create 1278 synthetic samples
  275. -> test with 'LR'
  276. LR tn, fp: 316, 17
  277. LR fn, tp: 6, 7
  278. LR f1 score: 0.378
  279. LR cohens kappa score: 0.347
  280. LR average precision score: 0.329
  281. -> test with 'GB'
  282. GB tn, fp: 331, 2
  283. GB fn, tp: 0, 13
  284. GB f1 score: 0.929
  285. GB cohens kappa score: 0.926
  286. -> test with 'KNN'
  287. KNN tn, fp: 307, 26
  288. KNN fn, tp: 0, 13
  289. KNN f1 score: 0.500
  290. KNN cohens kappa score: 0.470
  291. ------ Step 3/5: Slice 4/5 -------
  292. -> Reset the GAN
  293. -> Train generator for synthetic samples
  294. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:06, 1.36it/s] 20%|██ | 2/10 [00:01<00:05, 1.36it/s] 30%|███ | 3/10 [00:02<00:05, 1.32it/s] 40%|████ | 4/10 [00:03<00:04, 1.32it/s] 50%|█████ | 5/10 [00:03<00:03, 1.30it/s] 60%|██████ | 6/10 [00:04<00:03, 1.33it/s] 70%|███████ | 7/10 [00:05<00:02, 1.27it/s] 80%|████████ | 8/10 [00:06<00:01, 1.25it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.12it/s] 100%|██████████| 10/10 [00:07<00:00, 1.21it/s] 100%|██████████| 10/10 [00:07<00:00, 1.25it/s]
  295. -> create 1278 synthetic samples
  296. -> test with 'LR'
  297. LR tn, fp: 291, 42
  298. LR fn, tp: 0, 13
  299. LR f1 score: 0.382
  300. LR cohens kappa score: 0.342
  301. LR average precision score: 0.390
  302. -> test with 'GB'
  303. GB tn, fp: 333, 0
  304. GB fn, tp: 0, 13
  305. GB f1 score: 1.000
  306. GB cohens kappa score: 1.000
  307. -> test with 'KNN'
  308. KNN tn, fp: 323, 10
  309. KNN fn, tp: 0, 13
  310. KNN f1 score: 0.722
  311. KNN cohens kappa score: 0.708
  312. ------ Step 3/5: Slice 5/5 -------
  313. -> Reset the GAN
  314. -> Train generator for synthetic samples
  315. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.08it/s] 20%|██ | 2/10 [00:01<00:06, 1.30it/s] 30%|███ | 3/10 [00:02<00:05, 1.33it/s] 40%|████ | 4/10 [00:03<00:04, 1.33it/s] 50%|█████ | 5/10 [00:04<00:04, 1.21it/s] 60%|██████ | 6/10 [00:04<00:03, 1.23it/s] 70%|███████ | 7/10 [00:05<00:02, 1.22it/s] 80%|████████ | 8/10 [00:06<00:01, 1.25it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.24it/s] 100%|██████████| 10/10 [00:08<00:00, 1.18it/s] 100%|██████████| 10/10 [00:08<00:00, 1.23it/s]
  316. -> create 1280 synthetic samples
  317. -> test with 'LR'
  318. LR tn, fp: 275, 56
  319. LR fn, tp: 0, 13
  320. LR f1 score: 0.317
  321. LR cohens kappa score: 0.271
  322. LR average precision score: 0.429
  323. -> test with 'GB'
  324. GB tn, fp: 331, 0
  325. GB fn, tp: 0, 13
  326. GB f1 score: 1.000
  327. GB cohens kappa score: 1.000
  328. -> test with 'KNN'
  329. KNN tn, fp: 323, 8
  330. KNN fn, tp: 0, 13
  331. KNN f1 score: 0.765
  332. KNN cohens kappa score: 0.753
  333. ====== Step 4/5 =======
  334. -> Shuffling data
  335. -> Spliting data to slices
  336. ------ Step 4/5: Slice 1/5 -------
  337. -> Reset the GAN
  338. -> Train generator for synthetic samples
  339. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.21it/s] 20%|██ | 2/10 [00:01<00:06, 1.23it/s] 30%|███ | 3/10 [00:02<00:05, 1.23it/s] 40%|████ | 4/10 [00:03<00:04, 1.25it/s] 50%|█████ | 5/10 [00:03<00:03, 1.27it/s] 60%|██████ | 6/10 [00:04<00:03, 1.32it/s] 70%|███████ | 7/10 [00:05<00:02, 1.34it/s] 80%|████████ | 8/10 [00:06<00:01, 1.31it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.33it/s] 100%|██████████| 10/10 [00:07<00:00, 1.24it/s] 100%|██████████| 10/10 [00:07<00:00, 1.27it/s]
  340. -> create 1278 synthetic samples
  341. -> test with 'LR'
  342. LR tn, fp: 318, 15
  343. LR fn, tp: 5, 8
  344. LR f1 score: 0.444
  345. LR cohens kappa score: 0.416
  346. LR average precision score: 0.386
  347. -> test with 'GB'
  348. GB tn, fp: 333, 0
  349. GB fn, tp: 0, 13
  350. GB f1 score: 1.000
  351. GB cohens kappa score: 1.000
  352. -> test with 'KNN'
  353. KNN tn, fp: 319, 14
  354. KNN fn, tp: 0, 13
  355. KNN f1 score: 0.650
  356. KNN cohens kappa score: 0.631
  357. ------ Step 4/5: Slice 2/5 -------
  358. -> Reset the GAN
  359. -> Train generator for synthetic samples
  360. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:06, 1.33it/s] 20%|██ | 2/10 [00:01<00:05, 1.44it/s] 30%|███ | 3/10 [00:02<00:05, 1.34it/s] 40%|████ | 4/10 [00:02<00:04, 1.33it/s] 50%|█████ | 5/10 [00:03<00:03, 1.29it/s] 60%|██████ | 6/10 [00:04<00:03, 1.22it/s] 70%|███████ | 7/10 [00:05<00:02, 1.24it/s] 80%|████████ | 8/10 [00:06<00:01, 1.26it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.32it/s] 100%|██████████| 10/10 [00:07<00:00, 1.34it/s] 100%|██████████| 10/10 [00:07<00:00, 1.31it/s]
  361. -> create 1278 synthetic samples
  362. -> test with 'LR'
  363. LR tn, fp: 288, 45
  364. LR fn, tp: 0, 13
  365. LR f1 score: 0.366
  366. LR cohens kappa score: 0.325
  367. LR average precision score: 0.386
  368. -> test with 'GB'
  369. GB tn, fp: 333, 0
  370. GB fn, tp: 1, 12
  371. GB f1 score: 0.960
  372. GB cohens kappa score: 0.959
  373. -> test with 'KNN'
  374. KNN tn, fp: 320, 13
  375. KNN fn, tp: 3, 10
  376. KNN f1 score: 0.556
  377. KNN cohens kappa score: 0.533
  378. ------ Step 4/5: Slice 3/5 -------
  379. -> Reset the GAN
  380. -> Train generator for synthetic samples
  381. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.19it/s] 20%|██ | 2/10 [00:01<00:06, 1.17it/s] 30%|███ | 3/10 [00:02<00:05, 1.22it/s] 40%|████ | 4/10 [00:03<00:04, 1.24it/s] 50%|█████ | 5/10 [00:04<00:03, 1.28it/s] 60%|██████ | 6/10 [00:04<00:03, 1.30it/s] 70%|███████ | 7/10 [00:05<00:02, 1.37it/s] 80%|████████ | 8/10 [00:06<00:01, 1.40it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.41it/s] 100%|██████████| 10/10 [00:07<00:00, 1.34it/s] 100%|██████████| 10/10 [00:07<00:00, 1.31it/s]
  382. -> create 1278 synthetic samples
  383. -> test with 'LR'
  384. LR tn, fp: 275, 58
  385. LR fn, tp: 0, 13
  386. LR f1 score: 0.310
  387. LR cohens kappa score: 0.263
  388. LR average precision score: 0.316
  389. -> test with 'GB'
  390. GB tn, fp: 333, 0
  391. GB fn, tp: 0, 13
  392. GB f1 score: 1.000
  393. GB cohens kappa score: 1.000
  394. -> test with 'KNN'
  395. KNN tn, fp: 326, 7
  396. KNN fn, tp: 0, 13
  397. KNN f1 score: 0.788
  398. KNN cohens kappa score: 0.778
  399. ------ Step 4/5: Slice 4/5 -------
  400. -> Reset the GAN
  401. -> Train generator for synthetic samples
  402. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.16it/s] 20%|██ | 2/10 [00:01<00:06, 1.15it/s] 30%|███ | 3/10 [00:02<00:05, 1.25it/s] 40%|████ | 4/10 [00:03<00:04, 1.30it/s] 50%|█████ | 5/10 [00:03<00:03, 1.32it/s] 60%|██████ | 6/10 [00:04<00:03, 1.31it/s] 70%|███████ | 7/10 [00:05<00:02, 1.30it/s] 80%|████████ | 8/10 [00:06<00:01, 1.23it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.20it/s] 100%|██████████| 10/10 [00:08<00:00, 1.23it/s] 100%|██████████| 10/10 [00:08<00:00, 1.25it/s]
  403. -> create 1278 synthetic samples
  404. -> test with 'LR'
  405. LR tn, fp: 317, 16
  406. LR fn, tp: 7, 6
  407. LR f1 score: 0.343
  408. LR cohens kappa score: 0.310
  409. LR average precision score: 0.288
  410. -> test with 'GB'
  411. GB tn, fp: 332, 1
  412. GB fn, tp: 0, 13
  413. GB f1 score: 0.963
  414. GB cohens kappa score: 0.961
  415. -> test with 'KNN'
  416. KNN tn, fp: 317, 16
  417. KNN fn, tp: 0, 13
  418. KNN f1 score: 0.619
  419. KNN cohens kappa score: 0.598
  420. ------ Step 4/5: Slice 5/5 -------
  421. -> Reset the GAN
  422. -> Train generator for synthetic samples
  423. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.11it/s] 20%|██ | 2/10 [00:01<00:06, 1.26it/s] 30%|███ | 3/10 [00:02<00:05, 1.25it/s] 40%|████ | 4/10 [00:03<00:04, 1.33it/s] 50%|█████ | 5/10 [00:03<00:03, 1.32it/s] 60%|██████ | 6/10 [00:04<00:03, 1.30it/s] 70%|███████ | 7/10 [00:05<00:02, 1.30it/s] 80%|████████ | 8/10 [00:06<00:01, 1.36it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.39it/s] 100%|██████████| 10/10 [00:07<00:00, 1.43it/s] 100%|██████████| 10/10 [00:07<00:00, 1.35it/s]
  424. -> create 1280 synthetic samples
  425. -> test with 'LR'
  426. LR tn, fp: 284, 47
  427. LR fn, tp: 0, 13
  428. LR f1 score: 0.356
  429. LR cohens kappa score: 0.314
  430. LR average precision score: 0.337
  431. -> test with 'GB'
  432. GB tn, fp: 331, 0
  433. GB fn, tp: 0, 13
  434. GB f1 score: 1.000
  435. GB cohens kappa score: 1.000
  436. -> test with 'KNN'
  437. KNN tn, fp: 316, 15
  438. KNN fn, tp: 0, 13
  439. KNN f1 score: 0.634
  440. KNN cohens kappa score: 0.614
  441. ====== Step 5/5 =======
  442. -> Shuffling data
  443. -> Spliting data to slices
  444. ------ Step 5/5: Slice 1/5 -------
  445. -> Reset the GAN
  446. -> Train generator for synthetic samples
  447. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:06, 1.34it/s] 20%|██ | 2/10 [00:01<00:05, 1.39it/s] 30%|███ | 3/10 [00:02<00:05, 1.36it/s] 40%|████ | 4/10 [00:02<00:04, 1.37it/s] 50%|█████ | 5/10 [00:03<00:03, 1.36it/s] 60%|██████ | 6/10 [00:04<00:03, 1.33it/s] 70%|███████ | 7/10 [00:05<00:02, 1.31it/s] 80%|████████ | 8/10 [00:06<00:01, 1.31it/s] 90%|█████████ | 9/10 [00:06<00:00, 1.34it/s] 100%|██████████| 10/10 [00:07<00:00, 1.31it/s] 100%|██████████| 10/10 [00:07<00:00, 1.33it/s]
  448. -> create 1278 synthetic samples
  449. -> test with 'LR'
  450. LR tn, fp: 277, 56
  451. LR fn, tp: 0, 13
  452. LR f1 score: 0.317
  453. LR cohens kappa score: 0.271
  454. LR average precision score: 0.265
  455. -> test with 'GB'
  456. GB tn, fp: 333, 0
  457. GB fn, tp: 0, 13
  458. GB f1 score: 1.000
  459. GB cohens kappa score: 1.000
  460. -> test with 'KNN'
  461. KNN tn, fp: 318, 15
  462. KNN fn, tp: 1, 12
  463. KNN f1 score: 0.600
  464. KNN cohens kappa score: 0.579
  465. ------ Step 5/5: Slice 2/5 -------
  466. -> Reset the GAN
  467. -> Train generator for synthetic samples
  468. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:06, 1.39it/s] 20%|██ | 2/10 [00:01<00:05, 1.41it/s] 30%|███ | 3/10 [00:02<00:05, 1.28it/s] 40%|████ | 4/10 [00:03<00:04, 1.26it/s] 50%|█████ | 5/10 [00:03<00:04, 1.24it/s] 60%|██████ | 6/10 [00:04<00:03, 1.16it/s] 70%|███████ | 7/10 [00:05<00:02, 1.18it/s] 80%|████████ | 8/10 [00:06<00:01, 1.27it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.27it/s] 100%|██████████| 10/10 [00:07<00:00, 1.28it/s] 100%|██████████| 10/10 [00:07<00:00, 1.26it/s]
  469. -> create 1278 synthetic samples
  470. -> test with 'LR'
  471. LR tn, fp: 279, 54
  472. LR fn, tp: 0, 13
  473. LR f1 score: 0.325
  474. LR cohens kappa score: 0.280
  475. LR average precision score: 0.341
  476. -> test with 'GB'
  477. GB tn, fp: 333, 0
  478. GB fn, tp: 0, 13
  479. GB f1 score: 1.000
  480. GB cohens kappa score: 1.000
  481. -> test with 'KNN'
  482. KNN tn, fp: 319, 14
  483. KNN fn, tp: 0, 13
  484. KNN f1 score: 0.650
  485. KNN cohens kappa score: 0.631
  486. ------ Step 5/5: Slice 3/5 -------
  487. -> Reset the GAN
  488. -> Train generator for synthetic samples
  489. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:07, 1.17it/s] 20%|██ | 2/10 [00:01<00:07, 1.03it/s] 30%|███ | 3/10 [00:02<00:06, 1.04it/s] 40%|████ | 4/10 [00:03<00:05, 1.09it/s] 50%|█████ | 5/10 [00:04<00:04, 1.09it/s] 60%|██████ | 6/10 [00:05<00:03, 1.08it/s] 70%|███████ | 7/10 [00:06<00:02, 1.05it/s] 80%|████████ | 8/10 [00:07<00:01, 1.11it/s] 90%|█████████ | 9/10 [00:08<00:00, 1.14it/s] 100%|██████████| 10/10 [00:08<00:00, 1.16it/s] 100%|██████████| 10/10 [00:09<00:00, 1.11it/s]
  490. -> create 1278 synthetic samples
  491. -> test with 'LR'
  492. LR tn, fp: 318, 15
  493. LR fn, tp: 4, 9
  494. LR f1 score: 0.486
  495. LR cohens kappa score: 0.460
  496. LR average precision score: 0.379
  497. -> test with 'GB'
  498. GB tn, fp: 333, 0
  499. GB fn, tp: 1, 12
  500. GB f1 score: 0.960
  501. GB cohens kappa score: 0.959
  502. -> test with 'KNN'
  503. KNN tn, fp: 315, 18
  504. KNN fn, tp: 0, 13
  505. KNN f1 score: 0.591
  506. KNN cohens kappa score: 0.568
  507. ------ Step 5/5: Slice 4/5 -------
  508. -> Reset the GAN
  509. -> Train generator for synthetic samples
  510. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.09it/s] 20%|██ | 2/10 [00:01<00:06, 1.20it/s] 30%|███ | 3/10 [00:02<00:05, 1.25it/s] 40%|████ | 4/10 [00:03<00:04, 1.25it/s] 50%|█████ | 5/10 [00:04<00:04, 1.15it/s] 60%|██████ | 6/10 [00:05<00:03, 1.17it/s] 70%|███████ | 7/10 [00:05<00:02, 1.24it/s] 80%|████████ | 8/10 [00:06<00:01, 1.24it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.32it/s] 100%|██████████| 10/10 [00:07<00:00, 1.33it/s] 100%|██████████| 10/10 [00:07<00:00, 1.25it/s]
  511. -> create 1278 synthetic samples
  512. -> test with 'LR'
  513. LR tn, fp: 277, 56
  514. LR fn, tp: 0, 13
  515. LR f1 score: 0.317
  516. LR cohens kappa score: 0.271
  517. LR average precision score: 0.285
  518. -> test with 'GB'
  519. GB tn, fp: 333, 0
  520. GB fn, tp: 0, 13
  521. GB f1 score: 1.000
  522. GB cohens kappa score: 1.000
  523. -> test with 'KNN'
  524. KNN tn, fp: 301, 32
  525. KNN fn, tp: 0, 13
  526. KNN f1 score: 0.448
  527. KNN cohens kappa score: 0.414
  528. ------ Step 5/5: Slice 5/5 -------
  529. -> Reset the GAN
  530. -> Train generator for synthetic samples
  531. 0%| | 0/10 [00:00<?, ?it/s] 10%|█ | 1/10 [00:00<00:08, 1.06it/s] 20%|██ | 2/10 [00:01<00:07, 1.06it/s] 30%|███ | 3/10 [00:02<00:06, 1.10it/s] 40%|████ | 4/10 [00:03<00:04, 1.21it/s] 50%|█████ | 5/10 [00:04<00:04, 1.23it/s] 60%|██████ | 6/10 [00:04<00:03, 1.29it/s] 70%|███████ | 7/10 [00:05<00:02, 1.24it/s] 80%|████████ | 8/10 [00:06<00:01, 1.28it/s] 90%|█████████ | 9/10 [00:07<00:00, 1.29it/s] 100%|██████████| 10/10 [00:08<00:00, 1.29it/s] 100%|██████████| 10/10 [00:08<00:00, 1.24it/s]
  532. -> create 1280 synthetic samples
  533. -> test with 'LR'
  534. LR tn, fp: 297, 34
  535. LR fn, tp: 1, 12
  536. LR f1 score: 0.407
  537. LR cohens kappa score: 0.370
  538. LR average precision score: 0.463
  539. -> test with 'GB'
  540. GB tn, fp: 329, 2
  541. GB fn, tp: 0, 13
  542. GB f1 score: 0.929
  543. GB cohens kappa score: 0.926
  544. -> test with 'KNN'
  545. KNN tn, fp: 321, 10
  546. KNN fn, tp: 0, 13
  547. KNN f1 score: 0.722
  548. KNN cohens kappa score: 0.708
  549. ### Exercise is done.
  550. -----[ LR ]-----
  551. maximum:
  552. LR tn, fp: 319, 61
  553. LR fn, tp: 8, 13
  554. LR f1 score: 0.529
  555. LR cohens kappa score: 0.506
  556. LR average precision score: 0.463
  557. average:
  558. LR tn, fp: 294.2, 38.4
  559. LR fn, tp: 1.84, 11.16
  560. LR f1 score: 0.367
  561. LR cohens kappa score: 0.328
  562. LR average precision score: 0.357
  563. minimum:
  564. LR tn, fp: 272, 12
  565. LR fn, tp: 0, 5
  566. LR f1 score: 0.286
  567. LR cohens kappa score: 0.250
  568. LR average precision score: 0.265
  569. -----[ GB ]-----
  570. maximum:
  571. GB tn, fp: 333, 2
  572. GB fn, tp: 2, 13
  573. GB f1 score: 1.000
  574. GB cohens kappa score: 1.000
  575. average:
  576. GB tn, fp: 332.16, 0.44
  577. GB fn, tp: 0.24, 12.76
  578. GB f1 score: 0.974
  579. GB cohens kappa score: 0.973
  580. minimum:
  581. GB tn, fp: 329, 0
  582. GB fn, tp: 0, 11
  583. GB f1 score: 0.917
  584. GB cohens kappa score: 0.914
  585. -----[ KNN ]-----
  586. maximum:
  587. KNN tn, fp: 326, 32
  588. KNN fn, tp: 6, 13
  589. KNN f1 score: 0.788
  590. KNN cohens kappa score: 0.778
  591. average:
  592. KNN tn, fp: 318.2, 14.4
  593. KNN fn, tp: 0.56, 12.44
  594. KNN f1 score: 0.634
  595. KNN cohens kappa score: 0.614
  596. minimum:
  597. KNN tn, fp: 301, 5
  598. KNN fn, tp: 0, 7
  599. KNN f1 score: 0.448
  600. KNN cohens kappa score: 0.414