Training...
Epoch 1, CIFAR-10 Batch 1: Loss=3.596191644668579, Validation accuracy=0.11959999799728394
Epoch 1, CIFAR-10 Batch 2: Loss=2.8301358222961426, Validation accuracy=0.19039997458457947
Epoch 1, CIFAR-10 Batch 3: Loss=2.316746234893799, Validation accuracy=0.1947999745607376
Epoch 1, CIFAR-10 Batch 4: Loss=2.066059112548828, Validation accuracy=0.25060001015663147
Epoch 1, CIFAR-10 Batch 5: Loss=1.9852726459503174, Validation accuracy=0.28700000047683716
Epoch 2, CIFAR-10 Batch 1: Loss=1.8860323429107666, Validation accuracy=0.3086000084877014
Epoch 2, CIFAR-10 Batch 2: Loss=1.7972356081008911, Validation accuracy=0.35179999470710754
Epoch 2, CIFAR-10 Batch 3: Loss=1.672827959060669, Validation accuracy=0.3831999897956848
Epoch 2, CIFAR-10 Batch 4: Loss=1.6269925832748413, Validation accuracy=0.4071999788284302
Epoch 2, CIFAR-10 Batch 5: Loss=1.601941704750061, Validation accuracy=0.4253999888896942
Epoch 3, CIFAR-10 Batch 1: Loss=1.5257962942123413, Validation accuracy=0.4479999542236328
Epoch 3, CIFAR-10 Batch 2: Loss=1.4630465507507324, Validation accuracy=0.47919994592666626
Epoch 3, CIFAR-10 Batch 3: Loss=1.3777202367782593, Validation accuracy=0.4859999418258667
Epoch 3, CIFAR-10 Batch 4: Loss=1.320054054260254, Validation accuracy=0.4925999641418457
Epoch 3, CIFAR-10 Batch 5: Loss=1.337393879890442, Validation accuracy=0.5098000168800354
Epoch 4, CIFAR-10 Batch 1: Loss=1.3030941486358643, Validation accuracy=0.5235999226570129
Epoch 4, CIFAR-10 Batch 2: Loss=1.2722676992416382, Validation accuracy=0.5315999388694763
Epoch 4, CIFAR-10 Batch 3: Loss=1.1926805973052979, Validation accuracy=0.5407999753952026
Epoch 4, CIFAR-10 Batch 4: Loss=1.1677989959716797, Validation accuracy=0.5469999313354492
Epoch 4, CIFAR-10 Batch 5: Loss=1.1606148481369019, Validation accuracy=0.559999942779541
Epoch 5, CIFAR-10 Batch 1: Loss=1.1692306995391846, Validation accuracy=0.5679999589920044
Epoch 5, CIFAR-10 Batch 2: Loss=1.1541403532028198, Validation accuracy=0.567599892616272
Epoch 5, CIFAR-10 Batch 3: Loss=1.090762972831726, Validation accuracy=0.5745999813079834
Epoch 5, CIFAR-10 Batch 4: Loss=1.0765011310577393, Validation accuracy=0.5801998972892761
Epoch 5, CIFAR-10 Batch 5: Loss=1.058629035949707, Validation accuracy=0.5921999216079712
Epoch 6, CIFAR-10 Batch 1: Loss=1.075524091720581, Validation accuracy=0.5907999277114868
Epoch 6, CIFAR-10 Batch 2: Loss=1.085533857345581, Validation accuracy=0.5829999446868896
Epoch 6, CIFAR-10 Batch 3: Loss=1.0264976024627686, Validation accuracy=0.5895999073982239
Epoch 6, CIFAR-10 Batch 4: Loss=1.0214204788208008, Validation accuracy=0.5849999189376831
Epoch 6, CIFAR-10 Batch 5: Loss=1.0089836120605469, Validation accuracy=0.5961998701095581
Epoch 7, CIFAR-10 Batch 1: Loss=1.0121253728866577, Validation accuracy=0.6139998435974121
Epoch 7, CIFAR-10 Batch 2: Loss=1.0154056549072266, Validation accuracy=0.6073999404907227
Epoch 7, CIFAR-10 Batch 3: Loss=0.9338960647583008, Validation accuracy=0.6177999377250671
Epoch 7, CIFAR-10 Batch 4: Loss=0.9399778246879578, Validation accuracy=0.6121999621391296
Epoch 7, CIFAR-10 Batch 5: Loss=0.923679769039154, Validation accuracy=0.6155999302864075
Epoch 8, CIFAR-10 Batch 1: Loss=0.9524246454238892, Validation accuracy=0.6209998726844788
Epoch 8, CIFAR-10 Batch 2: Loss=0.9562322497367859, Validation accuracy=0.6229999661445618
Epoch 8, CIFAR-10 Batch 3: Loss=0.883797287940979, Validation accuracy=0.6303998827934265
Epoch 8, CIFAR-10 Batch 4: Loss=0.8960821032524109, Validation accuracy=0.6239998936653137
Epoch 8, CIFAR-10 Batch 5: Loss=0.8720555901527405, Validation accuracy=0.6269999146461487
Epoch 9, CIFAR-10 Batch 1: Loss=0.9022220373153687, Validation accuracy=0.6347999572753906
Epoch 9, CIFAR-10 Batch 2: Loss=0.8946985006332397, Validation accuracy=0.6417998671531677
Epoch 9, CIFAR-10 Batch 3: Loss=0.8571116924285889, Validation accuracy=0.6283999085426331
Epoch 9, CIFAR-10 Batch 4: Loss=0.8470996022224426, Validation accuracy=0.6393998861312866
Epoch 9, CIFAR-10 Batch 5: Loss=0.8102514147758484, Validation accuracy=0.6381999254226685
Epoch 10, CIFAR-10 Batch 1: Loss=0.852898120880127, Validation accuracy=0.6465998888015747
Epoch 10, CIFAR-10 Batch 2: Loss=0.8368192911148071, Validation accuracy=0.65559983253479
Epoch 10, CIFAR-10 Batch 3: Loss=0.8021507263183594, Validation accuracy=0.6453999280929565
Epoch 10, CIFAR-10 Batch 4: Loss=0.7987974882125854, Validation accuracy=0.6493998765945435
Epoch 10, CIFAR-10 Batch 5: Loss=0.7645756006240845, Validation accuracy=0.6523998975753784
Epoch 11, CIFAR-10 Batch 1: Loss=0.8052517771720886, Validation accuracy=0.6503998637199402
Epoch 11, CIFAR-10 Batch 2: Loss=0.792033851146698, Validation accuracy=0.6587998867034912
Epoch 11, CIFAR-10 Batch 3: Loss=0.7586128115653992, Validation accuracy=0.6539998054504395
Epoch 11, CIFAR-10 Batch 4: Loss=0.7627214789390564, Validation accuracy=0.6605998873710632
Epoch 11, CIFAR-10 Batch 5: Loss=0.7405994534492493, Validation accuracy=0.6599999070167542
Epoch 12, CIFAR-10 Batch 1: Loss=0.7670783996582031, Validation accuracy=0.6545998454093933
Epoch 12, CIFAR-10 Batch 2: Loss=0.7565175294876099, Validation accuracy=0.6675999164581299
Epoch 12, CIFAR-10 Batch 3: Loss=0.7227672338485718, Validation accuracy=0.6601998805999756
Epoch 12, CIFAR-10 Batch 4: Loss=0.7232500910758972, Validation accuracy=0.66159987449646
Epoch 12, CIFAR-10 Batch 5: Loss=0.7107397317886353, Validation accuracy=0.6547998785972595
Epoch 13, CIFAR-10 Batch 1: Loss=0.7324991226196289, Validation accuracy=0.6609998941421509
Epoch 13, CIFAR-10 Batch 2: Loss=0.7236279845237732, Validation accuracy=0.6699999570846558
Epoch 13, CIFAR-10 Batch 3: Loss=0.6874537467956543, Validation accuracy=0.6649998426437378
Epoch 13, CIFAR-10 Batch 4: Loss=0.685638427734375, Validation accuracy=0.6663998961448669
Epoch 13, CIFAR-10 Batch 5: Loss=0.6600831747055054, Validation accuracy=0.6709998846054077
Epoch 14, CIFAR-10 Batch 1: Loss=0.6854305267333984, Validation accuracy=0.6721999049186707
Epoch 14, CIFAR-10 Batch 2: Loss=0.6897182464599609, Validation accuracy=0.6779998540878296
Epoch 14, CIFAR-10 Batch 3: Loss=0.6547743082046509, Validation accuracy=0.6667998433113098
Epoch 14, CIFAR-10 Batch 4: Loss=0.6635459661483765, Validation accuracy=0.6775997877120972
Epoch 14, CIFAR-10 Batch 5: Loss=0.6298936605453491, Validation accuracy=0.6775998473167419
Epoch 15, CIFAR-10 Batch 1: Loss=0.6663693189620972, Validation accuracy=0.673599898815155
Epoch 15, CIFAR-10 Batch 2: Loss=0.6604249477386475, Validation accuracy=0.681999921798706
Epoch 15, CIFAR-10 Batch 3: Loss=0.6344577074050903, Validation accuracy=0.6703999042510986
Epoch 15, CIFAR-10 Batch 4: Loss=0.62324059009552, Validation accuracy=0.6805999279022217
Epoch 15, CIFAR-10 Batch 5: Loss=0.5893506407737732, Validation accuracy=0.683199942111969
Epoch 16, CIFAR-10 Batch 1: Loss=0.636084794998169, Validation accuracy=0.6799998879432678
Epoch 16, CIFAR-10 Batch 2: Loss=0.6378974914550781, Validation accuracy=0.6787999272346497
Epoch 16, CIFAR-10 Batch 3: Loss=0.5970638990402222, Validation accuracy=0.6733998656272888
Epoch 16, CIFAR-10 Batch 4: Loss=0.6014404296875, Validation accuracy=0.6777998805046082
Epoch 16, CIFAR-10 Batch 5: Loss=0.5778285264968872, Validation accuracy=0.6881998777389526
Epoch 17, CIFAR-10 Batch 1: Loss=0.6196664571762085, Validation accuracy=0.6785998940467834
Epoch 17, CIFAR-10 Batch 2: Loss=0.6068964600563049, Validation accuracy=0.6859999299049377
Epoch 17, CIFAR-10 Batch 3: Loss=0.5622032880783081, Validation accuracy=0.68479984998703
Epoch 17, CIFAR-10 Batch 4: Loss=0.5763555765151978, Validation accuracy=0.6853998899459839
Epoch 17, CIFAR-10 Batch 5: Loss=0.5500836968421936, Validation accuracy=0.6905999183654785
Epoch 18, CIFAR-10 Batch 1: Loss=0.5619458556175232, Validation accuracy=0.691399872303009
Epoch 18, CIFAR-10 Batch 2: Loss=0.565067708492279, Validation accuracy=0.6941998600959778
Epoch 18, CIFAR-10 Batch 3: Loss=0.5334730744361877, Validation accuracy=0.6899999380111694
Epoch 18, CIFAR-10 Batch 4: Loss=0.5396486520767212, Validation accuracy=0.692599892616272
Epoch 18, CIFAR-10 Batch 5: Loss=0.5087827444076538, Validation accuracy=0.6901998519897461
Epoch 19, CIFAR-10 Batch 1: Loss=0.538285493850708, Validation accuracy=0.6851998567581177
Epoch 19, CIFAR-10 Batch 2: Loss=0.5483095645904541, Validation accuracy=0.693199872970581
Epoch 19, CIFAR-10 Batch 3: Loss=0.5211815237998962, Validation accuracy=0.6911998391151428
Epoch 19, CIFAR-10 Batch 4: Loss=0.5215278267860413, Validation accuracy=0.6897998452186584
Epoch 19, CIFAR-10 Batch 5: Loss=0.5232316255569458, Validation accuracy=0.6863998174667358
Epoch 20, CIFAR-10 Batch 1: Loss=0.5206626057624817, Validation accuracy=0.6935998201370239
Epoch 20, CIFAR-10 Batch 2: Loss=0.5143779516220093, Validation accuracy=0.6999999284744263
Epoch 20, CIFAR-10 Batch 3: Loss=0.4822012782096863, Validation accuracy=0.6991998553276062
Epoch 20, CIFAR-10 Batch 4: Loss=0.492217481136322, Validation accuracy=0.6937998533248901
Epoch 20, CIFAR-10 Batch 5: Loss=0.4794415235519409, Validation accuracy=0.6943998336791992
Epoch 21, CIFAR-10 Batch 1: Loss=0.49447351694107056, Validation accuracy=0.6941998600959778
Epoch 21, CIFAR-10 Batch 2: Loss=0.5097225904464722, Validation accuracy=0.7045998573303223
Epoch 21, CIFAR-10 Batch 3: Loss=0.4686203896999359, Validation accuracy=0.6983998417854309
Epoch 21, CIFAR-10 Batch 4: Loss=0.47381383180618286, Validation accuracy=0.6967998147010803
Epoch 21, CIFAR-10 Batch 5: Loss=0.4399777948856354, Validation accuracy=0.7059998512268066
Epoch 22, CIFAR-10 Batch 1: Loss=0.4753015637397766, Validation accuracy=0.6945998668670654
Epoch 22, CIFAR-10 Batch 2: Loss=0.4773818850517273, Validation accuracy=0.7069998979568481
Epoch 22, CIFAR-10 Batch 3: Loss=0.44857627153396606, Validation accuracy=0.694399893283844
Epoch 22, CIFAR-10 Batch 4: Loss=0.45140865445137024, Validation accuracy=0.6985998749732971
Epoch 22, CIFAR-10 Batch 5: Loss=0.4253271222114563, Validation accuracy=0.7029998302459717
Epoch 23, CIFAR-10 Batch 1: Loss=0.439289391040802, Validation accuracy=0.6987999081611633
Epoch 23, CIFAR-10 Batch 2: Loss=0.4434622526168823, Validation accuracy=0.7083998918533325
Epoch 23, CIFAR-10 Batch 3: Loss=0.41633325815200806, Validation accuracy=0.7015998959541321
Epoch 23, CIFAR-10 Batch 4: Loss=0.42463499307632446, Validation accuracy=0.6995998024940491
Epoch 23, CIFAR-10 Batch 5: Loss=0.404775470495224, Validation accuracy=0.6969999074935913
Epoch 24, CIFAR-10 Batch 1: Loss=0.412749320268631, Validation accuracy=0.7021999359130859
Epoch 24, CIFAR-10 Batch 2: Loss=0.4176906645298004, Validation accuracy=0.7135998010635376
Epoch 24, CIFAR-10 Batch 3: Loss=0.387885183095932, Validation accuracy=0.7017998695373535
Epoch 24, CIFAR-10 Batch 4: Loss=0.4048633575439453, Validation accuracy=0.6935998201370239
Epoch 24, CIFAR-10 Batch 5: Loss=0.3773036599159241, Validation accuracy=0.6991998553276062
Epoch 25, CIFAR-10 Batch 1: Loss=0.38901716470718384, Validation accuracy=0.6999998688697815
Epoch 25, CIFAR-10 Batch 2: Loss=0.40014317631721497, Validation accuracy=0.7147997617721558
Epoch 25, CIFAR-10 Batch 3: Loss=0.3748718798160553, Validation accuracy=0.7089998126029968
Epoch 25, CIFAR-10 Batch 4: Loss=0.38148707151412964, Validation accuracy=0.7049998641014099
Epoch 25, CIFAR-10 Batch 5: Loss=0.3547472655773163, Validation accuracy=0.6987998485565186
Epoch 26, CIFAR-10 Batch 1: Loss=0.37638694047927856, Validation accuracy=0.6999998092651367
Epoch 26, CIFAR-10 Batch 2: Loss=0.37921297550201416, Validation accuracy=0.7083998918533325
Epoch 26, CIFAR-10 Batch 3: Loss=0.35160404443740845, Validation accuracy=0.7069998979568481
Epoch 26, CIFAR-10 Batch 4: Loss=0.36347612738609314, Validation accuracy=0.7039998173713684
Epoch 26, CIFAR-10 Batch 5: Loss=0.3209289312362671, Validation accuracy=0.7069998979568481
Epoch 27, CIFAR-10 Batch 1: Loss=0.36303871870040894, Validation accuracy=0.7023998498916626
Epoch 27, CIFAR-10 Batch 2: Loss=0.35542675852775574, Validation accuracy=0.7129998803138733
Epoch 27, CIFAR-10 Batch 3: Loss=0.3238350450992584, Validation accuracy=0.7065998315811157
Epoch 27, CIFAR-10 Batch 4: Loss=0.3417074680328369, Validation accuracy=0.7065998315811157
Epoch 27, CIFAR-10 Batch 5: Loss=0.31891733407974243, Validation accuracy=0.6999998688697815
Epoch 28, CIFAR-10 Batch 1: Loss=0.3440130352973938, Validation accuracy=0.7021998763084412
Epoch 28, CIFAR-10 Batch 2: Loss=0.33997729420661926, Validation accuracy=0.7137998342514038
Epoch 28, CIFAR-10 Batch 3: Loss=0.3192880153656006, Validation accuracy=0.7125998735427856
Epoch 28, CIFAR-10 Batch 4: Loss=0.3200072944164276, Validation accuracy=0.7113999128341675
Epoch 28, CIFAR-10 Batch 5: Loss=0.3165261745452881, Validation accuracy=0.6975998878479004
Epoch 29, CIFAR-10 Batch 1: Loss=0.3199344575405121, Validation accuracy=0.6971998810768127
Epoch 29, CIFAR-10 Batch 2: Loss=0.33648133277893066, Validation accuracy=0.708599865436554
Epoch 29, CIFAR-10 Batch 3: Loss=0.2920742630958557, Validation accuracy=0.7099999189376831
Epoch 29, CIFAR-10 Batch 4: Loss=0.3184308409690857, Validation accuracy=0.6991998553276062
Epoch 29, CIFAR-10 Batch 5: Loss=0.27337026596069336, Validation accuracy=0.7137998342514038
Epoch 30, CIFAR-10 Batch 1: Loss=0.30209773778915405, Validation accuracy=0.7037999033927917
Epoch 30, CIFAR-10 Batch 2: Loss=0.3426493704319, Validation accuracy=0.6913999319076538
Epoch 30, CIFAR-10 Batch 3: Loss=0.3001363277435303, Validation accuracy=0.6967998743057251
Epoch 30, CIFAR-10 Batch 4: Loss=0.3075724244117737, Validation accuracy=0.7027997970581055
Epoch 30, CIFAR-10 Batch 5: Loss=0.27757951617240906, Validation accuracy=0.7083998918533325
Epoch 31, CIFAR-10 Batch 1: Loss=0.279106467962265, Validation accuracy=0.7123998403549194
Epoch 31, CIFAR-10 Batch 2: Loss=0.3043026030063629, Validation accuracy=0.7063997983932495
Epoch 31, CIFAR-10 Batch 3: Loss=0.2681553363800049, Validation accuracy=0.6953998804092407
Epoch 31, CIFAR-10 Batch 4: Loss=0.2694190442562103, Validation accuracy=0.7101998329162598
Epoch 31, CIFAR-10 Batch 5: Loss=0.24221250414848328, Validation accuracy=0.7145998477935791
Epoch 32, CIFAR-10 Batch 1: Loss=0.2823907434940338, Validation accuracy=0.699199914932251
Epoch 32, CIFAR-10 Batch 2: Loss=0.28520292043685913, Validation accuracy=0.7045998573303223
Epoch 32, CIFAR-10 Batch 3: Loss=0.2501200735569, Validation accuracy=0.6999998092651367
Epoch 32, CIFAR-10 Batch 4: Loss=0.25333526730537415, Validation accuracy=0.7115998268127441
Epoch 32, CIFAR-10 Batch 5: Loss=0.22897742688655853, Validation accuracy=0.7179999351501465
Epoch 33, CIFAR-10 Batch 1: Loss=0.24984806776046753, Validation accuracy=0.7137998342514038
Epoch 33, CIFAR-10 Batch 2: Loss=0.26026031374931335, Validation accuracy=0.7081998586654663
Epoch 33, CIFAR-10 Batch 3: Loss=0.22220879793167114, Validation accuracy=0.7109998464584351
Epoch 33, CIFAR-10 Batch 4: Loss=0.2415698915719986, Validation accuracy=0.7159999012947083
Epoch 33, CIFAR-10 Batch 5: Loss=0.21168847382068634, Validation accuracy=0.7187998294830322
Epoch 34, CIFAR-10 Batch 1: Loss=0.23865245282649994, Validation accuracy=0.707399845123291
Epoch 34, CIFAR-10 Batch 2: Loss=0.25386691093444824, Validation accuracy=0.7063999176025391
Epoch 34, CIFAR-10 Batch 3: Loss=0.2265116423368454, Validation accuracy=0.6999998688697815
Epoch 34, CIFAR-10 Batch 4: Loss=0.2388649582862854, Validation accuracy=0.7071999311447144
Epoch 34, CIFAR-10 Batch 5: Loss=0.21580390632152557, Validation accuracy=0.7141998410224915
Epoch 35, CIFAR-10 Batch 1: Loss=0.21800455451011658, Validation accuracy=0.7101998925209045
Epoch 35, CIFAR-10 Batch 2: Loss=0.23256705701351166, Validation accuracy=0.7177998423576355
Epoch 35, CIFAR-10 Batch 3: Loss=0.19511345028877258, Validation accuracy=0.7189998626708984
Epoch 35, CIFAR-10 Batch 4: Loss=0.21604418754577637, Validation accuracy=0.7075998187065125
Epoch 35, CIFAR-10 Batch 5: Loss=0.20292723178863525, Validation accuracy=0.7127999067306519
Epoch 36, CIFAR-10 Batch 1: Loss=0.20829053223133087, Validation accuracy=0.7139998078346252
Epoch 36, CIFAR-10 Batch 2: Loss=0.23347780108451843, Validation accuracy=0.7141998410224915
Epoch 36, CIFAR-10 Batch 3: Loss=0.18610091507434845, Validation accuracy=0.7153998613357544
Epoch 36, CIFAR-10 Batch 4: Loss=0.20224900543689728, Validation accuracy=0.7121998071670532
Epoch 36, CIFAR-10 Batch 5: Loss=0.1913793385028839, Validation accuracy=0.7145999073982239
Epoch 37, CIFAR-10 Batch 1: Loss=0.19989782571792603, Validation accuracy=0.7117998600006104
Epoch 37, CIFAR-10 Batch 2: Loss=0.22334618866443634, Validation accuracy=0.7119998931884766
Epoch 37, CIFAR-10 Batch 3: Loss=0.1857011616230011, Validation accuracy=0.7123998403549194
Epoch 37, CIFAR-10 Batch 4: Loss=0.19192980229854584, Validation accuracy=0.7051998376846313
Epoch 37, CIFAR-10 Batch 5: Loss=0.19465085864067078, Validation accuracy=0.712199866771698
Epoch 38, CIFAR-10 Batch 1: Loss=0.1810031533241272, Validation accuracy=0.7045998573303223
Epoch 38, CIFAR-10 Batch 2: Loss=0.20639252662658691, Validation accuracy=0.7155998349189758
Epoch 38, CIFAR-10 Batch 3: Loss=0.1679804027080536, Validation accuracy=0.7221997976303101
Epoch 38, CIFAR-10 Batch 4: Loss=0.17614823579788208, Validation accuracy=0.7105998396873474
Epoch 38, CIFAR-10 Batch 5: Loss=0.18444564938545227, Validation accuracy=0.710399866104126
Epoch 39, CIFAR-10 Batch 1: Loss=0.16920557618141174, Validation accuracy=0.710399866104126
Epoch 39, CIFAR-10 Batch 2: Loss=0.18458586931228638, Validation accuracy=0.7161998152732849
Epoch 39, CIFAR-10 Batch 3: Loss=0.1565871387720108, Validation accuracy=0.7179999351501465
Epoch 39, CIFAR-10 Batch 4: Loss=0.1597345769405365, Validation accuracy=0.7053998708724976
Epoch 39, CIFAR-10 Batch 5: Loss=0.16446025669574738, Validation accuracy=0.7087998390197754
Epoch 40, CIFAR-10 Batch 1: Loss=0.1755354404449463, Validation accuracy=0.7065999507904053
Epoch 40, CIFAR-10 Batch 2: Loss=0.17808759212493896, Validation accuracy=0.7089998722076416
Epoch 40, CIFAR-10 Batch 3: Loss=0.15181349217891693, Validation accuracy=0.7155998945236206
Epoch 40, CIFAR-10 Batch 4: Loss=0.14883416891098022, Validation accuracy=0.7039998769760132
Epoch 40, CIFAR-10 Batch 5: Loss=0.15894439816474915, Validation accuracy=0.7113999128341675
Epoch 41, CIFAR-10 Batch 1: Loss=0.1620832085609436, Validation accuracy=0.7143998742103577
Epoch 41, CIFAR-10 Batch 2: Loss=0.16582335531711578, Validation accuracy=0.7115998268127441
Epoch 41, CIFAR-10 Batch 3: Loss=0.14033624529838562, Validation accuracy=0.710399866104126
Epoch 41, CIFAR-10 Batch 4: Loss=0.13110825419425964, Validation accuracy=0.7109998464584351
Epoch 41, CIFAR-10 Batch 5: Loss=0.14068938791751862, Validation accuracy=0.7159999012947083
Epoch 42, CIFAR-10 Batch 1: Loss=0.15013964474201202, Validation accuracy=0.7135999202728271
Epoch 42, CIFAR-10 Batch 2: Loss=0.14955472946166992, Validation accuracy=0.7125998139381409
Epoch 42, CIFAR-10 Batch 3: Loss=0.11894629895687103, Validation accuracy=0.7159998416900635
Epoch 42, CIFAR-10 Batch 4: Loss=0.1262790858745575, Validation accuracy=0.709199845790863
Epoch 42, CIFAR-10 Batch 5: Loss=0.127560093998909, Validation accuracy=0.7195998430252075
Epoch 43, CIFAR-10 Batch 1: Loss=0.12605130672454834, Validation accuracy=0.7163998484611511
Epoch 43, CIFAR-10 Batch 2: Loss=0.13135750591754913, Validation accuracy=0.7115998268127441
Epoch 43, CIFAR-10 Batch 3: Loss=0.11576075106859207, Validation accuracy=0.7197998762130737
Epoch 43, CIFAR-10 Batch 4: Loss=0.10825807601213455, Validation accuracy=0.7159999012947083
Epoch 43, CIFAR-10 Batch 5: Loss=0.1091403067111969, Validation accuracy=0.7191998362541199
Epoch 44, CIFAR-10 Batch 1: Loss=0.1096663549542427, Validation accuracy=0.7141998410224915
Epoch 44, CIFAR-10 Batch 2: Loss=0.12689995765686035, Validation accuracy=0.7141998410224915
Epoch 44, CIFAR-10 Batch 3: Loss=0.10147009789943695, Validation accuracy=0.7233998775482178
Epoch 44, CIFAR-10 Batch 4: Loss=0.11081117391586304, Validation accuracy=0.7163998484611511
Epoch 44, CIFAR-10 Batch 5: Loss=0.11455469578504562, Validation accuracy=0.7131998538970947
Epoch 45, CIFAR-10 Batch 1: Loss=0.10471072793006897, Validation accuracy=0.7125998735427856
Epoch 45, CIFAR-10 Batch 2: Loss=0.11697555333375931, Validation accuracy=0.7181998491287231
Epoch 45, CIFAR-10 Batch 3: Loss=0.09612768888473511, Validation accuracy=0.7177998423576355
Epoch 45, CIFAR-10 Batch 4: Loss=0.10434608906507492, Validation accuracy=0.709199845790863
Epoch 45, CIFAR-10 Batch 5: Loss=0.1002340093255043, Validation accuracy=0.7133998870849609
Epoch 46, CIFAR-10 Batch 1: Loss=0.1043657511472702, Validation accuracy=0.7171998620033264
Epoch 46, CIFAR-10 Batch 2: Loss=0.10978663712739944, Validation accuracy=0.7147998809814453
Epoch 46, CIFAR-10 Batch 3: Loss=0.09060336649417877, Validation accuracy=0.7155999541282654
Epoch 46, CIFAR-10 Batch 4: Loss=0.09989733248949051, Validation accuracy=0.7115998268127441
Epoch 46, CIFAR-10 Batch 5: Loss=0.09453509747982025, Validation accuracy=0.7185998558998108
Epoch 47, CIFAR-10 Batch 1: Loss=0.09540928155183792, Validation accuracy=0.7143998742103577
Epoch 47, CIFAR-10 Batch 2: Loss=0.10392753779888153, Validation accuracy=0.7175998687744141
Epoch 47, CIFAR-10 Batch 3: Loss=0.08333522081375122, Validation accuracy=0.716999888420105
Epoch 47, CIFAR-10 Batch 4: Loss=0.09752949327230453, Validation accuracy=0.7107998728752136
Epoch 47, CIFAR-10 Batch 5: Loss=0.0857909768819809, Validation accuracy=0.7175999283790588
Epoch 48, CIFAR-10 Batch 1: Loss=0.09151194989681244, Validation accuracy=0.7131998538970947
Epoch 48, CIFAR-10 Batch 2: Loss=0.09269651025533676, Validation accuracy=0.7169998288154602
Epoch 48, CIFAR-10 Batch 3: Loss=0.07764540612697601, Validation accuracy=0.71399986743927
Epoch 48, CIFAR-10 Batch 4: Loss=0.08980701118707657, Validation accuracy=0.7059999108314514
Epoch 48, CIFAR-10 Batch 5: Loss=0.08528096228837967, Validation accuracy=0.7137998342514038
Epoch 49, CIFAR-10 Batch 1: Loss=0.07910257577896118, Validation accuracy=0.7209998965263367
Epoch 49, CIFAR-10 Batch 2: Loss=0.0834222286939621, Validation accuracy=0.7123998999595642
Epoch 49, CIFAR-10 Batch 3: Loss=0.068524070084095, Validation accuracy=0.7197998762130737
Epoch 49, CIFAR-10 Batch 4: Loss=0.08364802598953247, Validation accuracy=0.7099998593330383
Epoch 49, CIFAR-10 Batch 5: Loss=0.07565202564001083, Validation accuracy=0.7143998742103577
Epoch 50, CIFAR-10 Batch 1: Loss=0.07751552760601044, Validation accuracy=0.7183998227119446
Epoch 50, CIFAR-10 Batch 2: Loss=0.08336591720581055, Validation accuracy=0.7155998945236206
Epoch 50, CIFAR-10 Batch 3: Loss=0.06813569366931915, Validation accuracy=0.7191998362541199
Epoch 50, CIFAR-10 Batch 4: Loss=0.07268206775188446, Validation accuracy=0.7127998471260071
Epoch 50, CIFAR-10 Batch 5: Loss=0.07546213269233704, Validation accuracy=0.7079998254776001
Epoch 51, CIFAR-10 Batch 1: Loss=0.07832249999046326, Validation accuracy=0.7135998010635376
Epoch 51, CIFAR-10 Batch 2: Loss=0.07929863035678864, Validation accuracy=0.71399986743927
Epoch 51, CIFAR-10 Batch 3: Loss=0.07352077960968018, Validation accuracy=0.7161998152732849
Epoch 51, CIFAR-10 Batch 4: Loss=0.06913211941719055, Validation accuracy=0.7043998837471008
Epoch 51, CIFAR-10 Batch 5: Loss=0.0683852806687355, Validation accuracy=0.7113998532295227
Epoch 52, CIFAR-10 Batch 1: Loss=0.07138774544000626, Validation accuracy=0.7129998803138733
Epoch 52, CIFAR-10 Batch 2: Loss=0.0702119991183281, Validation accuracy=0.7137998342514038
Epoch 52, CIFAR-10 Batch 3: Loss=0.06403297185897827, Validation accuracy=0.7151998281478882
Epoch 52, CIFAR-10 Batch 4: Loss=0.060955166816711426, Validation accuracy=0.71399986743927
Epoch 52, CIFAR-10 Batch 5: Loss=0.06391982734203339, Validation accuracy=0.7087998390197754
Epoch 53, CIFAR-10 Batch 1: Loss=0.06950539350509644, Validation accuracy=0.7141998410224915
Epoch 53, CIFAR-10 Batch 2: Loss=0.08050397038459778, Validation accuracy=0.7133998870849609
Epoch 53, CIFAR-10 Batch 3: Loss=0.06322576105594635, Validation accuracy=0.71399986743927
Epoch 53, CIFAR-10 Batch 4: Loss=0.06316187232732773, Validation accuracy=0.7127997875213623
Epoch 53, CIFAR-10 Batch 5: Loss=0.06346860527992249, Validation accuracy=0.7045997977256775
Epoch 54, CIFAR-10 Batch 1: Loss=0.06776342540979385, Validation accuracy=0.7177998423576355
Epoch 54, CIFAR-10 Batch 2: Loss=0.07332353293895721, Validation accuracy=0.7139999270439148
Epoch 54, CIFAR-10 Batch 3: Loss=0.06088455766439438, Validation accuracy=0.7113999128341675
Epoch 54, CIFAR-10 Batch 4: Loss=0.0633789673447609, Validation accuracy=0.7105998396873474
Epoch 54, CIFAR-10 Batch 5: Loss=0.0631679967045784, Validation accuracy=0.7071998119354248
Epoch 55, CIFAR-10 Batch 1: Loss=0.07798465341329575, Validation accuracy=0.7021998763084412
Epoch 55, CIFAR-10 Batch 2: Loss=0.07285696268081665, Validation accuracy=0.7087998390197754
Epoch 55, CIFAR-10 Batch 3: Loss=0.06569588929414749, Validation accuracy=0.7177999019622803
Epoch 55, CIFAR-10 Batch 4: Loss=0.05527675151824951, Validation accuracy=0.7145998477935791
Epoch 55, CIFAR-10 Batch 5: Loss=0.06025084853172302, Validation accuracy=0.7097998857498169
Epoch 56, CIFAR-10 Batch 1: Loss=0.06436019390821457, Validation accuracy=0.7115998864173889
Epoch 56, CIFAR-10 Batch 2: Loss=0.06333371996879578, Validation accuracy=0.720599889755249
Epoch 56, CIFAR-10 Batch 3: Loss=0.06803334504365921, Validation accuracy=0.7067998647689819
Epoch 56, CIFAR-10 Batch 4: Loss=0.053898848593235016, Validation accuracy=0.7043998837471008
Epoch 56, CIFAR-10 Batch 5: Loss=0.05352358520030975, Validation accuracy=0.7081998586654663
Epoch 57, CIFAR-10 Batch 1: Loss=0.05871087312698364, Validation accuracy=0.7171998023986816
Epoch 57, CIFAR-10 Batch 2: Loss=0.0613841749727726, Validation accuracy=0.7167998552322388
Epoch 57, CIFAR-10 Batch 3: Loss=0.059014081954956055, Validation accuracy=0.7053998112678528
Epoch 57, CIFAR-10 Batch 4: Loss=0.04395398497581482, Validation accuracy=0.7125998735427856
Epoch 57, CIFAR-10 Batch 5: Loss=0.04950186610221863, Validation accuracy=0.7119998931884766
Epoch 58, CIFAR-10 Batch 1: Loss=0.05126107856631279, Validation accuracy=0.7139999270439148
Epoch 58, CIFAR-10 Batch 2: Loss=0.052152834832668304, Validation accuracy=0.7185998558998108
Epoch 58, CIFAR-10 Batch 3: Loss=0.05288868397474289, Validation accuracy=0.7161998152732849
Epoch 58, CIFAR-10 Batch 4: Loss=0.04829757660627365, Validation accuracy=0.703799843788147
Epoch 58, CIFAR-10 Batch 5: Loss=0.043841782957315445, Validation accuracy=0.7095998525619507
Epoch 59, CIFAR-10 Batch 1: Loss=0.05129558593034744, Validation accuracy=0.7141998410224915
Epoch 59, CIFAR-10 Batch 2: Loss=0.04435642063617706, Validation accuracy=0.720599889755249
Epoch 59, CIFAR-10 Batch 3: Loss=0.04610337316989899, Validation accuracy=0.7155998945236206
Epoch 59, CIFAR-10 Batch 4: Loss=0.041270554065704346, Validation accuracy=0.7003998756408691
Epoch 59, CIFAR-10 Batch 5: Loss=0.048930950462818146, Validation accuracy=0.7107998728752136
Epoch 60, CIFAR-10 Batch 1: Loss=0.04339106008410454, Validation accuracy=0.7189998626708984
Epoch 60, CIFAR-10 Batch 2: Loss=0.04492587223649025, Validation accuracy=0.7147998809814453
Epoch 60, CIFAR-10 Batch 3: Loss=0.03894413262605667, Validation accuracy=0.7189998626708984
Epoch 60, CIFAR-10 Batch 4: Loss=0.035408519208431244, Validation accuracy=0.7121998071670532
Epoch 60, CIFAR-10 Batch 5: Loss=0.04148343205451965, Validation accuracy=0.7191998362541199
Epoch 61, CIFAR-10 Batch 1: Loss=0.0428810752928257, Validation accuracy=0.7115998864173889
Epoch 61, CIFAR-10 Batch 2: Loss=0.04012392833828926, Validation accuracy=0.7203998565673828
Epoch 61, CIFAR-10 Batch 3: Loss=0.03866593539714813, Validation accuracy=0.7153998613357544
Epoch 61, CIFAR-10 Batch 4: Loss=0.03297264873981476, Validation accuracy=0.7075998783111572
Epoch 61, CIFAR-10 Batch 5: Loss=0.03660612180829048, Validation accuracy=0.7143998742103577
Epoch 62, CIFAR-10 Batch 1: Loss=0.03450064733624458, Validation accuracy=0.718599796295166
Epoch 62, CIFAR-10 Batch 2: Loss=0.03814726322889328, Validation accuracy=0.7219998240470886
Epoch 62, CIFAR-10 Batch 3: Loss=0.04334612935781479, Validation accuracy=0.7099998593330383
Epoch 62, CIFAR-10 Batch 4: Loss=0.030083827674388885, Validation accuracy=0.7055999040603638
Epoch 62, CIFAR-10 Batch 5: Loss=0.037273108959198, Validation accuracy=0.7113998532295227
Epoch 63, CIFAR-10 Batch 1: Loss=0.03457082435488701, Validation accuracy=0.715799868106842
Epoch 63, CIFAR-10 Batch 2: Loss=0.03428924083709717, Validation accuracy=0.7205998301506042
Epoch 63, CIFAR-10 Batch 3: Loss=0.03167338669300079, Validation accuracy=0.7137998938560486
Epoch 63, CIFAR-10 Batch 4: Loss=0.0313510000705719, Validation accuracy=0.7117998600006104
Epoch 63, CIFAR-10 Batch 5: Loss=0.030943531543016434, Validation accuracy=0.720599889755249
Epoch 64, CIFAR-10 Batch 1: Loss=0.030534878373146057, Validation accuracy=0.7159998416900635
Epoch 64, CIFAR-10 Batch 2: Loss=0.03482475504279137, Validation accuracy=0.7149998545646667
Epoch 64, CIFAR-10 Batch 3: Loss=0.032408129423856735, Validation accuracy=0.7125998139381409
Epoch 64, CIFAR-10 Batch 4: Loss=0.02691776119172573, Validation accuracy=0.7095998525619507
Epoch 64, CIFAR-10 Batch 5: Loss=0.02774365246295929, Validation accuracy=0.7201999425888062
Epoch 65, CIFAR-10 Batch 1: Loss=0.03210210055112839, Validation accuracy=0.7195998430252075
Epoch 65, CIFAR-10 Batch 2: Loss=0.029581373557448387, Validation accuracy=0.7191998958587646
Epoch 65, CIFAR-10 Batch 3: Loss=0.028042789548635483, Validation accuracy=0.7185999155044556
Epoch 65, CIFAR-10 Batch 4: Loss=0.024993013590574265, Validation accuracy=0.7149998545646667
Epoch 65, CIFAR-10 Batch 5: Loss=0.029368264600634575, Validation accuracy=0.7195998430252075
Epoch 66, CIFAR-10 Batch 1: Loss=0.028628472238779068, Validation accuracy=0.7187998294830322
Epoch 66, CIFAR-10 Batch 2: Loss=0.026661790907382965, Validation accuracy=0.7193998694419861
Epoch 66, CIFAR-10 Batch 3: Loss=0.028538662940263748, Validation accuracy=0.7155998349189758
Epoch 66, CIFAR-10 Batch 4: Loss=0.026902437210083008, Validation accuracy=0.7159998416900635
Epoch 66, CIFAR-10 Batch 5: Loss=0.02972368337213993, Validation accuracy=0.7125998735427856
Epoch 67, CIFAR-10 Batch 1: Loss=0.02788686938583851, Validation accuracy=0.7137998938560486
Epoch 67, CIFAR-10 Batch 2: Loss=0.026235809549689293, Validation accuracy=0.7203998565673828
Epoch 67, CIFAR-10 Batch 3: Loss=0.03032740391790867, Validation accuracy=0.716999888420105
Epoch 67, CIFAR-10 Batch 4: Loss=0.024790966883301735, Validation accuracy=0.7185998558998108
Epoch 67, CIFAR-10 Batch 5: Loss=0.030179612338542938, Validation accuracy=0.7215998768806458
Epoch 68, CIFAR-10 Batch 1: Loss=0.025543803349137306, Validation accuracy=0.7149999141693115
Epoch 68, CIFAR-10 Batch 2: Loss=0.02487531304359436, Validation accuracy=0.7205998301506042
Epoch 68, CIFAR-10 Batch 3: Loss=0.025951918214559555, Validation accuracy=0.7175998687744141
Epoch 68, CIFAR-10 Batch 4: Loss=0.02427561767399311, Validation accuracy=0.7117998600006104
Epoch 68, CIFAR-10 Batch 5: Loss=0.027859177440404892, Validation accuracy=0.7167998552322388
Epoch 69, CIFAR-10 Batch 1: Loss=0.02514108270406723, Validation accuracy=0.714999794960022
Epoch 69, CIFAR-10 Batch 2: Loss=0.024948429316282272, Validation accuracy=0.7203998565673828
Epoch 69, CIFAR-10 Batch 3: Loss=0.029663793742656708, Validation accuracy=0.7157999277114868
Epoch 69, CIFAR-10 Batch 4: Loss=0.02321239560842514, Validation accuracy=0.7093998789787292
Epoch 69, CIFAR-10 Batch 5: Loss=0.031236032024025917, Validation accuracy=0.7141998410224915
Epoch 70, CIFAR-10 Batch 1: Loss=0.027181200683116913, Validation accuracy=0.7149999141693115
Epoch 70, CIFAR-10 Batch 2: Loss=0.02461812272667885, Validation accuracy=0.7213999032974243
Epoch 70, CIFAR-10 Batch 3: Loss=0.021658804267644882, Validation accuracy=0.7181998491287231
Epoch 70, CIFAR-10 Batch 4: Loss=0.01769775152206421, Validation accuracy=0.7165998816490173
Epoch 70, CIFAR-10 Batch 5: Loss=0.025581613183021545, Validation accuracy=0.7171998620033264
Epoch 71, CIFAR-10 Batch 1: Loss=0.02628903090953827, Validation accuracy=0.7069998979568481
Epoch 71, CIFAR-10 Batch 2: Loss=0.023124391213059425, Validation accuracy=0.7195998430252075
Epoch 71, CIFAR-10 Batch 3: Loss=0.024259794503450394, Validation accuracy=0.7171998023986816
Epoch 71, CIFAR-10 Batch 4: Loss=0.018677968531847, Validation accuracy=0.7135999202728271
Epoch 71, CIFAR-10 Batch 5: Loss=0.02495468035340309, Validation accuracy=0.7211997509002686
Epoch 72, CIFAR-10 Batch 1: Loss=0.02289871871471405, Validation accuracy=0.7067998051643372
Epoch 72, CIFAR-10 Batch 2: Loss=0.024390649050474167, Validation accuracy=0.7191997766494751
Epoch 72, CIFAR-10 Batch 3: Loss=0.02197733335196972, Validation accuracy=0.7147998809814453
Epoch 72, CIFAR-10 Batch 4: Loss=0.01779761351644993, Validation accuracy=0.7123997807502747
Epoch 72, CIFAR-10 Batch 5: Loss=0.021592261269688606, Validation accuracy=0.7205998301506042
Epoch 73, CIFAR-10 Batch 1: Loss=0.02566126175224781, Validation accuracy=0.7081998586654663
Epoch 73, CIFAR-10 Batch 2: Loss=0.025029005482792854, Validation accuracy=0.7179998755455017
Epoch 73, CIFAR-10 Batch 3: Loss=0.020810885354876518, Validation accuracy=0.7159998416900635
Epoch 73, CIFAR-10 Batch 4: Loss=0.01682908460497856, Validation accuracy=0.7195998430252075
Epoch 73, CIFAR-10 Batch 5: Loss=0.024554725736379623, Validation accuracy=0.7205998301506042
Epoch 74, CIFAR-10 Batch 1: Loss=0.02142605371773243, Validation accuracy=0.711199939250946
Epoch 74, CIFAR-10 Batch 2: Loss=0.02243703044950962, Validation accuracy=0.7203998565673828
Epoch 74, CIFAR-10 Batch 3: Loss=0.01813054084777832, Validation accuracy=0.7239998579025269
Epoch 74, CIFAR-10 Batch 4: Loss=0.022283945232629776, Validation accuracy=0.7135998606681824
Epoch 74, CIFAR-10 Batch 5: Loss=0.02060537412762642, Validation accuracy=0.7153998613357544
Epoch 75, CIFAR-10 Batch 1: Loss=0.021399807184934616, Validation accuracy=0.707399845123291
Epoch 75, CIFAR-10 Batch 2: Loss=0.027560919523239136, Validation accuracy=0.7099999189376831
Epoch 75, CIFAR-10 Batch 3: Loss=0.02120932750403881, Validation accuracy=0.7115998864173889
Epoch 75, CIFAR-10 Batch 4: Loss=0.01907244510948658, Validation accuracy=0.7103998064994812
Epoch 75, CIFAR-10 Batch 5: Loss=0.019225025549530983, Validation accuracy=0.7187998294830322
Epoch 76, CIFAR-10 Batch 1: Loss=0.02522781677544117, Validation accuracy=0.7057998776435852
Epoch 76, CIFAR-10 Batch 2: Loss=0.024243395775556564, Validation accuracy=0.7113997936248779
Epoch 76, CIFAR-10 Batch 3: Loss=0.020653950050473213, Validation accuracy=0.7147998809814453
Epoch 76, CIFAR-10 Batch 4: Loss=0.020075540989637375, Validation accuracy=0.7153998613357544
Epoch 76, CIFAR-10 Batch 5: Loss=0.02005782164633274, Validation accuracy=0.7195998430252075
Epoch 77, CIFAR-10 Batch 1: Loss=0.019759226590394974, Validation accuracy=0.7147997617721558
Epoch 77, CIFAR-10 Batch 2: Loss=0.024899952113628387, Validation accuracy=0.7019999027252197
Epoch 77, CIFAR-10 Batch 3: Loss=0.019529957324266434, Validation accuracy=0.7087998390197754
Epoch 77, CIFAR-10 Batch 4: Loss=0.01663251779973507, Validation accuracy=0.7119998335838318
Epoch 77, CIFAR-10 Batch 5: Loss=0.022007647901773453, Validation accuracy=0.7111998200416565
Epoch 78, CIFAR-10 Batch 1: Loss=0.019773246720433235, Validation accuracy=0.7131998538970947
Epoch 78, CIFAR-10 Batch 2: Loss=0.02372964844107628, Validation accuracy=0.7117998003959656
Epoch 78, CIFAR-10 Batch 3: Loss=0.016285154968500137, Validation accuracy=0.7187998294830322
Epoch 78, CIFAR-10 Batch 4: Loss=0.01457342877984047, Validation accuracy=0.7151998281478882
Epoch 78, CIFAR-10 Batch 5: Loss=0.018234150484204292, Validation accuracy=0.7169998288154602
Epoch 79, CIFAR-10 Batch 1: Loss=0.018522515892982483, Validation accuracy=0.7175998091697693
Epoch 79, CIFAR-10 Batch 2: Loss=0.02090192772448063, Validation accuracy=0.7099997997283936
Epoch 79, CIFAR-10 Batch 3: Loss=0.01735720783472061, Validation accuracy=0.7213999032974243
Epoch 79, CIFAR-10 Batch 4: Loss=0.01301324088126421, Validation accuracy=0.7203998565673828
Epoch 79, CIFAR-10 Batch 5: Loss=0.015696043148636818, Validation accuracy=0.7197998762130737
Epoch 80, CIFAR-10 Batch 1: Loss=0.01894948072731495, Validation accuracy=0.7123998403549194
Epoch 80, CIFAR-10 Batch 2: Loss=0.016260279342532158, Validation accuracy=0.7237998247146606
Epoch 80, CIFAR-10 Batch 3: Loss=0.014886665157973766, Validation accuracy=0.7229999303817749
Epoch 80, CIFAR-10 Batch 4: Loss=0.01252256240695715, Validation accuracy=0.7157999277114868
Epoch 80, CIFAR-10 Batch 5: Loss=0.014558658935129642, Validation accuracy=0.7187998294830322
Epoch 81, CIFAR-10 Batch 1: Loss=0.014987483620643616, Validation accuracy=0.7231998443603516
Epoch 81, CIFAR-10 Batch 2: Loss=0.014510495588183403, Validation accuracy=0.7189998626708984
Epoch 81, CIFAR-10 Batch 3: Loss=0.013355275616049767, Validation accuracy=0.7245997786521912
Epoch 81, CIFAR-10 Batch 4: Loss=0.011639559641480446, Validation accuracy=0.7153998613357544
Epoch 81, CIFAR-10 Batch 5: Loss=0.013392811641097069, Validation accuracy=0.7213998436927795
Epoch 82, CIFAR-10 Batch 1: Loss=0.013182097114622593, Validation accuracy=0.7219998836517334
Epoch 82, CIFAR-10 Batch 2: Loss=0.01655798964202404, Validation accuracy=0.7151999473571777
Epoch 82, CIFAR-10 Batch 3: Loss=0.013956381939351559, Validation accuracy=0.718799889087677
Epoch 82, CIFAR-10 Batch 4: Loss=0.009731466881930828, Validation accuracy=0.720399796962738
Epoch 82, CIFAR-10 Batch 5: Loss=0.014565729536116123, Validation accuracy=0.721599817276001
Epoch 83, CIFAR-10 Batch 1: Loss=0.013305666856467724, Validation accuracy=0.7167998552322388
Epoch 83, CIFAR-10 Batch 2: Loss=0.014533968642354012, Validation accuracy=0.716999888420105
Epoch 83, CIFAR-10 Batch 3: Loss=0.012171758338809013, Validation accuracy=0.7221998572349548
Epoch 83, CIFAR-10 Batch 4: Loss=0.00841508712619543, Validation accuracy=0.7171999216079712
Epoch 83, CIFAR-10 Batch 5: Loss=0.012255646288394928, Validation accuracy=0.7191998958587646
Epoch 84, CIFAR-10 Batch 1: Loss=0.012645691633224487, Validation accuracy=0.7155998349189758
Epoch 84, CIFAR-10 Batch 2: Loss=0.012040723115205765, Validation accuracy=0.7221998572349548
Epoch 84, CIFAR-10 Batch 3: Loss=0.013914854265749454, Validation accuracy=0.7195999026298523
Epoch 84, CIFAR-10 Batch 4: Loss=0.009389322251081467, Validation accuracy=0.7141998410224915
Epoch 84, CIFAR-10 Batch 5: Loss=0.010611040517687798, Validation accuracy=0.7261999249458313
Epoch 85, CIFAR-10 Batch 1: Loss=0.012450816109776497, Validation accuracy=0.722399890422821
Epoch 85, CIFAR-10 Batch 2: Loss=0.013041820377111435, Validation accuracy=0.7133998274803162
Epoch 85, CIFAR-10 Batch 3: Loss=0.011655531823635101, Validation accuracy=0.7235997915267944
Epoch 85, CIFAR-10 Batch 4: Loss=0.0093611478805542, Validation accuracy=0.7177998423576355
Epoch 85, CIFAR-10 Batch 5: Loss=0.009688027203083038, Validation accuracy=0.7235998511314392
Epoch 86, CIFAR-10 Batch 1: Loss=0.011956630274653435, Validation accuracy=0.7197999358177185
Epoch 86, CIFAR-10 Batch 2: Loss=0.010448240675032139, Validation accuracy=0.7141998410224915
Epoch 86, CIFAR-10 Batch 3: Loss=0.011287158355116844, Validation accuracy=0.718799889087677
Epoch 86, CIFAR-10 Batch 4: Loss=0.009117203764617443, Validation accuracy=0.7209998369216919
Epoch 86, CIFAR-10 Batch 5: Loss=0.01112643163651228, Validation accuracy=0.7207998633384705
Epoch 87, CIFAR-10 Batch 1: Loss=0.011310797184705734, Validation accuracy=0.7147998809814453
Epoch 87, CIFAR-10 Batch 2: Loss=0.009515434503555298, Validation accuracy=0.7223997712135315
Epoch 87, CIFAR-10 Batch 3: Loss=0.010363776236772537, Validation accuracy=0.7255998849868774
Epoch 87, CIFAR-10 Batch 4: Loss=0.007171031553298235, Validation accuracy=0.7155998349189758
Epoch 87, CIFAR-10 Batch 5: Loss=0.009686494246125221, Validation accuracy=0.7177998423576355
Epoch 88, CIFAR-10 Batch 1: Loss=0.01149222906678915, Validation accuracy=0.7155998945236206
Epoch 88, CIFAR-10 Batch 2: Loss=0.010427094995975494, Validation accuracy=0.715799868106842
Epoch 88, CIFAR-10 Batch 3: Loss=0.011057598516345024, Validation accuracy=0.7215998768806458
Epoch 88, CIFAR-10 Batch 4: Loss=0.008159306831657887, Validation accuracy=0.7213999032974243
Epoch 88, CIFAR-10 Batch 5: Loss=0.008546038530766964, Validation accuracy=0.7225998044013977
Epoch 89, CIFAR-10 Batch 1: Loss=0.009895135648548603, Validation accuracy=0.7167998552322388
Epoch 89, CIFAR-10 Batch 2: Loss=0.010163695551455021, Validation accuracy=0.7193998098373413
Epoch 89, CIFAR-10 Batch 3: Loss=0.009824748151004314, Validation accuracy=0.7209998965263367
Epoch 89, CIFAR-10 Batch 4: Loss=0.006611320190131664, Validation accuracy=0.7183997631072998
Epoch 89, CIFAR-10 Batch 5: Loss=0.010154088959097862, Validation accuracy=0.7231999039649963
Epoch 90, CIFAR-10 Batch 1: Loss=0.01014951802790165, Validation accuracy=0.7221998572349548
Epoch 90, CIFAR-10 Batch 2: Loss=0.0095282644033432, Validation accuracy=0.7245997786521912
Epoch 90, CIFAR-10 Batch 3: Loss=0.007176887709647417, Validation accuracy=0.725199818611145
Epoch 90, CIFAR-10 Batch 4: Loss=0.006764047313481569, Validation accuracy=0.7195998430252075
Epoch 90, CIFAR-10 Batch 5: Loss=0.007977679371833801, Validation accuracy=0.7215998768806458
Epoch 91, CIFAR-10 Batch 1: Loss=0.009497256949543953, Validation accuracy=0.7063997983932495
Epoch 91, CIFAR-10 Batch 2: Loss=0.013514293357729912, Validation accuracy=0.7191997766494751
Epoch 91, CIFAR-10 Batch 3: Loss=0.009037511423230171, Validation accuracy=0.7197998762130737
Epoch 91, CIFAR-10 Batch 4: Loss=0.008567504584789276, Validation accuracy=0.7183998823165894
Epoch 91, CIFAR-10 Batch 5: Loss=0.009020522236824036, Validation accuracy=0.7163999080657959
Epoch 92, CIFAR-10 Batch 1: Loss=0.007796343881636858, Validation accuracy=0.7113998532295227
Epoch 92, CIFAR-10 Batch 2: Loss=0.011643513105809689, Validation accuracy=0.7173998951911926
Epoch 92, CIFAR-10 Batch 3: Loss=0.006604225840419531, Validation accuracy=0.7207998037338257
Epoch 92, CIFAR-10 Batch 4: Loss=0.007020060904324055, Validation accuracy=0.7217998504638672
Epoch 92, CIFAR-10 Batch 5: Loss=0.007260557264089584, Validation accuracy=0.7177999019622803
Epoch 93, CIFAR-10 Batch 1: Loss=0.007058230694383383, Validation accuracy=0.7123998403549194
Epoch 93, CIFAR-10 Batch 2: Loss=0.01074883621186018, Validation accuracy=0.7183998823165894
Epoch 93, CIFAR-10 Batch 3: Loss=0.007204541936516762, Validation accuracy=0.7179999351501465
Epoch 93, CIFAR-10 Batch 4: Loss=0.006434853188693523, Validation accuracy=0.7211998701095581
Epoch 93, CIFAR-10 Batch 5: Loss=0.007312337402254343, Validation accuracy=0.7231999039649963
Epoch 94, CIFAR-10 Batch 1: Loss=0.009099135175347328, Validation accuracy=0.7113999128341675
Epoch 94, CIFAR-10 Batch 2: Loss=0.008132671006023884, Validation accuracy=0.7227998375892639
Epoch 94, CIFAR-10 Batch 3: Loss=0.006944425404071808, Validation accuracy=0.7231998443603516
Epoch 94, CIFAR-10 Batch 4: Loss=0.007608396466821432, Validation accuracy=0.7179998159408569
Epoch 94, CIFAR-10 Batch 5: Loss=0.008369640447199345, Validation accuracy=0.7123998403549194
Epoch 95, CIFAR-10 Batch 1: Loss=0.006686484906822443, Validation accuracy=0.7189998626708984
Epoch 95, CIFAR-10 Batch 2: Loss=0.009955007582902908, Validation accuracy=0.7223998308181763
Epoch 95, CIFAR-10 Batch 3: Loss=0.00806867890059948, Validation accuracy=0.7151998281478882
Epoch 95, CIFAR-10 Batch 4: Loss=0.006423587910830975, Validation accuracy=0.7179998755455017
Epoch 95, CIFAR-10 Batch 5: Loss=0.007088650017976761, Validation accuracy=0.7125998735427856
Epoch 96, CIFAR-10 Batch 1: Loss=0.007588584907352924, Validation accuracy=0.7125998735427856
Epoch 96, CIFAR-10 Batch 2: Loss=0.00792523194104433, Validation accuracy=0.7171999216079712
Epoch 96, CIFAR-10 Batch 3: Loss=0.00879823137074709, Validation accuracy=0.7141999006271362
Epoch 96, CIFAR-10 Batch 4: Loss=0.0073485239408910275, Validation accuracy=0.725199818611145
Epoch 96, CIFAR-10 Batch 5: Loss=0.007139712572097778, Validation accuracy=0.7235998511314392
Epoch 97, CIFAR-10 Batch 1: Loss=0.0068595753982663155, Validation accuracy=0.7159997820854187
Epoch 97, CIFAR-10 Batch 2: Loss=0.007698113098740578, Validation accuracy=0.7239998579025269
Epoch 97, CIFAR-10 Batch 3: Loss=0.00835911463946104, Validation accuracy=0.7149998545646667
Epoch 97, CIFAR-10 Batch 4: Loss=0.007553663104772568, Validation accuracy=0.7193998694419861
Epoch 97, CIFAR-10 Batch 5: Loss=0.007314232178032398, Validation accuracy=0.7163999080657959
Epoch 98, CIFAR-10 Batch 1: Loss=0.006154011934995651, Validation accuracy=0.7153999209403992
Epoch 98, CIFAR-10 Batch 2: Loss=0.00707691116258502, Validation accuracy=0.7205998301506042
Epoch 98, CIFAR-10 Batch 3: Loss=0.006568027660250664, Validation accuracy=0.7207998037338257
Epoch 98, CIFAR-10 Batch 4: Loss=0.005954512860625982, Validation accuracy=0.7155998945236206
Epoch 98, CIFAR-10 Batch 5: Loss=0.006839243695139885, Validation accuracy=0.7227999567985535
Epoch 99, CIFAR-10 Batch 1: Loss=0.0065099261701107025, Validation accuracy=0.71399986743927
Epoch 99, CIFAR-10 Batch 2: Loss=0.0071231527253985405, Validation accuracy=0.7145998477935791
Epoch 99, CIFAR-10 Batch 3: Loss=0.006846255622804165, Validation accuracy=0.718799889087677
Epoch 99, CIFAR-10 Batch 4: Loss=0.005248973611742258, Validation accuracy=0.7187998294830322
Epoch 99, CIFAR-10 Batch 5: Loss=0.007479959633201361, Validation accuracy=0.7219998836517334
Epoch 100, CIFAR-10 Batch 1: Loss=0.0072721559554338455, Validation accuracy=0.7123998403549194
Epoch 100, CIFAR-10 Batch 2: Loss=0.007958916015923023, Validation accuracy=0.7137998342514038
Epoch 100, CIFAR-10 Batch 3: Loss=0.006088641472160816, Validation accuracy=0.7105998396873474
Epoch 100, CIFAR-10 Batch 4: Loss=0.004985048435628414, Validation accuracy=0.7193998098373413
Epoch 100, CIFAR-10 Batch 5: Loss=0.005210121627897024, Validation accuracy=0.7245998382568359