Deep Belief Nets

Examples covered in the notebook touches on:

Pre-training,
feature extraction,
fine-tuning and
classification



In [1]:

    
import os
os.chdir('~/Codes/DL - Topic Modelling')

from __future__ import print_function, division
import sys
import timeit
from six.moves import cPickle as pickle

import numpy as np
import pandas as pd

import theano
import theano.tensor as T

from lib.deeplearning import deepbeliefnet









    



Using gpu device 0: Tesla K40c (CNMeM is disabled, cuDNN 5105)
/home/ekhongl/.conda/envs/py3/lib/python3.5/site-packages/theano/sandbox/cuda/__init__.py:600: UserWarning: Your cuDNN version is more recent than the one Theano officially supports. If you see any problems, try updating Theano or downgrading cuDNN to version 5.
  warnings.warn(warn)



In [2]:

    
# loading the data and transforming it into theano compatible variables
dat_x = np.genfromtxt('data/dtm_20news.csv', dtype='float32', delimiter=',', skip_header = 1)
dat_y = dat_x[:,0]
dat_x = dat_x[:,1:]
vocab =  np.genfromtxt('data/dtm_20news.csv', dtype=str, delimiter=',', max_rows = 1)[1:]
x = theano.shared(dat_x)
y = T.cast(dat_y, dtype='int32')

----------------------------------------------------------------------------------------------------------------------------------------------------------

1. Pretraining

Fitting the data to the deep belief model

----------------------------------------------------------------------------------------------------------------------------------------------------------



In [3]:

    
model = deepbeliefnet(architecture = [2756, 500, 500, 128])
model.pretrain(input = x, pretraining_epochs = 10, output_path = 'params/to_delete')









    



... building the model
Building layer: 0
   Input units: 2756
  Output units: 500
Building layer: 1
   Input units: 500
  Output units: 500
Building layer: 2
   Input units: 500
  Output units: 128
... getting the pretraining functions
... pre-training the model
Pre-training layer 0, epoch 0, cost  3.40055
Pre-training layer 0, epoch 1, cost  316.852
Pre-training layer 0, epoch 2, cost  187.822
Pre-training layer 0, epoch 3, cost  235.748
Pre-training layer 0, epoch 4, cost  482.326
Pre-training layer 0, epoch 5, cost  781.283
Pre-training layer 0, epoch 6, cost  1069.41
Pre-training layer 0, epoch 7, cost  1219.49
Pre-training layer 0, epoch 8, cost  1332.43
Pre-training layer 0, epoch 9, cost  1432.57
Pre-training layer 1, epoch 0, cost  -350.494
Pre-training layer 1, epoch 1, cost  -407.415






    



The pretraining for layer 0 ran for 0.04m






    



Pre-training layer 1, epoch 2, cost  -503.391
Pre-training layer 1, epoch 3, cost  -445.068
Pre-training layer 1, epoch 4, cost  -410.088
Pre-training layer 1, epoch 5, cost  -878.342
Pre-training layer 1, epoch 6, cost  -392.33
Pre-training layer 1, epoch 7, cost  -435.701
Pre-training layer 1, epoch 8, cost  -599.734
Pre-training layer 1, epoch 9, cost  -392.364
Pre-training layer 2, epoch 0, cost  -309.853
Pre-training layer 2, epoch 1, cost  -132.85






    



The pretraining for layer 1 ran for 0.06m






    



Pre-training layer 2, epoch 2, cost  -249.506
Pre-training layer 2, epoch 3, cost  -159.328
Pre-training layer 2, epoch 4, cost  -472.888
Pre-training layer 2, epoch 5, cost  -320.437
Pre-training layer 2, epoch 6, cost  -412.642
Pre-training layer 2, epoch 7, cost  -138.762
Pre-training layer 2, epoch 8, cost  -256.535
Pre-training layer 2, epoch 9, cost  -194.618






    



The pretraining for layer 2 ran for 0.06m

Visualizing the changes in likelihood for each iteration



In [4]:

    
import matplotlib.pyplot as plt
%matplotlib inline
plt_dat = np.genfromtxt('params_2000/dbn_params_pretrain/lproxy_layer_2.csv', delimiter=',', names = True)[:20]
plt.plot(plt_dat)
plt.show()

----------------------------------------------------------------------------------------------------------------------------------------------------------

2. Extracting Features

Retrieve features created by the unsupervised pretrained DBN outputs.

----------------------------------------------------------------------------------------------------------------------------------------------------------



In [31]:

    
model = deepbeliefnet(architecture = [2756, 500, 500, 128], opt_epochs = [900,5,10],
                      predefined_weights = 'params/dbn_params')
output = model.score(input = x)









    



... building the model
Building layer: 0
   Input units: 2756
  Output units: 500
Building layer: 1
   Input units: 500
  Output units: 500
Building layer: 2
   Input units: 500
  Output units: 128
Pre-trained DBN model from "params/dbn_params" loaded.



In [6]:

    
colnames = ['bit'] * 128
colnames = [colnames[i] + str(i) for i in range(128)]
colnames.insert(0,'_label_')
pd.DataFrame(data = np.c_[dat_y, output], 
             columns = colnames). \
             to_csv( 'data/dbn_features.csv', index = False)

----------------------------------------------------------------------------------------------------------------------------------------------------------

3. Fine-Tuning

Demonstrates the conversion of a DBN into an MLP and training it w.r.t. to targets

----------------------------------------------------------------------------------------------------------------------------------------------------------



In [7]:

    
model = deepbeliefnet(architecture = [2756, 500, 500, 128], opt_epochs = [900,5,10], n_outs = 20, predefined_weights = 'params/dbn_params')
#model.train(x=x, y=y,batch_size = 70, training_epochs = 10, output_path = 'params/to_delete')
model.train(x=x, y=y, training_epochs = 10000, learning_rate = (1/70)/2, batch_size = 120,
            drop_out = [0.2, .5, .5, .5], output_path = 'params/to_delete')









    



... building the model
Building layer: 0
   Input units: 2756
  Output units: 500
Building layer: 1
   Input units: 500
  Output units: 500
Building layer: 2
   Input units: 500
  Output units: 128
Pre-trained DBN model from "params/dbn_params" loaded.
... getting the finetuning functions
... finetuning the model
epoch 1, minibatch 101/101, validation error 95.253623 %
     epoch 1, minibatch 101/101, test error of best model 95.241935 %
Saving model...
...model saved.
epoch 2, minibatch 101/101, validation error 95.000000 %
     epoch 2, minibatch 101/101, test error of best model 95.161290 %
Saving model...
...model saved.
epoch 3, minibatch 101/101, validation error 94.021739 %
     epoch 3, minibatch 101/101, test error of best model 94.596774 %
Saving model...
...model saved.
epoch 4, minibatch 101/101, validation error 93.297101 %
     epoch 4, minibatch 101/101, test error of best model 93.817204 %
Saving model...
...model saved.
epoch 5, minibatch 101/101, validation error 92.500000 %
     epoch 5, minibatch 101/101, test error of best model 93.010753 %
Saving model...
...model saved.
epoch 6, minibatch 101/101, validation error 91.086957 %
     epoch 6, minibatch 101/101, test error of best model 91.881720 %
Saving model...
...model saved.
epoch 7, minibatch 101/101, validation error 90.036232 %
     epoch 7, minibatch 101/101, test error of best model 90.483871 %
Saving model...
...model saved.
epoch 8, minibatch 101/101, validation error 88.152174 %
     epoch 8, minibatch 101/101, test error of best model 89.112903 %
Saving model...
...model saved.
epoch 9, minibatch 101/101, validation error 86.521739 %
     epoch 9, minibatch 101/101, test error of best model 87.822581 %
Saving model...
...model saved.
epoch 10, minibatch 101/101, validation error 85.253623 %
     epoch 10, minibatch 101/101, test error of best model 86.021505 %
Saving model...
...model saved.
epoch 11, minibatch 101/101, validation error 83.152174 %
     epoch 11, minibatch 101/101, test error of best model 84.543011 %
Saving model...
...model saved.
epoch 12, minibatch 101/101, validation error 81.449275 %
     epoch 12, minibatch 101/101, test error of best model 83.064516 %
Saving model...
...model saved.
epoch 13, minibatch 101/101, validation error 79.855072 %
     epoch 13, minibatch 101/101, test error of best model 81.774194 %
Saving model...
...model saved.
epoch 14, minibatch 101/101, validation error 78.079710 %
     epoch 14, minibatch 101/101, test error of best model 80.564516 %
Saving model...
...model saved.
epoch 15, minibatch 101/101, validation error 76.884058 %
     epoch 15, minibatch 101/101, test error of best model 79.220430 %
Saving model...
...model saved.
epoch 16, minibatch 101/101, validation error 75.471014 %
     epoch 16, minibatch 101/101, test error of best model 77.903226 %
Saving model...
...model saved.
epoch 17, minibatch 101/101, validation error 74.239130 %
     epoch 17, minibatch 101/101, test error of best model 76.478495 %
Saving model...
...model saved.
epoch 18, minibatch 101/101, validation error 73.695652 %
     epoch 18, minibatch 101/101, test error of best model 74.973118 %
Saving model...
...model saved.
epoch 19, minibatch 101/101, validation error 72.753623 %
     epoch 19, minibatch 101/101, test error of best model 73.709677 %
Saving model...
...model saved.
epoch 20, minibatch 101/101, validation error 71.811594 %
     epoch 20, minibatch 101/101, test error of best model 72.419355 %
Saving model...
...model saved.
epoch 21, minibatch 101/101, validation error 70.036232 %
     epoch 21, minibatch 101/101, test error of best model 71.075269 %
Saving model...
...model saved.
epoch 22, minibatch 101/101, validation error 69.420290 %
     epoch 22, minibatch 101/101, test error of best model 70.053763 %
Saving model...
...model saved.
epoch 23, minibatch 101/101, validation error 68.405797 %
     epoch 23, minibatch 101/101, test error of best model 69.193548 %
Saving model...
...model saved.
epoch 24, minibatch 101/101, validation error 67.753623 %
     epoch 24, minibatch 101/101, test error of best model 68.629032 %
Saving model...
...model saved.
epoch 25, minibatch 101/101, validation error 66.666667 %
     epoch 25, minibatch 101/101, test error of best model 67.795699 %
Saving model...
...model saved.
epoch 26, minibatch 101/101, validation error 66.376812 %
     epoch 26, minibatch 101/101, test error of best model 67.365591 %
Saving model...
...model saved.
epoch 27, minibatch 101/101, validation error 65.760870 %
     epoch 27, minibatch 101/101, test error of best model 66.720430 %
Saving model...
...model saved.
epoch 28, minibatch 101/101, validation error 65.398551 %
     epoch 28, minibatch 101/101, test error of best model 65.967742 %
Saving model...
...model saved.
epoch 29, minibatch 101/101, validation error 64.891304 %
     epoch 29, minibatch 101/101, test error of best model 65.403226 %
Saving model...
...model saved.
epoch 30, minibatch 101/101, validation error 64.782609 %
     epoch 30, minibatch 101/101, test error of best model 65.000000 %
Saving model...
...model saved.
epoch 31, minibatch 101/101, validation error 64.202899 %
     epoch 31, minibatch 101/101, test error of best model 64.623656 %
Saving model...
...model saved.
epoch 32, minibatch 101/101, validation error 63.695652 %
     epoch 32, minibatch 101/101, test error of best model 63.844086 %
Saving model...
...model saved.
epoch 33, minibatch 101/101, validation error 63.152174 %
     epoch 33, minibatch 101/101, test error of best model 63.548387 %
Saving model...
...model saved.
epoch 34, minibatch 101/101, validation error 62.427536 %
     epoch 34, minibatch 101/101, test error of best model 63.360215 %
Saving model...
...model saved.
epoch 35, minibatch 101/101, validation error 62.101449 %
     epoch 35, minibatch 101/101, test error of best model 62.956989 %
Saving model...
...model saved.
epoch 36, minibatch 101/101, validation error 61.739130 %
     epoch 36, minibatch 101/101, test error of best model 62.419355 %
Saving model...
...model saved.
epoch 37, minibatch 101/101, validation error 61.630435 %
     epoch 37, minibatch 101/101, test error of best model 62.338710 %
Saving model...
...model saved.
epoch 38, minibatch 101/101, validation error 61.231884 %
     epoch 38, minibatch 101/101, test error of best model 61.908602 %
Saving model...
...model saved.
epoch 39, minibatch 101/101, validation error 61.086957 %
     epoch 39, minibatch 101/101, test error of best model 61.666667 %
Saving model...
...model saved.
epoch 40, minibatch 101/101, validation error 60.760870 %
     epoch 40, minibatch 101/101, test error of best model 61.209677 %
Saving model...
...model saved.
epoch 41, minibatch 101/101, validation error 60.507246 %
     epoch 41, minibatch 101/101, test error of best model 60.967742 %
Saving model...
...model saved.
epoch 42, minibatch 101/101, validation error 60.326087 %
     epoch 42, minibatch 101/101, test error of best model 60.618280 %
Saving model...
...model saved.
epoch 43, minibatch 101/101, validation error 60.000000 %
     epoch 43, minibatch 101/101, test error of best model 60.376344 %
Saving model...
...model saved.
epoch 44, minibatch 101/101, validation error 59.492754 %
     epoch 44, minibatch 101/101, test error of best model 60.215054 %
Saving model...
...model saved.
epoch 45, minibatch 101/101, validation error 59.275362 %
     epoch 45, minibatch 101/101, test error of best model 59.946237 %
Saving model...
...model saved.
epoch 46, minibatch 101/101, validation error 58.985507 %
     epoch 46, minibatch 101/101, test error of best model 59.650538 %
Saving model...
...model saved.
epoch 47, minibatch 101/101, validation error 58.695652 %
     epoch 47, minibatch 101/101, test error of best model 59.408602 %
Saving model...
...model saved.
epoch 48, minibatch 101/101, validation error 58.405797 %
     epoch 48, minibatch 101/101, test error of best model 59.112903 %
Saving model...
...model saved.
epoch 49, minibatch 101/101, validation error 58.442029 %
epoch 50, minibatch 101/101, validation error 58.007246 %
     epoch 50, minibatch 101/101, test error of best model 58.682796 %
Saving model...
...model saved.
epoch 51, minibatch 101/101, validation error 57.717391 %
     epoch 51, minibatch 101/101, test error of best model 58.440860 %
Saving model...
...model saved.
epoch 52, minibatch 101/101, validation error 57.028986 %
     epoch 52, minibatch 101/101, test error of best model 58.010753 %
Saving model...
...model saved.
epoch 53, minibatch 101/101, validation error 56.630435 %
     epoch 53, minibatch 101/101, test error of best model 57.688172 %
Saving model...
...model saved.
epoch 54, minibatch 101/101, validation error 56.123188 %
     epoch 54, minibatch 101/101, test error of best model 57.258065 %
Saving model...
...model saved.
epoch 55, minibatch 101/101, validation error 55.833333 %
     epoch 55, minibatch 101/101, test error of best model 57.069892 %
Saving model...
...model saved.
epoch 56, minibatch 101/101, validation error 55.688406 %
     epoch 56, minibatch 101/101, test error of best model 56.666667 %
Saving model...
...model saved.
epoch 57, minibatch 101/101, validation error 55.543478 %
     epoch 57, minibatch 101/101, test error of best model 56.263441 %
Saving model...
...model saved.
epoch 58, minibatch 101/101, validation error 55.217391 %
     epoch 58, minibatch 101/101, test error of best model 55.887097 %
Saving model...
...model saved.
epoch 59, minibatch 101/101, validation error 54.528986 %
     epoch 59, minibatch 101/101, test error of best model 55.134409 %
Saving model...
...model saved.
epoch 60, minibatch 101/101, validation error 54.094203 %
     epoch 60, minibatch 101/101, test error of best model 54.704301 %
Saving model...
...model saved.
epoch 61, minibatch 101/101, validation error 53.695652 %
     epoch 61, minibatch 101/101, test error of best model 54.139785 %
Saving model...
...model saved.
epoch 62, minibatch 101/101, validation error 53.333333 %
     epoch 62, minibatch 101/101, test error of best model 53.870968 %
Saving model...
...model saved.
epoch 63, minibatch 101/101, validation error 52.826087 %
     epoch 63, minibatch 101/101, test error of best model 53.763441 %
Saving model...
...model saved.
epoch 64, minibatch 101/101, validation error 52.717391 %
     epoch 64, minibatch 101/101, test error of best model 53.306452 %
Saving model...
...model saved.
epoch 65, minibatch 101/101, validation error 52.427536 %
     epoch 65, minibatch 101/101, test error of best model 52.768817 %
Saving model...
...model saved.
epoch 66, minibatch 101/101, validation error 52.210145 %
     epoch 66, minibatch 101/101, test error of best model 52.446237 %
Saving model...
...model saved.
epoch 67, minibatch 101/101, validation error 51.811594 %
     epoch 67, minibatch 101/101, test error of best model 51.908602 %
Saving model...
...model saved.
epoch 68, minibatch 101/101, validation error 51.594203 %
     epoch 68, minibatch 101/101, test error of best model 51.639785 %
Saving model...
...model saved.
epoch 69, minibatch 101/101, validation error 51.304348 %
     epoch 69, minibatch 101/101, test error of best model 51.290323 %
Saving model...
...model saved.
epoch 70, minibatch 101/101, validation error 51.050725 %
     epoch 70, minibatch 101/101, test error of best model 50.806452 %
Saving model...
...model saved.
epoch 71, minibatch 101/101, validation error 50.507246 %
     epoch 71, minibatch 101/101, test error of best model 50.483871 %
Saving model...
...model saved.
epoch 72, minibatch 101/101, validation error 50.108696 %
     epoch 72, minibatch 101/101, test error of best model 50.107527 %
Saving model...
...model saved.
epoch 73, minibatch 101/101, validation error 49.891304 %
     epoch 73, minibatch 101/101, test error of best model 49.838710 %
Saving model...
...model saved.
epoch 74, minibatch 101/101, validation error 49.637681 %
     epoch 74, minibatch 101/101, test error of best model 49.650538 %
Saving model...
...model saved.
epoch 75, minibatch 101/101, validation error 49.384058 %
     epoch 75, minibatch 101/101, test error of best model 49.381720 %
Saving model...
...model saved.
epoch 76, minibatch 101/101, validation error 49.384058 %
     epoch 76, minibatch 101/101, test error of best model 49.086022 %
Saving model...
...model saved.
epoch 77, minibatch 101/101, validation error 49.130435 %
     epoch 77, minibatch 101/101, test error of best model 48.387097 %
Saving model...
...model saved.
epoch 78, minibatch 101/101, validation error 48.840580 %
     epoch 78, minibatch 101/101, test error of best model 48.198925 %
Saving model...
...model saved.
epoch 79, minibatch 101/101, validation error 48.442029 %
     epoch 79, minibatch 101/101, test error of best model 47.849462 %
Saving model...
...model saved.
epoch 80, minibatch 101/101, validation error 48.369565 %
     epoch 80, minibatch 101/101, test error of best model 47.553763 %
Saving model...
...model saved.
epoch 81, minibatch 101/101, validation error 48.260870 %
     epoch 81, minibatch 101/101, test error of best model 47.311828 %
Saving model...
...model saved.
epoch 82, minibatch 101/101, validation error 47.862319 %
     epoch 82, minibatch 101/101, test error of best model 47.150538 %
Saving model...
...model saved.
epoch 83, minibatch 101/101, validation error 47.572464 %
     epoch 83, minibatch 101/101, test error of best model 46.908602 %
Saving model...
...model saved.
epoch 84, minibatch 101/101, validation error 47.246377 %
     epoch 84, minibatch 101/101, test error of best model 46.827957 %
Saving model...
...model saved.
epoch 85, minibatch 101/101, validation error 47.137681 %
     epoch 85, minibatch 101/101, test error of best model 46.639785 %
Saving model...
...model saved.
epoch 86, minibatch 101/101, validation error 46.739130 %
     epoch 86, minibatch 101/101, test error of best model 46.263441 %
Saving model...
...model saved.
epoch 87, minibatch 101/101, validation error 46.485507 %
     epoch 87, minibatch 101/101, test error of best model 45.940860 %
Saving model...
...model saved.
epoch 88, minibatch 101/101, validation error 46.159420 %
     epoch 88, minibatch 101/101, test error of best model 45.752688 %
Saving model...
...model saved.
epoch 89, minibatch 101/101, validation error 45.978261 %
     epoch 89, minibatch 101/101, test error of best model 45.430108 %
Saving model...
...model saved.
epoch 90, minibatch 101/101, validation error 45.688406 %
     epoch 90, minibatch 101/101, test error of best model 45.483871 %
Saving model...
...model saved.
epoch 91, minibatch 101/101, validation error 45.072464 %
     epoch 91, minibatch 101/101, test error of best model 45.026882 %
Saving model...
...model saved.
epoch 92, minibatch 101/101, validation error 44.673913 %
     epoch 92, minibatch 101/101, test error of best model 44.811828 %
Saving model...
...model saved.
epoch 93, minibatch 101/101, validation error 44.311594 %
     epoch 93, minibatch 101/101, test error of best model 44.596774 %
Saving model...
...model saved.
epoch 94, minibatch 101/101, validation error 43.985507 %
     epoch 94, minibatch 101/101, test error of best model 44.435484 %
Saving model...
...model saved.
epoch 95, minibatch 101/101, validation error 43.768116 %
     epoch 95, minibatch 101/101, test error of best model 44.327957 %
Saving model...
...model saved.
epoch 96, minibatch 101/101, validation error 43.442029 %
     epoch 96, minibatch 101/101, test error of best model 44.166667 %
Saving model...
...model saved.
epoch 97, minibatch 101/101, validation error 43.152174 %
     epoch 97, minibatch 101/101, test error of best model 43.790323 %
Saving model...
...model saved.
epoch 98, minibatch 101/101, validation error 42.934783 %
     epoch 98, minibatch 101/101, test error of best model 43.763441 %
Saving model...
...model saved.
epoch 99, minibatch 101/101, validation error 42.644928 %
     epoch 99, minibatch 101/101, test error of best model 43.494624 %
Saving model...
...model saved.
epoch 100, minibatch 101/101, validation error 42.427536 %
     epoch 100, minibatch 101/101, test error of best model 43.333333 %
Saving model...
...model saved.
epoch 101, minibatch 101/101, validation error 42.173913 %
     epoch 101, minibatch 101/101, test error of best model 43.225806 %
Saving model...
...model saved.
epoch 102, minibatch 101/101, validation error 41.775362 %
     epoch 102, minibatch 101/101, test error of best model 42.956989 %
Saving model...
...model saved.
epoch 103, minibatch 101/101, validation error 41.775362 %
     epoch 103, minibatch 101/101, test error of best model 42.741935 %
Saving model...
...model saved.
epoch 104, minibatch 101/101, validation error 41.666667 %
     epoch 104, minibatch 101/101, test error of best model 42.661290 %
Saving model...
...model saved.
epoch 105, minibatch 101/101, validation error 41.485507 %
     epoch 105, minibatch 101/101, test error of best model 42.419355 %
Saving model...
...model saved.
epoch 106, minibatch 101/101, validation error 41.304348 %
     epoch 106, minibatch 101/101, test error of best model 42.204301 %
Saving model...
...model saved.
epoch 107, minibatch 101/101, validation error 41.050725 %
     epoch 107, minibatch 101/101, test error of best model 42.123656 %
Saving model...
...model saved.
epoch 108, minibatch 101/101, validation error 40.833333 %
     epoch 108, minibatch 101/101, test error of best model 41.881720 %
Saving model...
...model saved.
epoch 109, minibatch 101/101, validation error 40.507246 %
     epoch 109, minibatch 101/101, test error of best model 41.586022 %
Saving model...
...model saved.
epoch 110, minibatch 101/101, validation error 40.398551 %
     epoch 110, minibatch 101/101, test error of best model 41.424731 %
Saving model...
...model saved.
epoch 111, minibatch 101/101, validation error 40.253623 %
     epoch 111, minibatch 101/101, test error of best model 41.397849 %
Saving model...
...model saved.
epoch 112, minibatch 101/101, validation error 39.963768 %
     epoch 112, minibatch 101/101, test error of best model 41.263441 %
Saving model...
...model saved.
epoch 113, minibatch 101/101, validation error 39.782609 %
     epoch 113, minibatch 101/101, test error of best model 41.129032 %
Saving model...
...model saved.
epoch 114, minibatch 101/101, validation error 39.528986 %
     epoch 114, minibatch 101/101, test error of best model 40.698925 %
Saving model...
...model saved.
epoch 115, minibatch 101/101, validation error 39.420290 %
     epoch 115, minibatch 101/101, test error of best model 40.564516 %
Saving model...
...model saved.
epoch 116, minibatch 101/101, validation error 39.347826 %
     epoch 116, minibatch 101/101, test error of best model 40.268817 %
Saving model...
...model saved.
epoch 117, minibatch 101/101, validation error 39.166667 %
     epoch 117, minibatch 101/101, test error of best model 40.053763 %
Saving model...
...model saved.
epoch 118, minibatch 101/101, validation error 39.057971 %
     epoch 118, minibatch 101/101, test error of best model 39.811828 %
Saving model...
...model saved.
epoch 119, minibatch 101/101, validation error 39.057971 %
epoch 120, minibatch 101/101, validation error 38.985507 %
     epoch 120, minibatch 101/101, test error of best model 39.569892 %
Saving model...
...model saved.
epoch 121, minibatch 101/101, validation error 38.804348 %
     epoch 121, minibatch 101/101, test error of best model 39.274194 %
Saving model...
...model saved.
epoch 122, minibatch 101/101, validation error 38.478261 %
     epoch 122, minibatch 101/101, test error of best model 39.086022 %
Saving model...
...model saved.
epoch 123, minibatch 101/101, validation error 38.224638 %
     epoch 123, minibatch 101/101, test error of best model 38.817204 %
Saving model...
...model saved.
epoch 124, minibatch 101/101, validation error 38.115942 %
     epoch 124, minibatch 101/101, test error of best model 38.682796 %
Saving model...
...model saved.
epoch 125, minibatch 101/101, validation error 38.043478 %
     epoch 125, minibatch 101/101, test error of best model 38.494624 %
Saving model...
...model saved.
epoch 126, minibatch 101/101, validation error 38.007246 %
     epoch 126, minibatch 101/101, test error of best model 38.172043 %
Saving model...
...model saved.
epoch 127, minibatch 101/101, validation error 37.934783 %
     epoch 127, minibatch 101/101, test error of best model 38.010753 %
Saving model...
...model saved.
epoch 128, minibatch 101/101, validation error 37.826087 %
     epoch 128, minibatch 101/101, test error of best model 37.956989 %
Saving model...
...model saved.
epoch 129, minibatch 101/101, validation error 37.681159 %
     epoch 129, minibatch 101/101, test error of best model 37.822581 %
Saving model...
...model saved.
epoch 130, minibatch 101/101, validation error 37.318841 %
     epoch 130, minibatch 101/101, test error of best model 37.553763 %
Saving model...
...model saved.
epoch 131, minibatch 101/101, validation error 36.956522 %
     epoch 131, minibatch 101/101, test error of best model 37.419355 %
Saving model...
...model saved.
epoch 132, minibatch 101/101, validation error 36.847826 %
     epoch 132, minibatch 101/101, test error of best model 37.069892 %
Saving model...
...model saved.
epoch 133, minibatch 101/101, validation error 36.702899 %
     epoch 133, minibatch 101/101, test error of best model 36.881720 %
Saving model...
...model saved.
epoch 134, minibatch 101/101, validation error 36.630435 %
     epoch 134, minibatch 101/101, test error of best model 36.693548 %
Saving model...
...model saved.
epoch 135, minibatch 101/101, validation error 36.449275 %
     epoch 135, minibatch 101/101, test error of best model 36.612903 %
Saving model...
...model saved.
epoch 136, minibatch 101/101, validation error 36.195652 %
     epoch 136, minibatch 101/101, test error of best model 36.478495 %
Saving model...
...model saved.
epoch 137, minibatch 101/101, validation error 36.159420 %
     epoch 137, minibatch 101/101, test error of best model 36.317204 %
Saving model...
...model saved.
epoch 138, minibatch 101/101, validation error 36.050725 %
     epoch 138, minibatch 101/101, test error of best model 36.048387 %
Saving model...
...model saved.
epoch 139, minibatch 101/101, validation error 35.942029 %
     epoch 139, minibatch 101/101, test error of best model 35.967742 %
Saving model...
...model saved.
epoch 140, minibatch 101/101, validation error 35.797101 %
     epoch 140, minibatch 101/101, test error of best model 35.913978 %
Saving model...
...model saved.
epoch 141, minibatch 101/101, validation error 35.869565 %
epoch 142, minibatch 101/101, validation error 35.688406 %
     epoch 142, minibatch 101/101, test error of best model 35.430108 %
Saving model...
...model saved.
epoch 143, minibatch 101/101, validation error 35.507246 %
     epoch 143, minibatch 101/101, test error of best model 35.268817 %
Saving model...
...model saved.
epoch 144, minibatch 101/101, validation error 35.362319 %
     epoch 144, minibatch 101/101, test error of best model 35.161290 %
Saving model...
...model saved.
epoch 145, minibatch 101/101, validation error 35.144928 %
     epoch 145, minibatch 101/101, test error of best model 35.000000 %
Saving model...
...model saved.
epoch 146, minibatch 101/101, validation error 35.108696 %
     epoch 146, minibatch 101/101, test error of best model 34.919355 %
Saving model...
...model saved.
epoch 147, minibatch 101/101, validation error 34.963768 %
     epoch 147, minibatch 101/101, test error of best model 34.865591 %
Saving model...
...model saved.
epoch 148, minibatch 101/101, validation error 34.963768 %
epoch 149, minibatch 101/101, validation error 34.746377 %
     epoch 149, minibatch 101/101, test error of best model 34.569892 %
Saving model...
...model saved.
epoch 150, minibatch 101/101, validation error 34.637681 %
     epoch 150, minibatch 101/101, test error of best model 34.543011 %
Saving model...
...model saved.
epoch 151, minibatch 101/101, validation error 34.384058 %
     epoch 151, minibatch 101/101, test error of best model 34.381720 %
Saving model...
...model saved.
epoch 152, minibatch 101/101, validation error 34.275362 %
     epoch 152, minibatch 101/101, test error of best model 34.301075 %
Saving model...
...model saved.
epoch 153, minibatch 101/101, validation error 34.094203 %
     epoch 153, minibatch 101/101, test error of best model 34.193548 %
Saving model...
...model saved.
epoch 154, minibatch 101/101, validation error 33.985507 %
     epoch 154, minibatch 101/101, test error of best model 33.870968 %
Saving model...
...model saved.
epoch 155, minibatch 101/101, validation error 33.840580 %
     epoch 155, minibatch 101/101, test error of best model 33.682796 %
Saving model...
...model saved.
epoch 156, minibatch 101/101, validation error 33.623188 %
     epoch 156, minibatch 101/101, test error of best model 33.440860 %
Saving model...
...model saved.
epoch 157, minibatch 101/101, validation error 33.514493 %
     epoch 157, minibatch 101/101, test error of best model 33.225806 %
Saving model...
...model saved.
epoch 158, minibatch 101/101, validation error 33.333333 %
     epoch 158, minibatch 101/101, test error of best model 33.037634 %
Saving model...
...model saved.
epoch 159, minibatch 101/101, validation error 33.224638 %
     epoch 159, minibatch 101/101, test error of best model 32.903226 %
Saving model...
...model saved.
epoch 160, minibatch 101/101, validation error 33.079710 %
     epoch 160, minibatch 101/101, test error of best model 32.688172 %
Saving model...
...model saved.
epoch 161, minibatch 101/101, validation error 32.898551 %
     epoch 161, minibatch 101/101, test error of best model 32.553763 %
Saving model...
...model saved.
epoch 162, minibatch 101/101, validation error 32.826087 %
     epoch 162, minibatch 101/101, test error of best model 32.338710 %
Saving model...
...model saved.
epoch 163, minibatch 101/101, validation error 32.789855 %
     epoch 163, minibatch 101/101, test error of best model 32.177419 %
Saving model...
...model saved.
epoch 164, minibatch 101/101, validation error 32.681159 %
     epoch 164, minibatch 101/101, test error of best model 31.962366 %
Saving model...
...model saved.
epoch 165, minibatch 101/101, validation error 32.572464 %
     epoch 165, minibatch 101/101, test error of best model 31.747312 %
Saving model...
...model saved.
epoch 166, minibatch 101/101, validation error 32.536232 %
     epoch 166, minibatch 101/101, test error of best model 31.666667 %
Saving model...
...model saved.
epoch 167, minibatch 101/101, validation error 32.500000 %
     epoch 167, minibatch 101/101, test error of best model 31.612903 %
Saving model...
...model saved.
epoch 168, minibatch 101/101, validation error 32.282609 %
     epoch 168, minibatch 101/101, test error of best model 31.532258 %
Saving model...
...model saved.
epoch 169, minibatch 101/101, validation error 32.137681 %
     epoch 169, minibatch 101/101, test error of best model 31.397849 %
Saving model...
...model saved.
epoch 170, minibatch 101/101, validation error 32.101449 %
     epoch 170, minibatch 101/101, test error of best model 31.317204 %
Saving model...
...model saved.
epoch 171, minibatch 101/101, validation error 32.028986 %
     epoch 171, minibatch 101/101, test error of best model 31.317204 %
Saving model...
...model saved.
epoch 172, minibatch 101/101, validation error 31.992754 %
     epoch 172, minibatch 101/101, test error of best model 31.155914 %
Saving model...
...model saved.
epoch 173, minibatch 101/101, validation error 31.884058 %
     epoch 173, minibatch 101/101, test error of best model 31.075269 %
Saving model...
...model saved.
epoch 174, minibatch 101/101, validation error 31.811594 %
     epoch 174, minibatch 101/101, test error of best model 30.994624 %
Saving model...
...model saved.
epoch 175, minibatch 101/101, validation error 31.775362 %
     epoch 175, minibatch 101/101, test error of best model 30.967742 %
Saving model...
...model saved.
epoch 176, minibatch 101/101, validation error 31.811594 %
epoch 177, minibatch 101/101, validation error 31.557971 %
     epoch 177, minibatch 101/101, test error of best model 30.779570 %
Saving model...
...model saved.
epoch 178, minibatch 101/101, validation error 31.413043 %
     epoch 178, minibatch 101/101, test error of best model 30.645161 %
Saving model...
...model saved.
epoch 179, minibatch 101/101, validation error 31.195652 %
     epoch 179, minibatch 101/101, test error of best model 30.537634 %
Saving model...
...model saved.
epoch 180, minibatch 101/101, validation error 31.050725 %
     epoch 180, minibatch 101/101, test error of best model 30.376344 %
Saving model...
...model saved.
epoch 181, minibatch 101/101, validation error 31.086957 %
epoch 182, minibatch 101/101, validation error 31.050725 %
epoch 183, minibatch 101/101, validation error 30.869565 %
     epoch 183, minibatch 101/101, test error of best model 29.758065 %
Saving model...
...model saved.
epoch 184, minibatch 101/101, validation error 30.760870 %
     epoch 184, minibatch 101/101, test error of best model 29.650538 %
Saving model...
...model saved.
epoch 185, minibatch 101/101, validation error 30.652174 %
     epoch 185, minibatch 101/101, test error of best model 29.596774 %
Saving model...
...model saved.
epoch 186, minibatch 101/101, validation error 30.579710 %
     epoch 186, minibatch 101/101, test error of best model 29.489247 %
Saving model...
...model saved.
epoch 187, minibatch 101/101, validation error 30.507246 %
     epoch 187, minibatch 101/101, test error of best model 29.408602 %
Saving model...
...model saved.
epoch 188, minibatch 101/101, validation error 30.289855 %
     epoch 188, minibatch 101/101, test error of best model 29.354839 %
Saving model...
...model saved.
epoch 189, minibatch 101/101, validation error 30.217391 %
     epoch 189, minibatch 101/101, test error of best model 29.274194 %
Saving model...
...model saved.
epoch 190, minibatch 101/101, validation error 30.108696 %
     epoch 190, minibatch 101/101, test error of best model 29.139785 %
Saving model...
...model saved.
epoch 191, minibatch 101/101, validation error 29.963768 %
     epoch 191, minibatch 101/101, test error of best model 29.112903 %
Saving model...
...model saved.
epoch 192, minibatch 101/101, validation error 29.855072 %
     epoch 192, minibatch 101/101, test error of best model 28.951613 %
Saving model...
...model saved.
epoch 193, minibatch 101/101, validation error 29.818841 %
     epoch 193, minibatch 101/101, test error of best model 28.817204 %
Saving model...
...model saved.
epoch 194, minibatch 101/101, validation error 29.528986 %
     epoch 194, minibatch 101/101, test error of best model 28.736559 %
Saving model...
...model saved.
epoch 195, minibatch 101/101, validation error 29.420290 %
     epoch 195, minibatch 101/101, test error of best model 28.790323 %
Saving model...
...model saved.
epoch 196, minibatch 101/101, validation error 29.311594 %
     epoch 196, minibatch 101/101, test error of best model 28.682796 %
Saving model...
...model saved.
epoch 197, minibatch 101/101, validation error 29.239130 %
     epoch 197, minibatch 101/101, test error of best model 28.655914 %
Saving model...
...model saved.
epoch 198, minibatch 101/101, validation error 29.094203 %
     epoch 198, minibatch 101/101, test error of best model 28.575269 %
Saving model...
...model saved.
epoch 199, minibatch 101/101, validation error 29.021739 %
     epoch 199, minibatch 101/101, test error of best model 28.521505 %
Saving model...
...model saved.
epoch 200, minibatch 101/101, validation error 28.949275 %
     epoch 200, minibatch 101/101, test error of best model 28.494624 %
Saving model...
...model saved.
epoch 201, minibatch 101/101, validation error 28.876812 %
     epoch 201, minibatch 101/101, test error of best model 28.467742 %
Saving model...
...model saved.
epoch 202, minibatch 101/101, validation error 28.768116 %
     epoch 202, minibatch 101/101, test error of best model 28.306452 %
Saving model...
...model saved.
epoch 203, minibatch 101/101, validation error 28.659420 %
     epoch 203, minibatch 101/101, test error of best model 28.198925 %
Saving model...
...model saved.
epoch 204, minibatch 101/101, validation error 28.623188 %
     epoch 204, minibatch 101/101, test error of best model 28.118280 %
Saving model...
...model saved.
epoch 205, minibatch 101/101, validation error 28.442029 %
     epoch 205, minibatch 101/101, test error of best model 27.983871 %
Saving model...
...model saved.
epoch 206, minibatch 101/101, validation error 28.333333 %
     epoch 206, minibatch 101/101, test error of best model 27.903226 %
Saving model...
...model saved.
epoch 207, minibatch 101/101, validation error 28.297101 %
     epoch 207, minibatch 101/101, test error of best model 27.822581 %
Saving model...
...model saved.
epoch 208, minibatch 101/101, validation error 28.260870 %
     epoch 208, minibatch 101/101, test error of best model 27.688172 %
Saving model...
...model saved.
epoch 209, minibatch 101/101, validation error 28.224638 %
     epoch 209, minibatch 101/101, test error of best model 27.526882 %
Saving model...
...model saved.
epoch 210, minibatch 101/101, validation error 28.224638 %
epoch 211, minibatch 101/101, validation error 28.079710 %
     epoch 211, minibatch 101/101, test error of best model 27.365591 %
Saving model...
...model saved.
epoch 212, minibatch 101/101, validation error 28.152174 %
epoch 213, minibatch 101/101, validation error 28.043478 %
     epoch 213, minibatch 101/101, test error of best model 27.204301 %
Saving model...
...model saved.
epoch 214, minibatch 101/101, validation error 28.043478 %
epoch 215, minibatch 101/101, validation error 28.079710 %
epoch 216, minibatch 101/101, validation error 28.007246 %
     epoch 216, minibatch 101/101, test error of best model 27.123656 %
Saving model...
...model saved.
epoch 217, minibatch 101/101, validation error 27.898551 %
     epoch 217, minibatch 101/101, test error of best model 27.043011 %
Saving model...
...model saved.
epoch 218, minibatch 101/101, validation error 27.717391 %
     epoch 218, minibatch 101/101, test error of best model 26.854839 %
Saving model...
...model saved.
epoch 219, minibatch 101/101, validation error 27.644928 %
     epoch 219, minibatch 101/101, test error of best model 26.801075 %
Saving model...
...model saved.
epoch 220, minibatch 101/101, validation error 27.572464 %
     epoch 220, minibatch 101/101, test error of best model 26.747312 %
Saving model...
...model saved.
epoch 221, minibatch 101/101, validation error 27.500000 %
     epoch 221, minibatch 101/101, test error of best model 26.720430 %
Saving model...
...model saved.
epoch 222, minibatch 101/101, validation error 27.463768 %
     epoch 222, minibatch 101/101, test error of best model 26.693548 %
Saving model...
...model saved.
epoch 223, minibatch 101/101, validation error 27.355072 %
     epoch 223, minibatch 101/101, test error of best model 26.612903 %
Saving model...
...model saved.
epoch 224, minibatch 101/101, validation error 27.246377 %
     epoch 224, minibatch 101/101, test error of best model 26.397849 %
Saving model...
...model saved.
epoch 225, minibatch 101/101, validation error 27.173913 %
     epoch 225, minibatch 101/101, test error of best model 26.370968 %
Saving model...
...model saved.
epoch 226, minibatch 101/101, validation error 27.101449 %
     epoch 226, minibatch 101/101, test error of best model 26.451613 %
Saving model...
...model saved.
epoch 227, minibatch 101/101, validation error 27.101449 %
epoch 228, minibatch 101/101, validation error 26.956522 %
     epoch 228, minibatch 101/101, test error of best model 26.424731 %
Saving model...
...model saved.
epoch 229, minibatch 101/101, validation error 26.920290 %
     epoch 229, minibatch 101/101, test error of best model 26.263441 %
Saving model...
...model saved.
epoch 230, minibatch 101/101, validation error 26.884058 %
     epoch 230, minibatch 101/101, test error of best model 26.182796 %
Saving model...
...model saved.
epoch 231, minibatch 101/101, validation error 26.775362 %
     epoch 231, minibatch 101/101, test error of best model 26.102151 %
Saving model...
...model saved.
epoch 232, minibatch 101/101, validation error 26.666667 %
     epoch 232, minibatch 101/101, test error of best model 25.940860 %
Saving model...
...model saved.
epoch 233, minibatch 101/101, validation error 26.557971 %
     epoch 233, minibatch 101/101, test error of best model 25.860215 %
Saving model...
...model saved.
epoch 234, minibatch 101/101, validation error 26.485507 %
     epoch 234, minibatch 101/101, test error of best model 25.779570 %
Saving model...
...model saved.
epoch 235, minibatch 101/101, validation error 26.449275 %
     epoch 235, minibatch 101/101, test error of best model 25.752688 %
Saving model...
...model saved.
epoch 236, minibatch 101/101, validation error 26.231884 %
     epoch 236, minibatch 101/101, test error of best model 25.725806 %
Saving model...
...model saved.
epoch 237, minibatch 101/101, validation error 26.086957 %
     epoch 237, minibatch 101/101, test error of best model 25.672043 %
Saving model...
...model saved.
epoch 238, minibatch 101/101, validation error 26.086957 %
epoch 239, minibatch 101/101, validation error 26.086957 %
epoch 240, minibatch 101/101, validation error 26.050725 %
     epoch 240, minibatch 101/101, test error of best model 25.510753 %
Saving model...
...model saved.
epoch 241, minibatch 101/101, validation error 26.014493 %
     epoch 241, minibatch 101/101, test error of best model 25.483871 %
Saving model...
...model saved.
epoch 242, minibatch 101/101, validation error 25.978261 %
     epoch 242, minibatch 101/101, test error of best model 25.322581 %
Saving model...
...model saved.
epoch 243, minibatch 101/101, validation error 25.905797 %
     epoch 243, minibatch 101/101, test error of best model 25.188172 %
Saving model...
...model saved.
epoch 244, minibatch 101/101, validation error 25.797101 %
     epoch 244, minibatch 101/101, test error of best model 25.107527 %
Saving model...
...model saved.
epoch 245, minibatch 101/101, validation error 25.797101 %
epoch 246, minibatch 101/101, validation error 25.760870 %
     epoch 246, minibatch 101/101, test error of best model 25.107527 %
Saving model...
...model saved.
epoch 247, minibatch 101/101, validation error 25.688406 %
     epoch 247, minibatch 101/101, test error of best model 24.946237 %
Saving model...
...model saved.
epoch 248, minibatch 101/101, validation error 25.615942 %
     epoch 248, minibatch 101/101, test error of best model 24.892473 %
Saving model...
...model saved.
epoch 249, minibatch 101/101, validation error 25.579710 %
     epoch 249, minibatch 101/101, test error of best model 24.838710 %
Saving model...
...model saved.
epoch 250, minibatch 101/101, validation error 25.615942 %
epoch 251, minibatch 101/101, validation error 25.615942 %
epoch 252, minibatch 101/101, validation error 25.688406 %
epoch 253, minibatch 101/101, validation error 25.688406 %
epoch 254, minibatch 101/101, validation error 25.652174 %
epoch 255, minibatch 101/101, validation error 25.579710 %
epoch 256, minibatch 101/101, validation error 25.507246 %
     epoch 256, minibatch 101/101, test error of best model 24.381720 %
Saving model...
...model saved.
epoch 257, minibatch 101/101, validation error 25.434783 %
     epoch 257, minibatch 101/101, test error of best model 24.354839 %
Saving model...
...model saved.
epoch 258, minibatch 101/101, validation error 25.398551 %
     epoch 258, minibatch 101/101, test error of best model 24.327957 %
Saving model...
...model saved.
epoch 259, minibatch 101/101, validation error 25.434783 %
epoch 260, minibatch 101/101, validation error 25.434783 %
epoch 261, minibatch 101/101, validation error 25.253623 %
     epoch 261, minibatch 101/101, test error of best model 24.166667 %
Saving model...
...model saved.
epoch 262, minibatch 101/101, validation error 25.217391 %
     epoch 262, minibatch 101/101, test error of best model 24.139785 %
Saving model...
...model saved.
epoch 263, minibatch 101/101, validation error 25.217391 %
epoch 264, minibatch 101/101, validation error 25.181159 %
     epoch 264, minibatch 101/101, test error of best model 24.086022 %
Saving model...
...model saved.
epoch 265, minibatch 101/101, validation error 25.072464 %
     epoch 265, minibatch 101/101, test error of best model 24.005376 %
Saving model...
...model saved.
epoch 266, minibatch 101/101, validation error 25.036232 %
     epoch 266, minibatch 101/101, test error of best model 24.005376 %
Saving model...
...model saved.
epoch 267, minibatch 101/101, validation error 24.818841 %
     epoch 267, minibatch 101/101, test error of best model 23.924731 %
Saving model...
...model saved.
epoch 268, minibatch 101/101, validation error 24.746377 %
     epoch 268, minibatch 101/101, test error of best model 23.870968 %
Saving model...
...model saved.
epoch 269, minibatch 101/101, validation error 24.637681 %
     epoch 269, minibatch 101/101, test error of best model 23.790323 %
Saving model...
...model saved.
epoch 270, minibatch 101/101, validation error 24.601449 %
     epoch 270, minibatch 101/101, test error of best model 23.682796 %
Saving model...
...model saved.
epoch 271, minibatch 101/101, validation error 24.637681 %
epoch 272, minibatch 101/101, validation error 24.601449 %
epoch 273, minibatch 101/101, validation error 24.528986 %
     epoch 273, minibatch 101/101, test error of best model 23.413978 %
Saving model...
...model saved.
epoch 274, minibatch 101/101, validation error 24.420290 %
     epoch 274, minibatch 101/101, test error of best model 23.306452 %
Saving model...
...model saved.
epoch 275, minibatch 101/101, validation error 24.384058 %
     epoch 275, minibatch 101/101, test error of best model 23.279570 %
Saving model...
...model saved.
epoch 276, minibatch 101/101, validation error 24.311594 %
     epoch 276, minibatch 101/101, test error of best model 23.198925 %
Saving model...
...model saved.
epoch 277, minibatch 101/101, validation error 24.275362 %
     epoch 277, minibatch 101/101, test error of best model 23.145161 %
Saving model...
...model saved.
epoch 278, minibatch 101/101, validation error 24.202899 %
     epoch 278, minibatch 101/101, test error of best model 23.118280 %
Saving model...
...model saved.
epoch 279, minibatch 101/101, validation error 24.130435 %
     epoch 279, minibatch 101/101, test error of best model 23.064516 %
Saving model...
...model saved.
epoch 280, minibatch 101/101, validation error 24.094203 %
     epoch 280, minibatch 101/101, test error of best model 22.930108 %
Saving model...
...model saved.
epoch 281, minibatch 101/101, validation error 24.094203 %
     epoch 281, minibatch 101/101, test error of best model 22.903226 %
Saving model...
...model saved.
epoch 282, minibatch 101/101, validation error 24.057971 %
     epoch 282, minibatch 101/101, test error of best model 22.795699 %
Saving model...
...model saved.
epoch 283, minibatch 101/101, validation error 23.913043 %
     epoch 283, minibatch 101/101, test error of best model 22.741935 %
Saving model...
...model saved.
epoch 284, minibatch 101/101, validation error 23.949275 %
epoch 285, minibatch 101/101, validation error 23.949275 %
epoch 286, minibatch 101/101, validation error 23.985507 %
epoch 287, minibatch 101/101, validation error 23.985507 %
epoch 288, minibatch 101/101, validation error 23.913043 %
epoch 289, minibatch 101/101, validation error 23.876812 %
     epoch 289, minibatch 101/101, test error of best model 22.553763 %
Saving model...
...model saved.
epoch 290, minibatch 101/101, validation error 23.804348 %
     epoch 290, minibatch 101/101, test error of best model 22.419355 %
Saving model...
...model saved.
epoch 291, minibatch 101/101, validation error 23.768116 %
     epoch 291, minibatch 101/101, test error of best model 22.365591 %
Saving model...
...model saved.
epoch 292, minibatch 101/101, validation error 23.768116 %
epoch 293, minibatch 101/101, validation error 23.695652 %
     epoch 293, minibatch 101/101, test error of best model 22.204301 %
Saving model...
...model saved.
epoch 294, minibatch 101/101, validation error 23.659420 %
     epoch 294, minibatch 101/101, test error of best model 22.150538 %
Saving model...
...model saved.
epoch 295, minibatch 101/101, validation error 23.586957 %
     epoch 295, minibatch 101/101, test error of best model 22.177419 %
Saving model...
...model saved.
epoch 296, minibatch 101/101, validation error 23.550725 %
     epoch 296, minibatch 101/101, test error of best model 22.096774 %
Saving model...
...model saved.
epoch 297, minibatch 101/101, validation error 23.369565 %
     epoch 297, minibatch 101/101, test error of best model 22.069892 %
Saving model...
...model saved.
epoch 298, minibatch 101/101, validation error 23.297101 %
     epoch 298, minibatch 101/101, test error of best model 21.989247 %
Saving model...
...model saved.
epoch 299, minibatch 101/101, validation error 23.188406 %
     epoch 299, minibatch 101/101, test error of best model 21.935484 %
Saving model...
...model saved.
epoch 300, minibatch 101/101, validation error 23.043478 %
     epoch 300, minibatch 101/101, test error of best model 21.881720 %
Saving model...
...model saved.
epoch 301, minibatch 101/101, validation error 22.971014 %
     epoch 301, minibatch 101/101, test error of best model 21.827957 %
Saving model...
...model saved.
epoch 302, minibatch 101/101, validation error 22.898551 %
     epoch 302, minibatch 101/101, test error of best model 21.801075 %
Saving model...
...model saved.
epoch 303, minibatch 101/101, validation error 22.789855 %
     epoch 303, minibatch 101/101, test error of best model 21.801075 %
Saving model...
...model saved.
epoch 304, minibatch 101/101, validation error 22.681159 %
     epoch 304, minibatch 101/101, test error of best model 21.720430 %
Saving model...
...model saved.
epoch 305, minibatch 101/101, validation error 22.608696 %
     epoch 305, minibatch 101/101, test error of best model 21.639785 %
Saving model...
...model saved.
epoch 306, minibatch 101/101, validation error 22.536232 %
     epoch 306, minibatch 101/101, test error of best model 21.586022 %
Saving model...
...model saved.
epoch 307, minibatch 101/101, validation error 22.572464 %
epoch 308, minibatch 101/101, validation error 22.355072 %
     epoch 308, minibatch 101/101, test error of best model 21.424731 %
Saving model...
...model saved.
epoch 309, minibatch 101/101, validation error 22.318841 %
     epoch 309, minibatch 101/101, test error of best model 21.397849 %
Saving model...
...model saved.
epoch 310, minibatch 101/101, validation error 22.282609 %
     epoch 310, minibatch 101/101, test error of best model 21.236559 %
Saving model...
...model saved.
epoch 311, minibatch 101/101, validation error 22.173913 %
     epoch 311, minibatch 101/101, test error of best model 21.182796 %
Saving model...
...model saved.
epoch 312, minibatch 101/101, validation error 22.173913 %
epoch 313, minibatch 101/101, validation error 22.101449 %
     epoch 313, minibatch 101/101, test error of best model 21.155914 %
Saving model...
...model saved.
epoch 314, minibatch 101/101, validation error 22.065217 %
     epoch 314, minibatch 101/101, test error of best model 21.102151 %
Saving model...
...model saved.
epoch 315, minibatch 101/101, validation error 21.992754 %
     epoch 315, minibatch 101/101, test error of best model 21.021505 %
Saving model...
...model saved.
epoch 316, minibatch 101/101, validation error 21.956522 %
     epoch 316, minibatch 101/101, test error of best model 20.860215 %
Saving model...
...model saved.
epoch 317, minibatch 101/101, validation error 21.956522 %
epoch 318, minibatch 101/101, validation error 21.884058 %
     epoch 318, minibatch 101/101, test error of best model 20.618280 %
Saving model...
...model saved.
epoch 319, minibatch 101/101, validation error 21.847826 %
     epoch 319, minibatch 101/101, test error of best model 20.618280 %
Saving model...
...model saved.
epoch 320, minibatch 101/101, validation error 21.775362 %
     epoch 320, minibatch 101/101, test error of best model 20.618280 %
Saving model...
...model saved.
epoch 321, minibatch 101/101, validation error 21.739130 %
     epoch 321, minibatch 101/101, test error of best model 20.510753 %
Saving model...
...model saved.
epoch 322, minibatch 101/101, validation error 21.666667 %
     epoch 322, minibatch 101/101, test error of best model 20.483871 %
Saving model...
...model saved.
epoch 323, minibatch 101/101, validation error 21.630435 %
     epoch 323, minibatch 101/101, test error of best model 20.403226 %
Saving model...
...model saved.
epoch 324, minibatch 101/101, validation error 21.630435 %
epoch 325, minibatch 101/101, validation error 21.594203 %
     epoch 325, minibatch 101/101, test error of best model 20.403226 %
Saving model...
...model saved.
epoch 326, minibatch 101/101, validation error 21.557971 %
     epoch 326, minibatch 101/101, test error of best model 20.295699 %
Saving model...
...model saved.
epoch 327, minibatch 101/101, validation error 21.557971 %
epoch 328, minibatch 101/101, validation error 21.485507 %
     epoch 328, minibatch 101/101, test error of best model 20.188172 %
Saving model...
...model saved.
epoch 329, minibatch 101/101, validation error 21.413043 %
     epoch 329, minibatch 101/101, test error of best model 20.188172 %
Saving model...
...model saved.
epoch 330, minibatch 101/101, validation error 21.304348 %
     epoch 330, minibatch 101/101, test error of best model 20.188172 %
Saving model...
...model saved.
epoch 331, minibatch 101/101, validation error 21.231884 %
     epoch 331, minibatch 101/101, test error of best model 20.134409 %
Saving model...
...model saved.
epoch 332, minibatch 101/101, validation error 21.159420 %
     epoch 332, minibatch 101/101, test error of best model 20.053763 %
Saving model...
...model saved.
epoch 333, minibatch 101/101, validation error 21.014493 %
     epoch 333, minibatch 101/101, test error of best model 20.000000 %
Saving model...
...model saved.
epoch 334, minibatch 101/101, validation error 20.905797 %
     epoch 334, minibatch 101/101, test error of best model 19.946237 %
Saving model...
...model saved.
epoch 335, minibatch 101/101, validation error 20.869565 %
     epoch 335, minibatch 101/101, test error of best model 19.919355 %
Saving model...
...model saved.
epoch 336, minibatch 101/101, validation error 20.869565 %
epoch 337, minibatch 101/101, validation error 20.833333 %
     epoch 337, minibatch 101/101, test error of best model 19.892473 %
Saving model...
...model saved.
epoch 338, minibatch 101/101, validation error 20.797101 %
     epoch 338, minibatch 101/101, test error of best model 19.838710 %
Saving model...
...model saved.
epoch 339, minibatch 101/101, validation error 20.724638 %
     epoch 339, minibatch 101/101, test error of best model 19.784946 %
Saving model...
...model saved.
epoch 340, minibatch 101/101, validation error 20.724638 %
epoch 341, minibatch 101/101, validation error 20.652174 %
     epoch 341, minibatch 101/101, test error of best model 19.677419 %
Saving model...
...model saved.
epoch 342, minibatch 101/101, validation error 20.652174 %
epoch 343, minibatch 101/101, validation error 20.579710 %
     epoch 343, minibatch 101/101, test error of best model 19.569892 %
Saving model...
...model saved.
epoch 344, minibatch 101/101, validation error 20.543478 %
     epoch 344, minibatch 101/101, test error of best model 19.516129 %
Saving model...
...model saved.
epoch 345, minibatch 101/101, validation error 20.471014 %
     epoch 345, minibatch 101/101, test error of best model 19.435484 %
Saving model...
...model saved.
epoch 346, minibatch 101/101, validation error 20.362319 %
     epoch 346, minibatch 101/101, test error of best model 19.408602 %
Saving model...
...model saved.
epoch 347, minibatch 101/101, validation error 20.362319 %
epoch 348, minibatch 101/101, validation error 20.289855 %
     epoch 348, minibatch 101/101, test error of best model 19.354839 %
Saving model...
...model saved.
epoch 349, minibatch 101/101, validation error 20.289855 %
epoch 350, minibatch 101/101, validation error 20.253623 %
     epoch 350, minibatch 101/101, test error of best model 19.354839 %
Saving model...
...model saved.
epoch 351, minibatch 101/101, validation error 20.217391 %
     epoch 351, minibatch 101/101, test error of best model 19.327957 %
Saving model...
...model saved.
epoch 352, minibatch 101/101, validation error 20.181159 %
     epoch 352, minibatch 101/101, test error of best model 19.301075 %
Saving model...
...model saved.
epoch 353, minibatch 101/101, validation error 20.181159 %
epoch 354, minibatch 101/101, validation error 20.181159 %
epoch 355, minibatch 101/101, validation error 20.144928 %
     epoch 355, minibatch 101/101, test error of best model 19.247312 %
Saving model...
...model saved.
epoch 356, minibatch 101/101, validation error 20.036232 %
     epoch 356, minibatch 101/101, test error of best model 19.193548 %
Saving model...
...model saved.
epoch 357, minibatch 101/101, validation error 20.036232 %
epoch 358, minibatch 101/101, validation error 20.072464 %
epoch 359, minibatch 101/101, validation error 20.072464 %
epoch 360, minibatch 101/101, validation error 20.072464 %
epoch 361, minibatch 101/101, validation error 20.072464 %
epoch 362, minibatch 101/101, validation error 19.855072 %
     epoch 362, minibatch 101/101, test error of best model 18.790323 %
Saving model...
...model saved.
epoch 363, minibatch 101/101, validation error 19.855072 %
epoch 364, minibatch 101/101, validation error 19.818841 %
     epoch 364, minibatch 101/101, test error of best model 18.655914 %
Saving model...
...model saved.
epoch 365, minibatch 101/101, validation error 19.818841 %
epoch 366, minibatch 101/101, validation error 19.782609 %
     epoch 366, minibatch 101/101, test error of best model 18.655914 %
Saving model...
...model saved.
epoch 367, minibatch 101/101, validation error 19.746377 %
     epoch 367, minibatch 101/101, test error of best model 18.629032 %
Saving model...
...model saved.
epoch 368, minibatch 101/101, validation error 19.710145 %
     epoch 368, minibatch 101/101, test error of best model 18.602151 %
Saving model...
...model saved.
epoch 369, minibatch 101/101, validation error 19.637681 %
     epoch 369, minibatch 101/101, test error of best model 18.494624 %
Saving model...
...model saved.
epoch 370, minibatch 101/101, validation error 19.601449 %
     epoch 370, minibatch 101/101, test error of best model 18.494624 %
Saving model...
...model saved.
epoch 371, minibatch 101/101, validation error 19.637681 %
epoch 372, minibatch 101/101, validation error 19.601449 %
epoch 373, minibatch 101/101, validation error 19.565217 %
     epoch 373, minibatch 101/101, test error of best model 18.440860 %
Saving model...
...model saved.
epoch 374, minibatch 101/101, validation error 19.565217 %
     epoch 374, minibatch 101/101, test error of best model 18.413978 %
Saving model...
...model saved.
epoch 375, minibatch 101/101, validation error 19.492754 %
     epoch 375, minibatch 101/101, test error of best model 18.360215 %
Saving model...
...model saved.
epoch 376, minibatch 101/101, validation error 19.384058 %
     epoch 376, minibatch 101/101, test error of best model 18.225806 %
Saving model...
...model saved.
epoch 377, minibatch 101/101, validation error 19.384058 %
epoch 378, minibatch 101/101, validation error 19.275362 %
     epoch 378, minibatch 101/101, test error of best model 18.118280 %
Saving model...
...model saved.
epoch 379, minibatch 101/101, validation error 19.202899 %
     epoch 379, minibatch 101/101, test error of best model 18.118280 %
Saving model...
...model saved.
epoch 380, minibatch 101/101, validation error 19.202899 %
epoch 381, minibatch 101/101, validation error 19.094203 %
     epoch 381, minibatch 101/101, test error of best model 18.091398 %
Saving model...
...model saved.
epoch 382, minibatch 101/101, validation error 19.094203 %
epoch 383, minibatch 101/101, validation error 19.057971 %
     epoch 383, minibatch 101/101, test error of best model 18.037634 %
Saving model...
...model saved.
epoch 384, minibatch 101/101, validation error 19.021739 %
     epoch 384, minibatch 101/101, test error of best model 18.037634 %
Saving model...
...model saved.
epoch 385, minibatch 101/101, validation error 18.985507 %
     epoch 385, minibatch 101/101, test error of best model 18.037634 %
Saving model...
...model saved.
epoch 386, minibatch 101/101, validation error 18.840580 %
     epoch 386, minibatch 101/101, test error of best model 18.037634 %
Saving model...
...model saved.
epoch 387, minibatch 101/101, validation error 18.768116 %
     epoch 387, minibatch 101/101, test error of best model 18.010753 %
Saving model...
...model saved.
epoch 388, minibatch 101/101, validation error 18.768116 %
epoch 389, minibatch 101/101, validation error 18.695652 %
     epoch 389, minibatch 101/101, test error of best model 17.903226 %
Saving model...
...model saved.
epoch 390, minibatch 101/101, validation error 18.695652 %
epoch 391, minibatch 101/101, validation error 18.695652 %
epoch 392, minibatch 101/101, validation error 18.659420 %
     epoch 392, minibatch 101/101, test error of best model 17.634409 %
Saving model...
...model saved.
epoch 393, minibatch 101/101, validation error 18.623188 %
     epoch 393, minibatch 101/101, test error of best model 17.634409 %
Saving model...
...model saved.
epoch 394, minibatch 101/101, validation error 18.623188 %
epoch 395, minibatch 101/101, validation error 18.623188 %
epoch 396, minibatch 101/101, validation error 18.623188 %
epoch 397, minibatch 101/101, validation error 18.623188 %
epoch 398, minibatch 101/101, validation error 18.623188 %
epoch 399, minibatch 101/101, validation error 18.623188 %
epoch 400, minibatch 101/101, validation error 18.623188 %
epoch 401, minibatch 101/101, validation error 18.623188 %
epoch 402, minibatch 101/101, validation error 18.586957 %
     epoch 402, minibatch 101/101, test error of best model 17.338710 %
Saving model...
...model saved.
epoch 403, minibatch 101/101, validation error 18.514493 %
     epoch 403, minibatch 101/101, test error of best model 17.284946 %
Saving model...
...model saved.
epoch 404, minibatch 101/101, validation error 18.514493 %
epoch 405, minibatch 101/101, validation error 18.369565 %
     epoch 405, minibatch 101/101, test error of best model 17.204301 %
Saving model...
...model saved.
epoch 406, minibatch 101/101, validation error 18.405797 %
epoch 407, minibatch 101/101, validation error 18.369565 %
epoch 408, minibatch 101/101, validation error 18.333333 %
     epoch 408, minibatch 101/101, test error of best model 17.204301 %
Saving model...
...model saved.
epoch 409, minibatch 101/101, validation error 18.297101 %
     epoch 409, minibatch 101/101, test error of best model 17.204301 %
Saving model...
...model saved.
epoch 410, minibatch 101/101, validation error 18.224638 %
     epoch 410, minibatch 101/101, test error of best model 17.150538 %
Saving model...
...model saved.
epoch 411, minibatch 101/101, validation error 18.079710 %
     epoch 411, minibatch 101/101, test error of best model 17.123656 %
Saving model...
...model saved.
epoch 412, minibatch 101/101, validation error 18.043478 %
     epoch 412, minibatch 101/101, test error of best model 17.177419 %
Saving model...
...model saved.
epoch 413, minibatch 101/101, validation error 18.043478 %
epoch 414, minibatch 101/101, validation error 17.934783 %
     epoch 414, minibatch 101/101, test error of best model 17.069892 %
Saving model...
...model saved.
epoch 415, minibatch 101/101, validation error 17.898551 %
     epoch 415, minibatch 101/101, test error of best model 17.016129 %
Saving model...
...model saved.
epoch 416, minibatch 101/101, validation error 17.862319 %
     epoch 416, minibatch 101/101, test error of best model 17.016129 %
Saving model...
...model saved.
epoch 417, minibatch 101/101, validation error 17.717391 %
     epoch 417, minibatch 101/101, test error of best model 16.881720 %
Saving model...
...model saved.
epoch 418, minibatch 101/101, validation error 17.644928 %
     epoch 418, minibatch 101/101, test error of best model 16.854839 %
Saving model...
...model saved.
epoch 419, minibatch 101/101, validation error 17.644928 %
epoch 420, minibatch 101/101, validation error 17.644928 %
epoch 421, minibatch 101/101, validation error 17.608696 %
     epoch 421, minibatch 101/101, test error of best model 16.666667 %
Saving model...
...model saved.
epoch 422, minibatch 101/101, validation error 17.500000 %
     epoch 422, minibatch 101/101, test error of best model 16.666667 %
Saving model...
...model saved.
epoch 423, minibatch 101/101, validation error 17.391304 %
     epoch 423, minibatch 101/101, test error of best model 16.666667 %
Saving model...
...model saved.
epoch 424, minibatch 101/101, validation error 17.391304 %
epoch 425, minibatch 101/101, validation error 17.391304 %
epoch 426, minibatch 101/101, validation error 17.355072 %
     epoch 426, minibatch 101/101, test error of best model 16.586022 %
Saving model...
...model saved.
epoch 427, minibatch 101/101, validation error 17.282609 %
     epoch 427, minibatch 101/101, test error of best model 16.586022 %
Saving model...
...model saved.
epoch 428, minibatch 101/101, validation error 17.318841 %
epoch 429, minibatch 101/101, validation error 17.318841 %
epoch 430, minibatch 101/101, validation error 17.246377 %
     epoch 430, minibatch 101/101, test error of best model 16.559140 %
Saving model...
...model saved.
epoch 431, minibatch 101/101, validation error 17.173913 %
     epoch 431, minibatch 101/101, test error of best model 16.559140 %
Saving model...
...model saved.
epoch 432, minibatch 101/101, validation error 17.137681 %
     epoch 432, minibatch 101/101, test error of best model 16.532258 %
Saving model...
...model saved.
epoch 433, minibatch 101/101, validation error 17.101449 %
     epoch 433, minibatch 101/101, test error of best model 16.478495 %
Saving model...
...model saved.
epoch 434, minibatch 101/101, validation error 17.101449 %
epoch 435, minibatch 101/101, validation error 17.101449 %
epoch 436, minibatch 101/101, validation error 17.028986 %
     epoch 436, minibatch 101/101, test error of best model 16.478495 %
Saving model...
...model saved.
epoch 437, minibatch 101/101, validation error 17.028986 %
epoch 438, minibatch 101/101, validation error 16.992754 %
     epoch 438, minibatch 101/101, test error of best model 16.505376 %
Saving model...
...model saved.
epoch 439, minibatch 101/101, validation error 16.992754 %
epoch 440, minibatch 101/101, validation error 16.992754 %
epoch 441, minibatch 101/101, validation error 16.992754 %
epoch 442, minibatch 101/101, validation error 16.884058 %
     epoch 442, minibatch 101/101, test error of best model 16.290323 %
Saving model...
...model saved.
epoch 443, minibatch 101/101, validation error 16.847826 %
     epoch 443, minibatch 101/101, test error of best model 16.236559 %
Saving model...
...model saved.
epoch 444, minibatch 101/101, validation error 16.775362 %
     epoch 444, minibatch 101/101, test error of best model 16.236559 %
Saving model...
...model saved.
epoch 445, minibatch 101/101, validation error 16.775362 %
epoch 446, minibatch 101/101, validation error 16.775362 %
epoch 447, minibatch 101/101, validation error 16.739130 %
     epoch 447, minibatch 101/101, test error of best model 16.129032 %
Saving model...
...model saved.
epoch 448, minibatch 101/101, validation error 16.702899 %
     epoch 448, minibatch 101/101, test error of best model 16.129032 %
Saving model...
...model saved.
epoch 449, minibatch 101/101, validation error 16.666667 %
     epoch 449, minibatch 101/101, test error of best model 16.075269 %
Saving model...
...model saved.
epoch 450, minibatch 101/101, validation error 16.630435 %
     epoch 450, minibatch 101/101, test error of best model 16.075269 %
Saving model...
...model saved.
epoch 451, minibatch 101/101, validation error 16.521739 %
     epoch 451, minibatch 101/101, test error of best model 16.048387 %
Saving model...
...model saved.
epoch 452, minibatch 101/101, validation error 16.449275 %
     epoch 452, minibatch 101/101, test error of best model 16.048387 %
Saving model...
...model saved.
epoch 453, minibatch 101/101, validation error 16.485507 %
epoch 454, minibatch 101/101, validation error 16.449275 %
epoch 455, minibatch 101/101, validation error 16.413043 %
     epoch 455, minibatch 101/101, test error of best model 16.048387 %
Saving model...
...model saved.
epoch 456, minibatch 101/101, validation error 16.376812 %
     epoch 456, minibatch 101/101, test error of best model 15.967742 %
Saving model...
...model saved.
epoch 457, minibatch 101/101, validation error 16.340580 %
     epoch 457, minibatch 101/101, test error of best model 15.967742 %
Saving model...
...model saved.
epoch 458, minibatch 101/101, validation error 16.340580 %
epoch 459, minibatch 101/101, validation error 16.304348 %
     epoch 459, minibatch 101/101, test error of best model 15.967742 %
Saving model...
...model saved.
epoch 460, minibatch 101/101, validation error 16.304348 %
epoch 461, minibatch 101/101, validation error 16.268116 %
     epoch 461, minibatch 101/101, test error of best model 15.887097 %
Saving model...
...model saved.
epoch 462, minibatch 101/101, validation error 16.231884 %
     epoch 462, minibatch 101/101, test error of best model 15.887097 %
Saving model...
...model saved.
epoch 463, minibatch 101/101, validation error 16.231884 %
epoch 464, minibatch 101/101, validation error 16.159420 %
     epoch 464, minibatch 101/101, test error of best model 15.860215 %
Saving model...
...model saved.
epoch 465, minibatch 101/101, validation error 16.050725 %
     epoch 465, minibatch 101/101, test error of best model 15.860215 %
Saving model...
...model saved.
epoch 466, minibatch 101/101, validation error 16.050725 %
epoch 467, minibatch 101/101, validation error 16.050725 %
epoch 468, minibatch 101/101, validation error 16.014493 %
     epoch 468, minibatch 101/101, test error of best model 15.887097 %
Saving model...
...model saved.
epoch 469, minibatch 101/101, validation error 15.978261 %
     epoch 469, minibatch 101/101, test error of best model 15.860215 %
Saving model...
...model saved.
epoch 470, minibatch 101/101, validation error 15.978261 %
epoch 471, minibatch 101/101, validation error 15.942029 %
     epoch 471, minibatch 101/101, test error of best model 15.860215 %
Saving model...
...model saved.
epoch 472, minibatch 101/101, validation error 15.942029 %
epoch 473, minibatch 101/101, validation error 15.869565 %
     epoch 473, minibatch 101/101, test error of best model 15.779570 %
Saving model...
...model saved.
epoch 474, minibatch 101/101, validation error 15.833333 %
     epoch 474, minibatch 101/101, test error of best model 15.698925 %
Saving model...
...model saved.
epoch 475, minibatch 101/101, validation error 15.833333 %
epoch 476, minibatch 101/101, validation error 15.760870 %
     epoch 476, minibatch 101/101, test error of best model 15.645161 %
Saving model...
...model saved.
epoch 477, minibatch 101/101, validation error 15.724638 %
     epoch 477, minibatch 101/101, test error of best model 15.645161 %
Saving model...
...model saved.
epoch 478, minibatch 101/101, validation error 15.724638 %
epoch 479, minibatch 101/101, validation error 15.724638 %
epoch 480, minibatch 101/101, validation error 15.688406 %
     epoch 480, minibatch 101/101, test error of best model 15.618280 %
Saving model...
...model saved.
epoch 481, minibatch 101/101, validation error 15.688406 %
epoch 482, minibatch 101/101, validation error 15.688406 %
epoch 483, minibatch 101/101, validation error 15.652174 %
     epoch 483, minibatch 101/101, test error of best model 15.456989 %
Saving model...
...model saved.
epoch 484, minibatch 101/101, validation error 15.615942 %
     epoch 484, minibatch 101/101, test error of best model 15.430108 %
Saving model...
...model saved.
epoch 485, minibatch 101/101, validation error 15.579710 %
     epoch 485, minibatch 101/101, test error of best model 15.456989 %
Saving model...
...model saved.
epoch 486, minibatch 101/101, validation error 15.579710 %
epoch 487, minibatch 101/101, validation error 15.579710 %
epoch 488, minibatch 101/101, validation error 15.579710 %
epoch 489, minibatch 101/101, validation error 15.543478 %
     epoch 489, minibatch 101/101, test error of best model 15.376344 %
Saving model...
...model saved.
epoch 490, minibatch 101/101, validation error 15.543478 %
epoch 491, minibatch 101/101, validation error 15.507246 %
     epoch 491, minibatch 101/101, test error of best model 15.295699 %
Saving model...
...model saved.
epoch 492, minibatch 101/101, validation error 15.507246 %
epoch 493, minibatch 101/101, validation error 15.471014 %
     epoch 493, minibatch 101/101, test error of best model 15.295699 %
Saving model...
...model saved.
epoch 494, minibatch 101/101, validation error 15.434783 %
     epoch 494, minibatch 101/101, test error of best model 15.295699 %
Saving model...
...model saved.
epoch 495, minibatch 101/101, validation error 15.253623 %
     epoch 495, minibatch 101/101, test error of best model 15.268817 %
Saving model...
...model saved.
epoch 496, minibatch 101/101, validation error 15.253623 %
epoch 497, minibatch 101/101, validation error 15.217391 %
     epoch 497, minibatch 101/101, test error of best model 15.161290 %
Saving model...
...model saved.
epoch 498, minibatch 101/101, validation error 15.217391 %
epoch 499, minibatch 101/101, validation error 15.217391 %
epoch 500, minibatch 101/101, validation error 15.217391 %
epoch 501, minibatch 101/101, validation error 15.144928 %
     epoch 501, minibatch 101/101, test error of best model 15.080645 %
Saving model...
...model saved.
epoch 502, minibatch 101/101, validation error 15.181159 %
epoch 503, minibatch 101/101, validation error 15.181159 %
epoch 504, minibatch 101/101, validation error 15.144928 %
epoch 505, minibatch 101/101, validation error 15.108696 %
     epoch 505, minibatch 101/101, test error of best model 15.026882 %
Saving model...
...model saved.
epoch 506, minibatch 101/101, validation error 15.108696 %
epoch 507, minibatch 101/101, validation error 15.108696 %
epoch 508, minibatch 101/101, validation error 15.036232 %
     epoch 508, minibatch 101/101, test error of best model 14.892473 %
Saving model...
...model saved.
epoch 509, minibatch 101/101, validation error 15.000000 %
     epoch 509, minibatch 101/101, test error of best model 14.919355 %
Saving model...
...model saved.
epoch 510, minibatch 101/101, validation error 14.963768 %
     epoch 510, minibatch 101/101, test error of best model 14.892473 %
Saving model...
...model saved.
epoch 511, minibatch 101/101, validation error 14.927536 %
     epoch 511, minibatch 101/101, test error of best model 14.865591 %
Saving model...
...model saved.
epoch 512, minibatch 101/101, validation error 14.927536 %
epoch 513, minibatch 101/101, validation error 14.927536 %
epoch 514, minibatch 101/101, validation error 14.927536 %
epoch 515, minibatch 101/101, validation error 14.927536 %
epoch 516, minibatch 101/101, validation error 14.927536 %
epoch 517, minibatch 101/101, validation error 14.927536 %
epoch 518, minibatch 101/101, validation error 14.927536 %
epoch 519, minibatch 101/101, validation error 14.891304 %
     epoch 519, minibatch 101/101, test error of best model 14.731183 %
Saving model...
...model saved.
epoch 520, minibatch 101/101, validation error 14.891304 %
epoch 521, minibatch 101/101, validation error 14.855072 %
     epoch 521, minibatch 101/101, test error of best model 14.731183 %
Saving model...
...model saved.
epoch 522, minibatch 101/101, validation error 14.855072 %
epoch 523, minibatch 101/101, validation error 14.855072 %
epoch 524, minibatch 101/101, validation error 14.855072 %
epoch 525, minibatch 101/101, validation error 14.855072 %
epoch 526, minibatch 101/101, validation error 14.818841 %
     epoch 526, minibatch 101/101, test error of best model 14.677419 %
Saving model...
...model saved.
epoch 527, minibatch 101/101, validation error 14.746377 %
     epoch 527, minibatch 101/101, test error of best model 14.650538 %
Saving model...
...model saved.
epoch 528, minibatch 101/101, validation error 14.710145 %
     epoch 528, minibatch 101/101, test error of best model 14.650538 %
Saving model...
...model saved.
epoch 529, minibatch 101/101, validation error 14.637681 %
     epoch 529, minibatch 101/101, test error of best model 14.543011 %
Saving model...
...model saved.
epoch 530, minibatch 101/101, validation error 14.601449 %
     epoch 530, minibatch 101/101, test error of best model 14.489247 %
Saving model...
...model saved.
epoch 531, minibatch 101/101, validation error 14.601449 %
epoch 532, minibatch 101/101, validation error 14.601449 %
epoch 533, minibatch 101/101, validation error 14.601449 %
epoch 534, minibatch 101/101, validation error 14.601449 %
epoch 535, minibatch 101/101, validation error 14.601449 %
epoch 536, minibatch 101/101, validation error 14.565217 %
     epoch 536, minibatch 101/101, test error of best model 14.354839 %
Saving model...
...model saved.
epoch 537, minibatch 101/101, validation error 14.565217 %
epoch 538, minibatch 101/101, validation error 14.528986 %
     epoch 538, minibatch 101/101, test error of best model 14.247312 %
Saving model...
...model saved.
epoch 539, minibatch 101/101, validation error 14.565217 %
epoch 540, minibatch 101/101, validation error 14.528986 %
epoch 541, minibatch 101/101, validation error 14.528986 %
epoch 542, minibatch 101/101, validation error 14.528986 %
epoch 543, minibatch 101/101, validation error 14.492754 %
     epoch 543, minibatch 101/101, test error of best model 14.166667 %
Saving model...
...model saved.
epoch 544, minibatch 101/101, validation error 14.492754 %
epoch 545, minibatch 101/101, validation error 14.492754 %
epoch 546, minibatch 101/101, validation error 14.492754 %
epoch 547, minibatch 101/101, validation error 14.492754 %
epoch 548, minibatch 101/101, validation error 14.456522 %
     epoch 548, minibatch 101/101, test error of best model 14.086022 %
Saving model...
...model saved.
epoch 549, minibatch 101/101, validation error 14.456522 %
epoch 550, minibatch 101/101, validation error 14.420290 %
     epoch 550, minibatch 101/101, test error of best model 14.112903 %
Saving model...
...model saved.
epoch 551, minibatch 101/101, validation error 14.420290 %
epoch 552, minibatch 101/101, validation error 14.420290 %
epoch 553, minibatch 101/101, validation error 14.384058 %
     epoch 553, minibatch 101/101, test error of best model 14.032258 %
Saving model...
...model saved.
epoch 554, minibatch 101/101, validation error 14.347826 %
     epoch 554, minibatch 101/101, test error of best model 14.005376 %
Saving model...
...model saved.
epoch 555, minibatch 101/101, validation error 14.347826 %
epoch 556, minibatch 101/101, validation error 14.239130 %
     epoch 556, minibatch 101/101, test error of best model 13.978495 %
Saving model...
...model saved.
epoch 557, minibatch 101/101, validation error 14.202899 %
     epoch 557, minibatch 101/101, test error of best model 13.978495 %
Saving model...
...model saved.
epoch 558, minibatch 101/101, validation error 14.130435 %
     epoch 558, minibatch 101/101, test error of best model 13.924731 %
Saving model...
...model saved.
epoch 559, minibatch 101/101, validation error 14.130435 %
epoch 560, minibatch 101/101, validation error 14.094203 %
     epoch 560, minibatch 101/101, test error of best model 13.924731 %
Saving model...
...model saved.
epoch 561, minibatch 101/101, validation error 14.057971 %
     epoch 561, minibatch 101/101, test error of best model 13.870968 %
Saving model...
...model saved.
epoch 562, minibatch 101/101, validation error 14.021739 %
     epoch 562, minibatch 101/101, test error of best model 13.870968 %
Saving model...
...model saved.
epoch 563, minibatch 101/101, validation error 14.021739 %
epoch 564, minibatch 101/101, validation error 14.021739 %
epoch 565, minibatch 101/101, validation error 14.021739 %
epoch 566, minibatch 101/101, validation error 14.021739 %
epoch 567, minibatch 101/101, validation error 14.021739 %
epoch 568, minibatch 101/101, validation error 14.021739 %
epoch 569, minibatch 101/101, validation error 13.985507 %
     epoch 569, minibatch 101/101, test error of best model 13.817204 %
Saving model...
...model saved.
epoch 570, minibatch 101/101, validation error 13.985507 %
epoch 571, minibatch 101/101, validation error 13.985507 %
epoch 572, minibatch 101/101, validation error 13.913043 %
     epoch 572, minibatch 101/101, test error of best model 13.817204 %
Saving model...
...model saved.
epoch 573, minibatch 101/101, validation error 13.913043 %
epoch 574, minibatch 101/101, validation error 13.876812 %
     epoch 574, minibatch 101/101, test error of best model 13.817204 %
Saving model...
...model saved.
epoch 575, minibatch 101/101, validation error 13.840580 %
     epoch 575, minibatch 101/101, test error of best model 13.817204 %
Saving model...
...model saved.
epoch 576, minibatch 101/101, validation error 13.840580 %
epoch 577, minibatch 101/101, validation error 13.840580 %
epoch 578, minibatch 101/101, validation error 13.840580 %
epoch 579, minibatch 101/101, validation error 13.840580 %
epoch 580, minibatch 101/101, validation error 13.768116 %
     epoch 580, minibatch 101/101, test error of best model 13.817204 %
Saving model...
...model saved.
epoch 581, minibatch 101/101, validation error 13.768116 %
epoch 582, minibatch 101/101, validation error 13.768116 %
epoch 583, minibatch 101/101, validation error 13.731884 %
     epoch 583, minibatch 101/101, test error of best model 13.709677 %
Saving model...
...model saved.
epoch 584, minibatch 101/101, validation error 13.731884 %
epoch 585, minibatch 101/101, validation error 13.731884 %
epoch 586, minibatch 101/101, validation error 13.623188 %
     epoch 586, minibatch 101/101, test error of best model 13.682796 %
Saving model...
...model saved.
epoch 587, minibatch 101/101, validation error 13.623188 %
epoch 588, minibatch 101/101, validation error 13.623188 %
epoch 589, minibatch 101/101, validation error 13.623188 %
epoch 590, minibatch 101/101, validation error 13.623188 %
epoch 591, minibatch 101/101, validation error 13.659420 %
epoch 592, minibatch 101/101, validation error 13.659420 %
epoch 593, minibatch 101/101, validation error 13.659420 %
epoch 594, minibatch 101/101, validation error 13.659420 %
epoch 595, minibatch 101/101, validation error 13.623188 %
epoch 596, minibatch 101/101, validation error 13.550725 %
     epoch 596, minibatch 101/101, test error of best model 13.602151 %
Saving model...
...model saved.
epoch 597, minibatch 101/101, validation error 13.550725 %
epoch 598, minibatch 101/101, validation error 13.550725 %
epoch 599, minibatch 101/101, validation error 13.550725 %
epoch 600, minibatch 101/101, validation error 13.550725 %
epoch 601, minibatch 101/101, validation error 13.514493 %
     epoch 601, minibatch 101/101, test error of best model 13.575269 %
Saving model...
...model saved.
epoch 602, minibatch 101/101, validation error 13.514493 %
epoch 603, minibatch 101/101, validation error 13.514493 %
epoch 604, minibatch 101/101, validation error 13.514493 %
epoch 605, minibatch 101/101, validation error 13.514493 %
epoch 606, minibatch 101/101, validation error 13.514493 %
epoch 607, minibatch 101/101, validation error 13.514493 %
epoch 608, minibatch 101/101, validation error 13.514493 %
epoch 609, minibatch 101/101, validation error 13.514493 %
epoch 610, minibatch 101/101, validation error 13.478261 %
     epoch 610, minibatch 101/101, test error of best model 13.467742 %
Saving model...
...model saved.
epoch 611, minibatch 101/101, validation error 13.478261 %
epoch 612, minibatch 101/101, validation error 13.514493 %
epoch 613, minibatch 101/101, validation error 13.478261 %
epoch 614, minibatch 101/101, validation error 13.442029 %
     epoch 614, minibatch 101/101, test error of best model 13.440860 %
Saving model...
...model saved.
epoch 615, minibatch 101/101, validation error 13.442029 %
epoch 616, minibatch 101/101, validation error 13.442029 %
epoch 617, minibatch 101/101, validation error 13.442029 %
epoch 618, minibatch 101/101, validation error 13.442029 %
epoch 619, minibatch 101/101, validation error 13.442029 %
epoch 620, minibatch 101/101, validation error 13.442029 %
epoch 621, minibatch 101/101, validation error 13.442029 %
epoch 622, minibatch 101/101, validation error 13.442029 %
epoch 623, minibatch 101/101, validation error 13.405797 %
     epoch 623, minibatch 101/101, test error of best model 13.413978 %
Saving model...
...model saved.
epoch 624, minibatch 101/101, validation error 13.405797 %
epoch 625, minibatch 101/101, validation error 13.405797 %
epoch 626, minibatch 101/101, validation error 13.369565 %
     epoch 626, minibatch 101/101, test error of best model 13.387097 %
Saving model...
...model saved.
epoch 627, minibatch 101/101, validation error 13.333333 %
     epoch 627, minibatch 101/101, test error of best model 13.360215 %
Saving model...
...model saved.
epoch 628, minibatch 101/101, validation error 13.333333 %
epoch 629, minibatch 101/101, validation error 13.333333 %
epoch 630, minibatch 101/101, validation error 13.297101 %
     epoch 630, minibatch 101/101, test error of best model 13.360215 %
Saving model...
...model saved.
epoch 631, minibatch 101/101, validation error 13.260870 %
     epoch 631, minibatch 101/101, test error of best model 13.360215 %
Saving model...
...model saved.
epoch 632, minibatch 101/101, validation error 13.260870 %
epoch 633, minibatch 101/101, validation error 13.260870 %
epoch 634, minibatch 101/101, validation error 13.260870 %
epoch 635, minibatch 101/101, validation error 13.260870 %
epoch 636, minibatch 101/101, validation error 13.260870 %
epoch 637, minibatch 101/101, validation error 13.260870 %
epoch 638, minibatch 101/101, validation error 13.260870 %
epoch 639, minibatch 101/101, validation error 13.224638 %
     epoch 639, minibatch 101/101, test error of best model 13.306452 %
Saving model...
...model saved.
epoch 640, minibatch 101/101, validation error 13.224638 %
epoch 641, minibatch 101/101, validation error 13.224638 %
epoch 642, minibatch 101/101, validation error 13.224638 %
epoch 643, minibatch 101/101, validation error 13.224638 %
epoch 644, minibatch 101/101, validation error 13.260870 %
epoch 645, minibatch 101/101, validation error 13.188406 %
     epoch 645, minibatch 101/101, test error of best model 13.360215 %
Saving model...
...model saved.
epoch 646, minibatch 101/101, validation error 13.188406 %
epoch 647, minibatch 101/101, validation error 13.188406 %
epoch 648, minibatch 101/101, validation error 13.188406 %
epoch 649, minibatch 101/101, validation error 13.188406 %
epoch 650, minibatch 101/101, validation error 13.188406 %
epoch 651, minibatch 101/101, validation error 13.224638 %
epoch 652, minibatch 101/101, validation error 13.188406 %
epoch 653, minibatch 101/101, validation error 13.188406 %
epoch 654, minibatch 101/101, validation error 13.188406 %
epoch 655, minibatch 101/101, validation error 13.188406 %
epoch 656, minibatch 101/101, validation error 13.188406 %
epoch 657, minibatch 101/101, validation error 13.188406 %
epoch 658, minibatch 101/101, validation error 13.188406 %
epoch 659, minibatch 101/101, validation error 13.152174 %
     epoch 659, minibatch 101/101, test error of best model 13.225806 %
Saving model...
...model saved.
epoch 660, minibatch 101/101, validation error 13.152174 %
epoch 661, minibatch 101/101, validation error 13.152174 %
epoch 662, minibatch 101/101, validation error 13.152174 %
epoch 663, minibatch 101/101, validation error 13.152174 %
epoch 664, minibatch 101/101, validation error 13.152174 %
epoch 665, minibatch 101/101, validation error 13.115942 %
     epoch 665, minibatch 101/101, test error of best model 13.172043 %
Saving model...
...model saved.
epoch 666, minibatch 101/101, validation error 13.152174 %
epoch 667, minibatch 101/101, validation error 13.152174 %
epoch 668, minibatch 101/101, validation error 13.152174 %
epoch 669, minibatch 101/101, validation error 13.115942 %
epoch 670, minibatch 101/101, validation error 13.115942 %
epoch 671, minibatch 101/101, validation error 13.115942 %
epoch 672, minibatch 101/101, validation error 13.079710 %
     epoch 672, minibatch 101/101, test error of best model 13.037634 %
Saving model...
...model saved.
epoch 673, minibatch 101/101, validation error 13.007246 %
     epoch 673, minibatch 101/101, test error of best model 13.010753 %
Saving model...
...model saved.
epoch 674, minibatch 101/101, validation error 12.971014 %
     epoch 674, minibatch 101/101, test error of best model 13.010753 %
Saving model...
...model saved.
epoch 675, minibatch 101/101, validation error 13.007246 %
epoch 676, minibatch 101/101, validation error 13.007246 %
epoch 677, minibatch 101/101, validation error 13.007246 %
epoch 678, minibatch 101/101, validation error 13.007246 %
epoch 679, minibatch 101/101, validation error 13.007246 %
epoch 680, minibatch 101/101, validation error 12.934783 %
     epoch 680, minibatch 101/101, test error of best model 13.010753 %
Saving model...
...model saved.
epoch 681, minibatch 101/101, validation error 12.934783 %
epoch 682, minibatch 101/101, validation error 12.934783 %
epoch 683, minibatch 101/101, validation error 12.934783 %
epoch 684, minibatch 101/101, validation error 12.934783 %
epoch 685, minibatch 101/101, validation error 12.934783 %
epoch 686, minibatch 101/101, validation error 12.934783 %
epoch 687, minibatch 101/101, validation error 12.898551 %
     epoch 687, minibatch 101/101, test error of best model 12.876344 %
Saving model...
...model saved.
epoch 688, minibatch 101/101, validation error 12.862319 %
     epoch 688, minibatch 101/101, test error of best model 12.876344 %
Saving model...
...model saved.
epoch 689, minibatch 101/101, validation error 12.862319 %
epoch 690, minibatch 101/101, validation error 12.862319 %
epoch 691, minibatch 101/101, validation error 12.862319 %
epoch 692, minibatch 101/101, validation error 12.862319 %
epoch 693, minibatch 101/101, validation error 12.862319 %
epoch 694, minibatch 101/101, validation error 12.862319 %
epoch 695, minibatch 101/101, validation error 12.789855 %
     epoch 695, minibatch 101/101, test error of best model 12.795699 %
Saving model...
...model saved.
epoch 696, minibatch 101/101, validation error 12.789855 %
epoch 697, minibatch 101/101, validation error 12.826087 %
epoch 698, minibatch 101/101, validation error 12.826087 %
epoch 699, minibatch 101/101, validation error 12.826087 %
epoch 700, minibatch 101/101, validation error 12.826087 %
epoch 701, minibatch 101/101, validation error 12.789855 %
epoch 702, minibatch 101/101, validation error 12.753623 %
     epoch 702, minibatch 101/101, test error of best model 12.634409 %
Saving model...
...model saved.
epoch 703, minibatch 101/101, validation error 12.753623 %
epoch 704, minibatch 101/101, validation error 12.717391 %
     epoch 704, minibatch 101/101, test error of best model 12.580645 %
Saving model...
...model saved.
epoch 705, minibatch 101/101, validation error 12.717391 %
epoch 706, minibatch 101/101, validation error 12.717391 %
epoch 707, minibatch 101/101, validation error 12.717391 %
epoch 708, minibatch 101/101, validation error 12.717391 %
epoch 709, minibatch 101/101, validation error 12.717391 %
epoch 710, minibatch 101/101, validation error 12.717391 %
epoch 711, minibatch 101/101, validation error 12.717391 %
epoch 712, minibatch 101/101, validation error 12.717391 %
epoch 713, minibatch 101/101, validation error 12.717391 %
epoch 714, minibatch 101/101, validation error 12.717391 %
epoch 715, minibatch 101/101, validation error 12.717391 %
epoch 716, minibatch 101/101, validation error 12.681159 %
     epoch 716, minibatch 101/101, test error of best model 12.526882 %
Saving model...
...model saved.
epoch 717, minibatch 101/101, validation error 12.681159 %
epoch 718, minibatch 101/101, validation error 12.644928 %
     epoch 718, minibatch 101/101, test error of best model 12.500000 %
Saving model...
...model saved.
epoch 719, minibatch 101/101, validation error 12.644928 %
epoch 720, minibatch 101/101, validation error 12.572464 %
     epoch 720, minibatch 101/101, test error of best model 12.500000 %
Saving model...
...model saved.
epoch 721, minibatch 101/101, validation error 12.572464 %
epoch 722, minibatch 101/101, validation error 12.572464 %
epoch 723, minibatch 101/101, validation error 12.572464 %
epoch 724, minibatch 101/101, validation error 12.572464 %
epoch 725, minibatch 101/101, validation error 12.572464 %
epoch 726, minibatch 101/101, validation error 12.572464 %
epoch 727, minibatch 101/101, validation error 12.572464 %
epoch 728, minibatch 101/101, validation error 12.572464 %
epoch 729, minibatch 101/101, validation error 12.572464 %
epoch 730, minibatch 101/101, validation error 12.572464 %
epoch 731, minibatch 101/101, validation error 12.500000 %
     epoch 731, minibatch 101/101, test error of best model 12.446237 %
Saving model...
...model saved.
epoch 732, minibatch 101/101, validation error 12.500000 %
epoch 733, minibatch 101/101, validation error 12.427536 %
     epoch 733, minibatch 101/101, test error of best model 12.446237 %
Saving model...
...model saved.
epoch 734, minibatch 101/101, validation error 12.427536 %
epoch 735, minibatch 101/101, validation error 12.427536 %
epoch 736, minibatch 101/101, validation error 12.427536 %
epoch 737, minibatch 101/101, validation error 12.427536 %
epoch 738, minibatch 101/101, validation error 12.427536 %
epoch 739, minibatch 101/101, validation error 12.427536 %
epoch 740, minibatch 101/101, validation error 12.427536 %
epoch 741, minibatch 101/101, validation error 12.391304 %
     epoch 741, minibatch 101/101, test error of best model 12.419355 %
Saving model...
...model saved.
epoch 742, minibatch 101/101, validation error 12.355072 %
     epoch 742, minibatch 101/101, test error of best model 12.419355 %
Saving model...
...model saved.
epoch 743, minibatch 101/101, validation error 12.355072 %
epoch 744, minibatch 101/101, validation error 12.355072 %
epoch 745, minibatch 101/101, validation error 12.355072 %
epoch 746, minibatch 101/101, validation error 12.318841 %
     epoch 746, minibatch 101/101, test error of best model 12.392473 %
Saving model...
...model saved.
epoch 747, minibatch 101/101, validation error 12.318841 %
epoch 748, minibatch 101/101, validation error 12.282609 %
     epoch 748, minibatch 101/101, test error of best model 12.392473 %
Saving model...
...model saved.
epoch 749, minibatch 101/101, validation error 12.282609 %
epoch 750, minibatch 101/101, validation error 12.282609 %
epoch 751, minibatch 101/101, validation error 12.282609 %
epoch 752, minibatch 101/101, validation error 12.282609 %
epoch 753, minibatch 101/101, validation error 12.282609 %
epoch 754, minibatch 101/101, validation error 12.282609 %
epoch 755, minibatch 101/101, validation error 12.282609 %
epoch 756, minibatch 101/101, validation error 12.282609 %
epoch 757, minibatch 101/101, validation error 12.282609 %
epoch 758, minibatch 101/101, validation error 12.282609 %
epoch 759, minibatch 101/101, validation error 12.246377 %
     epoch 759, minibatch 101/101, test error of best model 12.338710 %
Saving model...
...model saved.
epoch 760, minibatch 101/101, validation error 12.246377 %
epoch 761, minibatch 101/101, validation error 12.246377 %
epoch 762, minibatch 101/101, validation error 12.246377 %
epoch 763, minibatch 101/101, validation error 12.246377 %
epoch 764, minibatch 101/101, validation error 12.246377 %
epoch 765, minibatch 101/101, validation error 12.210145 %
     epoch 765, minibatch 101/101, test error of best model 12.338710 %
Saving model...
...model saved.
epoch 766, minibatch 101/101, validation error 12.173913 %
     epoch 766, minibatch 101/101, test error of best model 12.338710 %
Saving model...
...model saved.
epoch 767, minibatch 101/101, validation error 12.173913 %
epoch 768, minibatch 101/101, validation error 12.173913 %
epoch 769, minibatch 101/101, validation error 12.137681 %
     epoch 769, minibatch 101/101, test error of best model 12.258065 %
Saving model...
...model saved.
epoch 770, minibatch 101/101, validation error 12.137681 %
epoch 771, minibatch 101/101, validation error 12.137681 %
epoch 772, minibatch 101/101, validation error 12.137681 %
epoch 773, minibatch 101/101, validation error 12.137681 %
epoch 774, minibatch 101/101, validation error 12.137681 %
epoch 775, minibatch 101/101, validation error 12.137681 %
epoch 776, minibatch 101/101, validation error 12.137681 %
epoch 777, minibatch 101/101, validation error 12.210145 %
epoch 778, minibatch 101/101, validation error 12.210145 %
epoch 779, minibatch 101/101, validation error 12.210145 %
epoch 780, minibatch 101/101, validation error 12.210145 %
epoch 781, minibatch 101/101, validation error 12.210145 %
epoch 782, minibatch 101/101, validation error 12.173913 %
epoch 783, minibatch 101/101, validation error 12.137681 %
epoch 784, minibatch 101/101, validation error 12.101449 %
     epoch 784, minibatch 101/101, test error of best model 12.204301 %
Saving model...
...model saved.
epoch 785, minibatch 101/101, validation error 12.101449 %
epoch 786, minibatch 101/101, validation error 12.101449 %
epoch 787, minibatch 101/101, validation error 12.101449 %
epoch 788, minibatch 101/101, validation error 12.101449 %
epoch 789, minibatch 101/101, validation error 12.101449 %
epoch 790, minibatch 101/101, validation error 12.065217 %
     epoch 790, minibatch 101/101, test error of best model 12.123656 %
Saving model...
...model saved.
epoch 791, minibatch 101/101, validation error 12.065217 %
epoch 792, minibatch 101/101, validation error 12.028986 %
     epoch 792, minibatch 101/101, test error of best model 12.123656 %
Saving model...
...model saved.
epoch 793, minibatch 101/101, validation error 12.028986 %
epoch 794, minibatch 101/101, validation error 12.028986 %
epoch 795, minibatch 101/101, validation error 12.028986 %
epoch 796, minibatch 101/101, validation error 12.028986 %
epoch 797, minibatch 101/101, validation error 12.028986 %
epoch 798, minibatch 101/101, validation error 12.028986 %
epoch 799, minibatch 101/101, validation error 12.028986 %
epoch 800, minibatch 101/101, validation error 12.028986 %
epoch 801, minibatch 101/101, validation error 12.028986 %
epoch 802, minibatch 101/101, validation error 12.028986 %
epoch 803, minibatch 101/101, validation error 12.028986 %
epoch 804, minibatch 101/101, validation error 12.028986 %
epoch 805, minibatch 101/101, validation error 12.028986 %
epoch 806, minibatch 101/101, validation error 12.028986 %
epoch 807, minibatch 101/101, validation error 12.028986 %
epoch 808, minibatch 101/101, validation error 12.028986 %
epoch 809, minibatch 101/101, validation error 12.028986 %
epoch 810, minibatch 101/101, validation error 12.028986 %
epoch 811, minibatch 101/101, validation error 11.992754 %
     epoch 811, minibatch 101/101, test error of best model 11.989247 %
Saving model...
...model saved.
epoch 812, minibatch 101/101, validation error 11.992754 %
epoch 813, minibatch 101/101, validation error 11.920290 %
     epoch 813, minibatch 101/101, test error of best model 11.962366 %
Saving model...
...model saved.
epoch 814, minibatch 101/101, validation error 11.920290 %
epoch 815, minibatch 101/101, validation error 11.920290 %
epoch 816, minibatch 101/101, validation error 11.847826 %
     epoch 816, minibatch 101/101, test error of best model 11.935484 %
Saving model...
...model saved.
epoch 817, minibatch 101/101, validation error 11.847826 %
epoch 818, minibatch 101/101, validation error 11.847826 %
epoch 819, minibatch 101/101, validation error 11.847826 %
epoch 820, minibatch 101/101, validation error 11.847826 %
epoch 821, minibatch 101/101, validation error 11.847826 %
epoch 822, minibatch 101/101, validation error 11.847826 %
epoch 823, minibatch 101/101, validation error 11.847826 %
epoch 824, minibatch 101/101, validation error 11.884058 %
epoch 825, minibatch 101/101, validation error 11.847826 %
epoch 826, minibatch 101/101, validation error 11.847826 %
epoch 827, minibatch 101/101, validation error 11.847826 %
epoch 828, minibatch 101/101, validation error 11.775362 %
     epoch 828, minibatch 101/101, test error of best model 11.854839 %
Saving model...
...model saved.
epoch 829, minibatch 101/101, validation error 11.775362 %
epoch 830, minibatch 101/101, validation error 11.739130 %
     epoch 830, minibatch 101/101, test error of best model 11.854839 %
Saving model...
...model saved.
epoch 831, minibatch 101/101, validation error 11.739130 %
epoch 832, minibatch 101/101, validation error 11.739130 %
epoch 833, minibatch 101/101, validation error 11.739130 %
epoch 834, minibatch 101/101, validation error 11.739130 %
epoch 835, minibatch 101/101, validation error 11.739130 %
epoch 836, minibatch 101/101, validation error 11.775362 %
epoch 837, minibatch 101/101, validation error 11.775362 %
epoch 838, minibatch 101/101, validation error 11.775362 %
epoch 839, minibatch 101/101, validation error 11.775362 %
epoch 840, minibatch 101/101, validation error 11.775362 %
epoch 841, minibatch 101/101, validation error 11.739130 %
epoch 842, minibatch 101/101, validation error 11.739130 %
epoch 843, minibatch 101/101, validation error 11.739130 %
epoch 844, minibatch 101/101, validation error 11.739130 %
epoch 845, minibatch 101/101, validation error 11.666667 %
     epoch 845, minibatch 101/101, test error of best model 11.720430 %
Saving model...
...model saved.
epoch 846, minibatch 101/101, validation error 11.666667 %
epoch 847, minibatch 101/101, validation error 11.666667 %
epoch 848, minibatch 101/101, validation error 11.666667 %
epoch 849, minibatch 101/101, validation error 11.666667 %
epoch 850, minibatch 101/101, validation error 11.666667 %
epoch 851, minibatch 101/101, validation error 11.666667 %
epoch 852, minibatch 101/101, validation error 11.666667 %
epoch 853, minibatch 101/101, validation error 11.666667 %
epoch 854, minibatch 101/101, validation error 11.666667 %
epoch 855, minibatch 101/101, validation error 11.666667 %
epoch 856, minibatch 101/101, validation error 11.666667 %
epoch 857, minibatch 101/101, validation error 11.630435 %
     epoch 857, minibatch 101/101, test error of best model 11.666667 %
Saving model...
...model saved.
epoch 858, minibatch 101/101, validation error 11.630435 %
epoch 859, minibatch 101/101, validation error 11.630435 %
epoch 860, minibatch 101/101, validation error 11.594203 %
     epoch 860, minibatch 101/101, test error of best model 11.666667 %
Saving model...
...model saved.
epoch 861, minibatch 101/101, validation error 11.594203 %
epoch 862, minibatch 101/101, validation error 11.594203 %
epoch 863, minibatch 101/101, validation error 11.594203 %
epoch 864, minibatch 101/101, validation error 11.594203 %
epoch 865, minibatch 101/101, validation error 11.594203 %
epoch 866, minibatch 101/101, validation error 11.594203 %
epoch 867, minibatch 101/101, validation error 11.594203 %
epoch 868, minibatch 101/101, validation error 11.594203 %
epoch 869, minibatch 101/101, validation error 11.594203 %
epoch 870, minibatch 101/101, validation error 11.594203 %
epoch 871, minibatch 101/101, validation error 11.594203 %
epoch 872, minibatch 101/101, validation error 11.630435 %
epoch 873, minibatch 101/101, validation error 11.630435 %
epoch 874, minibatch 101/101, validation error 11.630435 %
epoch 875, minibatch 101/101, validation error 11.630435 %
epoch 876, minibatch 101/101, validation error 11.630435 %
epoch 877, minibatch 101/101, validation error 11.594203 %
epoch 878, minibatch 101/101, validation error 11.594203 %
epoch 879, minibatch 101/101, validation error 11.594203 %
epoch 880, minibatch 101/101, validation error 11.594203 %
epoch 881, minibatch 101/101, validation error 11.594203 %
epoch 882, minibatch 101/101, validation error 11.630435 %
epoch 883, minibatch 101/101, validation error 11.630435 %
epoch 884, minibatch 101/101, validation error 11.630435 %
epoch 885, minibatch 101/101, validation error 11.630435 %
epoch 886, minibatch 101/101, validation error 11.630435 %
epoch 887, minibatch 101/101, validation error 11.594203 %
epoch 888, minibatch 101/101, validation error 11.594203 %
epoch 889, minibatch 101/101, validation error 11.594203 %
epoch 890, minibatch 101/101, validation error 11.594203 %
epoch 891, minibatch 101/101, validation error 11.594203 %
epoch 892, minibatch 101/101, validation error 11.557971 %
     epoch 892, minibatch 101/101, test error of best model 11.478495 %
Saving model...
...model saved.
epoch 893, minibatch 101/101, validation error 11.557971 %
epoch 894, minibatch 101/101, validation error 11.557971 %
epoch 895, minibatch 101/101, validation error 11.557971 %
epoch 896, minibatch 101/101, validation error 11.557971 %
epoch 897, minibatch 101/101, validation error 11.594203 %
epoch 898, minibatch 101/101, validation error 11.594203 %
epoch 899, minibatch 101/101, validation error 11.594203 %
epoch 900, minibatch 101/101, validation error 11.557971 %
epoch 901, minibatch 101/101, validation error 11.557971 %
epoch 902, minibatch 101/101, validation error 11.557971 %
epoch 903, minibatch 101/101, validation error 11.557971 %
epoch 904, minibatch 101/101, validation error 11.557971 %
epoch 905, minibatch 101/101, validation error 11.521739 %
     epoch 905, minibatch 101/101, test error of best model 11.370968 %
Saving model...
...model saved.
epoch 906, minibatch 101/101, validation error 11.521739 %
epoch 907, minibatch 101/101, validation error 11.521739 %
epoch 908, minibatch 101/101, validation error 11.557971 %
epoch 909, minibatch 101/101, validation error 11.557971 %
epoch 910, minibatch 101/101, validation error 11.557971 %
epoch 911, minibatch 101/101, validation error 11.521739 %
epoch 912, minibatch 101/101, validation error 11.521739 %
epoch 913, minibatch 101/101, validation error 11.485507 %
     epoch 913, minibatch 101/101, test error of best model 11.344086 %
Saving model...
...model saved.
epoch 914, minibatch 101/101, validation error 11.485507 %
epoch 915, minibatch 101/101, validation error 11.413043 %
     epoch 915, minibatch 101/101, test error of best model 11.344086 %
Saving model...
...model saved.
epoch 916, minibatch 101/101, validation error 11.413043 %
epoch 917, minibatch 101/101, validation error 11.413043 %
epoch 918, minibatch 101/101, validation error 11.413043 %
epoch 919, minibatch 101/101, validation error 11.413043 %
epoch 920, minibatch 101/101, validation error 11.413043 %
epoch 921, minibatch 101/101, validation error 11.413043 %
epoch 922, minibatch 101/101, validation error 11.413043 %
epoch 923, minibatch 101/101, validation error 11.413043 %
epoch 924, minibatch 101/101, validation error 11.413043 %
epoch 925, minibatch 101/101, validation error 11.413043 %
epoch 926, minibatch 101/101, validation error 11.376812 %
     epoch 926, minibatch 101/101, test error of best model 11.344086 %
Saving model...
...model saved.
epoch 927, minibatch 101/101, validation error 11.376812 %
epoch 928, minibatch 101/101, validation error 11.340580 %
     epoch 928, minibatch 101/101, test error of best model 11.344086 %
Saving model...
...model saved.
epoch 929, minibatch 101/101, validation error 11.340580 %
epoch 930, minibatch 101/101, validation error 11.340580 %
epoch 931, minibatch 101/101, validation error 11.340580 %
epoch 932, minibatch 101/101, validation error 11.340580 %
epoch 933, minibatch 101/101, validation error 11.340580 %
epoch 934, minibatch 101/101, validation error 11.340580 %
epoch 935, minibatch 101/101, validation error 11.340580 %
epoch 936, minibatch 101/101, validation error 11.340580 %
epoch 937, minibatch 101/101, validation error 11.340580 %
epoch 938, minibatch 101/101, validation error 11.268116 %
     epoch 938, minibatch 101/101, test error of best model 11.263441 %
Saving model...
...model saved.
epoch 939, minibatch 101/101, validation error 11.268116 %
epoch 940, minibatch 101/101, validation error 11.268116 %
epoch 941, minibatch 101/101, validation error 11.268116 %
epoch 942, minibatch 101/101, validation error 11.268116 %
epoch 943, minibatch 101/101, validation error 11.268116 %
epoch 944, minibatch 101/101, validation error 11.268116 %
epoch 945, minibatch 101/101, validation error 11.268116 %
epoch 946, minibatch 101/101, validation error 11.268116 %
epoch 947, minibatch 101/101, validation error 11.304348 %
epoch 948, minibatch 101/101, validation error 11.304348 %
epoch 949, minibatch 101/101, validation error 11.304348 %
epoch 950, minibatch 101/101, validation error 11.304348 %
epoch 951, minibatch 101/101, validation error 11.304348 %
epoch 952, minibatch 101/101, validation error 11.340580 %
epoch 953, minibatch 101/101, validation error 11.340580 %
epoch 954, minibatch 101/101, validation error 11.340580 %
epoch 955, minibatch 101/101, validation error 11.340580 %
epoch 956, minibatch 101/101, validation error 11.376812 %
epoch 957, minibatch 101/101, validation error 11.376812 %
epoch 958, minibatch 101/101, validation error 11.376812 %
epoch 959, minibatch 101/101, validation error 11.376812 %
epoch 960, minibatch 101/101, validation error 11.376812 %
epoch 961, minibatch 101/101, validation error 11.376812 %
epoch 962, minibatch 101/101, validation error 11.376812 %
epoch 963, minibatch 101/101, validation error 11.376812 %
epoch 964, minibatch 101/101, validation error 11.376812 %
epoch 965, minibatch 101/101, validation error 11.340580 %
epoch 966, minibatch 101/101, validation error 11.304348 %
epoch 967, minibatch 101/101, validation error 11.304348 %
epoch 968, minibatch 101/101, validation error 11.304348 %
epoch 969, minibatch 101/101, validation error 11.304348 %
epoch 970, minibatch 101/101, validation error 11.304348 %
epoch 971, minibatch 101/101, validation error 11.304348 %
epoch 972, minibatch 101/101, validation error 11.304348 %
epoch 973, minibatch 101/101, validation error 11.304348 %
epoch 974, minibatch 101/101, validation error 11.304348 %
epoch 975, minibatch 101/101, validation error 11.304348 %
epoch 976, minibatch 101/101, validation error 11.304348 %
epoch 977, minibatch 101/101, validation error 11.304348 %
epoch 978, minibatch 101/101, validation error 11.304348 %
epoch 979, minibatch 101/101, validation error 11.304348 %
epoch 980, minibatch 101/101, validation error 11.304348 %
epoch 981, minibatch 101/101, validation error 11.268116 %
epoch 982, minibatch 101/101, validation error 11.268116 %
epoch 983, minibatch 101/101, validation error 11.268116 %
epoch 984, minibatch 101/101, validation error 11.268116 %
epoch 985, minibatch 101/101, validation error 11.268116 %
epoch 986, minibatch 101/101, validation error 11.195652 %
     epoch 986, minibatch 101/101, test error of best model 11.129032 %
Saving model...
...model saved.
epoch 987, minibatch 101/101, validation error 11.195652 %
epoch 988, minibatch 101/101, validation error 11.195652 %
epoch 989, minibatch 101/101, validation error 11.195652 %
epoch 990, minibatch 101/101, validation error 11.195652 %
epoch 991, minibatch 101/101, validation error 11.195652 %
epoch 992, minibatch 101/101, validation error 11.195652 %
epoch 993, minibatch 101/101, validation error 11.195652 %
epoch 994, minibatch 101/101, validation error 11.195652 %
epoch 995, minibatch 101/101, validation error 11.195652 %
epoch 996, minibatch 101/101, validation error 11.195652 %
epoch 997, minibatch 101/101, validation error 11.195652 %
epoch 998, minibatch 101/101, validation error 11.195652 %
epoch 999, minibatch 101/101, validation error 11.195652 %
epoch 1000, minibatch 101/101, validation error 11.195652 %
epoch 1001, minibatch 101/101, validation error 11.195652 %
epoch 1002, minibatch 101/101, validation error 11.195652 %
epoch 1003, minibatch 101/101, validation error 11.195652 %
epoch 1004, minibatch 101/101, validation error 11.231884 %
epoch 1005, minibatch 101/101, validation error 11.231884 %
epoch 1006, minibatch 101/101, validation error 11.231884 %
epoch 1007, minibatch 101/101, validation error 11.159420 %
     epoch 1007, minibatch 101/101, test error of best model 11.075269 %
Saving model...
...model saved.
epoch 1008, minibatch 101/101, validation error 11.159420 %
epoch 1009, minibatch 101/101, validation error 11.159420 %
epoch 1010, minibatch 101/101, validation error 11.159420 %
epoch 1011, minibatch 101/101, validation error 11.159420 %
epoch 1012, minibatch 101/101, validation error 11.159420 %
epoch 1013, minibatch 101/101, validation error 11.159420 %
epoch 1014, minibatch 101/101, validation error 11.159420 %
epoch 1015, minibatch 101/101, validation error 11.159420 %
epoch 1016, minibatch 101/101, validation error 11.159420 %
epoch 1017, minibatch 101/101, validation error 11.159420 %
epoch 1018, minibatch 101/101, validation error 11.159420 %
epoch 1019, minibatch 101/101, validation error 11.159420 %
epoch 1020, minibatch 101/101, validation error 11.159420 %
epoch 1021, minibatch 101/101, validation error 11.159420 %
epoch 1022, minibatch 101/101, validation error 11.159420 %
epoch 1023, minibatch 101/101, validation error 11.159420 %
epoch 1024, minibatch 101/101, validation error 11.123188 %
     epoch 1024, minibatch 101/101, test error of best model 11.021505 %
Saving model...
...model saved.
epoch 1025, minibatch 101/101, validation error 11.123188 %
epoch 1026, minibatch 101/101, validation error 11.123188 %
epoch 1027, minibatch 101/101, validation error 11.123188 %
epoch 1028, minibatch 101/101, validation error 11.123188 %
epoch 1029, minibatch 101/101, validation error 11.123188 %
epoch 1030, minibatch 101/101, validation error 11.123188 %
epoch 1031, minibatch 101/101, validation error 11.123188 %
epoch 1032, minibatch 101/101, validation error 11.159420 %
epoch 1033, minibatch 101/101, validation error 11.159420 %
epoch 1034, minibatch 101/101, validation error 11.159420 %
epoch 1035, minibatch 101/101, validation error 11.159420 %
epoch 1036, minibatch 101/101, validation error 11.159420 %
epoch 1037, minibatch 101/101, validation error 11.159420 %
epoch 1038, minibatch 101/101, validation error 11.159420 %
epoch 1039, minibatch 101/101, validation error 11.159420 %
epoch 1040, minibatch 101/101, validation error 11.159420 %
epoch 1041, minibatch 101/101, validation error 11.159420 %
epoch 1042, minibatch 101/101, validation error 11.159420 %
epoch 1043, minibatch 101/101, validation error 11.195652 %
epoch 1044, minibatch 101/101, validation error 11.195652 %
epoch 1045, minibatch 101/101, validation error 11.195652 %
epoch 1046, minibatch 101/101, validation error 11.195652 %
epoch 1047, minibatch 101/101, validation error 11.195652 %
epoch 1048, minibatch 101/101, validation error 11.195652 %
epoch 1049, minibatch 101/101, validation error 11.195652 %
epoch 1050, minibatch 101/101, validation error 11.195652 %
epoch 1051, minibatch 101/101, validation error 11.195652 %
epoch 1052, minibatch 101/101, validation error 11.195652 %
epoch 1053, minibatch 101/101, validation error 11.195652 %
epoch 1054, minibatch 101/101, validation error 11.195652 %
epoch 1055, minibatch 101/101, validation error 11.195652 %
epoch 1056, minibatch 101/101, validation error 11.195652 %
epoch 1057, minibatch 101/101, validation error 11.195652 %
epoch 1058, minibatch 101/101, validation error 11.195652 %
epoch 1059, minibatch 101/101, validation error 11.195652 %
epoch 1060, minibatch 101/101, validation error 11.195652 %
epoch 1061, minibatch 101/101, validation error 11.195652 %
epoch 1062, minibatch 101/101, validation error 11.195652 %
epoch 1063, minibatch 101/101, validation error 11.195652 %
epoch 1064, minibatch 101/101, validation error 11.195652 %
epoch 1065, minibatch 101/101, validation error 11.195652 %
epoch 1066, minibatch 101/101, validation error 11.195652 %
epoch 1067, minibatch 101/101, validation error 11.195652 %
epoch 1068, minibatch 101/101, validation error 11.195652 %
epoch 1069, minibatch 101/101, validation error 11.195652 %
epoch 1070, minibatch 101/101, validation error 11.195652 %
epoch 1071, minibatch 101/101, validation error 11.195652 %
epoch 1072, minibatch 101/101, validation error 11.195652 %
epoch 1073, minibatch 101/101, validation error 11.195652 %
epoch 1074, minibatch 101/101, validation error 11.195652 %
epoch 1075, minibatch 101/101, validation error 11.195652 %
epoch 1076, minibatch 101/101, validation error 11.195652 %
epoch 1077, minibatch 101/101, validation error 11.195652 %
epoch 1078, minibatch 101/101, validation error 11.195652 %
epoch 1079, minibatch 101/101, validation error 11.195652 %
epoch 1080, minibatch 101/101, validation error 11.195652 %
epoch 1081, minibatch 101/101, validation error 11.231884 %
epoch 1082, minibatch 101/101, validation error 11.231884 %
epoch 1083, minibatch 101/101, validation error 11.231884 %
epoch 1084, minibatch 101/101, validation error 11.159420 %
epoch 1085, minibatch 101/101, validation error 11.159420 %
epoch 1086, minibatch 101/101, validation error 11.159420 %
epoch 1087, minibatch 101/101, validation error 11.159420 %
epoch 1088, minibatch 101/101, validation error 11.195652 %
epoch 1089, minibatch 101/101, validation error 11.195652 %
epoch 1090, minibatch 101/101, validation error 11.195652 %
epoch 1091, minibatch 101/101, validation error 11.159420 %
epoch 1092, minibatch 101/101, validation error 11.159420 %
epoch 1093, minibatch 101/101, validation error 11.159420 %
epoch 1094, minibatch 101/101, validation error 11.159420 %
epoch 1095, minibatch 101/101, validation error 11.159420 %
epoch 1096, minibatch 101/101, validation error 11.159420 %
epoch 1097, minibatch 101/101, validation error 11.159420 %
epoch 1098, minibatch 101/101, validation error 11.159420 %
epoch 1099, minibatch 101/101, validation error 11.159420 %
epoch 1100, minibatch 101/101, validation error 11.159420 %
epoch 1101, minibatch 101/101, validation error 11.159420 %
epoch 1102, minibatch 101/101, validation error 11.159420 %
epoch 1103, minibatch 101/101, validation error 11.159420 %
epoch 1104, minibatch 101/101, validation error 11.159420 %
epoch 1105, minibatch 101/101, validation error 11.159420 %
epoch 1106, minibatch 101/101, validation error 11.159420 %
epoch 1107, minibatch 101/101, validation error 11.159420 %
epoch 1108, minibatch 101/101, validation error 11.159420 %
epoch 1109, minibatch 101/101, validation error 11.231884 %
epoch 1110, minibatch 101/101, validation error 11.231884 %
epoch 1111, minibatch 101/101, validation error 11.231884 %
epoch 1112, minibatch 101/101, validation error 11.195652 %
epoch 1113, minibatch 101/101, validation error 11.195652 %
epoch 1114, minibatch 101/101, validation error 11.195652 %
epoch 1115, minibatch 101/101, validation error 11.195652 %
epoch 1116, minibatch 101/101, validation error 11.195652 %
epoch 1117, minibatch 101/101, validation error 11.195652 %
epoch 1118, minibatch 101/101, validation error 11.195652 %
epoch 1119, minibatch 101/101, validation error 11.195652 %
epoch 1120, minibatch 101/101, validation error 11.195652 %
epoch 1121, minibatch 101/101, validation error 11.195652 %
epoch 1122, minibatch 101/101, validation error 11.195652 %
epoch 1123, minibatch 101/101, validation error 11.195652 %
epoch 1124, minibatch 101/101, validation error 11.195652 %
epoch 1125, minibatch 101/101, validation error 11.195652 %
epoch 1126, minibatch 101/101, validation error 11.195652 %
epoch 1127, minibatch 101/101, validation error 11.195652 %
epoch 1128, minibatch 101/101, validation error 11.195652 %
epoch 1129, minibatch 101/101, validation error 11.195652 %
epoch 1130, minibatch 101/101, validation error 11.195652 %
epoch 1131, minibatch 101/101, validation error 11.195652 %
epoch 1132, minibatch 101/101, validation error 11.195652 %
epoch 1133, minibatch 101/101, validation error 11.195652 %
epoch 1134, minibatch 101/101, validation error 11.195652 %
epoch 1135, minibatch 101/101, validation error 11.195652 %
epoch 1136, minibatch 101/101, validation error 11.195652 %
epoch 1137, minibatch 101/101, validation error 11.159420 %
epoch 1138, minibatch 101/101, validation error 11.159420 %
epoch 1139, minibatch 101/101, validation error 11.159420 %
epoch 1140, minibatch 101/101, validation error 11.159420 %
epoch 1141, minibatch 101/101, validation error 11.159420 %
epoch 1142, minibatch 101/101, validation error 11.159420 %
epoch 1143, minibatch 101/101, validation error 11.159420 %
epoch 1144, minibatch 101/101, validation error 11.159420 %
epoch 1145, minibatch 101/101, validation error 11.159420 %
epoch 1146, minibatch 101/101, validation error 11.159420 %
epoch 1147, minibatch 101/101, validation error 11.159420 %
epoch 1148, minibatch 101/101, validation error 11.159420 %
epoch 1149, minibatch 101/101, validation error 11.159420 %
epoch 1150, minibatch 101/101, validation error 11.159420 %
epoch 1151, minibatch 101/101, validation error 11.159420 %
epoch 1152, minibatch 101/101, validation error 11.159420 %
epoch 1153, minibatch 101/101, validation error 11.195652 %
epoch 1154, minibatch 101/101, validation error 11.195652 %
epoch 1155, minibatch 101/101, validation error 11.195652 %
epoch 1156, minibatch 101/101, validation error 11.195652 %
epoch 1157, minibatch 101/101, validation error 11.195652 %
epoch 1158, minibatch 101/101, validation error 11.195652 %
epoch 1159, minibatch 101/101, validation error 11.195652 %
epoch 1160, minibatch 101/101, validation error 11.195652 %
epoch 1161, minibatch 101/101, validation error 11.195652 %
epoch 1162, minibatch 101/101, validation error 11.195652 %
epoch 1163, minibatch 101/101, validation error 11.195652 %
epoch 1164, minibatch 101/101, validation error 11.195652 %
epoch 1165, minibatch 101/101, validation error 11.195652 %
epoch 1166, minibatch 101/101, validation error 11.195652 %
epoch 1167, minibatch 101/101, validation error 11.195652 %
epoch 1168, minibatch 101/101, validation error 11.195652 %
epoch 1169, minibatch 101/101, validation error 11.195652 %
epoch 1170, minibatch 101/101, validation error 11.195652 %
epoch 1171, minibatch 101/101, validation error 11.231884 %
epoch 1172, minibatch 101/101, validation error 11.231884 %
epoch 1173, minibatch 101/101, validation error 11.231884 %
epoch 1174, minibatch 101/101, validation error 11.231884 %
epoch 1175, minibatch 101/101, validation error 11.231884 %
epoch 1176, minibatch 101/101, validation error 11.231884 %
epoch 1177, minibatch 101/101, validation error 11.231884 %
epoch 1178, minibatch 101/101, validation error 11.231884 %
epoch 1179, minibatch 101/101, validation error 11.231884 %
epoch 1180, minibatch 101/101, validation error 11.231884 %
epoch 1181, minibatch 101/101, validation error 11.231884 %
epoch 1182, minibatch 101/101, validation error 11.231884 %
epoch 1183, minibatch 101/101, validation error 11.231884 %
epoch 1184, minibatch 101/101, validation error 11.231884 %
epoch 1185, minibatch 101/101, validation error 11.231884 %
epoch 1186, minibatch 101/101, validation error 11.231884 %
epoch 1187, minibatch 101/101, validation error 11.231884 %
epoch 1188, minibatch 101/101, validation error 11.231884 %
epoch 1189, minibatch 101/101, validation error 11.231884 %
epoch 1190, minibatch 101/101, validation error 11.231884 %
epoch 1191, minibatch 101/101, validation error 11.231884 %
epoch 1192, minibatch 101/101, validation error 11.231884 %
epoch 1193, minibatch 101/101, validation error 11.231884 %
epoch 1194, minibatch 101/101, validation error 11.231884 %
epoch 1195, minibatch 101/101, validation error 11.231884 %
epoch 1196, minibatch 101/101, validation error 11.231884 %
epoch 1197, minibatch 101/101, validation error 11.231884 %
epoch 1198, minibatch 101/101, validation error 11.231884 %
epoch 1199, minibatch 101/101, validation error 11.231884 %
epoch 1200, minibatch 101/101, validation error 11.231884 %
epoch 1201, minibatch 101/101, validation error 11.231884 %
epoch 1202, minibatch 101/101, validation error 11.195652 %
epoch 1203, minibatch 101/101, validation error 11.195652 %
epoch 1204, minibatch 101/101, validation error 11.159420 %
epoch 1205, minibatch 101/101, validation error 11.159420 %
epoch 1206, minibatch 101/101, validation error 11.159420 %
epoch 1207, minibatch 101/101, validation error 11.159420 %
epoch 1208, minibatch 101/101, validation error 11.159420 %
epoch 1209, minibatch 101/101, validation error 11.159420 %
epoch 1210, minibatch 101/101, validation error 11.159420 %
epoch 1211, minibatch 101/101, validation error 11.159420 %
epoch 1212, minibatch 101/101, validation error 11.159420 %
epoch 1213, minibatch 101/101, validation error 11.159420 %
epoch 1214, minibatch 101/101, validation error 11.159420 %
epoch 1215, minibatch 101/101, validation error 11.159420 %
epoch 1216, minibatch 101/101, validation error 11.159420 %
epoch 1217, minibatch 101/101, validation error 11.159420 %
epoch 1218, minibatch 101/101, validation error 11.159420 %
epoch 1219, minibatch 101/101, validation error 11.159420 %
epoch 1220, minibatch 101/101, validation error 11.159420 %
epoch 1221, minibatch 101/101, validation error 11.159420 %
epoch 1222, minibatch 101/101, validation error 11.159420 %
epoch 1223, minibatch 101/101, validation error 11.159420 %
epoch 1224, minibatch 101/101, validation error 11.159420 %
epoch 1225, minibatch 101/101, validation error 11.159420 %
epoch 1226, minibatch 101/101, validation error 11.159420 %
epoch 1227, minibatch 101/101, validation error 11.195652 %
epoch 1228, minibatch 101/101, validation error 11.195652 %
epoch 1229, minibatch 101/101, validation error 11.195652 %
epoch 1230, minibatch 101/101, validation error 11.195652 %
epoch 1231, minibatch 101/101, validation error 11.195652 %
epoch 1232, minibatch 101/101, validation error 11.195652 %
epoch 1233, minibatch 101/101, validation error 11.195652 %
epoch 1234, minibatch 101/101, validation error 11.195652 %
epoch 1235, minibatch 101/101, validation error 11.195652 %
epoch 1236, minibatch 101/101, validation error 11.195652 %
epoch 1237, minibatch 101/101, validation error 11.195652 %
epoch 1238, minibatch 101/101, validation error 11.195652 %
epoch 1239, minibatch 101/101, validation error 11.195652 %
epoch 1240, minibatch 101/101, validation error 11.195652 %
epoch 1241, minibatch 101/101, validation error 11.195652 %
epoch 1242, minibatch 101/101, validation error 11.195652 %
epoch 1243, minibatch 101/101, validation error 11.195652 %
epoch 1244, minibatch 101/101, validation error 11.195652 %
epoch 1245, minibatch 101/101, validation error 11.195652 %
epoch 1246, minibatch 101/101, validation error 11.195652 %
epoch 1247, minibatch 101/101, validation error 11.195652 %
epoch 1248, minibatch 101/101, validation error 11.195652 %
epoch 1249, minibatch 101/101, validation error 11.195652 %
epoch 1250, minibatch 101/101, validation error 11.195652 %
epoch 1251, minibatch 101/101, validation error 11.195652 %
epoch 1252, minibatch 101/101, validation error 11.195652 %
epoch 1253, minibatch 101/101, validation error 11.195652 %
epoch 1254, minibatch 101/101, validation error 11.195652 %
epoch 1255, minibatch 101/101, validation error 11.195652 %
epoch 1256, minibatch 101/101, validation error 11.195652 %
epoch 1257, minibatch 101/101, validation error 11.195652 %
epoch 1258, minibatch 101/101, validation error 11.195652 %
epoch 1259, minibatch 101/101, validation error 11.195652 %
epoch 1260, minibatch 101/101, validation error 11.195652 %
epoch 1261, minibatch 101/101, validation error 11.195652 %
epoch 1262, minibatch 101/101, validation error 11.195652 %
epoch 1263, minibatch 101/101, validation error 11.195652 %
epoch 1264, minibatch 101/101, validation error 11.195652 %
epoch 1265, minibatch 101/101, validation error 11.195652 %
epoch 1266, minibatch 101/101, validation error 11.195652 %
epoch 1267, minibatch 101/101, validation error 11.195652 %
epoch 1268, minibatch 101/101, validation error 11.195652 %
epoch 1269, minibatch 101/101, validation error 11.195652 %
epoch 1270, minibatch 101/101, validation error 11.195652 %
epoch 1271, minibatch 101/101, validation error 11.195652 %
epoch 1272, minibatch 101/101, validation error 11.195652 %
epoch 1273, minibatch 101/101, validation error 11.195652 %
epoch 1274, minibatch 101/101, validation error 11.195652 %
epoch 1275, minibatch 101/101, validation error 11.195652 %
epoch 1276, minibatch 101/101, validation error 11.195652 %
epoch 1277, minibatch 101/101, validation error 11.195652 %
epoch 1278, minibatch 101/101, validation error 11.195652 %
epoch 1279, minibatch 101/101, validation error 11.195652 %
epoch 1280, minibatch 101/101, validation error 11.159420 %
epoch 1281, minibatch 101/101, validation error 11.159420 %
epoch 1282, minibatch 101/101, validation error 11.159420 %
epoch 1283, minibatch 101/101, validation error 11.159420 %
epoch 1284, minibatch 101/101, validation error 11.159420 %
epoch 1285, minibatch 101/101, validation error 11.159420 %
epoch 1286, minibatch 101/101, validation error 11.159420 %
epoch 1287, minibatch 101/101, validation error 11.159420 %
epoch 1288, minibatch 101/101, validation error 11.159420 %
epoch 1289, minibatch 101/101, validation error 11.159420 %
epoch 1290, minibatch 101/101, validation error 11.159420 %
epoch 1291, minibatch 101/101, validation error 11.159420 %
epoch 1292, minibatch 101/101, validation error 11.159420 %
epoch 1293, minibatch 101/101, validation error 11.159420 %
epoch 1294, minibatch 101/101, validation error 11.195652 %
epoch 1295, minibatch 101/101, validation error 11.195652 %
epoch 1296, minibatch 101/101, validation error 11.195652 %
epoch 1297, minibatch 101/101, validation error 11.195652 %
epoch 1298, minibatch 101/101, validation error 11.195652 %
epoch 1299, minibatch 101/101, validation error 11.195652 %
epoch 1300, minibatch 101/101, validation error 11.195652 %
epoch 1301, minibatch 101/101, validation error 11.195652 %
epoch 1302, minibatch 101/101, validation error 11.195652 %
epoch 1303, minibatch 101/101, validation error 11.195652 %
epoch 1304, minibatch 101/101, validation error 11.159420 %
epoch 1305, minibatch 101/101, validation error 11.159420 %
epoch 1306, minibatch 101/101, validation error 11.159420 %
epoch 1307, minibatch 101/101, validation error 11.159420 %
epoch 1308, minibatch 101/101, validation error 11.159420 %
epoch 1309, minibatch 101/101, validation error 11.159420 %
epoch 1310, minibatch 101/101, validation error 11.159420 %
epoch 1311, minibatch 101/101, validation error 11.159420 %
epoch 1312, minibatch 101/101, validation error 11.159420 %
epoch 1313, minibatch 101/101, validation error 11.159420 %
epoch 1314, minibatch 101/101, validation error 11.159420 %
epoch 1315, minibatch 101/101, validation error 11.159420 %
epoch 1316, minibatch 101/101, validation error 11.159420 %
epoch 1317, minibatch 101/101, validation error 11.159420 %
epoch 1318, minibatch 101/101, validation error 11.159420 %
epoch 1319, minibatch 101/101, validation error 11.159420 %
epoch 1320, minibatch 101/101, validation error 11.159420 %
epoch 1321, minibatch 101/101, validation error 11.159420 %
epoch 1322, minibatch 101/101, validation error 11.159420 %
epoch 1323, minibatch 101/101, validation error 11.159420 %
epoch 1324, minibatch 101/101, validation error 11.159420 %
epoch 1325, minibatch 101/101, validation error 11.159420 %
epoch 1326, minibatch 101/101, validation error 11.159420 %
epoch 1327, minibatch 101/101, validation error 11.159420 %
epoch 1328, minibatch 101/101, validation error 11.159420 %
epoch 1329, minibatch 101/101, validation error 11.159420 %
epoch 1330, minibatch 101/101, validation error 11.159420 %
epoch 1331, minibatch 101/101, validation error 11.159420 %
epoch 1332, minibatch 101/101, validation error 11.159420 %
epoch 1333, minibatch 101/101, validation error 11.159420 %
epoch 1334, minibatch 101/101, validation error 11.159420 %
epoch 1335, minibatch 101/101, validation error 11.159420 %
epoch 1336, minibatch 101/101, validation error 11.195652 %
epoch 1337, minibatch 101/101, validation error 11.195652 %
epoch 1338, minibatch 101/101, validation error 11.195652 %
epoch 1339, minibatch 101/101, validation error 11.195652 %
epoch 1340, minibatch 101/101, validation error 11.195652 %
epoch 1341, minibatch 101/101, validation error 11.195652 %
epoch 1342, minibatch 101/101, validation error 11.195652 %
epoch 1343, minibatch 101/101, validation error 11.195652 %
epoch 1344, minibatch 101/101, validation error 11.195652 %
epoch 1345, minibatch 101/101, validation error 11.195652 %
epoch 1346, minibatch 101/101, validation error 11.195652 %
epoch 1347, minibatch 101/101, validation error 11.195652 %
epoch 1348, minibatch 101/101, validation error 11.195652 %
epoch 1349, minibatch 101/101, validation error 11.195652 %
epoch 1350, minibatch 101/101, validation error 11.195652 %
epoch 1351, minibatch 101/101, validation error 11.195652 %
epoch 1352, minibatch 101/101, validation error 11.195652 %
epoch 1353, minibatch 101/101, validation error 11.195652 %
epoch 1354, minibatch 101/101, validation error 11.195652 %
epoch 1355, minibatch 101/101, validation error 11.195652 %
epoch 1356, minibatch 101/101, validation error 11.195652 %
epoch 1357, minibatch 101/101, validation error 11.195652 %
epoch 1358, minibatch 101/101, validation error 11.195652 %
epoch 1359, minibatch 101/101, validation error 11.195652 %
epoch 1360, minibatch 101/101, validation error 11.195652 %
epoch 1361, minibatch 101/101, validation error 11.195652 %
epoch 1362, minibatch 101/101, validation error 11.195652 %
epoch 1363, minibatch 101/101, validation error 11.195652 %
epoch 1364, minibatch 101/101, validation error 11.195652 %
epoch 1365, minibatch 101/101, validation error 11.195652 %
epoch 1366, minibatch 101/101, validation error 11.195652 %
epoch 1367, minibatch 101/101, validation error 11.195652 %
epoch 1368, minibatch 101/101, validation error 11.195652 %
epoch 1369, minibatch 101/101, validation error 11.195652 %
epoch 1370, minibatch 101/101, validation error 11.195652 %
epoch 1371, minibatch 101/101, validation error 11.231884 %
epoch 1372, minibatch 101/101, validation error 11.231884 %
epoch 1373, minibatch 101/101, validation error 11.231884 %
epoch 1374, minibatch 101/101, validation error 11.231884 %
epoch 1375, minibatch 101/101, validation error 11.231884 %
epoch 1376, minibatch 101/101, validation error 11.231884 %
epoch 1377, minibatch 101/101, validation error 11.231884 %
epoch 1378, minibatch 101/101, validation error 11.231884 %
epoch 1379, minibatch 101/101, validation error 11.231884 %
epoch 1380, minibatch 101/101, validation error 11.231884 %
epoch 1381, minibatch 101/101, validation error 11.231884 %
epoch 1382, minibatch 101/101, validation error 11.231884 %
epoch 1383, minibatch 101/101, validation error 11.231884 %
epoch 1384, minibatch 101/101, validation error 11.231884 %
epoch 1385, minibatch 101/101, validation error 11.231884 %
epoch 1386, minibatch 101/101, validation error 11.231884 %
epoch 1387, minibatch 101/101, validation error 11.231884 %
epoch 1388, minibatch 101/101, validation error 11.231884 %
epoch 1389, minibatch 101/101, validation error 11.231884 %
epoch 1390, minibatch 101/101, validation error 11.231884 %
epoch 1391, minibatch 101/101, validation error 11.231884 %
epoch 1392, minibatch 101/101, validation error 11.231884 %
epoch 1393, minibatch 101/101, validation error 11.231884 %
epoch 1394, minibatch 101/101, validation error 11.231884 %
epoch 1395, minibatch 101/101, validation error 11.231884 %
epoch 1396, minibatch 101/101, validation error 11.231884 %
epoch 1397, minibatch 101/101, validation error 11.231884 %
epoch 1398, minibatch 101/101, validation error 11.231884 %
epoch 1399, minibatch 101/101, validation error 11.231884 %
epoch 1400, minibatch 101/101, validation error 11.231884 %
epoch 1401, minibatch 101/101, validation error 11.231884 %
epoch 1402, minibatch 101/101, validation error 11.231884 %
epoch 1403, minibatch 101/101, validation error 11.231884 %
epoch 1404, minibatch 101/101, validation error 11.195652 %
epoch 1405, minibatch 101/101, validation error 11.195652 %
epoch 1406, minibatch 101/101, validation error 11.195652 %
epoch 1407, minibatch 101/101, validation error 11.195652 %
epoch 1408, minibatch 101/101, validation error 11.195652 %
epoch 1409, minibatch 101/101, validation error 11.195652 %
epoch 1410, minibatch 101/101, validation error 11.123188 %
epoch 1411, minibatch 101/101, validation error 11.123188 %
epoch 1412, minibatch 101/101, validation error 11.123188 %
epoch 1413, minibatch 101/101, validation error 11.123188 %
epoch 1414, minibatch 101/101, validation error 11.123188 %
epoch 1415, minibatch 101/101, validation error 11.123188 %
epoch 1416, minibatch 101/101, validation error 11.123188 %
epoch 1417, minibatch 101/101, validation error 11.123188 %
epoch 1418, minibatch 101/101, validation error 11.123188 %
epoch 1419, minibatch 101/101, validation error 11.123188 %
epoch 1420, minibatch 101/101, validation error 11.123188 %
epoch 1421, minibatch 101/101, validation error 11.123188 %
epoch 1422, minibatch 101/101, validation error 11.123188 %
epoch 1423, minibatch 101/101, validation error 11.123188 %
epoch 1424, minibatch 101/101, validation error 11.123188 %
epoch 1425, minibatch 101/101, validation error 11.123188 %
epoch 1426, minibatch 101/101, validation error 11.123188 %
epoch 1427, minibatch 101/101, validation error 11.123188 %
epoch 1428, minibatch 101/101, validation error 11.123188 %
epoch 1429, minibatch 101/101, validation error 11.123188 %
epoch 1430, minibatch 101/101, validation error 11.123188 %
epoch 1431, minibatch 101/101, validation error 11.123188 %
epoch 1432, minibatch 101/101, validation error 11.123188 %
epoch 1433, minibatch 101/101, validation error 11.123188 %
epoch 1434, minibatch 101/101, validation error 11.123188 %
epoch 1435, minibatch 101/101, validation error 11.159420 %
epoch 1436, minibatch 101/101, validation error 11.159420 %
epoch 1437, minibatch 101/101, validation error 11.159420 %
epoch 1438, minibatch 101/101, validation error 11.159420 %
epoch 1439, minibatch 101/101, validation error 11.159420 %
epoch 1440, minibatch 101/101, validation error 11.159420 %
epoch 1441, minibatch 101/101, validation error 11.195652 %
epoch 1442, minibatch 101/101, validation error 11.195652 %
epoch 1443, minibatch 101/101, validation error 11.195652 %
epoch 1444, minibatch 101/101, validation error 11.195652 %
epoch 1445, minibatch 101/101, validation error 11.195652 %
epoch 1446, minibatch 101/101, validation error 11.195652 %
epoch 1447, minibatch 101/101, validation error 11.195652 %
epoch 1448, minibatch 101/101, validation error 11.195652 %
epoch 1449, minibatch 101/101, validation error 11.195652 %
epoch 1450, minibatch 101/101, validation error 11.195652 %
epoch 1451, minibatch 101/101, validation error 11.195652 %
epoch 1452, minibatch 101/101, validation error 11.231884 %
epoch 1453, minibatch 101/101, validation error 11.231884 %
epoch 1454, minibatch 101/101, validation error 11.231884 %
epoch 1455, minibatch 101/101, validation error 11.231884 %
epoch 1456, minibatch 101/101, validation error 11.231884 %
epoch 1457, minibatch 101/101, validation error 11.231884 %
epoch 1458, minibatch 101/101, validation error 11.231884 %
epoch 1459, minibatch 101/101, validation error 11.231884 %
epoch 1460, minibatch 101/101, validation error 11.195652 %
epoch 1461, minibatch 101/101, validation error 11.159420 %
epoch 1462, minibatch 101/101, validation error 11.159420 %
epoch 1463, minibatch 101/101, validation error 11.159420 %
epoch 1464, minibatch 101/101, validation error 11.159420 %
epoch 1465, minibatch 101/101, validation error 11.195652 %
epoch 1466, minibatch 101/101, validation error 11.195652 %
epoch 1467, minibatch 101/101, validation error 11.195652 %
epoch 1468, minibatch 101/101, validation error 11.195652 %
epoch 1469, minibatch 101/101, validation error 11.195652 %
epoch 1470, minibatch 101/101, validation error 11.195652 %
epoch 1471, minibatch 101/101, validation error 11.195652 %
epoch 1472, minibatch 101/101, validation error 11.195652 %
epoch 1473, minibatch 101/101, validation error 11.195652 %
epoch 1474, minibatch 101/101, validation error 11.195652 %
epoch 1475, minibatch 101/101, validation error 11.195652 %
epoch 1476, minibatch 101/101, validation error 11.195652 %
epoch 1477, minibatch 101/101, validation error 11.195652 %
epoch 1478, minibatch 101/101, validation error 11.195652 %
epoch 1479, minibatch 101/101, validation error 11.195652 %
epoch 1480, minibatch 101/101, validation error 11.195652 %
epoch 1481, minibatch 101/101, validation error 11.195652 %
epoch 1482, minibatch 101/101, validation error 11.195652 %
epoch 1483, minibatch 101/101, validation error 11.195652 %
epoch 1484, minibatch 101/101, validation error 11.195652 %
epoch 1485, minibatch 101/101, validation error 11.195652 %
epoch 1486, minibatch 101/101, validation error 11.195652 %
epoch 1487, minibatch 101/101, validation error 11.195652 %
epoch 1488, minibatch 101/101, validation error 11.195652 %
epoch 1489, minibatch 101/101, validation error 11.195652 %
epoch 1490, minibatch 101/101, validation error 11.195652 %
epoch 1491, minibatch 101/101, validation error 11.195652 %
epoch 1492, minibatch 101/101, validation error 11.195652 %
epoch 1493, minibatch 101/101, validation error 11.195652 %
epoch 1494, minibatch 101/101, validation error 11.195652 %
epoch 1495, minibatch 101/101, validation error 11.195652 %
epoch 1496, minibatch 101/101, validation error 11.195652 %
epoch 1497, minibatch 101/101, validation error 11.195652 %
epoch 1498, minibatch 101/101, validation error 11.195652 %
epoch 1499, minibatch 101/101, validation error 11.195652 %
epoch 1500, minibatch 101/101, validation error 11.195652 %
epoch 1501, minibatch 101/101, validation error 11.195652 %
epoch 1502, minibatch 101/101, validation error 11.195652 %
epoch 1503, minibatch 101/101, validation error 11.195652 %
epoch 1504, minibatch 101/101, validation error 11.195652 %
epoch 1505, minibatch 101/101, validation error 11.195652 %
epoch 1506, minibatch 101/101, validation error 11.195652 %
epoch 1507, minibatch 101/101, validation error 11.195652 %
epoch 1508, minibatch 101/101, validation error 11.195652 %
epoch 1509, minibatch 101/101, validation error 11.195652 %
epoch 1510, minibatch 101/101, validation error 11.195652 %
epoch 1511, minibatch 101/101, validation error 11.195652 %
epoch 1512, minibatch 101/101, validation error 11.195652 %
epoch 1513, minibatch 101/101, validation error 11.195652 %
epoch 1514, minibatch 101/101, validation error 11.195652 %
epoch 1515, minibatch 101/101, validation error 11.195652 %
epoch 1516, minibatch 101/101, validation error 11.159420 %
epoch 1517, minibatch 101/101, validation error 11.159420 %
epoch 1518, minibatch 101/101, validation error 11.159420 %
epoch 1519, minibatch 101/101, validation error 11.159420 %
epoch 1520, minibatch 101/101, validation error 11.159420 %
epoch 1521, minibatch 101/101, validation error 11.159420 %
epoch 1522, minibatch 101/101, validation error 11.159420 %
epoch 1523, minibatch 101/101, validation error 11.159420 %
epoch 1524, minibatch 101/101, validation error 11.159420 %
epoch 1525, minibatch 101/101, validation error 11.159420 %
epoch 1526, minibatch 101/101, validation error 11.159420 %
epoch 1527, minibatch 101/101, validation error 11.159420 %
epoch 1528, minibatch 101/101, validation error 11.159420 %
epoch 1529, minibatch 101/101, validation error 11.159420 %
epoch 1530, minibatch 101/101, validation error 11.159420 %
epoch 1531, minibatch 101/101, validation error 11.159420 %
epoch 1532, minibatch 101/101, validation error 11.159420 %
epoch 1533, minibatch 101/101, validation error 11.159420 %
epoch 1534, minibatch 101/101, validation error 11.159420 %
epoch 1535, minibatch 101/101, validation error 11.159420 %
epoch 1536, minibatch 101/101, validation error 11.159420 %
epoch 1537, minibatch 101/101, validation error 11.159420 %
epoch 1538, minibatch 101/101, validation error 11.123188 %
epoch 1539, minibatch 101/101, validation error 11.123188 %
epoch 1540, minibatch 101/101, validation error 11.123188 %
epoch 1541, minibatch 101/101, validation error 11.123188 %
epoch 1542, minibatch 101/101, validation error 11.123188 %
epoch 1543, minibatch 101/101, validation error 11.123188 %
epoch 1544, minibatch 101/101, validation error 11.123188 %
epoch 1545, minibatch 101/101, validation error 11.123188 %
epoch 1546, minibatch 101/101, validation error 11.123188 %
epoch 1547, minibatch 101/101, validation error 11.123188 %
epoch 1548, minibatch 101/101, validation error 11.123188 %
epoch 1549, minibatch 101/101, validation error 11.123188 %
epoch 1550, minibatch 101/101, validation error 11.123188 %
epoch 1551, minibatch 101/101, validation error 11.123188 %
epoch 1552, minibatch 101/101, validation error 11.123188 %
epoch 1553, minibatch 101/101, validation error 11.123188 %
epoch 1554, minibatch 101/101, validation error 11.123188 %
epoch 1555, minibatch 101/101, validation error 11.123188 %
epoch 1556, minibatch 101/101, validation error 11.123188 %
epoch 1557, minibatch 101/101, validation error 11.123188 %
epoch 1558, minibatch 101/101, validation error 11.123188 %
epoch 1559, minibatch 101/101, validation error 11.123188 %
epoch 1560, minibatch 101/101, validation error 11.123188 %
epoch 1561, minibatch 101/101, validation error 11.086957 %
     epoch 1561, minibatch 101/101, test error of best model 10.376344 %
Saving model...
...model saved.
epoch 1562, minibatch 101/101, validation error 11.086957 %
epoch 1563, minibatch 101/101, validation error 11.086957 %
epoch 1564, minibatch 101/101, validation error 11.086957 %
epoch 1565, minibatch 101/101, validation error 11.086957 %
epoch 1566, minibatch 101/101, validation error 11.086957 %
epoch 1567, minibatch 101/101, validation error 11.086957 %
epoch 1568, minibatch 101/101, validation error 11.086957 %
epoch 1569, minibatch 101/101, validation error 11.123188 %
epoch 1570, minibatch 101/101, validation error 11.123188 %
epoch 1571, minibatch 101/101, validation error 11.123188 %
epoch 1572, minibatch 101/101, validation error 11.123188 %
epoch 1573, minibatch 101/101, validation error 11.123188 %
epoch 1574, minibatch 101/101, validation error 11.123188 %
epoch 1575, minibatch 101/101, validation error 11.123188 %
epoch 1576, minibatch 101/101, validation error 11.123188 %
epoch 1577, minibatch 101/101, validation error 11.123188 %
epoch 1578, minibatch 101/101, validation error 11.123188 %
epoch 1579, minibatch 101/101, validation error 11.123188 %
epoch 1580, minibatch 101/101, validation error 11.123188 %
epoch 1581, minibatch 101/101, validation error 11.123188 %
epoch 1582, minibatch 101/101, validation error 11.123188 %
epoch 1583, minibatch 101/101, validation error 11.123188 %
epoch 1584, minibatch 101/101, validation error 11.123188 %
epoch 1585, minibatch 101/101, validation error 11.123188 %
epoch 1586, minibatch 101/101, validation error 11.123188 %
epoch 1587, minibatch 101/101, validation error 11.123188 %
epoch 1588, minibatch 101/101, validation error 11.123188 %
epoch 1589, minibatch 101/101, validation error 11.123188 %
epoch 1590, minibatch 101/101, validation error 11.123188 %
epoch 1591, minibatch 101/101, validation error 11.123188 %
epoch 1592, minibatch 101/101, validation error 11.123188 %
epoch 1593, minibatch 101/101, validation error 11.123188 %
epoch 1594, minibatch 101/101, validation error 11.123188 %
epoch 1595, minibatch 101/101, validation error 11.123188 %
epoch 1596, minibatch 101/101, validation error 11.123188 %
epoch 1597, minibatch 101/101, validation error 11.123188 %
epoch 1598, minibatch 101/101, validation error 11.123188 %
epoch 1599, minibatch 101/101, validation error 11.123188 %
epoch 1600, minibatch 101/101, validation error 11.123188 %
epoch 1601, minibatch 101/101, validation error 11.123188 %
epoch 1602, minibatch 101/101, validation error 11.123188 %
epoch 1603, minibatch 101/101, validation error 11.123188 %
epoch 1604, minibatch 101/101, validation error 11.123188 %
epoch 1605, minibatch 101/101, validation error 11.123188 %
epoch 1606, minibatch 101/101, validation error 11.123188 %
epoch 1607, minibatch 101/101, validation error 11.123188 %
epoch 1608, minibatch 101/101, validation error 11.123188 %
epoch 1609, minibatch 101/101, validation error 11.123188 %
epoch 1610, minibatch 101/101, validation error 11.123188 %
epoch 1611, minibatch 101/101, validation error 11.123188 %
epoch 1612, minibatch 101/101, validation error 11.123188 %
epoch 1613, minibatch 101/101, validation error 11.123188 %
epoch 1614, minibatch 101/101, validation error 11.123188 %
epoch 1615, minibatch 101/101, validation error 11.123188 %
epoch 1616, minibatch 101/101, validation error 11.123188 %
epoch 1617, minibatch 101/101, validation error 11.123188 %
epoch 1618, minibatch 101/101, validation error 11.123188 %
epoch 1619, minibatch 101/101, validation error 11.123188 %
epoch 1620, minibatch 101/101, validation error 11.123188 %
epoch 1621, minibatch 101/101, validation error 11.123188 %
epoch 1622, minibatch 101/101, validation error 11.123188 %
epoch 1623, minibatch 101/101, validation error 11.123188 %
epoch 1624, minibatch 101/101, validation error 11.123188 %
epoch 1625, minibatch 101/101, validation error 11.123188 %
epoch 1626, minibatch 101/101, validation error 11.123188 %
epoch 1627, minibatch 101/101, validation error 11.123188 %
epoch 1628, minibatch 101/101, validation error 11.123188 %
epoch 1629, minibatch 101/101, validation error 11.123188 %
epoch 1630, minibatch 101/101, validation error 11.123188 %
epoch 1631, minibatch 101/101, validation error 11.123188 %
epoch 1632, minibatch 101/101, validation error 11.123188 %
epoch 1633, minibatch 101/101, validation error 11.123188 %
epoch 1634, minibatch 101/101, validation error 11.123188 %
epoch 1635, minibatch 101/101, validation error 11.123188 %
epoch 1636, minibatch 101/101, validation error 11.123188 %
epoch 1637, minibatch 101/101, validation error 11.123188 %
epoch 1638, minibatch 101/101, validation error 11.123188 %
epoch 1639, minibatch 101/101, validation error 11.123188 %
epoch 1640, minibatch 101/101, validation error 11.123188 %
epoch 1641, minibatch 101/101, validation error 11.123188 %
epoch 1642, minibatch 101/101, validation error 11.123188 %
epoch 1643, minibatch 101/101, validation error 11.123188 %
epoch 1644, minibatch 101/101, validation error 11.123188 %
epoch 1645, minibatch 101/101, validation error 11.123188 %
epoch 1646, minibatch 101/101, validation error 11.123188 %
epoch 1647, minibatch 101/101, validation error 11.123188 %
epoch 1648, minibatch 101/101, validation error 11.123188 %
epoch 1649, minibatch 101/101, validation error 11.123188 %
epoch 1650, minibatch 101/101, validation error 11.123188 %
epoch 1651, minibatch 101/101, validation error 11.123188 %
epoch 1652, minibatch 101/101, validation error 11.123188 %
epoch 1653, minibatch 101/101, validation error 11.123188 %
epoch 1654, minibatch 101/101, validation error 11.123188 %
epoch 1655, minibatch 101/101, validation error 11.123188 %
epoch 1656, minibatch 101/101, validation error 11.123188 %
epoch 1657, minibatch 101/101, validation error 11.123188 %
epoch 1658, minibatch 101/101, validation error 11.123188 %
epoch 1659, minibatch 101/101, validation error 11.123188 %
epoch 1660, minibatch 101/101, validation error 11.159420 %
epoch 1661, minibatch 101/101, validation error 11.159420 %
epoch 1662, minibatch 101/101, validation error 11.159420 %
epoch 1663, minibatch 101/101, validation error 11.159420 %
epoch 1664, minibatch 101/101, validation error 11.159420 %
epoch 1665, minibatch 101/101, validation error 11.159420 %
epoch 1666, minibatch 101/101, validation error 11.159420 %
epoch 1667, minibatch 101/101, validation error 11.159420 %
epoch 1668, minibatch 101/101, validation error 11.159420 %
epoch 1669, minibatch 101/101, validation error 11.159420 %
epoch 1670, minibatch 101/101, validation error 11.159420 %
epoch 1671, minibatch 101/101, validation error 11.159420 %
epoch 1672, minibatch 101/101, validation error 11.159420 %
epoch 1673, minibatch 101/101, validation error 11.159420 %
epoch 1674, minibatch 101/101, validation error 11.159420 %
epoch 1675, minibatch 101/101, validation error 11.159420 %
epoch 1676, minibatch 101/101, validation error 11.159420 %
epoch 1677, minibatch 101/101, validation error 11.159420 %
epoch 1678, minibatch 101/101, validation error 11.159420 %
epoch 1679, minibatch 101/101, validation error 11.159420 %
epoch 1680, minibatch 101/101, validation error 11.159420 %
epoch 1681, minibatch 101/101, validation error 11.159420 %
epoch 1682, minibatch 101/101, validation error 11.159420 %
epoch 1683, minibatch 101/101, validation error 11.159420 %
epoch 1684, minibatch 101/101, validation error 11.159420 %
epoch 1685, minibatch 101/101, validation error 11.195652 %
epoch 1686, minibatch 101/101, validation error 11.195652 %
epoch 1687, minibatch 101/101, validation error 11.159420 %
epoch 1688, minibatch 101/101, validation error 11.159420 %
epoch 1689, minibatch 101/101, validation error 11.159420 %
epoch 1690, minibatch 101/101, validation error 11.159420 %
epoch 1691, minibatch 101/101, validation error 11.159420 %
epoch 1692, minibatch 101/101, validation error 11.159420 %
epoch 1693, minibatch 101/101, validation error 11.159420 %
epoch 1694, minibatch 101/101, validation error 11.159420 %
epoch 1695, minibatch 101/101, validation error 11.159420 %
epoch 1696, minibatch 101/101, validation error 11.159420 %
epoch 1697, minibatch 101/101, validation error 11.123188 %
epoch 1698, minibatch 101/101, validation error 11.123188 %
epoch 1699, minibatch 101/101, validation error 11.123188 %
epoch 1700, minibatch 101/101, validation error 11.123188 %
epoch 1701, minibatch 101/101, validation error 11.123188 %
epoch 1702, minibatch 101/101, validation error 11.123188 %
epoch 1703, minibatch 101/101, validation error 11.123188 %
epoch 1704, minibatch 101/101, validation error 11.123188 %
epoch 1705, minibatch 101/101, validation error 11.123188 %
epoch 1706, minibatch 101/101, validation error 11.123188 %
epoch 1707, minibatch 101/101, validation error 11.123188 %
epoch 1708, minibatch 101/101, validation error 11.123188 %
epoch 1709, minibatch 101/101, validation error 11.123188 %
epoch 1710, minibatch 101/101, validation error 11.123188 %
epoch 1711, minibatch 101/101, validation error 11.123188 %
epoch 1712, minibatch 101/101, validation error 11.123188 %
epoch 1713, minibatch 101/101, validation error 11.123188 %
epoch 1714, minibatch 101/101, validation error 11.123188 %
epoch 1715, minibatch 101/101, validation error 11.123188 %
epoch 1716, minibatch 101/101, validation error 11.123188 %
epoch 1717, minibatch 101/101, validation error 11.123188 %
epoch 1718, minibatch 101/101, validation error 11.123188 %
epoch 1719, minibatch 101/101, validation error 11.123188 %
epoch 1720, minibatch 101/101, validation error 11.123188 %
epoch 1721, minibatch 101/101, validation error 11.123188 %
epoch 1722, minibatch 101/101, validation error 11.123188 %
epoch 1723, minibatch 101/101, validation error 11.123188 %
epoch 1724, minibatch 101/101, validation error 11.123188 %
epoch 1725, minibatch 101/101, validation error 11.123188 %
epoch 1726, minibatch 101/101, validation error 11.123188 %
epoch 1727, minibatch 101/101, validation error 11.123188 %
epoch 1728, minibatch 101/101, validation error 11.123188 %
epoch 1729, minibatch 101/101, validation error 11.123188 %
epoch 1730, minibatch 101/101, validation error 11.123188 %
epoch 1731, minibatch 101/101, validation error 11.123188 %
epoch 1732, minibatch 101/101, validation error 11.123188 %
epoch 1733, minibatch 101/101, validation error 11.123188 %
epoch 1734, minibatch 101/101, validation error 11.123188 %
epoch 1735, minibatch 101/101, validation error 11.123188 %
epoch 1736, minibatch 101/101, validation error 11.123188 %
epoch 1737, minibatch 101/101, validation error 11.123188 %
epoch 1738, minibatch 101/101, validation error 11.123188 %
epoch 1739, minibatch 101/101, validation error 11.123188 %
epoch 1740, minibatch 101/101, validation error 11.123188 %
epoch 1741, minibatch 101/101, validation error 11.123188 %
epoch 1742, minibatch 101/101, validation error 11.123188 %
epoch 1743, minibatch 101/101, validation error 11.123188 %
epoch 1744, minibatch 101/101, validation error 11.123188 %
epoch 1745, minibatch 101/101, validation error 11.123188 %
epoch 1746, minibatch 101/101, validation error 11.123188 %
epoch 1747, minibatch 101/101, validation error 11.123188 %
epoch 1748, minibatch 101/101, validation error 11.123188 %
epoch 1749, minibatch 101/101, validation error 11.123188 %
epoch 1750, minibatch 101/101, validation error 11.123188 %
epoch 1751, minibatch 101/101, validation error 11.123188 %
epoch 1752, minibatch 101/101, validation error 11.123188 %
epoch 1753, minibatch 101/101, validation error 11.123188 %
epoch 1754, minibatch 101/101, validation error 11.123188 %
epoch 1755, minibatch 101/101, validation error 11.123188 %
epoch 1756, minibatch 101/101, validation error 11.123188 %
epoch 1757, minibatch 101/101, validation error 11.123188 %
epoch 1758, minibatch 101/101, validation error 11.123188 %
epoch 1759, minibatch 101/101, validation error 11.123188 %
epoch 1760, minibatch 101/101, validation error 11.123188 %
epoch 1761, minibatch 101/101, validation error 11.123188 %
epoch 1762, minibatch 101/101, validation error 11.123188 %
epoch 1763, minibatch 101/101, validation error 11.123188 %
epoch 1764, minibatch 101/101, validation error 11.123188 %
epoch 1765, minibatch 101/101, validation error 11.123188 %
epoch 1766, minibatch 101/101, validation error 11.123188 %
epoch 1767, minibatch 101/101, validation error 11.123188 %
epoch 1768, minibatch 101/101, validation error 11.123188 %
epoch 1769, minibatch 101/101, validation error 11.123188 %
epoch 1770, minibatch 101/101, validation error 11.123188 %
epoch 1771, minibatch 101/101, validation error 11.123188 %
epoch 1772, minibatch 101/101, validation error 11.123188 %
epoch 1773, minibatch 101/101, validation error 11.123188 %
epoch 1774, minibatch 101/101, validation error 11.123188 %
epoch 1775, minibatch 101/101, validation error 11.123188 %
epoch 1776, minibatch 101/101, validation error 11.123188 %
epoch 1777, minibatch 101/101, validation error 11.123188 %
epoch 1778, minibatch 101/101, validation error 11.123188 %
epoch 1779, minibatch 101/101, validation error 11.123188 %
epoch 1780, minibatch 101/101, validation error 11.123188 %
epoch 1781, minibatch 101/101, validation error 11.123188 %
epoch 1782, minibatch 101/101, validation error 11.123188 %
epoch 1783, minibatch 101/101, validation error 11.123188 %
epoch 1784, minibatch 101/101, validation error 11.123188 %
epoch 1785, minibatch 101/101, validation error 11.123188 %
epoch 1786, minibatch 101/101, validation error 11.123188 %
epoch 1787, minibatch 101/101, validation error 11.123188 %
epoch 1788, minibatch 101/101, validation error 11.123188 %
epoch 1789, minibatch 101/101, validation error 11.123188 %
epoch 1790, minibatch 101/101, validation error 11.123188 %
epoch 1791, minibatch 101/101, validation error 11.123188 %
epoch 1792, minibatch 101/101, validation error 11.123188 %
epoch 1793, minibatch 101/101, validation error 11.123188 %
epoch 1794, minibatch 101/101, validation error 11.123188 %
epoch 1795, minibatch 101/101, validation error 11.123188 %
epoch 1796, minibatch 101/101, validation error 11.123188 %
epoch 1797, minibatch 101/101, validation error 11.123188 %
epoch 1798, minibatch 101/101, validation error 11.123188 %
epoch 1799, minibatch 101/101, validation error 11.123188 %
epoch 1800, minibatch 101/101, validation error 11.123188 %
epoch 1801, minibatch 101/101, validation error 11.123188 %
epoch 1802, minibatch 101/101, validation error 11.123188 %
epoch 1803, minibatch 101/101, validation error 11.086957 %
epoch 1804, minibatch 101/101, validation error 11.086957 %
epoch 1805, minibatch 101/101, validation error 11.086957 %
epoch 1806, minibatch 101/101, validation error 11.086957 %
epoch 1807, minibatch 101/101, validation error 11.086957 %
epoch 1808, minibatch 101/101, validation error 11.086957 %
epoch 1809, minibatch 101/101, validation error 11.086957 %
epoch 1810, minibatch 101/101, validation error 11.086957 %
epoch 1811, minibatch 101/101, validation error 11.086957 %
epoch 1812, minibatch 101/101, validation error 11.086957 %
epoch 1813, minibatch 101/101, validation error 11.086957 %
epoch 1814, minibatch 101/101, validation error 11.086957 %
epoch 1815, minibatch 101/101, validation error 11.086957 %
epoch 1816, minibatch 101/101, validation error 11.086957 %
epoch 1817, minibatch 101/101, validation error 11.086957 %
epoch 1818, minibatch 101/101, validation error 11.086957 %
epoch 1819, minibatch 101/101, validation error 11.086957 %
epoch 1820, minibatch 101/101, validation error 11.086957 %
epoch 1821, minibatch 101/101, validation error 11.086957 %
epoch 1822, minibatch 101/101, validation error 11.086957 %
epoch 1823, minibatch 101/101, validation error 11.086957 %
epoch 1824, minibatch 101/101, validation error 11.086957 %
epoch 1825, minibatch 101/101, validation error 11.086957 %
epoch 1826, minibatch 101/101, validation error 11.086957 %
epoch 1827, minibatch 101/101, validation error 11.086957 %
epoch 1828, minibatch 101/101, validation error 11.086957 %
epoch 1829, minibatch 101/101, validation error 11.086957 %
epoch 1830, minibatch 101/101, validation error 11.086957 %
epoch 1831, minibatch 101/101, validation error 11.086957 %
epoch 1832, minibatch 101/101, validation error 11.086957 %
epoch 1833, minibatch 101/101, validation error 11.086957 %
epoch 1834, minibatch 101/101, validation error 11.086957 %
epoch 1835, minibatch 101/101, validation error 11.086957 %
epoch 1836, minibatch 101/101, validation error 11.086957 %
epoch 1837, minibatch 101/101, validation error 11.086957 %
epoch 1838, minibatch 101/101, validation error 11.086957 %
epoch 1839, minibatch 101/101, validation error 11.086957 %
epoch 1840, minibatch 101/101, validation error 11.086957 %
epoch 1841, minibatch 101/101, validation error 11.086957 %
epoch 1842, minibatch 101/101, validation error 11.086957 %
epoch 1843, minibatch 101/101, validation error 11.086957 %
epoch 1844, minibatch 101/101, validation error 11.086957 %
epoch 1845, minibatch 101/101, validation error 11.086957 %
epoch 1846, minibatch 101/101, validation error 11.086957 %
epoch 1847, minibatch 101/101, validation error 11.086957 %
epoch 1848, minibatch 101/101, validation error 11.086957 %
epoch 1849, minibatch 101/101, validation error 11.086957 %
epoch 1850, minibatch 101/101, validation error 11.086957 %
epoch 1851, minibatch 101/101, validation error 11.086957 %
epoch 1852, minibatch 101/101, validation error 11.086957 %
epoch 1853, minibatch 101/101, validation error 11.086957 %
epoch 1854, minibatch 101/101, validation error 11.086957 %
epoch 1855, minibatch 101/101, validation error 11.086957 %
epoch 1856, minibatch 101/101, validation error 11.086957 %
epoch 1857, minibatch 101/101, validation error 11.086957 %
epoch 1858, minibatch 101/101, validation error 11.086957 %
epoch 1859, minibatch 101/101, validation error 11.086957 %
epoch 1860, minibatch 101/101, validation error 11.086957 %
epoch 1861, minibatch 101/101, validation error 11.086957 %
epoch 1862, minibatch 101/101, validation error 11.086957 %
epoch 1863, minibatch 101/101, validation error 11.086957 %
epoch 1864, minibatch 101/101, validation error 11.086957 %
epoch 1865, minibatch 101/101, validation error 11.086957 %
epoch 1866, minibatch 101/101, validation error 11.086957 %
epoch 1867, minibatch 101/101, validation error 11.086957 %
epoch 1868, minibatch 101/101, validation error 11.086957 %
epoch 1869, minibatch 101/101, validation error 11.086957 %
epoch 1870, minibatch 101/101, validation error 11.086957 %
epoch 1871, minibatch 101/101, validation error 11.086957 %
epoch 1872, minibatch 101/101, validation error 11.086957 %
epoch 1873, minibatch 101/101, validation error 11.086957 %
epoch 1874, minibatch 101/101, validation error 11.086957 %
epoch 1875, minibatch 101/101, validation error 11.086957 %
epoch 1876, minibatch 101/101, validation error 11.086957 %
epoch 1877, minibatch 101/101, validation error 11.086957 %
epoch 1878, minibatch 101/101, validation error 11.086957 %
epoch 1879, minibatch 101/101, validation error 11.086957 %
epoch 1880, minibatch 101/101, validation error 11.086957 %
epoch 1881, minibatch 101/101, validation error 11.086957 %
epoch 1882, minibatch 101/101, validation error 11.086957 %
epoch 1883, minibatch 101/101, validation error 11.086957 %
epoch 1884, minibatch 101/101, validation error 11.086957 %
epoch 1885, minibatch 101/101, validation error 11.086957 %
epoch 1886, minibatch 101/101, validation error 11.086957 %
epoch 1887, minibatch 101/101, validation error 11.086957 %
epoch 1888, minibatch 101/101, validation error 11.086957 %
epoch 1889, minibatch 101/101, validation error 11.086957 %
epoch 1890, minibatch 101/101, validation error 11.086957 %
epoch 1891, minibatch 101/101, validation error 11.086957 %
epoch 1892, minibatch 101/101, validation error 11.086957 %
epoch 1893, minibatch 101/101, validation error 11.086957 %
epoch 1894, minibatch 101/101, validation error 11.086957 %
epoch 1895, minibatch 101/101, validation error 11.086957 %
epoch 1896, minibatch 101/101, validation error 11.086957 %
epoch 1897, minibatch 101/101, validation error 11.123188 %
epoch 1898, minibatch 101/101, validation error 11.123188 %
epoch 1899, minibatch 101/101, validation error 11.123188 %
epoch 1900, minibatch 101/101, validation error 11.123188 %
epoch 1901, minibatch 101/101, validation error 11.123188 %
epoch 1902, minibatch 101/101, validation error 11.123188 %
epoch 1903, minibatch 101/101, validation error 11.123188 %
epoch 1904, minibatch 101/101, validation error 11.123188 %
epoch 1905, minibatch 101/101, validation error 11.123188 %
epoch 1906, minibatch 101/101, validation error 11.123188 %
epoch 1907, minibatch 101/101, validation error 11.123188 %
epoch 1908, minibatch 101/101, validation error 11.123188 %
epoch 1909, minibatch 101/101, validation error 11.123188 %
epoch 1910, minibatch 101/101, validation error 11.123188 %
epoch 1911, minibatch 101/101, validation error 11.123188 %
epoch 1912, minibatch 101/101, validation error 11.123188 %
epoch 1913, minibatch 101/101, validation error 11.123188 %
epoch 1914, minibatch 101/101, validation error 11.123188 %
epoch 1915, minibatch 101/101, validation error 11.123188 %
epoch 1916, minibatch 101/101, validation error 11.123188 %
epoch 1917, minibatch 101/101, validation error 11.123188 %
epoch 1918, minibatch 101/101, validation error 11.123188 %
epoch 1919, minibatch 101/101, validation error 11.123188 %
epoch 1920, minibatch 101/101, validation error 11.123188 %
epoch 1921, minibatch 101/101, validation error 11.123188 %
epoch 1922, minibatch 101/101, validation error 11.123188 %
epoch 1923, minibatch 101/101, validation error 11.123188 %
epoch 1924, minibatch 101/101, validation error 11.123188 %
epoch 1925, minibatch 101/101, validation error 11.123188 %
epoch 1926, minibatch 101/101, validation error 11.123188 %
epoch 1927, minibatch 101/101, validation error 11.123188 %
epoch 1928, minibatch 101/101, validation error 11.123188 %
epoch 1929, minibatch 101/101, validation error 11.123188 %
epoch 1930, minibatch 101/101, validation error 11.123188 %
epoch 1931, minibatch 101/101, validation error 11.123188 %
epoch 1932, minibatch 101/101, validation error 11.123188 %
epoch 1933, minibatch 101/101, validation error 11.123188 %
epoch 1934, minibatch 101/101, validation error 11.123188 %
epoch 1935, minibatch 101/101, validation error 11.123188 %
epoch 1936, minibatch 101/101, validation error 11.123188 %
epoch 1937, minibatch 101/101, validation error 11.123188 %
epoch 1938, minibatch 101/101, validation error 11.123188 %
epoch 1939, minibatch 101/101, validation error 11.123188 %
epoch 1940, minibatch 101/101, validation error 11.123188 %
epoch 1941, minibatch 101/101, validation error 11.123188 %
epoch 1942, minibatch 101/101, validation error 11.123188 %
epoch 1943, minibatch 101/101, validation error 11.123188 %
epoch 1944, minibatch 101/101, validation error 11.123188 %
epoch 1945, minibatch 101/101, validation error 11.123188 %
epoch 1946, minibatch 101/101, validation error 11.123188 %
epoch 1947, minibatch 101/101, validation error 11.123188 %
epoch 1948, minibatch 101/101, validation error 11.123188 %
epoch 1949, minibatch 101/101, validation error 11.123188 %
epoch 1950, minibatch 101/101, validation error 11.123188 %
epoch 1951, minibatch 101/101, validation error 11.123188 %
epoch 1952, minibatch 101/101, validation error 11.123188 %
epoch 1953, minibatch 101/101, validation error 11.123188 %
epoch 1954, minibatch 101/101, validation error 11.123188 %
epoch 1955, minibatch 101/101, validation error 11.123188 %
epoch 1956, minibatch 101/101, validation error 11.123188 %
epoch 1957, minibatch 101/101, validation error 11.123188 %
epoch 1958, minibatch 101/101, validation error 11.123188 %
epoch 1959, minibatch 101/101, validation error 11.123188 %
epoch 1960, minibatch 101/101, validation error 11.123188 %
epoch 1961, minibatch 101/101, validation error 11.123188 %
epoch 1962, minibatch 101/101, validation error 11.123188 %
epoch 1963, minibatch 101/101, validation error 11.159420 %
epoch 1964, minibatch 101/101, validation error 11.159420 %
epoch 1965, minibatch 101/101, validation error 11.159420 %
epoch 1966, minibatch 101/101, validation error 11.159420 %
epoch 1967, minibatch 101/101, validation error 11.159420 %
epoch 1968, minibatch 101/101, validation error 11.159420 %
epoch 1969, minibatch 101/101, validation error 11.159420 %
epoch 1970, minibatch 101/101, validation error 11.159420 %
epoch 1971, minibatch 101/101, validation error 11.159420 %
Optimization complete with best validation score of 11.086957 %, obtained at iteration 157661, with test performance 10.376344 %






    



The fine tuning ran for 16.13m

Loading the trained MLP



In [9]:

    
model = deepbeliefnet(architecture = [2756, 500, 500, 128], n_outs = 20, predefined_weights = 'params/to_delete/trained_dbn.pkl')









    



... building the model
Building layer: 0
   Input units: 2756
  Output units: 500
Building layer: 1
   Input units: 500
  Output units: 500
Building layer: 2
   Input units: 500
  Output units: 128
Fine-tuned (or MLP) model from "params/to_delete/trained_dbn.pkl" loaded.

Calculating the accuracy of the trained model on the full dataset



In [10]:

    
sum([1 for i, j in zip(model.predict(x), dat_y) if i == j])/len(dat_y)









    Out[10]:





0.8958997238155938

Demonstrating how the predict function can be used to calculated the classes



In [11]:

    
model.predict(x,prob=True)









    Out[11]:





array([[  9.86977935e-01,   6.72943715e-05,   4.30024073e-07, ...,
          1.64206012e-05,   2.02706110e-06,   9.68406815e-03],
       [  9.99687612e-01,   4.61518454e-07,   3.67210578e-06, ...,
          6.94850769e-07,   3.49400580e-08,   1.19424067e-05],
       [  9.35047448e-01,   6.55943179e-04,   2.22503932e-05, ...,
          4.64923278e-06,   1.19572242e-05,   2.95562036e-02],
       ..., 
       [  2.70321907e-04,   1.37912684e-06,   2.81152825e-08, ...,
          6.23549204e-06,   1.82347103e-05,   9.57813561e-01],
       [  9.08685979e-05,   5.38064614e-06,   2.95243666e-07, ...,
          1.37577663e-05,   1.62180935e-04,   9.60871935e-01],
       [  1.34823859e-01,   3.80856800e-05,   1.15504470e-02, ...,
          1.30842021e-02,   8.59890715e-04,   7.60234058e-01]], dtype=float32)