语言翻译

在此项目中，你将了解神经网络机器翻译这一领域。你将用由英语和法语语句组成的数据集，训练一个序列到序列模型（sequence to sequence model），该模型能够将新的英语句子翻译成法语。

获取数据

因为将整个英语语言内容翻译成法语需要大量训练时间，所以我们提供了一小部分的英语语料库。



In [4]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import helper
import problem_unittests as tests

source_path = 'data/small_vocab_en'
target_path = 'data/small_vocab_fr'
source_text = helper.load_data(source_path)
target_text = helper.load_data(target_path)

探索数据

研究 view_sentence_range，查看并熟悉该数据的不同部分。



In [2]:

    
view_sentence_range = (0, 10)

"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import numpy as np

print('Dataset Stats')
print('Roughly the number of unique words in source: {}'.format(len({word: None for word in source_text.split()})))
print('Roughly the number of unique words in target: {}'.format(len({word: None for word in target_text.split()})))

sentences = source_text.split('\n')
word_counts = [len(sentence.split()) for sentence in sentences]
print('Number of sentences: {}'.format(len(sentences)))
print('Average number of words in a sentence: {}'.format(np.average(word_counts)))

print()
print('English sentences {} to {}:'.format(*view_sentence_range))
print('\n'.join(source_text.split('\n')[view_sentence_range[0]:view_sentence_range[1]]))
print()
print('French sentences {} to {}:'.format(*view_sentence_range))
print('\n'.join(target_text.split('\n')[view_sentence_range[0]:view_sentence_range[1]]))









    



Dataset Stats
Roughly the number of unique words in source: 227
Roughly the number of unique words in target: 355
Number of sentences: 137861
Average number of words in a sentence: 13.225277634719028

English sentences 0 to 10:
new jersey is sometimes quiet during autumn , and it is snowy in april .
the united states is usually chilly during july , and it is usually freezing in november .
california is usually quiet during march , and it is usually hot in june .
the united states is sometimes mild during june , and it is cold in september .
your least liked fruit is the grape , but my least liked is the apple .
his favorite fruit is the orange , but my favorite is the grape .
paris is relaxing during december , but it is usually chilly in july .
new jersey is busy during spring , and it is never hot in march .
our least liked fruit is the lemon , but my least liked is the grape .
the united states is sometimes busy during january , and it is sometimes warm in november .

French sentences 0 to 10:
new jersey est parfois calme pendant l' automne , et il est neigeux en avril .
les états-unis est généralement froid en juillet , et il gèle habituellement en novembre .
california est généralement calme en mars , et il est généralement chaud en juin .
les états-unis est parfois légère en juin , et il fait froid en septembre .
votre moins aimé fruit est le raisin , mais mon moins aimé est la pomme .
son fruit préféré est l'orange , mais mon préféré est le raisin .
paris est relaxant en décembre , mais il est généralement froid en juillet .
new jersey est occupé au printemps , et il est jamais chaude en mars .
notre fruit est moins aimé le citron , mais mon moins aimé est le raisin .
les états-unis est parfois occupé en janvier , et il est parfois chaud en novembre .

实现预处理函数

文本到单词 id

和之前的 RNN 一样，你必须首先将文本转换为数字，这样计算机才能读懂。在函数 text_to_ids() 中，你需要将单词中的 source_text 和 target_text 转为 id。但是，你需要在 target_text 中每个句子的末尾，添加 <EOS> 单词 id。这样可以帮助神经网络预测句子应该在什么地方结束。

你可以通过以下代码获取 <EOS> 单词ID：

target_vocab_to_int['<EOS>']

你可以使用 source_vocab_to_int 和 target_vocab_to_int 获得其他单词 id。



In [3]:

    
def text_to_ids(source_text, target_text, source_vocab_to_int, target_vocab_to_int):
    """
    Convert source and target text to proper word ids
    :param source_text: String that contains all the source text.
    :param target_text: String that contains all the target text.
    :param source_vocab_to_int: Dictionary to go from the source words to an id
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :return: A tuple of lists (source_id_text, target_id_text)
    """
    # TODO: Implement Function
    source_sentences = source_text.split('\n')
    source_id_text = []
    for sentence in source_sentences:
        source_id_text.append([source_vocab_to_int[word] for word in sentence.split()])
    target_sentences = target_text.split('\n')
    target_id_text = []
    for sentence in target_sentences:
        target_id_text.append([target_vocab_to_int[word] for word in sentence.split()]+[target_vocab_to_int['<EOS>']])
    return source_id_text, target_id_text

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_text_to_ids(text_to_ids)









    



Tests Passed

预处理所有数据并保存

运行以下代码单元，预处理所有数据，并保存到文件中。



In [4]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
helper.preprocess_and_save_data(source_path, target_path, text_to_ids)

检查点

这是你的第一个检查点。如果你什么时候决定再回到该记事本，或需要重新启动该记事本，可以从这里继续。预处理的数据已保存到磁盘上。



In [1]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import numpy as np
import helper

(source_int_text, target_int_text), (source_vocab_to_int, target_vocab_to_int), _ = helper.load_preprocess()

检查 TensorFlow 版本，确认可访问 GPU

这一检查步骤，可以确保你使用的是正确版本的 TensorFlow，并且能够访问 GPU。



In [2]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
from distutils.version import LooseVersion
import warnings
import tensorflow as tf

# Check TensorFlow Version
assert LooseVersion(tf.__version__) in [LooseVersion('1.0.0'), LooseVersion('1.0.1')], 'This project requires TensorFlow version 1.0  You are using {}'.format(tf.__version__)
print('TensorFlow Version: {}'.format(tf.__version__))

# Check for a GPU
if not tf.test.gpu_device_name():
    warnings.warn('No GPU found. Please use a GPU to train your neural network.')
else:
    print('Default GPU Device: {}'.format(tf.test.gpu_device_name()))









    



TensorFlow Version: 1.0.0
Default GPU Device: /gpu:0

构建神经网络

你将通过实现以下函数，构建出要构建一个序列到序列模型所需的组件：

model_inputs
process_decoding_input
encoding_layer
decoding_layer_train
decoding_layer_infer
decoding_layer
seq2seq_model

输入

实现 model_inputs() 函数，为神经网络创建 TF 占位符。该函数应该创建以下占位符：

名为 “input” 的输入文本占位符，并使用 TF Placeholder 名称参数（等级（Rank）为 2）。
目标占位符（等级为 2）。
学习速率占位符（等级为 0）。
名为 “keep_prob” 的保留率占位符，并使用 TF Placeholder 名称参数（等级为 0）。

在以下元祖（tuple）中返回占位符：（输入、目标、学习速率、保留率）



In [5]:

    
def model_inputs():
    """
    Create TF Placeholders for input, targets, and learning rate.
    :return: Tuple (input, targets, learning rate, keep probability)
    """
    # TODO: Implement Function
    input_ = tf.placeholder(tf.int32, [None, None], name='input')
    targets = tf.placeholder(tf.int32, [None, None], name='targets')
    learning_rate = tf.placeholder(tf.float32, name='learning_rate')
    keep_prob = tf.placeholder(tf.float32, None, name='keep_prob')
    return input_, targets, learning_rate, keep_prob

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_model_inputs(model_inputs)









    



Tests Passed

处理解码输入

使用 TensorFlow 实现 process_decoding_input，以便删掉 target_data 中每个批次的最后一个单词 ID，并将 GO ID 放到每个批次的开头。



In [6]:

    
def process_decoding_input(target_data, target_vocab_to_int, batch_size):
    """
    Preprocess target data for dencoding
    :param target_data: Target Placehoder
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :param batch_size: Batch Size
    :return: Preprocessed target data
    """
    # TODO: Implement Function
    del_last_datas = tf.strided_slice(target_data, [0, 0], [batch_size, -1], [1,1])
    go_ids = tf.fill([batch_size, 1], target_vocab_to_int['<GO>'])
    return tf.concat([go_ids, del_last_datas], axis=1)

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_process_decoding_input(process_decoding_input)









    



Tests Passed

编码

实现 encoding_layer()，以使用 tf.nn.dynamic_rnn() 创建编码器 RNN 层级。



In [7]:

    
def encoding_layer(rnn_inputs, rnn_size, num_layers, keep_prob):
    """
    Create encoding layer
    :param rnn_inputs: Inputs for the RNN
    :param rnn_size: RNN Size
    :param num_layers: Number of layers
    :param keep_prob: Dropout keep probability
    :return: RNN state
    """
    # TODO: Implement Function
    def lstm_cell():
        lstm = tf.contrib.rnn.BasicLSTMCell(rnn_size)
        return tf.contrib.rnn.DropoutWrapper(lstm, output_keep_prob=keep_prob)
    cell = tf.contrib.rnn.MultiRNNCell([lstm_cell() for _ in range(num_layers)])
    outputs, final_state = tf.nn.dynamic_rnn(cell, rnn_inputs, dtype=tf.float32)
    return final_state

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_encoding_layer(encoding_layer)









    



Tests Passed

解码 - 训练

使用 tf.contrib.seq2seq.simple_decoder_fn_train() 和 tf.contrib.seq2seq.dynamic_rnn_decoder() 创建训练分对数（training logits）。将 output_fn 应用到 tf.contrib.seq2seq.dynamic_rnn_decoder() 输出上。



In [8]:

    
def decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope,
                         output_fn, keep_prob):
    """
    Create a decoding layer for training
    :param encoder_state: Encoder State
    :param dec_cell: Decoder RNN Cell
    :param dec_embed_input: Decoder embedded input
    :param sequence_length: Sequence Length
    :param decoding_scope: TenorFlow Variable Scope for decoding
    :param output_fn: Function to apply the output layer
    :param keep_prob: Dropout keep probability
    :return: Train Logits
    """
    # TODO: Implement Function
    # Training Decoder
    train_decoder_fn = tf.contrib.seq2seq.simple_decoder_fn_train(encoder_state)
    train_pred, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(
        dec_cell, train_decoder_fn, dec_embed_input, sequence_length, scope=decoding_scope)
    
    # Apply output function
    train_logits =  output_fn(tf.nn.dropout(train_pred, keep_prob))
    return train_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_decoding_layer_train(decoding_layer_train)









    



Tests Passed

解码 - 推论

使用 tf.contrib.seq2seq.simple_decoder_fn_inference() 和 tf.contrib.seq2seq.dynamic_rnn_decoder() 创建推论分对数（inference logits）。



In [9]:

    
def decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, start_of_sequence_id, end_of_sequence_id,
                         maximum_length, vocab_size, decoding_scope, output_fn, keep_prob):
    """
    Create a decoding layer for inference
    :param encoder_state: Encoder state
    :param dec_cell: Decoder RNN Cell
    :param dec_embeddings: Decoder embeddings
    :param start_of_sequence_id: GO ID
    :param end_of_sequence_id: EOS Id
    :param maximum_length: The maximum allowed time steps to decode
    :param vocab_size: Size of vocabulary
    :param decoding_scope: TensorFlow Variable Scope for decoding
    :param output_fn: Function to apply the output layer
    :param keep_prob: Dropout keep probability
    :return: Inference Logits
    """
    # TODO: Implement Function
    infer_decoder_fn = tf.contrib.seq2seq.simple_decoder_fn_inference(
        output_fn, encoder_state, dec_embeddings, start_of_sequence_id, end_of_sequence_id, 
        maximum_length - 1, vocab_size)
    inference_logits, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(dec_cell, infer_decoder_fn, scope=decoding_scope)
    return inference_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_decoding_layer_infer(decoding_layer_infer)









    



Tests Passed

构建解码层级

实现 decoding_layer() 以创建解码器 RNN 层级。

使用 rnn_size 和 num_layers 创建解码 RNN 单元。
使用 lambda 创建输出函数，将输入，也就是分对数转换为类分对数（class logits）。
使用 decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope, output_fn, keep_prob) 函数获取训练分对数。
使用 decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, start_of_sequence_id, end_of_sequence_id, maximum_length, vocab_size, decoding_scope, output_fn, keep_prob) 函数获取推论分对数。

注意：你将需要使用 tf.variable_scope 在训练和推论分对数间分享变量。



In [10]:

    
def decoding_layer(dec_embed_input, dec_embeddings, encoder_state, vocab_size, sequence_length, rnn_size,
                   num_layers, target_vocab_to_int, keep_prob):
    """
    Create decoding layer
    :param dec_embed_input: Decoder embedded input
    :param dec_embeddings: Decoder embeddings
    :param encoder_state: The encoded state
    :param vocab_size: Size of vocabulary
    :param sequence_length: Sequence Length
    :param rnn_size: RNN Size
    :param num_layers: Number of layers
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :param keep_prob: Dropout keep probability
    :return: Tuple of (Training Logits, Inference Logits)
    """
    # TODO: Implement Function
    # Decoder RNNs
    def lstm_cell():
        lstm = tf.contrib.rnn.BasicLSTMCell(rnn_size)
        return tf.contrib.rnn.DropoutWrapper(lstm, output_keep_prob=keep_prob)
    dec_cell = tf.contrib.rnn.MultiRNNCell([lstm_cell() for _ in range(num_layers)])

    with tf.variable_scope("decoding") as decoding_scope:
        output_fn = lambda x: tf.contrib.layers.fully_connected(
            x, vocab_size, activation_fn=None, scope=decoding_scope)
        training_decoder_output = decoding_layer_train(
            encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope,
            output_fn, keep_prob)

    with tf.variable_scope("decoding", reuse=True) as decoding_scope:
        start_of_sequence_id = target_vocab_to_int["<GO>"]
        end_of_sequence_id = target_vocab_to_int["<EOS>"]
        inference_decoder_output = decoding_layer_infer(
            encoder_state, dec_cell, dec_embeddings,start_of_sequence_id, end_of_sequence_id,
            sequence_length, vocab_size, decoding_scope, output_fn, keep_prob)
    
    return training_decoder_output, inference_decoder_output


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_decoding_layer(decoding_layer)









    



Tests Passed

构建神经网络

应用你在上方实现的函数，以：

向编码器的输入数据应用嵌入。
使用 encoding_layer(rnn_inputs, rnn_size, num_layers, keep_prob) 编码输入。
使用 process_decoding_input(target_data, target_vocab_to_int, batch_size) 函数处理目标数据。
向解码器的目标数据应用嵌入。
使用 decoding_layer(dec_embed_input, dec_embeddings, encoder_state, vocab_size, sequence_length, rnn_size, num_layers, target_vocab_to_int, keep_prob) 解码编码的输入数据。



In [11]:

    
def seq2seq_model(input_data, target_data, keep_prob, batch_size, sequence_length, source_vocab_size, target_vocab_size,
                  enc_embedding_size, dec_embedding_size, rnn_size, num_layers, target_vocab_to_int):
    """
    Build the Sequence-to-Sequence part of the neural network
    :param input_data: Input placeholder
    :param target_data: Target placeholder
    :param keep_prob: Dropout keep probability placeholder
    :param batch_size: Batch Size
    :param sequence_length: Sequence Length
    :param source_vocab_size: Source vocabulary size
    :param target_vocab_size: Target vocabulary size
    :param enc_embedding_size: Decoder embedding size
    :param dec_embedding_size: Encoder embedding size
    :param rnn_size: RNN Size
    :param num_layers: Number of layers
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :return: Tuple of (Training Logits, Inference Logits)
    """
    # TODO: Implement Function
    # Encoder embedding
    enc_embed_input = tf.contrib.layers.embed_sequence(input_data, source_vocab_size, enc_embedding_size)
    # Encoder
    enc_state = encoding_layer(enc_embed_input, rnn_size, num_layers, keep_prob)
    
    # Process Decoding Input
    dec_input = process_decoding_input(target_data, target_vocab_to_int, batch_size)
    # Decoder Embedding
    dec_embeddings = tf.Variable(tf.random_uniform([target_vocab_size, dec_embedding_size]))
    dec_embed_input = tf.nn.embedding_lookup(dec_embeddings, dec_input)
    
    train_logits, refer_logits = decoding_layer(
        dec_embed_input, dec_embeddings, enc_state, target_vocab_size, 
        sequence_length, rnn_size, num_layers, target_vocab_to_int, keep_prob)
    
    return train_logits, refer_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_seq2seq_model(seq2seq_model)









    



Tests Passed

训练神经网络

超参数

调试以下参数：

将 epochs 设为 epoch 次数。
将 batch_size 设为批次大小。
将 rnn_size 设为 RNN 的大小。
将 num_layers 设为层级数量。
将 encoding_embedding_size 设为编码器嵌入大小。
将 decoding_embedding_size 设为解码器嵌入大小
将 learning_rate 设为训练速率。
将 keep_probability 设为丢弃保留率（Dropout keep probability）。



In [21]:

    
# Number of Epochs
epochs = 5
# Batch Size
batch_size = 256
# RNN Size
rnn_size = 256
# Number of Layers
num_layers = 2
# Embedding Size
encoding_embedding_size = 200
decoding_embedding_size = 300
# Learning Rate
learning_rate = 0.002
# Dropout Keep Probability
keep_probability = 0.8

构建图表

使用你实现的神经网络构建图表。



In [22]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
save_path = 'checkpoints/dev'
(source_int_text, target_int_text), (source_vocab_to_int, target_vocab_to_int), _ = helper.load_preprocess()
max_source_sentence_length = max([len(sentence) for sentence in source_int_text])

train_graph = tf.Graph()
with train_graph.as_default():
    input_data, targets, lr, keep_prob = model_inputs()
    sequence_length = tf.placeholder_with_default(max_source_sentence_length, None, name='sequence_length')
    input_shape = tf.shape(input_data)
    
    train_logits, inference_logits = seq2seq_model(
        tf.reverse(input_data, [-1]), targets, keep_prob, batch_size, sequence_length, len(source_vocab_to_int), len(target_vocab_to_int),
        encoding_embedding_size, decoding_embedding_size, rnn_size, num_layers, target_vocab_to_int)

    tf.identity(inference_logits, 'logits')
    with tf.name_scope("optimization"):
        # Loss function
        cost = tf.contrib.seq2seq.sequence_loss(
            train_logits,
            targets,
            tf.ones([input_shape[0], sequence_length]))

        # Optimizer
        optimizer = tf.train.AdamOptimizer(lr)

        # Gradient Clipping
        gradients = optimizer.compute_gradients(cost)
        capped_gradients = [(tf.clip_by_value(grad, -1., 1.), var) for grad, var in gradients if grad is not None]
        train_op = optimizer.apply_gradients(capped_gradients)

训练

利用预处理的数据训练神经网络。如果很难获得低损失值，请访问我们的论坛，看看其他人是否遇到了相同的问题。



In [23]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import time

def get_accuracy(target, logits):
    """
    Calculate accuracy
    """
    max_seq = max(target.shape[1], logits.shape[1])
    if max_seq - target.shape[1]:
        target = np.pad(
            target,
            [(0,0),(0,max_seq - target.shape[1])],
            'constant')
    if max_seq - logits.shape[1]:
        logits = np.pad(
            logits,
            [(0,0),(0,max_seq - logits.shape[1]), (0,0)],
            'constant')

    return np.mean(np.equal(target, np.argmax(logits, 2)))

train_source = source_int_text[batch_size:]
train_target = target_int_text[batch_size:]

valid_source = helper.pad_sentence_batch(source_int_text[:batch_size])
valid_target = helper.pad_sentence_batch(target_int_text[:batch_size])

with tf.Session(graph=train_graph) as sess:
    sess.run(tf.global_variables_initializer())

    for epoch_i in range(epochs):
        for batch_i, (source_batch, target_batch) in enumerate(
                helper.batch_data(train_source, train_target, batch_size)):
            start_time = time.time()
            
            _, loss = sess.run(
                [train_op, cost],
                {input_data: source_batch,
                 targets: target_batch,
                 lr: learning_rate,
                 sequence_length: target_batch.shape[1],
                 keep_prob: keep_probability})
            
            batch_train_logits = sess.run(
                inference_logits,
                {input_data: source_batch, keep_prob: 1.0})
            batch_valid_logits = sess.run(
                inference_logits,
                {input_data: valid_source, keep_prob: 1.0})
                
            train_acc = get_accuracy(target_batch, batch_train_logits)
            valid_acc = get_accuracy(np.array(valid_target), batch_valid_logits)
            end_time = time.time()
            print('Epoch {:>3} Batch {:>4}/{} - Train Accuracy: {:>6.3f}, Validation Accuracy: {:>6.3f}, Loss: {:>6.3f}'
                  .format(epoch_i, batch_i, len(source_int_text) // batch_size, train_acc, valid_acc, loss))

    # Save Model
    saver = tf.train.Saver()
    saver.save(sess, save_path)
    print('Model Trained and Saved')









    



Epoch   0 Batch    0/538 - Train Accuracy:  0.234, Validation Accuracy:  0.316, Loss:  5.926
Epoch   0 Batch    1/538 - Train Accuracy:  0.231, Validation Accuracy:  0.316, Loss:  5.279
Epoch   0 Batch    2/538 - Train Accuracy:  0.252, Validation Accuracy:  0.316, Loss:  4.634
Epoch   0 Batch    3/538 - Train Accuracy:  0.245, Validation Accuracy:  0.332, Loss:  4.468
Epoch   0 Batch    4/538 - Train Accuracy:  0.276, Validation Accuracy:  0.347, Loss:  4.108
Epoch   0 Batch    5/538 - Train Accuracy:  0.299, Validation Accuracy:  0.347, Loss:  3.817
Epoch   0 Batch    6/538 - Train Accuracy:  0.305, Validation Accuracy:  0.347, Loss:  3.656
Epoch   0 Batch    7/538 - Train Accuracy:  0.282, Validation Accuracy:  0.347, Loss:  3.640
Epoch   0 Batch    8/538 - Train Accuracy:  0.280, Validation Accuracy:  0.347, Loss:  3.558
Epoch   0 Batch    9/538 - Train Accuracy:  0.279, Validation Accuracy:  0.347, Loss:  3.448
Epoch   0 Batch   10/538 - Train Accuracy:  0.260, Validation Accuracy:  0.347, Loss:  3.482
Epoch   0 Batch   11/538 - Train Accuracy:  0.275, Validation Accuracy:  0.349, Loss:  3.372
Epoch   0 Batch   12/538 - Train Accuracy:  0.285, Validation Accuracy:  0.364, Loss:  3.362
Epoch   0 Batch   13/538 - Train Accuracy:  0.378, Validation Accuracy:  0.401, Loss:  3.063
Epoch   0 Batch   14/538 - Train Accuracy:  0.331, Validation Accuracy:  0.397, Loss:  3.170
Epoch   0 Batch   15/538 - Train Accuracy:  0.375, Validation Accuracy:  0.401, Loss:  3.047
Epoch   0 Batch   16/538 - Train Accuracy:  0.358, Validation Accuracy:  0.399, Loss:  2.988
Epoch   0 Batch   17/538 - Train Accuracy:  0.341, Validation Accuracy:  0.404, Loss:  3.042
Epoch   0 Batch   18/538 - Train Accuracy:  0.331, Validation Accuracy:  0.401, Loss:  3.107
Epoch   0 Batch   19/538 - Train Accuracy:  0.346, Validation Accuracy:  0.418, Loss:  3.027
Epoch   0 Batch   20/538 - Train Accuracy:  0.384, Validation Accuracy:  0.426, Loss:  2.910
Epoch   0 Batch   21/538 - Train Accuracy:  0.309, Validation Accuracy:  0.415, Loss:  3.074
Epoch   0 Batch   22/538 - Train Accuracy:  0.371, Validation Accuracy:  0.435, Loss:  2.926
Epoch   0 Batch   23/538 - Train Accuracy:  0.401, Validation Accuracy:  0.453, Loss:  2.866
Epoch   0 Batch   24/538 - Train Accuracy:  0.396, Validation Accuracy:  0.441, Loss:  2.807
Epoch   0 Batch   25/538 - Train Accuracy:  0.382, Validation Accuracy:  0.438, Loss:  2.855
Epoch   0 Batch   26/538 - Train Accuracy:  0.384, Validation Accuracy:  0.442, Loss:  2.814
Epoch   0 Batch   27/538 - Train Accuracy:  0.391, Validation Accuracy:  0.444, Loss:  2.759
Epoch   0 Batch   28/538 - Train Accuracy:  0.446, Validation Accuracy:  0.448, Loss:  2.516
Epoch   0 Batch   29/538 - Train Accuracy:  0.407, Validation Accuracy:  0.449, Loss:  2.658
Epoch   0 Batch   30/538 - Train Accuracy:  0.390, Validation Accuracy:  0.453, Loss:  2.729
Epoch   0 Batch   31/538 - Train Accuracy:  0.420, Validation Accuracy:  0.455, Loss:  2.574
Epoch   0 Batch   32/538 - Train Accuracy:  0.405, Validation Accuracy:  0.450, Loss:  2.614
Epoch   0 Batch   33/538 - Train Accuracy:  0.425, Validation Accuracy:  0.460, Loss:  2.575
Epoch   0 Batch   34/538 - Train Accuracy:  0.407, Validation Accuracy:  0.461, Loss:  2.613
Epoch   0 Batch   35/538 - Train Accuracy:  0.401, Validation Accuracy:  0.465, Loss:  2.629
Epoch   0 Batch   36/538 - Train Accuracy:  0.419, Validation Accuracy:  0.457, Loss:  2.481
Epoch   0 Batch   37/538 - Train Accuracy:  0.408, Validation Accuracy:  0.461, Loss:  2.554
Epoch   0 Batch   38/538 - Train Accuracy:  0.389, Validation Accuracy:  0.463, Loss:  2.567
Epoch   0 Batch   39/538 - Train Accuracy:  0.417, Validation Accuracy:  0.474, Loss:  2.562
Epoch   0 Batch   40/538 - Train Accuracy:  0.475, Validation Accuracy:  0.471, Loss:  2.294
Epoch   0 Batch   41/538 - Train Accuracy:  0.421, Validation Accuracy:  0.477, Loss:  2.511
Epoch   0 Batch   42/538 - Train Accuracy:  0.428, Validation Accuracy:  0.478, Loss:  2.441
Epoch   0 Batch   43/538 - Train Accuracy:  0.430, Validation Accuracy:  0.478, Loss:  2.465
Epoch   0 Batch   44/538 - Train Accuracy:  0.419, Validation Accuracy:  0.474, Loss:  2.497
Epoch   0 Batch   45/538 - Train Accuracy:  0.447, Validation Accuracy:  0.476, Loss:  2.313
Epoch   0 Batch   46/538 - Train Accuracy:  0.421, Validation Accuracy:  0.477, Loss:  2.400
Epoch   0 Batch   47/538 - Train Accuracy:  0.438, Validation Accuracy:  0.478, Loss:  2.275
Epoch   0 Batch   48/538 - Train Accuracy:  0.453, Validation Accuracy:  0.480, Loss:  2.236
Epoch   0 Batch   49/538 - Train Accuracy:  0.411, Validation Accuracy:  0.482, Loss:  2.408
Epoch   0 Batch   50/538 - Train Accuracy:  0.440, Validation Accuracy:  0.488, Loss:  2.289
Epoch   0 Batch   51/538 - Train Accuracy:  0.361, Validation Accuracy:  0.482, Loss:  2.503
Epoch   0 Batch   52/538 - Train Accuracy:  0.442, Validation Accuracy:  0.485, Loss:  2.287
Epoch   0 Batch   53/538 - Train Accuracy:  0.459, Validation Accuracy:  0.464, Loss:  2.108
Epoch   0 Batch   54/538 - Train Accuracy:  0.414, Validation Accuracy:  0.468, Loss:  2.293
Epoch   0 Batch   55/538 - Train Accuracy:  0.420, Validation Accuracy:  0.490, Loss:  2.318
Epoch   0 Batch   56/538 - Train Accuracy:  0.438, Validation Accuracy:  0.473, Loss:  2.175
Epoch   0 Batch   57/538 - Train Accuracy:  0.395, Validation Accuracy:  0.468, Loss:  2.338
Epoch   0 Batch   58/538 - Train Accuracy:  0.397, Validation Accuracy:  0.480, Loss:  2.298
Epoch   0 Batch   59/538 - Train Accuracy:  0.427, Validation Accuracy:  0.484, Loss:  2.227
Epoch   0 Batch   60/538 - Train Accuracy:  0.431, Validation Accuracy:  0.488, Loss:  2.229
Epoch   0 Batch   61/538 - Train Accuracy:  0.425, Validation Accuracy:  0.475, Loss:  2.128
Epoch   0 Batch   62/538 - Train Accuracy:  0.441, Validation Accuracy:  0.491, Loss:  2.113
Epoch   0 Batch   63/538 - Train Accuracy:  0.467, Validation Accuracy:  0.498, Loss:  2.026
Epoch   0 Batch   64/538 - Train Accuracy:  0.465, Validation Accuracy:  0.503, Loss:  2.025
Epoch   0 Batch   65/538 - Train Accuracy:  0.427, Validation Accuracy:  0.503, Loss:  2.146
Epoch   0 Batch   66/538 - Train Accuracy:  0.465, Validation Accuracy:  0.506, Loss:  1.958
Epoch   0 Batch   67/538 - Train Accuracy:  0.440, Validation Accuracy:  0.497, Loss:  2.019
Epoch   0 Batch   68/538 - Train Accuracy:  0.457, Validation Accuracy:  0.492, Loss:  1.895
Epoch   0 Batch   69/538 - Train Accuracy:  0.436, Validation Accuracy:  0.500, Loss:  2.011
Epoch   0 Batch   70/538 - Train Accuracy:  0.472, Validation Accuracy:  0.498, Loss:  1.909
Epoch   0 Batch   71/538 - Train Accuracy:  0.445, Validation Accuracy:  0.490, Loss:  1.960
Epoch   0 Batch   72/538 - Train Accuracy:  0.469, Validation Accuracy:  0.495, Loss:  1.857
Epoch   0 Batch   73/538 - Train Accuracy:  0.431, Validation Accuracy:  0.495, Loss:  1.940
Epoch   0 Batch   74/538 - Train Accuracy:  0.450, Validation Accuracy:  0.488, Loss:  1.860
Epoch   0 Batch   75/538 - Train Accuracy:  0.481, Validation Accuracy:  0.499, Loss:  1.837
Epoch   0 Batch   76/538 - Train Accuracy:  0.431, Validation Accuracy:  0.494, Loss:  1.941
Epoch   0 Batch   77/538 - Train Accuracy:  0.442, Validation Accuracy:  0.503, Loss:  1.862
Epoch   0 Batch   78/538 - Train Accuracy:  0.456, Validation Accuracy:  0.493, Loss:  1.811
Epoch   0 Batch   79/538 - Train Accuracy:  0.437, Validation Accuracy:  0.460, Loss:  1.740
Epoch   0 Batch   80/538 - Train Accuracy:  0.428, Validation Accuracy:  0.499, Loss:  1.841
Epoch   0 Batch   81/538 - Train Accuracy:  0.435, Validation Accuracy:  0.489, Loss:  1.798
Epoch   0 Batch   82/538 - Train Accuracy:  0.442, Validation Accuracy:  0.488, Loss:  1.728
Epoch   0 Batch   83/538 - Train Accuracy:  0.422, Validation Accuracy:  0.477, Loss:  1.753
Epoch   0 Batch   84/538 - Train Accuracy:  0.445, Validation Accuracy:  0.484, Loss:  1.674
Epoch   0 Batch   85/538 - Train Accuracy:  0.447, Validation Accuracy:  0.465, Loss:  1.585
Epoch   0 Batch   86/538 - Train Accuracy:  0.428, Validation Accuracy:  0.476, Loss:  1.713
Epoch   0 Batch   87/538 - Train Accuracy:  0.416, Validation Accuracy:  0.470, Loss:  1.634
Epoch   0 Batch   88/538 - Train Accuracy:  0.411, Validation Accuracy:  0.461, Loss:  1.647
Epoch   0 Batch   89/538 - Train Accuracy:  0.435, Validation Accuracy:  0.473, Loss:  1.617
Epoch   0 Batch   90/538 - Train Accuracy:  0.453, Validation Accuracy:  0.488, Loss:  1.554
Epoch   0 Batch   91/538 - Train Accuracy:  0.419, Validation Accuracy:  0.470, Loss:  1.616
Epoch   0 Batch   92/538 - Train Accuracy:  0.422, Validation Accuracy:  0.473, Loss:  1.552
Epoch   0 Batch   93/538 - Train Accuracy:  0.429, Validation Accuracy:  0.481, Loss:  1.540
Epoch   0 Batch   94/538 - Train Accuracy:  0.419, Validation Accuracy:  0.468, Loss:  1.572
Epoch   0 Batch   95/538 - Train Accuracy:  0.465, Validation Accuracy:  0.466, Loss:  1.384
Epoch   0 Batch   96/538 - Train Accuracy:  0.444, Validation Accuracy:  0.460, Loss:  1.390
Epoch   0 Batch   97/538 - Train Accuracy:  0.397, Validation Accuracy:  0.466, Loss:  1.454
Epoch   0 Batch   98/538 - Train Accuracy:  0.440, Validation Accuracy:  0.454, Loss:  1.349
Epoch   0 Batch   99/538 - Train Accuracy:  0.396, Validation Accuracy:  0.450, Loss:  1.464
Epoch   0 Batch  100/538 - Train Accuracy:  0.380, Validation Accuracy:  0.439, Loss:  1.380
Epoch   0 Batch  101/538 - Train Accuracy:  0.373, Validation Accuracy:  0.431, Loss:  1.388
Epoch   0 Batch  102/538 - Train Accuracy:  0.413, Validation Accuracy:  0.474, Loss:  1.430
Epoch   0 Batch  103/538 - Train Accuracy:  0.420, Validation Accuracy:  0.481, Loss:  1.365
Epoch   0 Batch  104/538 - Train Accuracy:  0.439, Validation Accuracy:  0.473, Loss:  1.321
Epoch   0 Batch  105/538 - Train Accuracy:  0.409, Validation Accuracy:  0.442, Loss:  1.278
Epoch   0 Batch  106/538 - Train Accuracy:  0.395, Validation Accuracy:  0.443, Loss:  1.316
Epoch   0 Batch  107/538 - Train Accuracy:  0.375, Validation Accuracy:  0.447, Loss:  1.337
Epoch   0 Batch  108/538 - Train Accuracy:  0.402, Validation Accuracy:  0.457, Loss:  1.301
Epoch   0 Batch  109/538 - Train Accuracy:  0.416, Validation Accuracy:  0.466, Loss:  1.277
Epoch   0 Batch  110/538 - Train Accuracy:  0.427, Validation Accuracy:  0.475, Loss:  1.312
Epoch   0 Batch  111/538 - Train Accuracy:  0.453, Validation Accuracy:  0.485, Loss:  1.216
Epoch   0 Batch  112/538 - Train Accuracy:  0.402, Validation Accuracy:  0.466, Loss:  1.272
Epoch   0 Batch  113/538 - Train Accuracy:  0.414, Validation Accuracy:  0.474, Loss:  1.280
Epoch   0 Batch  114/538 - Train Accuracy:  0.497, Validation Accuracy:  0.498, Loss:  1.177
Epoch   0 Batch  115/538 - Train Accuracy:  0.469, Validation Accuracy:  0.515, Loss:  1.206
Epoch   0 Batch  116/538 - Train Accuracy:  0.478, Validation Accuracy:  0.511, Loss:  1.217
Epoch   0 Batch  117/538 - Train Accuracy:  0.484, Validation Accuracy:  0.517, Loss:  1.161
Epoch   0 Batch  118/538 - Train Accuracy:  0.510, Validation Accuracy:  0.520, Loss:  1.145
Epoch   0 Batch  119/538 - Train Accuracy:  0.496, Validation Accuracy:  0.521, Loss:  1.119
Epoch   0 Batch  120/538 - Train Accuracy:  0.465, Validation Accuracy:  0.518, Loss:  1.150
Epoch   0 Batch  121/538 - Train Accuracy:  0.487, Validation Accuracy:  0.511, Loss:  1.101
Epoch   0 Batch  122/538 - Train Accuracy:  0.472, Validation Accuracy:  0.512, Loss:  1.112
Epoch   0 Batch  123/538 - Train Accuracy:  0.518, Validation Accuracy:  0.520, Loss:  1.087
Epoch   0 Batch  124/538 - Train Accuracy:  0.499, Validation Accuracy:  0.514, Loss:  1.041
Epoch   0 Batch  125/538 - Train Accuracy:  0.494, Validation Accuracy:  0.512, Loss:  1.088
Epoch   0 Batch  126/538 - Train Accuracy:  0.517, Validation Accuracy:  0.511, Loss:  1.066
Epoch   0 Batch  127/538 - Train Accuracy:  0.447, Validation Accuracy:  0.507, Loss:  1.142
Epoch   0 Batch  128/538 - Train Accuracy:  0.476, Validation Accuracy:  0.508, Loss:  1.074
Epoch   0 Batch  129/538 - Train Accuracy:  0.474, Validation Accuracy:  0.505, Loss:  1.052
Epoch   0 Batch  130/538 - Train Accuracy:  0.476, Validation Accuracy:  0.502, Loss:  1.049
Epoch   0 Batch  131/538 - Train Accuracy:  0.459, Validation Accuracy:  0.491, Loss:  1.082
Epoch   0 Batch  132/538 - Train Accuracy:  0.463, Validation Accuracy:  0.490, Loss:  1.023
Epoch   0 Batch  133/538 - Train Accuracy:  0.494, Validation Accuracy:  0.505, Loss:  0.978
Epoch   0 Batch  134/538 - Train Accuracy:  0.453, Validation Accuracy:  0.502, Loss:  1.096
Epoch   0 Batch  135/538 - Train Accuracy:  0.470, Validation Accuracy:  0.497, Loss:  1.040
Epoch   0 Batch  136/538 - Train Accuracy:  0.468, Validation Accuracy:  0.499, Loss:  1.021
Epoch   0 Batch  137/538 - Train Accuracy:  0.467, Validation Accuracy:  0.499, Loss:  1.021
Epoch   0 Batch  138/538 - Train Accuracy:  0.479, Validation Accuracy:  0.498, Loss:  1.017
Epoch   0 Batch  139/538 - Train Accuracy:  0.446, Validation Accuracy:  0.498, Loss:  1.082
Epoch   0 Batch  140/538 - Train Accuracy:  0.448, Validation Accuracy:  0.499, Loss:  1.086
Epoch   0 Batch  141/538 - Train Accuracy:  0.461, Validation Accuracy:  0.503, Loss:  1.066
Epoch   0 Batch  142/538 - Train Accuracy:  0.491, Validation Accuracy:  0.507, Loss:  0.960
Epoch   0 Batch  143/538 - Train Accuracy:  0.463, Validation Accuracy:  0.511, Loss:  1.022
Epoch   0 Batch  144/538 - Train Accuracy:  0.473, Validation Accuracy:  0.507, Loss:  1.015
Epoch   0 Batch  145/538 - Train Accuracy:  0.477, Validation Accuracy:  0.501, Loss:  1.000
Epoch   0 Batch  146/538 - Train Accuracy:  0.476, Validation Accuracy:  0.503, Loss:  0.937
Epoch   0 Batch  147/538 - Train Accuracy:  0.490, Validation Accuracy:  0.503, Loss:  0.961
Epoch   0 Batch  148/538 - Train Accuracy:  0.452, Validation Accuracy:  0.499, Loss:  1.048
Epoch   0 Batch  149/538 - Train Accuracy:  0.478, Validation Accuracy:  0.509, Loss:  0.961
Epoch   0 Batch  150/538 - Train Accuracy:  0.502, Validation Accuracy:  0.527, Loss:  0.979
Epoch   0 Batch  151/538 - Train Accuracy:  0.496, Validation Accuracy:  0.525, Loss:  0.934
Epoch   0 Batch  152/538 - Train Accuracy:  0.499, Validation Accuracy:  0.530, Loss:  0.924
Epoch   0 Batch  153/538 - Train Accuracy:  0.480, Validation Accuracy:  0.533, Loss:  0.972
Epoch   0 Batch  154/538 - Train Accuracy:  0.475, Validation Accuracy:  0.527, Loss:  0.923
Epoch   0 Batch  155/538 - Train Accuracy:  0.518, Validation Accuracy:  0.524, Loss:  0.922
Epoch   0 Batch  156/538 - Train Accuracy:  0.467, Validation Accuracy:  0.516, Loss:  0.939
Epoch   0 Batch  157/538 - Train Accuracy:  0.487, Validation Accuracy:  0.522, Loss:  0.896
Epoch   0 Batch  158/538 - Train Accuracy:  0.498, Validation Accuracy:  0.536, Loss:  0.964
Epoch   0 Batch  159/538 - Train Accuracy:  0.496, Validation Accuracy:  0.531, Loss:  0.954
Epoch   0 Batch  160/538 - Train Accuracy:  0.501, Validation Accuracy:  0.520, Loss:  0.883
Epoch   0 Batch  161/538 - Train Accuracy:  0.485, Validation Accuracy:  0.520, Loss:  0.911
Epoch   0 Batch  162/538 - Train Accuracy:  0.518, Validation Accuracy:  0.524, Loss:  0.890
Epoch   0 Batch  163/538 - Train Accuracy:  0.494, Validation Accuracy:  0.525, Loss:  0.916
Epoch   0 Batch  164/538 - Train Accuracy:  0.488, Validation Accuracy:  0.526, Loss:  0.925
Epoch   0 Batch  165/538 - Train Accuracy:  0.514, Validation Accuracy:  0.528, Loss:  0.842
Epoch   0 Batch  166/538 - Train Accuracy:  0.496, Validation Accuracy:  0.525, Loss:  0.892
Epoch   0 Batch  167/538 - Train Accuracy:  0.537, Validation Accuracy:  0.529, Loss:  0.848
Epoch   0 Batch  168/538 - Train Accuracy:  0.479, Validation Accuracy:  0.540, Loss:  0.927
Epoch   0 Batch  169/538 - Train Accuracy:  0.501, Validation Accuracy:  0.553, Loss:  0.873
Epoch   0 Batch  170/538 - Train Accuracy:  0.525, Validation Accuracy:  0.556, Loss:  0.855
Epoch   0 Batch  171/538 - Train Accuracy:  0.492, Validation Accuracy:  0.539, Loss:  0.904
Epoch   0 Batch  172/538 - Train Accuracy:  0.512, Validation Accuracy:  0.542, Loss:  0.849
Epoch   0 Batch  173/538 - Train Accuracy:  0.508, Validation Accuracy:  0.542, Loss:  0.843
Epoch   0 Batch  174/538 - Train Accuracy:  0.466, Validation Accuracy:  0.536, Loss:  0.901
Epoch   0 Batch  175/538 - Train Accuracy:  0.460, Validation Accuracy:  0.535, Loss:  0.902
Epoch   0 Batch  176/538 - Train Accuracy:  0.484, Validation Accuracy:  0.534, Loss:  0.897
Epoch   0 Batch  177/538 - Train Accuracy:  0.511, Validation Accuracy:  0.540, Loss:  0.848
Epoch   0 Batch  178/538 - Train Accuracy:  0.540, Validation Accuracy:  0.547, Loss:  0.812
Epoch   0 Batch  179/538 - Train Accuracy:  0.499, Validation Accuracy:  0.552, Loss:  0.859
Epoch   0 Batch  180/538 - Train Accuracy:  0.540, Validation Accuracy:  0.552, Loss:  0.833
Epoch   0 Batch  181/538 - Train Accuracy:  0.488, Validation Accuracy:  0.552, Loss:  0.881
Epoch   0 Batch  182/538 - Train Accuracy:  0.475, Validation Accuracy:  0.529, Loss:  0.866
Epoch   0 Batch  183/538 - Train Accuracy:  0.518, Validation Accuracy:  0.542, Loss:  0.795
Epoch   0 Batch  184/538 - Train Accuracy:  0.523, Validation Accuracy:  0.545, Loss:  0.800
Epoch   0 Batch  185/538 - Train Accuracy:  0.510, Validation Accuracy:  0.541, Loss:  0.827
Epoch   0 Batch  186/538 - Train Accuracy:  0.528, Validation Accuracy:  0.549, Loss:  0.826
Epoch   0 Batch  187/538 - Train Accuracy:  0.560, Validation Accuracy:  0.560, Loss:  0.786
Epoch   0 Batch  188/538 - Train Accuracy:  0.509, Validation Accuracy:  0.549, Loss:  0.829
Epoch   0 Batch  189/538 - Train Accuracy:  0.527, Validation Accuracy:  0.536, Loss:  0.830
Epoch   0 Batch  190/538 - Train Accuracy:  0.522, Validation Accuracy:  0.545, Loss:  0.836
Epoch   0 Batch  191/538 - Train Accuracy:  0.552, Validation Accuracy:  0.551, Loss:  0.788
Epoch   0 Batch  192/538 - Train Accuracy:  0.538, Validation Accuracy:  0.543, Loss:  0.811
Epoch   0 Batch  193/538 - Train Accuracy:  0.533, Validation Accuracy:  0.550, Loss:  0.783
Epoch   0 Batch  194/538 - Train Accuracy:  0.518, Validation Accuracy:  0.551, Loss:  0.846
Epoch   0 Batch  195/538 - Train Accuracy:  0.538, Validation Accuracy:  0.563, Loss:  0.784
Epoch   0 Batch  196/538 - Train Accuracy:  0.550, Validation Accuracy:  0.555, Loss:  0.780
Epoch   0 Batch  197/538 - Train Accuracy:  0.547, Validation Accuracy:  0.552, Loss:  0.774
Epoch   0 Batch  198/538 - Train Accuracy:  0.587, Validation Accuracy:  0.568, Loss:  0.779
Epoch   0 Batch  199/538 - Train Accuracy:  0.503, Validation Accuracy:  0.538, Loss:  0.817
Epoch   0 Batch  200/538 - Train Accuracy:  0.515, Validation Accuracy:  0.549, Loss:  0.786
Epoch   0 Batch  201/538 - Train Accuracy:  0.555, Validation Accuracy:  0.560, Loss:  0.775
Epoch   0 Batch  202/538 - Train Accuracy:  0.522, Validation Accuracy:  0.563, Loss:  0.823
Epoch   0 Batch  203/538 - Train Accuracy:  0.540, Validation Accuracy:  0.554, Loss:  0.819
Epoch   0 Batch  204/538 - Train Accuracy:  0.518, Validation Accuracy:  0.570, Loss:  0.799
Epoch   0 Batch  205/538 - Train Accuracy:  0.546, Validation Accuracy:  0.564, Loss:  0.744
Epoch   0 Batch  206/538 - Train Accuracy:  0.525, Validation Accuracy:  0.548, Loss:  0.805
Epoch   0 Batch  207/538 - Train Accuracy:  0.536, Validation Accuracy:  0.539, Loss:  0.748
Epoch   0 Batch  208/538 - Train Accuracy:  0.526, Validation Accuracy:  0.556, Loss:  0.791
Epoch   0 Batch  209/538 - Train Accuracy:  0.543, Validation Accuracy:  0.562, Loss:  0.778
Epoch   0 Batch  210/538 - Train Accuracy:  0.538, Validation Accuracy:  0.551, Loss:  0.756
Epoch   0 Batch  211/538 - Train Accuracy:  0.531, Validation Accuracy:  0.575, Loss:  0.803
Epoch   0 Batch  212/538 - Train Accuracy:  0.579, Validation Accuracy:  0.574, Loss:  0.750
Epoch   0 Batch  213/538 - Train Accuracy:  0.555, Validation Accuracy:  0.576, Loss:  0.752
Epoch   0 Batch  214/538 - Train Accuracy:  0.562, Validation Accuracy:  0.565, Loss:  0.758
Epoch   0 Batch  215/538 - Train Accuracy:  0.539, Validation Accuracy:  0.570, Loss:  0.764
Epoch   0 Batch  216/538 - Train Accuracy:  0.533, Validation Accuracy:  0.569, Loss:  0.773
Epoch   0 Batch  217/538 - Train Accuracy:  0.593, Validation Accuracy:  0.568, Loss:  0.723
Epoch   0 Batch  218/538 - Train Accuracy:  0.535, Validation Accuracy:  0.569, Loss:  0.766
Epoch   0 Batch  219/538 - Train Accuracy:  0.547, Validation Accuracy:  0.576, Loss:  0.777
Epoch   0 Batch  220/538 - Train Accuracy:  0.533, Validation Accuracy:  0.570, Loss:  0.721
Epoch   0 Batch  221/538 - Train Accuracy:  0.566, Validation Accuracy:  0.574, Loss:  0.711
Epoch   0 Batch  222/538 - Train Accuracy:  0.558, Validation Accuracy:  0.590, Loss:  0.706
Epoch   0 Batch  223/538 - Train Accuracy:  0.534, Validation Accuracy:  0.576, Loss:  0.755
Epoch   0 Batch  224/538 - Train Accuracy:  0.528, Validation Accuracy:  0.567, Loss:  0.762
Epoch   0 Batch  225/538 - Train Accuracy:  0.566, Validation Accuracy:  0.571, Loss:  0.713
Epoch   0 Batch  226/538 - Train Accuracy:  0.581, Validation Accuracy:  0.576, Loss:  0.706
Epoch   0 Batch  227/538 - Train Accuracy:  0.597, Validation Accuracy:  0.585, Loss:  0.693
Epoch   0 Batch  228/538 - Train Accuracy:  0.565, Validation Accuracy:  0.579, Loss:  0.700
Epoch   0 Batch  229/538 - Train Accuracy:  0.581, Validation Accuracy:  0.581, Loss:  0.705
Epoch   0 Batch  230/538 - Train Accuracy:  0.557, Validation Accuracy:  0.573, Loss:  0.724
Epoch   0 Batch  231/538 - Train Accuracy:  0.558, Validation Accuracy:  0.577, Loss:  0.730
Epoch   0 Batch  232/538 - Train Accuracy:  0.589, Validation Accuracy:  0.587, Loss:  0.723
Epoch   0 Batch  233/538 - Train Accuracy:  0.613, Validation Accuracy:  0.600, Loss:  0.716
Epoch   0 Batch  234/538 - Train Accuracy:  0.546, Validation Accuracy:  0.588, Loss:  0.750
Epoch   0 Batch  235/538 - Train Accuracy:  0.555, Validation Accuracy:  0.575, Loss:  0.765
Epoch   0 Batch  236/538 - Train Accuracy:  0.554, Validation Accuracy:  0.587, Loss:  0.808
Epoch   0 Batch  237/538 - Train Accuracy:  0.577, Validation Accuracy:  0.585, Loss:  0.735
Epoch   0 Batch  238/538 - Train Accuracy:  0.584, Validation Accuracy:  0.570, Loss:  0.719
Epoch   0 Batch  239/538 - Train Accuracy:  0.561, Validation Accuracy:  0.581, Loss:  0.771
Epoch   0 Batch  240/538 - Train Accuracy:  0.563, Validation Accuracy:  0.586, Loss:  0.772
Epoch   0 Batch  241/538 - Train Accuracy:  0.549, Validation Accuracy:  0.586, Loss:  0.740
Epoch   0 Batch  242/538 - Train Accuracy:  0.588, Validation Accuracy:  0.584, Loss:  0.740
Epoch   0 Batch  243/538 - Train Accuracy:  0.555, Validation Accuracy:  0.582, Loss:  0.780
Epoch   0 Batch  244/538 - Train Accuracy:  0.565, Validation Accuracy:  0.580, Loss:  0.715
Epoch   0 Batch  245/538 - Train Accuracy:  0.554, Validation Accuracy:  0.578, Loss:  0.753
Epoch   0 Batch  246/538 - Train Accuracy:  0.599, Validation Accuracy:  0.574, Loss:  0.687
Epoch   0 Batch  247/538 - Train Accuracy:  0.553, Validation Accuracy:  0.575, Loss:  0.741
Epoch   0 Batch  248/538 - Train Accuracy:  0.547, Validation Accuracy:  0.570, Loss:  0.740
Epoch   0 Batch  249/538 - Train Accuracy:  0.558, Validation Accuracy:  0.572, Loss:  0.693
Epoch   0 Batch  250/538 - Train Accuracy:  0.569, Validation Accuracy:  0.576, Loss:  0.715
Epoch   0 Batch  251/538 - Train Accuracy:  0.566, Validation Accuracy:  0.583, Loss:  0.736
Epoch   0 Batch  252/538 - Train Accuracy:  0.580, Validation Accuracy:  0.591, Loss:  0.681
Epoch   0 Batch  253/538 - Train Accuracy:  0.582, Validation Accuracy:  0.593, Loss:  0.680
Epoch   0 Batch  254/538 - Train Accuracy:  0.581, Validation Accuracy:  0.587, Loss:  0.729
Epoch   0 Batch  255/538 - Train Accuracy:  0.582, Validation Accuracy:  0.599, Loss:  0.716
Epoch   0 Batch  256/538 - Train Accuracy:  0.569, Validation Accuracy:  0.605, Loss:  0.719
Epoch   0 Batch  257/538 - Train Accuracy:  0.601, Validation Accuracy:  0.605, Loss:  0.683
Epoch   0 Batch  258/538 - Train Accuracy:  0.612, Validation Accuracy:  0.608, Loss:  0.691
Epoch   0 Batch  259/538 - Train Accuracy:  0.615, Validation Accuracy:  0.607, Loss:  0.677
Epoch   0 Batch  260/538 - Train Accuracy:  0.584, Validation Accuracy:  0.602, Loss:  0.696
Epoch   0 Batch  261/538 - Train Accuracy:  0.567, Validation Accuracy:  0.592, Loss:  0.731
Epoch   0 Batch  262/538 - Train Accuracy:  0.558, Validation Accuracy:  0.589, Loss:  0.702
Epoch   0 Batch  263/538 - Train Accuracy:  0.582, Validation Accuracy:  0.586, Loss:  0.695
Epoch   0 Batch  264/538 - Train Accuracy:  0.573, Validation Accuracy:  0.584, Loss:  0.712
Epoch   0 Batch  265/538 - Train Accuracy:  0.545, Validation Accuracy:  0.582, Loss:  0.730
Epoch   0 Batch  266/538 - Train Accuracy:  0.599, Validation Accuracy:  0.584, Loss:  0.693
Epoch   0 Batch  267/538 - Train Accuracy:  0.571, Validation Accuracy:  0.587, Loss:  0.690
Epoch   0 Batch  268/538 - Train Accuracy:  0.591, Validation Accuracy:  0.594, Loss:  0.658
Epoch   0 Batch  269/538 - Train Accuracy:  0.574, Validation Accuracy:  0.606, Loss:  0.684
Epoch   0 Batch  270/538 - Train Accuracy:  0.579, Validation Accuracy:  0.605, Loss:  0.688
Epoch   0 Batch  271/538 - Train Accuracy:  0.574, Validation Accuracy:  0.602, Loss:  0.703
Epoch   0 Batch  272/538 - Train Accuracy:  0.559, Validation Accuracy:  0.604, Loss:  0.728
Epoch   0 Batch  273/538 - Train Accuracy:  0.592, Validation Accuracy:  0.611, Loss:  0.690
Epoch   0 Batch  274/538 - Train Accuracy:  0.550, Validation Accuracy:  0.612, Loss:  0.732
Epoch   0 Batch  275/538 - Train Accuracy:  0.581, Validation Accuracy:  0.611, Loss:  0.707
Epoch   0 Batch  276/538 - Train Accuracy:  0.601, Validation Accuracy:  0.611, Loss:  0.689
Epoch   0 Batch  277/538 - Train Accuracy:  0.576, Validation Accuracy:  0.612, Loss:  0.689
Epoch   0 Batch  278/538 - Train Accuracy:  0.591, Validation Accuracy:  0.614, Loss:  0.687
Epoch   0 Batch  279/538 - Train Accuracy:  0.592, Validation Accuracy:  0.615, Loss:  0.664
Epoch   0 Batch  280/538 - Train Accuracy:  0.634, Validation Accuracy:  0.619, Loss:  0.647
Epoch   0 Batch  281/538 - Train Accuracy:  0.602, Validation Accuracy:  0.622, Loss:  0.697
Epoch   0 Batch  282/538 - Train Accuracy:  0.605, Validation Accuracy:  0.619, Loss:  0.662
Epoch   0 Batch  283/538 - Train Accuracy:  0.594, Validation Accuracy:  0.611, Loss:  0.676
Epoch   0 Batch  284/538 - Train Accuracy:  0.603, Validation Accuracy:  0.614, Loss:  0.674
Epoch   0 Batch  285/538 - Train Accuracy:  0.611, Validation Accuracy:  0.618, Loss:  0.635
Epoch   0 Batch  286/538 - Train Accuracy:  0.577, Validation Accuracy:  0.614, Loss:  0.665
Epoch   0 Batch  287/538 - Train Accuracy:  0.618, Validation Accuracy:  0.611, Loss:  0.650
Epoch   0 Batch  288/538 - Train Accuracy:  0.574, Validation Accuracy:  0.616, Loss:  0.680
Epoch   0 Batch  289/538 - Train Accuracy:  0.632, Validation Accuracy:  0.613, Loss:  0.612
Epoch   0 Batch  290/538 - Train Accuracy:  0.585, Validation Accuracy:  0.620, Loss:  0.653
Epoch   0 Batch  291/538 - Train Accuracy:  0.606, Validation Accuracy:  0.612, Loss:  0.647
Epoch   0 Batch  292/538 - Train Accuracy:  0.613, Validation Accuracy:  0.611, Loss:  0.628
Epoch   0 Batch  293/538 - Train Accuracy:  0.603, Validation Accuracy:  0.617, Loss:  0.629
Epoch   0 Batch  294/538 - Train Accuracy:  0.573, Validation Accuracy:  0.616, Loss:  0.684
Epoch   0 Batch  295/538 - Train Accuracy:  0.626, Validation Accuracy:  0.622, Loss:  0.604
Epoch   0 Batch  296/538 - Train Accuracy:  0.606, Validation Accuracy:  0.621, Loss:  0.639
Epoch   0 Batch  297/538 - Train Accuracy:  0.591, Validation Accuracy:  0.618, Loss:  0.673
Epoch   0 Batch  298/538 - Train Accuracy:  0.605, Validation Accuracy:  0.618, Loss:  0.630
Epoch   0 Batch  299/538 - Train Accuracy:  0.612, Validation Accuracy:  0.619, Loss:  0.634
Epoch   0 Batch  300/538 - Train Accuracy:  0.610, Validation Accuracy:  0.619, Loss:  0.623
Epoch   0 Batch  301/538 - Train Accuracy:  0.595, Validation Accuracy:  0.617, Loss:  0.647
Epoch   0 Batch  302/538 - Train Accuracy:  0.638, Validation Accuracy:  0.621, Loss:  0.611
Epoch   0 Batch  303/538 - Train Accuracy:  0.648, Validation Accuracy:  0.623, Loss:  0.604
Epoch   0 Batch  304/538 - Train Accuracy:  0.596, Validation Accuracy:  0.618, Loss:  0.640
Epoch   0 Batch  305/538 - Train Accuracy:  0.610, Validation Accuracy:  0.617, Loss:  0.612
Epoch   0 Batch  306/538 - Train Accuracy:  0.616, Validation Accuracy:  0.613, Loss:  0.628
Epoch   0 Batch  307/538 - Train Accuracy:  0.604, Validation Accuracy:  0.612, Loss:  0.635
Epoch   0 Batch  308/538 - Train Accuracy:  0.616, Validation Accuracy:  0.625, Loss:  0.614
Epoch   0 Batch  309/538 - Train Accuracy:  0.590, Validation Accuracy:  0.623, Loss:  0.626
Epoch   0 Batch  310/538 - Train Accuracy:  0.603, Validation Accuracy:  0.617, Loss:  0.631
Epoch   0 Batch  311/538 - Train Accuracy:  0.616, Validation Accuracy:  0.620, Loss:  0.615
Epoch   0 Batch  312/538 - Train Accuracy:  0.647, Validation Accuracy:  0.632, Loss:  0.577
Epoch   0 Batch  313/538 - Train Accuracy:  0.608, Validation Accuracy:  0.634, Loss:  0.652
Epoch   0 Batch  314/538 - Train Accuracy:  0.610, Validation Accuracy:  0.631, Loss:  0.623
Epoch   0 Batch  315/538 - Train Accuracy:  0.600, Validation Accuracy:  0.634, Loss:  0.614
Epoch   0 Batch  316/538 - Train Accuracy:  0.611, Validation Accuracy:  0.630, Loss:  0.603
Epoch   0 Batch  317/538 - Train Accuracy:  0.624, Validation Accuracy:  0.633, Loss:  0.625
Epoch   0 Batch  318/538 - Train Accuracy:  0.608, Validation Accuracy:  0.636, Loss:  0.613
Epoch   0 Batch  319/538 - Train Accuracy:  0.621, Validation Accuracy:  0.636, Loss:  0.604
Epoch   0 Batch  320/538 - Train Accuracy:  0.637, Validation Accuracy:  0.639, Loss:  0.600
Epoch   0 Batch  321/538 - Train Accuracy:  0.620, Validation Accuracy:  0.634, Loss:  0.585
Epoch   0 Batch  322/538 - Train Accuracy:  0.631, Validation Accuracy:  0.633, Loss:  0.595
Epoch   0 Batch  323/538 - Train Accuracy:  0.618, Validation Accuracy:  0.636, Loss:  0.592
Epoch   0 Batch  324/538 - Train Accuracy:  0.588, Validation Accuracy:  0.614, Loss:  0.642
Epoch   0 Batch  325/538 - Train Accuracy:  0.621, Validation Accuracy:  0.640, Loss:  0.604
Epoch   0 Batch  326/538 - Train Accuracy:  0.613, Validation Accuracy:  0.638, Loss:  0.620
Epoch   0 Batch  327/538 - Train Accuracy:  0.615, Validation Accuracy:  0.627, Loss:  0.625
Epoch   0 Batch  328/538 - Train Accuracy:  0.640, Validation Accuracy:  0.627, Loss:  0.587
Epoch   0 Batch  329/538 - Train Accuracy:  0.636, Validation Accuracy:  0.625, Loss:  0.588
Epoch   0 Batch  330/538 - Train Accuracy:  0.619, Validation Accuracy:  0.622, Loss:  0.577
Epoch   0 Batch  331/538 - Train Accuracy:  0.622, Validation Accuracy:  0.624, Loss:  0.585
Epoch   0 Batch  332/538 - Train Accuracy:  0.601, Validation Accuracy:  0.615, Loss:  0.619
Epoch   0 Batch  333/538 - Train Accuracy:  0.622, Validation Accuracy:  0.621, Loss:  0.584
Epoch   0 Batch  334/538 - Train Accuracy:  0.650, Validation Accuracy:  0.627, Loss:  0.556
Epoch   0 Batch  335/538 - Train Accuracy:  0.624, Validation Accuracy:  0.634, Loss:  0.587
Epoch   0 Batch  336/538 - Train Accuracy:  0.625, Validation Accuracy:  0.631, Loss:  0.576
Epoch   0 Batch  337/538 - Train Accuracy:  0.632, Validation Accuracy:  0.622, Loss:  0.582
Epoch   0 Batch  338/538 - Train Accuracy:  0.595, Validation Accuracy:  0.627, Loss:  0.599
Epoch   0 Batch  339/538 - Train Accuracy:  0.618, Validation Accuracy:  0.622, Loss:  0.581
Epoch   0 Batch  340/538 - Train Accuracy:  0.616, Validation Accuracy:  0.629, Loss:  0.623
Epoch   0 Batch  341/538 - Train Accuracy:  0.599, Validation Accuracy:  0.625, Loss:  0.597
Epoch   0 Batch  342/538 - Train Accuracy:  0.614, Validation Accuracy:  0.625, Loss:  0.578
Epoch   0 Batch  343/538 - Train Accuracy:  0.614, Validation Accuracy:  0.623, Loss:  0.613
Epoch   0 Batch  344/538 - Train Accuracy:  0.609, Validation Accuracy:  0.639, Loss:  0.591
Epoch   0 Batch  345/538 - Train Accuracy:  0.625, Validation Accuracy:  0.640, Loss:  0.583
Epoch   0 Batch  346/538 - Train Accuracy:  0.622, Validation Accuracy:  0.635, Loss:  0.588
Epoch   0 Batch  347/538 - Train Accuracy:  0.617, Validation Accuracy:  0.634, Loss:  0.599
Epoch   0 Batch  348/538 - Train Accuracy:  0.617, Validation Accuracy:  0.634, Loss:  0.556
Epoch   0 Batch  349/538 - Train Accuracy:  0.577, Validation Accuracy:  0.630, Loss:  0.593
Epoch   0 Batch  350/538 - Train Accuracy:  0.616, Validation Accuracy:  0.626, Loss:  0.594
Epoch   0 Batch  351/538 - Train Accuracy:  0.604, Validation Accuracy:  0.620, Loss:  0.616
Epoch   0 Batch  352/538 - Train Accuracy:  0.646, Validation Accuracy:  0.625, Loss:  0.583
Epoch   0 Batch  353/538 - Train Accuracy:  0.627, Validation Accuracy:  0.636, Loss:  0.600
Epoch   0 Batch  354/538 - Train Accuracy:  0.606, Validation Accuracy:  0.633, Loss:  0.606
Epoch   0 Batch  355/538 - Train Accuracy:  0.614, Validation Accuracy:  0.635, Loss:  0.597
Epoch   0 Batch  356/538 - Train Accuracy:  0.629, Validation Accuracy:  0.632, Loss:  0.539
Epoch   0 Batch  357/538 - Train Accuracy:  0.629, Validation Accuracy:  0.634, Loss:  0.572
Epoch   0 Batch  358/538 - Train Accuracy:  0.588, Validation Accuracy:  0.618, Loss:  0.586
Epoch   0 Batch  359/538 - Train Accuracy:  0.633, Validation Accuracy:  0.624, Loss:  0.581
Epoch   0 Batch  360/538 - Train Accuracy:  0.628, Validation Accuracy:  0.623, Loss:  0.587
Epoch   0 Batch  361/538 - Train Accuracy:  0.605, Validation Accuracy:  0.610, Loss:  0.572
Epoch   0 Batch  362/538 - Train Accuracy:  0.622, Validation Accuracy:  0.624, Loss:  0.555
Epoch   0 Batch  363/538 - Train Accuracy:  0.638, Validation Accuracy:  0.633, Loss:  0.545
Epoch   0 Batch  364/538 - Train Accuracy:  0.590, Validation Accuracy:  0.635, Loss:  0.608
Epoch   0 Batch  365/538 - Train Accuracy:  0.621, Validation Accuracy:  0.630, Loss:  0.561
Epoch   0 Batch  366/538 - Train Accuracy:  0.626, Validation Accuracy:  0.630, Loss:  0.584
Epoch   0 Batch  367/538 - Train Accuracy:  0.634, Validation Accuracy:  0.623, Loss:  0.560
Epoch   0 Batch  368/538 - Train Accuracy:  0.682, Validation Accuracy:  0.630, Loss:  0.511
Epoch   0 Batch  369/538 - Train Accuracy:  0.616, Validation Accuracy:  0.624, Loss:  0.572
Epoch   0 Batch  370/538 - Train Accuracy:  0.621, Validation Accuracy:  0.621, Loss:  0.592
Epoch   0 Batch  371/538 - Train Accuracy:  0.630, Validation Accuracy:  0.623, Loss:  0.549
Epoch   0 Batch  372/538 - Train Accuracy:  0.641, Validation Accuracy:  0.637, Loss:  0.565
Epoch   0 Batch  373/538 - Train Accuracy:  0.623, Validation Accuracy:  0.635, Loss:  0.563
Epoch   0 Batch  374/538 - Train Accuracy:  0.615, Validation Accuracy:  0.642, Loss:  0.583
Epoch   0 Batch  375/538 - Train Accuracy:  0.637, Validation Accuracy:  0.634, Loss:  0.537
Epoch   0 Batch  376/538 - Train Accuracy:  0.623, Validation Accuracy:  0.638, Loss:  0.573
Epoch   0 Batch  377/538 - Train Accuracy:  0.631, Validation Accuracy:  0.632, Loss:  0.555
Epoch   0 Batch  378/538 - Train Accuracy:  0.652, Validation Accuracy:  0.641, Loss:  0.534
Epoch   0 Batch  379/538 - Train Accuracy:  0.653, Validation Accuracy:  0.646, Loss:  0.535
Epoch   0 Batch  380/538 - Train Accuracy:  0.612, Validation Accuracy:  0.638, Loss:  0.561
Epoch   0 Batch  381/538 - Train Accuracy:  0.635, Validation Accuracy:  0.643, Loss:  0.522
Epoch   0 Batch  382/538 - Train Accuracy:  0.610, Validation Accuracy:  0.633, Loss:  0.558
Epoch   0 Batch  383/538 - Train Accuracy:  0.631, Validation Accuracy:  0.634, Loss:  0.560
Epoch   0 Batch  384/538 - Train Accuracy:  0.655, Validation Accuracy:  0.634, Loss:  0.532
Epoch   0 Batch  385/538 - Train Accuracy:  0.649, Validation Accuracy:  0.636, Loss:  0.534
Epoch   0 Batch  386/538 - Train Accuracy:  0.629, Validation Accuracy:  0.627, Loss:  0.558
Epoch   0 Batch  387/538 - Train Accuracy:  0.617, Validation Accuracy:  0.629, Loss:  0.553
Epoch   0 Batch  388/538 - Train Accuracy:  0.629, Validation Accuracy:  0.631, Loss:  0.540
Epoch   0 Batch  389/538 - Train Accuracy:  0.627, Validation Accuracy:  0.638, Loss:  0.569
Epoch   0 Batch  390/538 - Train Accuracy:  0.651, Validation Accuracy:  0.637, Loss:  0.530
Epoch   0 Batch  391/538 - Train Accuracy:  0.642, Validation Accuracy:  0.645, Loss:  0.534
Epoch   0 Batch  392/538 - Train Accuracy:  0.649, Validation Accuracy:  0.648, Loss:  0.530
Epoch   0 Batch  393/538 - Train Accuracy:  0.641, Validation Accuracy:  0.644, Loss:  0.519
Epoch   0 Batch  394/538 - Train Accuracy:  0.595, Validation Accuracy:  0.643, Loss:  0.567
Epoch   0 Batch  395/538 - Train Accuracy:  0.639, Validation Accuracy:  0.652, Loss:  0.562
Epoch   0 Batch  396/538 - Train Accuracy:  0.622, Validation Accuracy:  0.661, Loss:  0.542
Epoch   0 Batch  397/538 - Train Accuracy:  0.620, Validation Accuracy:  0.652, Loss:  0.553
Epoch   0 Batch  398/538 - Train Accuracy:  0.619, Validation Accuracy:  0.655, Loss:  0.554
Epoch   0 Batch  399/538 - Train Accuracy:  0.619, Validation Accuracy:  0.656, Loss:  0.568
Epoch   0 Batch  400/538 - Train Accuracy:  0.635, Validation Accuracy:  0.653, Loss:  0.528
Epoch   0 Batch  401/538 - Train Accuracy:  0.628, Validation Accuracy:  0.654, Loss:  0.547
Epoch   0 Batch  402/538 - Train Accuracy:  0.642, Validation Accuracy:  0.646, Loss:  0.532
Epoch   0 Batch  403/538 - Train Accuracy:  0.633, Validation Accuracy:  0.657, Loss:  0.546
Epoch   0 Batch  404/538 - Train Accuracy:  0.656, Validation Accuracy:  0.663, Loss:  0.521
Epoch   0 Batch  405/538 - Train Accuracy:  0.640, Validation Accuracy:  0.651, Loss:  0.519
Epoch   0 Batch  406/538 - Train Accuracy:  0.655, Validation Accuracy:  0.651, Loss:  0.512
Epoch   0 Batch  407/538 - Train Accuracy:  0.658, Validation Accuracy:  0.663, Loss:  0.539
Epoch   0 Batch  408/538 - Train Accuracy:  0.619, Validation Accuracy:  0.662, Loss:  0.557
Epoch   0 Batch  409/538 - Train Accuracy:  0.630, Validation Accuracy:  0.654, Loss:  0.549
Epoch   0 Batch  410/538 - Train Accuracy:  0.629, Validation Accuracy:  0.649, Loss:  0.534
Epoch   0 Batch  411/538 - Train Accuracy:  0.636, Validation Accuracy:  0.654, Loss:  0.515
Epoch   0 Batch  412/538 - Train Accuracy:  0.671, Validation Accuracy:  0.667, Loss:  0.512
Epoch   0 Batch  413/538 - Train Accuracy:  0.651, Validation Accuracy:  0.670, Loss:  0.529
Epoch   0 Batch  414/538 - Train Accuracy:  0.634, Validation Accuracy:  0.657, Loss:  0.548
Epoch   0 Batch  415/538 - Train Accuracy:  0.614, Validation Accuracy:  0.653, Loss:  0.540
Epoch   0 Batch  416/538 - Train Accuracy:  0.678, Validation Accuracy:  0.661, Loss:  0.504
Epoch   0 Batch  417/538 - Train Accuracy:  0.644, Validation Accuracy:  0.665, Loss:  0.511
Epoch   0 Batch  418/538 - Train Accuracy:  0.637, Validation Accuracy:  0.661, Loss:  0.532
Epoch   0 Batch  419/538 - Train Accuracy:  0.649, Validation Accuracy:  0.658, Loss:  0.506
Epoch   0 Batch  420/538 - Train Accuracy:  0.641, Validation Accuracy:  0.655, Loss:  0.532
Epoch   0 Batch  421/538 - Train Accuracy:  0.649, Validation Accuracy:  0.659, Loss:  0.492
Epoch   0 Batch  422/538 - Train Accuracy:  0.649, Validation Accuracy:  0.653, Loss:  0.523
Epoch   0 Batch  423/538 - Train Accuracy:  0.648, Validation Accuracy:  0.654, Loss:  0.527
Epoch   0 Batch  424/538 - Train Accuracy:  0.623, Validation Accuracy:  0.658, Loss:  0.521
Epoch   0 Batch  425/538 - Train Accuracy:  0.649, Validation Accuracy:  0.660, Loss:  0.514
Epoch   0 Batch  426/538 - Train Accuracy:  0.654, Validation Accuracy:  0.665, Loss:  0.511
Epoch   0 Batch  427/538 - Train Accuracy:  0.638, Validation Accuracy:  0.665, Loss:  0.532
Epoch   0 Batch  428/538 - Train Accuracy:  0.665, Validation Accuracy:  0.660, Loss:  0.490
Epoch   0 Batch  429/538 - Train Accuracy:  0.664, Validation Accuracy:  0.669, Loss:  0.507
Epoch   0 Batch  430/538 - Train Accuracy:  0.659, Validation Accuracy:  0.670, Loss:  0.522
Epoch   0 Batch  431/538 - Train Accuracy:  0.664, Validation Accuracy:  0.663, Loss:  0.510
Epoch   0 Batch  432/538 - Train Accuracy:  0.701, Validation Accuracy:  0.660, Loss:  0.470
Epoch   0 Batch  433/538 - Train Accuracy:  0.627, Validation Accuracy:  0.668, Loss:  0.536
Epoch   0 Batch  434/538 - Train Accuracy:  0.636, Validation Accuracy:  0.672, Loss:  0.519
Epoch   0 Batch  435/538 - Train Accuracy:  0.640, Validation Accuracy:  0.666, Loss:  0.517
Epoch   0 Batch  436/538 - Train Accuracy:  0.624, Validation Accuracy:  0.647, Loss:  0.521
Epoch   0 Batch  437/538 - Train Accuracy:  0.617, Validation Accuracy:  0.668, Loss:  0.521
Epoch   0 Batch  438/538 - Train Accuracy:  0.653, Validation Accuracy:  0.665, Loss:  0.501
Epoch   0 Batch  439/538 - Train Accuracy:  0.676, Validation Accuracy:  0.664, Loss:  0.500
Epoch   0 Batch  440/538 - Train Accuracy:  0.646, Validation Accuracy:  0.666, Loss:  0.534
Epoch   0 Batch  441/538 - Train Accuracy:  0.644, Validation Accuracy:  0.665, Loss:  0.529
Epoch   0 Batch  442/538 - Train Accuracy:  0.662, Validation Accuracy:  0.674, Loss:  0.474
Epoch   0 Batch  443/538 - Train Accuracy:  0.667, Validation Accuracy:  0.671, Loss:  0.497
Epoch   0 Batch  444/538 - Train Accuracy:  0.674, Validation Accuracy:  0.668, Loss:  0.480
Epoch   0 Batch  445/538 - Train Accuracy:  0.666, Validation Accuracy:  0.673, Loss:  0.499
Epoch   0 Batch  446/538 - Train Accuracy:  0.666, Validation Accuracy:  0.665, Loss:  0.488
Epoch   0 Batch  447/538 - Train Accuracy:  0.639, Validation Accuracy:  0.668, Loss:  0.521
Epoch   0 Batch  448/538 - Train Accuracy:  0.666, Validation Accuracy:  0.670, Loss:  0.477
Epoch   0 Batch  449/538 - Train Accuracy:  0.647, Validation Accuracy:  0.664, Loss:  0.513
Epoch   0 Batch  450/538 - Train Accuracy:  0.674, Validation Accuracy:  0.675, Loss:  0.499
Epoch   0 Batch  451/538 - Train Accuracy:  0.644, Validation Accuracy:  0.671, Loss:  0.494
Epoch   0 Batch  452/538 - Train Accuracy:  0.667, Validation Accuracy:  0.669, Loss:  0.484
Epoch   0 Batch  453/538 - Train Accuracy:  0.639, Validation Accuracy:  0.676, Loss:  0.512
Epoch   0 Batch  454/538 - Train Accuracy:  0.676, Validation Accuracy:  0.671, Loss:  0.482
Epoch   0 Batch  455/538 - Train Accuracy:  0.676, Validation Accuracy:  0.663, Loss:  0.458
Epoch   0 Batch  456/538 - Train Accuracy:  0.719, Validation Accuracy:  0.654, Loss:  0.439
Epoch   0 Batch  457/538 - Train Accuracy:  0.644, Validation Accuracy:  0.667, Loss:  0.514
Epoch   0 Batch  458/538 - Train Accuracy:  0.664, Validation Accuracy:  0.673, Loss:  0.471
Epoch   0 Batch  459/538 - Train Accuracy:  0.683, Validation Accuracy:  0.672, Loss:  0.487
Epoch   0 Batch  460/538 - Train Accuracy:  0.647, Validation Accuracy:  0.667, Loss:  0.467
Epoch   0 Batch  461/538 - Train Accuracy:  0.628, Validation Accuracy:  0.680, Loss:  0.525
Epoch   0 Batch  462/538 - Train Accuracy:  0.659, Validation Accuracy:  0.675, Loss:  0.482
Epoch   0 Batch  463/538 - Train Accuracy:  0.643, Validation Accuracy:  0.674, Loss:  0.489
Epoch   0 Batch  464/538 - Train Accuracy:  0.658, Validation Accuracy:  0.669, Loss:  0.491
Epoch   0 Batch  465/538 - Train Accuracy:  0.645, Validation Accuracy:  0.668, Loss:  0.496
Epoch   0 Batch  466/538 - Train Accuracy:  0.652, Validation Accuracy:  0.673, Loss:  0.499
Epoch   0 Batch  467/538 - Train Accuracy:  0.655, Validation Accuracy:  0.674, Loss:  0.483
Epoch   0 Batch  468/538 - Train Accuracy:  0.677, Validation Accuracy:  0.661, Loss:  0.490
Epoch   0 Batch  469/538 - Train Accuracy:  0.672, Validation Accuracy:  0.661, Loss:  0.484
Epoch   0 Batch  470/538 - Train Accuracy:  0.663, Validation Accuracy:  0.660, Loss:  0.471
Epoch   0 Batch  471/538 - Train Accuracy:  0.665, Validation Accuracy:  0.666, Loss:  0.469
Epoch   0 Batch  472/538 - Train Accuracy:  0.686, Validation Accuracy:  0.665, Loss:  0.457
Epoch   0 Batch  473/538 - Train Accuracy:  0.649, Validation Accuracy:  0.665, Loss:  0.483
Epoch   0 Batch  474/538 - Train Accuracy:  0.674, Validation Accuracy:  0.663, Loss:  0.452
Epoch   0 Batch  475/538 - Train Accuracy:  0.645, Validation Accuracy:  0.652, Loss:  0.465
Epoch   0 Batch  476/538 - Train Accuracy:  0.637, Validation Accuracy:  0.648, Loss:  0.485
Epoch   0 Batch  477/538 - Train Accuracy:  0.680, Validation Accuracy:  0.657, Loss:  0.472
Epoch   0 Batch  478/538 - Train Accuracy:  0.693, Validation Accuracy:  0.665, Loss:  0.447
Epoch   0 Batch  479/538 - Train Accuracy:  0.698, Validation Accuracy:  0.656, Loss:  0.436
Epoch   0 Batch  480/538 - Train Accuracy:  0.666, Validation Accuracy:  0.649, Loss:  0.455
Epoch   0 Batch  481/538 - Train Accuracy:  0.701, Validation Accuracy:  0.661, Loss:  0.443
Epoch   0 Batch  482/538 - Train Accuracy:  0.688, Validation Accuracy:  0.658, Loss:  0.418
Epoch   0 Batch  483/538 - Train Accuracy:  0.652, Validation Accuracy:  0.644, Loss:  0.482
Epoch   0 Batch  484/538 - Train Accuracy:  0.687, Validation Accuracy:  0.650, Loss:  0.467
Epoch   0 Batch  485/538 - Train Accuracy:  0.659, Validation Accuracy:  0.660, Loss:  0.457
Epoch   0 Batch  486/538 - Train Accuracy:  0.672, Validation Accuracy:  0.654, Loss:  0.442
Epoch   0 Batch  487/538 - Train Accuracy:  0.661, Validation Accuracy:  0.645, Loss:  0.439
Epoch   0 Batch  488/538 - Train Accuracy:  0.681, Validation Accuracy:  0.665, Loss:  0.462
Epoch   0 Batch  489/538 - Train Accuracy:  0.650, Validation Accuracy:  0.679, Loss:  0.483
Epoch   0 Batch  490/538 - Train Accuracy:  0.673, Validation Accuracy:  0.688, Loss:  0.459
Epoch   0 Batch  491/538 - Train Accuracy:  0.650, Validation Accuracy:  0.667, Loss:  0.476
Epoch   0 Batch  492/538 - Train Accuracy:  0.659, Validation Accuracy:  0.685, Loss:  0.470
Epoch   0 Batch  493/538 - Train Accuracy:  0.642, Validation Accuracy:  0.679, Loss:  0.449
Epoch   0 Batch  494/538 - Train Accuracy:  0.663, Validation Accuracy:  0.691, Loss:  0.476
Epoch   0 Batch  495/538 - Train Accuracy:  0.651, Validation Accuracy:  0.663, Loss:  0.463
Epoch   0 Batch  496/538 - Train Accuracy:  0.660, Validation Accuracy:  0.676, Loss:  0.450
Epoch   0 Batch  497/538 - Train Accuracy:  0.667, Validation Accuracy:  0.673, Loss:  0.442
Epoch   0 Batch  498/538 - Train Accuracy:  0.642, Validation Accuracy:  0.671, Loss:  0.452
Epoch   0 Batch  499/538 - Train Accuracy:  0.677, Validation Accuracy:  0.673, Loss:  0.435
Epoch   0 Batch  500/538 - Train Accuracy:  0.701, Validation Accuracy:  0.681, Loss:  0.417
Epoch   0 Batch  501/538 - Train Accuracy:  0.703, Validation Accuracy:  0.687, Loss:  0.453
Epoch   0 Batch  502/538 - Train Accuracy:  0.670, Validation Accuracy:  0.686, Loss:  0.454
Epoch   0 Batch  503/538 - Train Accuracy:  0.686, Validation Accuracy:  0.685, Loss:  0.440
Epoch   0 Batch  504/538 - Train Accuracy:  0.670, Validation Accuracy:  0.674, Loss:  0.440
Epoch   0 Batch  505/538 - Train Accuracy:  0.675, Validation Accuracy:  0.686, Loss:  0.438
Epoch   0 Batch  506/538 - Train Accuracy:  0.692, Validation Accuracy:  0.682, Loss:  0.445
Epoch   0 Batch  507/538 - Train Accuracy:  0.638, Validation Accuracy:  0.676, Loss:  0.459
Epoch   0 Batch  508/538 - Train Accuracy:  0.675, Validation Accuracy:  0.676, Loss:  0.429
Epoch   0 Batch  509/538 - Train Accuracy:  0.668, Validation Accuracy:  0.675, Loss:  0.445
Epoch   0 Batch  510/538 - Train Accuracy:  0.678, Validation Accuracy:  0.683, Loss:  0.429
Epoch   0 Batch  511/538 - Train Accuracy:  0.700, Validation Accuracy:  0.676, Loss:  0.425
Epoch   0 Batch  512/538 - Train Accuracy:  0.698, Validation Accuracy:  0.686, Loss:  0.427
Epoch   0 Batch  513/538 - Train Accuracy:  0.666, Validation Accuracy:  0.674, Loss:  0.446
Epoch   0 Batch  514/538 - Train Accuracy:  0.673, Validation Accuracy:  0.694, Loss:  0.453
Epoch   0 Batch  515/538 - Train Accuracy:  0.675, Validation Accuracy:  0.686, Loss:  0.443
Epoch   0 Batch  516/538 - Train Accuracy:  0.671, Validation Accuracy:  0.681, Loss:  0.435
Epoch   0 Batch  517/538 - Train Accuracy:  0.708, Validation Accuracy:  0.674, Loss:  0.427
Epoch   0 Batch  518/538 - Train Accuracy:  0.659, Validation Accuracy:  0.673, Loss:  0.462
Epoch   0 Batch  519/538 - Train Accuracy:  0.708, Validation Accuracy:  0.685, Loss:  0.431
Epoch   0 Batch  520/538 - Train Accuracy:  0.671, Validation Accuracy:  0.673, Loss:  0.452
Epoch   0 Batch  521/538 - Train Accuracy:  0.671, Validation Accuracy:  0.675, Loss:  0.458
Epoch   0 Batch  522/538 - Train Accuracy:  0.666, Validation Accuracy:  0.685, Loss:  0.437
Epoch   0 Batch  523/538 - Train Accuracy:  0.671, Validation Accuracy:  0.687, Loss:  0.431
Epoch   0 Batch  524/538 - Train Accuracy:  0.646, Validation Accuracy:  0.676, Loss:  0.450
Epoch   0 Batch  525/538 - Train Accuracy:  0.731, Validation Accuracy:  0.678, Loss:  0.412
Epoch   0 Batch  526/538 - Train Accuracy:  0.699, Validation Accuracy:  0.691, Loss:  0.408
Epoch   0 Batch  527/538 - Train Accuracy:  0.695, Validation Accuracy:  0.694, Loss:  0.428
Epoch   0 Batch  528/538 - Train Accuracy:  0.666, Validation Accuracy:  0.686, Loss:  0.453
Epoch   0 Batch  529/538 - Train Accuracy:  0.692, Validation Accuracy:  0.693, Loss:  0.415
Epoch   0 Batch  530/538 - Train Accuracy:  0.685, Validation Accuracy:  0.702, Loss:  0.429
Epoch   0 Batch  531/538 - Train Accuracy:  0.696, Validation Accuracy:  0.694, Loss:  0.432
Epoch   0 Batch  532/538 - Train Accuracy:  0.685, Validation Accuracy:  0.682, Loss:  0.421
Epoch   0 Batch  533/538 - Train Accuracy:  0.716, Validation Accuracy:  0.690, Loss:  0.432
Epoch   0 Batch  534/538 - Train Accuracy:  0.703, Validation Accuracy:  0.685, Loss:  0.391
Epoch   0 Batch  535/538 - Train Accuracy:  0.680, Validation Accuracy:  0.679, Loss:  0.399
Epoch   0 Batch  536/538 - Train Accuracy:  0.712, Validation Accuracy:  0.700, Loss:  0.423
Epoch   1 Batch    0/538 - Train Accuracy:  0.680, Validation Accuracy:  0.694, Loss:  0.409
Epoch   1 Batch    1/538 - Train Accuracy:  0.694, Validation Accuracy:  0.694, Loss:  0.418
Epoch   1 Batch    2/538 - Train Accuracy:  0.683, Validation Accuracy:  0.706, Loss:  0.437
Epoch   1 Batch    3/538 - Train Accuracy:  0.688, Validation Accuracy:  0.700, Loss:  0.414
Epoch   1 Batch    4/538 - Train Accuracy:  0.712, Validation Accuracy:  0.696, Loss:  0.416
Epoch   1 Batch    5/538 - Train Accuracy:  0.690, Validation Accuracy:  0.697, Loss:  0.417
Epoch   1 Batch    6/538 - Train Accuracy:  0.715, Validation Accuracy:  0.697, Loss:  0.404
Epoch   1 Batch    7/538 - Train Accuracy:  0.706, Validation Accuracy:  0.691, Loss:  0.417
Epoch   1 Batch    8/538 - Train Accuracy:  0.702, Validation Accuracy:  0.679, Loss:  0.424
Epoch   1 Batch    9/538 - Train Accuracy:  0.688, Validation Accuracy:  0.689, Loss:  0.417
Epoch   1 Batch   10/538 - Train Accuracy:  0.691, Validation Accuracy:  0.694, Loss:  0.432
Epoch   1 Batch   11/538 - Train Accuracy:  0.702, Validation Accuracy:  0.693, Loss:  0.411
Epoch   1 Batch   12/538 - Train Accuracy:  0.672, Validation Accuracy:  0.686, Loss:  0.415
Epoch   1 Batch   13/538 - Train Accuracy:  0.726, Validation Accuracy:  0.682, Loss:  0.384
Epoch   1 Batch   14/538 - Train Accuracy:  0.704, Validation Accuracy:  0.686, Loss:  0.406
Epoch   1 Batch   15/538 - Train Accuracy:  0.718, Validation Accuracy:  0.694, Loss:  0.381
Epoch   1 Batch   16/538 - Train Accuracy:  0.713, Validation Accuracy:  0.698, Loss:  0.383
Epoch   1 Batch   17/538 - Train Accuracy:  0.687, Validation Accuracy:  0.709, Loss:  0.404
Epoch   1 Batch   18/538 - Train Accuracy:  0.689, Validation Accuracy:  0.699, Loss:  0.414
Epoch   1 Batch   19/538 - Train Accuracy:  0.715, Validation Accuracy:  0.698, Loss:  0.409
Epoch   1 Batch   20/538 - Train Accuracy:  0.714, Validation Accuracy:  0.700, Loss:  0.402
Epoch   1 Batch   21/538 - Train Accuracy:  0.661, Validation Accuracy:  0.684, Loss:  0.424
Epoch   1 Batch   22/538 - Train Accuracy:  0.685, Validation Accuracy:  0.715, Loss:  0.432
Epoch   1 Batch   23/538 - Train Accuracy:  0.711, Validation Accuracy:  0.714, Loss:  0.434
Epoch   1 Batch   24/538 - Train Accuracy:  0.679, Validation Accuracy:  0.689, Loss:  0.391
Epoch   1 Batch   25/538 - Train Accuracy:  0.702, Validation Accuracy:  0.710, Loss:  0.426
Epoch   1 Batch   26/538 - Train Accuracy:  0.684, Validation Accuracy:  0.704, Loss:  0.436
Epoch   1 Batch   27/538 - Train Accuracy:  0.693, Validation Accuracy:  0.692, Loss:  0.393
Epoch   1 Batch   28/538 - Train Accuracy:  0.723, Validation Accuracy:  0.707, Loss:  0.375
Epoch   1 Batch   29/538 - Train Accuracy:  0.711, Validation Accuracy:  0.708, Loss:  0.379
Epoch   1 Batch   30/538 - Train Accuracy:  0.700, Validation Accuracy:  0.699, Loss:  0.437
Epoch   1 Batch   31/538 - Train Accuracy:  0.698, Validation Accuracy:  0.694, Loss:  0.371
Epoch   1 Batch   32/538 - Train Accuracy:  0.682, Validation Accuracy:  0.700, Loss:  0.388
Epoch   1 Batch   33/538 - Train Accuracy:  0.725, Validation Accuracy:  0.722, Loss:  0.388
Epoch   1 Batch   34/538 - Train Accuracy:  0.705, Validation Accuracy:  0.704, Loss:  0.395
Epoch   1 Batch   35/538 - Train Accuracy:  0.675, Validation Accuracy:  0.689, Loss:  0.390
Epoch   1 Batch   36/538 - Train Accuracy:  0.729, Validation Accuracy:  0.706, Loss:  0.384
Epoch   1 Batch   37/538 - Train Accuracy:  0.710, Validation Accuracy:  0.695, Loss:  0.388
Epoch   1 Batch   38/538 - Train Accuracy:  0.690, Validation Accuracy:  0.713, Loss:  0.398
Epoch   1 Batch   39/538 - Train Accuracy:  0.698, Validation Accuracy:  0.706, Loss:  0.397
Epoch   1 Batch   40/538 - Train Accuracy:  0.737, Validation Accuracy:  0.723, Loss:  0.345
Epoch   1 Batch   41/538 - Train Accuracy:  0.730, Validation Accuracy:  0.729, Loss:  0.386
Epoch   1 Batch   42/538 - Train Accuracy:  0.733, Validation Accuracy:  0.730, Loss:  0.381
Epoch   1 Batch   43/538 - Train Accuracy:  0.707, Validation Accuracy:  0.728, Loss:  0.398
Epoch   1 Batch   44/538 - Train Accuracy:  0.700, Validation Accuracy:  0.733, Loss:  0.405
Epoch   1 Batch   45/538 - Train Accuracy:  0.727, Validation Accuracy:  0.731, Loss:  0.355
Epoch   1 Batch   46/538 - Train Accuracy:  0.725, Validation Accuracy:  0.721, Loss:  0.361
Epoch   1 Batch   47/538 - Train Accuracy:  0.710, Validation Accuracy:  0.720, Loss:  0.363
Epoch   1 Batch   48/538 - Train Accuracy:  0.741, Validation Accuracy:  0.721, Loss:  0.346
Epoch   1 Batch   49/538 - Train Accuracy:  0.717, Validation Accuracy:  0.723, Loss:  0.385
Epoch   1 Batch   50/538 - Train Accuracy:  0.731, Validation Accuracy:  0.724, Loss:  0.373
Epoch   1 Batch   51/538 - Train Accuracy:  0.687, Validation Accuracy:  0.707, Loss:  0.410
Epoch   1 Batch   52/538 - Train Accuracy:  0.740, Validation Accuracy:  0.726, Loss:  0.381
Epoch   1 Batch   53/538 - Train Accuracy:  0.718, Validation Accuracy:  0.705, Loss:  0.337
Epoch   1 Batch   54/538 - Train Accuracy:  0.719, Validation Accuracy:  0.709, Loss:  0.359
Epoch   1 Batch   55/538 - Train Accuracy:  0.711, Validation Accuracy:  0.704, Loss:  0.372
Epoch   1 Batch   56/538 - Train Accuracy:  0.717, Validation Accuracy:  0.707, Loss:  0.353
Epoch   1 Batch   57/538 - Train Accuracy:  0.679, Validation Accuracy:  0.715, Loss:  0.397
Epoch   1 Batch   58/538 - Train Accuracy:  0.704, Validation Accuracy:  0.713, Loss:  0.379
Epoch   1 Batch   59/538 - Train Accuracy:  0.719, Validation Accuracy:  0.715, Loss:  0.373
Epoch   1 Batch   60/538 - Train Accuracy:  0.723, Validation Accuracy:  0.723, Loss:  0.374
Epoch   1 Batch   61/538 - Train Accuracy:  0.726, Validation Accuracy:  0.714, Loss:  0.363
Epoch   1 Batch   62/538 - Train Accuracy:  0.743, Validation Accuracy:  0.718, Loss:  0.354
Epoch   1 Batch   63/538 - Train Accuracy:  0.741, Validation Accuracy:  0.715, Loss:  0.336
Epoch   1 Batch   64/538 - Train Accuracy:  0.737, Validation Accuracy:  0.709, Loss:  0.343
Epoch   1 Batch   65/538 - Train Accuracy:  0.711, Validation Accuracy:  0.714, Loss:  0.367
Epoch   1 Batch   66/538 - Train Accuracy:  0.724, Validation Accuracy:  0.707, Loss:  0.339
Epoch   1 Batch   67/538 - Train Accuracy:  0.729, Validation Accuracy:  0.709, Loss:  0.348
Epoch   1 Batch   68/538 - Train Accuracy:  0.732, Validation Accuracy:  0.713, Loss:  0.344
Epoch   1 Batch   69/538 - Train Accuracy:  0.740, Validation Accuracy:  0.716, Loss:  0.352
Epoch   1 Batch   70/538 - Train Accuracy:  0.754, Validation Accuracy:  0.714, Loss:  0.335
Epoch   1 Batch   71/538 - Train Accuracy:  0.685, Validation Accuracy:  0.707, Loss:  0.360
Epoch   1 Batch   72/538 - Train Accuracy:  0.755, Validation Accuracy:  0.722, Loss:  0.360
Epoch   1 Batch   73/538 - Train Accuracy:  0.709, Validation Accuracy:  0.730, Loss:  0.363
Epoch   1 Batch   74/538 - Train Accuracy:  0.741, Validation Accuracy:  0.719, Loss:  0.330
Epoch   1 Batch   75/538 - Train Accuracy:  0.733, Validation Accuracy:  0.714, Loss:  0.329
Epoch   1 Batch   76/538 - Train Accuracy:  0.741, Validation Accuracy:  0.723, Loss:  0.360
Epoch   1 Batch   77/538 - Train Accuracy:  0.737, Validation Accuracy:  0.727, Loss:  0.338
Epoch   1 Batch   78/538 - Train Accuracy:  0.750, Validation Accuracy:  0.724, Loss:  0.333
Epoch   1 Batch   79/538 - Train Accuracy:  0.759, Validation Accuracy:  0.722, Loss:  0.324
Epoch   1 Batch   80/538 - Train Accuracy:  0.728, Validation Accuracy:  0.719, Loss:  0.352
Epoch   1 Batch   81/538 - Train Accuracy:  0.739, Validation Accuracy:  0.727, Loss:  0.346
Epoch   1 Batch   82/538 - Train Accuracy:  0.729, Validation Accuracy:  0.727, Loss:  0.341
Epoch   1 Batch   83/538 - Train Accuracy:  0.727, Validation Accuracy:  0.737, Loss:  0.340
Epoch   1 Batch   84/538 - Train Accuracy:  0.727, Validation Accuracy:  0.736, Loss:  0.344
Epoch   1 Batch   85/538 - Train Accuracy:  0.759, Validation Accuracy:  0.725, Loss:  0.313
Epoch   1 Batch   86/538 - Train Accuracy:  0.746, Validation Accuracy:  0.740, Loss:  0.347
Epoch   1 Batch   87/538 - Train Accuracy:  0.727, Validation Accuracy:  0.714, Loss:  0.338
Epoch   1 Batch   88/538 - Train Accuracy:  0.754, Validation Accuracy:  0.722, Loss:  0.346
Epoch   1 Batch   89/538 - Train Accuracy:  0.739, Validation Accuracy:  0.731, Loss:  0.331
Epoch   1 Batch   90/538 - Train Accuracy:  0.743, Validation Accuracy:  0.738, Loss:  0.338
Epoch   1 Batch   91/538 - Train Accuracy:  0.762, Validation Accuracy:  0.745, Loss:  0.336
Epoch   1 Batch   92/538 - Train Accuracy:  0.737, Validation Accuracy:  0.744, Loss:  0.336
Epoch   1 Batch   93/538 - Train Accuracy:  0.726, Validation Accuracy:  0.738, Loss:  0.337
Epoch   1 Batch   94/538 - Train Accuracy:  0.761, Validation Accuracy:  0.742, Loss:  0.331
Epoch   1 Batch   95/538 - Train Accuracy:  0.766, Validation Accuracy:  0.743, Loss:  0.305
Epoch   1 Batch   96/538 - Train Accuracy:  0.768, Validation Accuracy:  0.742, Loss:  0.301
Epoch   1 Batch   97/538 - Train Accuracy:  0.747, Validation Accuracy:  0.741, Loss:  0.321
Epoch   1 Batch   98/538 - Train Accuracy:  0.771, Validation Accuracy:  0.731, Loss:  0.315
Epoch   1 Batch   99/538 - Train Accuracy:  0.725, Validation Accuracy:  0.735, Loss:  0.324
Epoch   1 Batch  100/538 - Train Accuracy:  0.749, Validation Accuracy:  0.740, Loss:  0.316
Epoch   1 Batch  101/538 - Train Accuracy:  0.734, Validation Accuracy:  0.726, Loss:  0.336
Epoch   1 Batch  102/538 - Train Accuracy:  0.769, Validation Accuracy:  0.733, Loss:  0.320
Epoch   1 Batch  103/538 - Train Accuracy:  0.766, Validation Accuracy:  0.732, Loss:  0.313
Epoch   1 Batch  104/538 - Train Accuracy:  0.756, Validation Accuracy:  0.724, Loss:  0.313
Epoch   1 Batch  105/538 - Train Accuracy:  0.735, Validation Accuracy:  0.721, Loss:  0.307
Epoch   1 Batch  106/538 - Train Accuracy:  0.740, Validation Accuracy:  0.738, Loss:  0.315
Epoch   1 Batch  107/538 - Train Accuracy:  0.729, Validation Accuracy:  0.738, Loss:  0.333
Epoch   1 Batch  108/538 - Train Accuracy:  0.746, Validation Accuracy:  0.740, Loss:  0.325
Epoch   1 Batch  109/538 - Train Accuracy:  0.782, Validation Accuracy:  0.741, Loss:  0.304
Epoch   1 Batch  110/538 - Train Accuracy:  0.762, Validation Accuracy:  0.746, Loss:  0.317
Epoch   1 Batch  111/538 - Train Accuracy:  0.778, Validation Accuracy:  0.753, Loss:  0.301
Epoch   1 Batch  112/538 - Train Accuracy:  0.776, Validation Accuracy:  0.752, Loss:  0.315
Epoch   1 Batch  113/538 - Train Accuracy:  0.748, Validation Accuracy:  0.744, Loss:  0.334
Epoch   1 Batch  114/538 - Train Accuracy:  0.769, Validation Accuracy:  0.745, Loss:  0.305
Epoch   1 Batch  115/538 - Train Accuracy:  0.766, Validation Accuracy:  0.753, Loss:  0.321
Epoch   1 Batch  116/538 - Train Accuracy:  0.761, Validation Accuracy:  0.753, Loss:  0.324
Epoch   1 Batch  117/538 - Train Accuracy:  0.772, Validation Accuracy:  0.751, Loss:  0.302
Epoch   1 Batch  118/538 - Train Accuracy:  0.772, Validation Accuracy:  0.740, Loss:  0.292
Epoch   1 Batch  119/538 - Train Accuracy:  0.813, Validation Accuracy:  0.739, Loss:  0.282
Epoch   1 Batch  120/538 - Train Accuracy:  0.761, Validation Accuracy:  0.741, Loss:  0.286
Epoch   1 Batch  121/538 - Train Accuracy:  0.759, Validation Accuracy:  0.740, Loss:  0.299
Epoch   1 Batch  122/538 - Train Accuracy:  0.768, Validation Accuracy:  0.744, Loss:  0.288
Epoch   1 Batch  123/538 - Train Accuracy:  0.787, Validation Accuracy:  0.750, Loss:  0.276
Epoch   1 Batch  124/538 - Train Accuracy:  0.764, Validation Accuracy:  0.751, Loss:  0.270
Epoch   1 Batch  125/538 - Train Accuracy:  0.797, Validation Accuracy:  0.753, Loss:  0.289
Epoch   1 Batch  126/538 - Train Accuracy:  0.772, Validation Accuracy:  0.752, Loss:  0.276
Epoch   1 Batch  127/538 - Train Accuracy:  0.754, Validation Accuracy:  0.751, Loss:  0.312
Epoch   1 Batch  128/538 - Train Accuracy:  0.771, Validation Accuracy:  0.742, Loss:  0.289
Epoch   1 Batch  129/538 - Train Accuracy:  0.756, Validation Accuracy:  0.732, Loss:  0.280
Epoch   1 Batch  130/538 - Train Accuracy:  0.764, Validation Accuracy:  0.742, Loss:  0.284
Epoch   1 Batch  131/538 - Train Accuracy:  0.742, Validation Accuracy:  0.740, Loss:  0.307
Epoch   1 Batch  132/538 - Train Accuracy:  0.738, Validation Accuracy:  0.737, Loss:  0.297
Epoch   1 Batch  133/538 - Train Accuracy:  0.774, Validation Accuracy:  0.751, Loss:  0.273
Epoch   1 Batch  134/538 - Train Accuracy:  0.733, Validation Accuracy:  0.749, Loss:  0.302
Epoch   1 Batch  135/538 - Train Accuracy:  0.761, Validation Accuracy:  0.751, Loss:  0.290
Epoch   1 Batch  136/538 - Train Accuracy:  0.750, Validation Accuracy:  0.756, Loss:  0.289
Epoch   1 Batch  137/538 - Train Accuracy:  0.755, Validation Accuracy:  0.766, Loss:  0.287
Epoch   1 Batch  138/538 - Train Accuracy:  0.782, Validation Accuracy:  0.762, Loss:  0.284
Epoch   1 Batch  139/538 - Train Accuracy:  0.763, Validation Accuracy:  0.764, Loss:  0.305
Epoch   1 Batch  140/538 - Train Accuracy:  0.744, Validation Accuracy:  0.750, Loss:  0.313
Epoch   1 Batch  141/538 - Train Accuracy:  0.782, Validation Accuracy:  0.747, Loss:  0.293
Epoch   1 Batch  142/538 - Train Accuracy:  0.800, Validation Accuracy:  0.754, Loss:  0.276
Epoch   1 Batch  143/538 - Train Accuracy:  0.764, Validation Accuracy:  0.757, Loss:  0.290
Epoch   1 Batch  144/538 - Train Accuracy:  0.777, Validation Accuracy:  0.763, Loss:  0.293
Epoch   1 Batch  145/538 - Train Accuracy:  0.754, Validation Accuracy:  0.753, Loss:  0.287
Epoch   1 Batch  146/538 - Train Accuracy:  0.774, Validation Accuracy:  0.758, Loss:  0.278
Epoch   1 Batch  147/538 - Train Accuracy:  0.785, Validation Accuracy:  0.763, Loss:  0.270
Epoch   1 Batch  148/538 - Train Accuracy:  0.746, Validation Accuracy:  0.753, Loss:  0.299
Epoch   1 Batch  149/538 - Train Accuracy:  0.793, Validation Accuracy:  0.765, Loss:  0.266
Epoch   1 Batch  150/538 - Train Accuracy:  0.777, Validation Accuracy:  0.768, Loss:  0.273
Epoch   1 Batch  151/538 - Train Accuracy:  0.757, Validation Accuracy:  0.764, Loss:  0.270
Epoch   1 Batch  152/538 - Train Accuracy:  0.775, Validation Accuracy:  0.762, Loss:  0.273
Epoch   1 Batch  153/538 - Train Accuracy:  0.764, Validation Accuracy:  0.759, Loss:  0.296
Epoch   1 Batch  154/538 - Train Accuracy:  0.755, Validation Accuracy:  0.762, Loss:  0.263
Epoch   1 Batch  155/538 - Train Accuracy:  0.768, Validation Accuracy:  0.760, Loss:  0.277
Epoch   1 Batch  156/538 - Train Accuracy:  0.750, Validation Accuracy:  0.764, Loss:  0.282
Epoch   1 Batch  157/538 - Train Accuracy:  0.797, Validation Accuracy:  0.765, Loss:  0.255
Epoch   1 Batch  158/538 - Train Accuracy:  0.808, Validation Accuracy:  0.778, Loss:  0.289
Epoch   1 Batch  159/538 - Train Accuracy:  0.763, Validation Accuracy:  0.766, Loss:  0.278
Epoch   1 Batch  160/538 - Train Accuracy:  0.754, Validation Accuracy:  0.761, Loss:  0.264
Epoch   1 Batch  161/538 - Train Accuracy:  0.764, Validation Accuracy:  0.760, Loss:  0.273
Epoch   1 Batch  162/538 - Train Accuracy:  0.792, Validation Accuracy:  0.762, Loss:  0.270
Epoch   1 Batch  163/538 - Train Accuracy:  0.778, Validation Accuracy:  0.769, Loss:  0.284
Epoch   1 Batch  164/538 - Train Accuracy:  0.782, Validation Accuracy:  0.773, Loss:  0.275
Epoch   1 Batch  165/538 - Train Accuracy:  0.795, Validation Accuracy:  0.766, Loss:  0.249
Epoch   1 Batch  166/538 - Train Accuracy:  0.795, Validation Accuracy:  0.768, Loss:  0.254
Epoch   1 Batch  167/538 - Train Accuracy:  0.797, Validation Accuracy:  0.775, Loss:  0.267
Epoch   1 Batch  168/538 - Train Accuracy:  0.758, Validation Accuracy:  0.776, Loss:  0.291
Epoch   1 Batch  169/538 - Train Accuracy:  0.801, Validation Accuracy:  0.776, Loss:  0.258
Epoch   1 Batch  170/538 - Train Accuracy:  0.765, Validation Accuracy:  0.779, Loss:  0.262
Epoch   1 Batch  171/538 - Train Accuracy:  0.780, Validation Accuracy:  0.776, Loss:  0.273
Epoch   1 Batch  172/538 - Train Accuracy:  0.801, Validation Accuracy:  0.771, Loss:  0.245
Epoch   1 Batch  173/538 - Train Accuracy:  0.785, Validation Accuracy:  0.771, Loss:  0.247
Epoch   1 Batch  174/538 - Train Accuracy:  0.773, Validation Accuracy:  0.773, Loss:  0.258
Epoch   1 Batch  175/538 - Train Accuracy:  0.808, Validation Accuracy:  0.772, Loss:  0.250
Epoch   1 Batch  176/538 - Train Accuracy:  0.792, Validation Accuracy:  0.781, Loss:  0.271
Epoch   1 Batch  177/538 - Train Accuracy:  0.782, Validation Accuracy:  0.770, Loss:  0.242
Epoch   1 Batch  178/538 - Train Accuracy:  0.778, Validation Accuracy:  0.771, Loss:  0.244
Epoch   1 Batch  179/538 - Train Accuracy:  0.793, Validation Accuracy:  0.771, Loss:  0.251
Epoch   1 Batch  180/538 - Train Accuracy:  0.822, Validation Accuracy:  0.769, Loss:  0.250
Epoch   1 Batch  181/538 - Train Accuracy:  0.765, Validation Accuracy:  0.773, Loss:  0.255
Epoch   1 Batch  182/538 - Train Accuracy:  0.790, Validation Accuracy:  0.785, Loss:  0.253
Epoch   1 Batch  183/538 - Train Accuracy:  0.817, Validation Accuracy:  0.779, Loss:  0.235
Epoch   1 Batch  184/538 - Train Accuracy:  0.834, Validation Accuracy:  0.786, Loss:  0.238
Epoch   1 Batch  185/538 - Train Accuracy:  0.827, Validation Accuracy:  0.809, Loss:  0.240
Epoch   1 Batch  186/538 - Train Accuracy:  0.788, Validation Accuracy:  0.786, Loss:  0.245
Epoch   1 Batch  187/538 - Train Accuracy:  0.814, Validation Accuracy:  0.801, Loss:  0.234
Epoch   1 Batch  188/538 - Train Accuracy:  0.796, Validation Accuracy:  0.789, Loss:  0.243
Epoch   1 Batch  189/538 - Train Accuracy:  0.787, Validation Accuracy:  0.783, Loss:  0.246
Epoch   1 Batch  190/538 - Train Accuracy:  0.795, Validation Accuracy:  0.782, Loss:  0.266
Epoch   1 Batch  191/538 - Train Accuracy:  0.792, Validation Accuracy:  0.777, Loss:  0.251
Epoch   1 Batch  192/538 - Train Accuracy:  0.797, Validation Accuracy:  0.779, Loss:  0.242
Epoch   1 Batch  193/538 - Train Accuracy:  0.792, Validation Accuracy:  0.779, Loss:  0.238
Epoch   1 Batch  194/538 - Train Accuracy:  0.779, Validation Accuracy:  0.777, Loss:  0.253
Epoch   1 Batch  195/538 - Train Accuracy:  0.827, Validation Accuracy:  0.790, Loss:  0.239
Epoch   1 Batch  196/538 - Train Accuracy:  0.802, Validation Accuracy:  0.800, Loss:  0.229
Epoch   1 Batch  197/538 - Train Accuracy:  0.797, Validation Accuracy:  0.790, Loss:  0.236
Epoch   1 Batch  198/538 - Train Accuracy:  0.813, Validation Accuracy:  0.794, Loss:  0.239
Epoch   1 Batch  199/538 - Train Accuracy:  0.779, Validation Accuracy:  0.790, Loss:  0.243
Epoch   1 Batch  200/538 - Train Accuracy:  0.818, Validation Accuracy:  0.793, Loss:  0.229
Epoch   1 Batch  201/538 - Train Accuracy:  0.803, Validation Accuracy:  0.789, Loss:  0.237
Epoch   1 Batch  202/538 - Train Accuracy:  0.860, Validation Accuracy:  0.793, Loss:  0.230
Epoch   1 Batch  203/538 - Train Accuracy:  0.775, Validation Accuracy:  0.787, Loss:  0.249
Epoch   1 Batch  204/538 - Train Accuracy:  0.799, Validation Accuracy:  0.777, Loss:  0.243
Epoch   1 Batch  205/538 - Train Accuracy:  0.830, Validation Accuracy:  0.778, Loss:  0.222
Epoch   1 Batch  206/538 - Train Accuracy:  0.776, Validation Accuracy:  0.783, Loss:  0.238
Epoch   1 Batch  207/538 - Train Accuracy:  0.828, Validation Accuracy:  0.799, Loss:  0.230
Epoch   1 Batch  208/538 - Train Accuracy:  0.828, Validation Accuracy:  0.800, Loss:  0.249
Epoch   1 Batch  209/538 - Train Accuracy:  0.839, Validation Accuracy:  0.795, Loss:  0.225
Epoch   1 Batch  210/538 - Train Accuracy:  0.776, Validation Accuracy:  0.796, Loss:  0.228
Epoch   1 Batch  211/538 - Train Accuracy:  0.824, Validation Accuracy:  0.803, Loss:  0.242
Epoch   1 Batch  212/538 - Train Accuracy:  0.814, Validation Accuracy:  0.802, Loss:  0.230
Epoch   1 Batch  213/538 - Train Accuracy:  0.806, Validation Accuracy:  0.797, Loss:  0.220
Epoch   1 Batch  214/538 - Train Accuracy:  0.822, Validation Accuracy:  0.794, Loss:  0.224
Epoch   1 Batch  215/538 - Train Accuracy:  0.833, Validation Accuracy:  0.801, Loss:  0.219
Epoch   1 Batch  216/538 - Train Accuracy:  0.798, Validation Accuracy:  0.782, Loss:  0.240
Epoch   1 Batch  217/538 - Train Accuracy:  0.820, Validation Accuracy:  0.790, Loss:  0.233
Epoch   1 Batch  218/538 - Train Accuracy:  0.792, Validation Accuracy:  0.790, Loss:  0.233
Epoch   1 Batch  219/538 - Train Accuracy:  0.771, Validation Accuracy:  0.803, Loss:  0.257
Epoch   1 Batch  220/538 - Train Accuracy:  0.809, Validation Accuracy:  0.790, Loss:  0.217
Epoch   1 Batch  221/538 - Train Accuracy:  0.832, Validation Accuracy:  0.792, Loss:  0.217
Epoch   1 Batch  222/538 - Train Accuracy:  0.795, Validation Accuracy:  0.783, Loss:  0.212
Epoch   1 Batch  223/538 - Train Accuracy:  0.803, Validation Accuracy:  0.783, Loss:  0.235
Epoch   1 Batch  224/538 - Train Accuracy:  0.809, Validation Accuracy:  0.786, Loss:  0.234
Epoch   1 Batch  225/538 - Train Accuracy:  0.837, Validation Accuracy:  0.805, Loss:  0.217
Epoch   1 Batch  226/538 - Train Accuracy:  0.838, Validation Accuracy:  0.789, Loss:  0.223
Epoch   1 Batch  227/538 - Train Accuracy:  0.827, Validation Accuracy:  0.785, Loss:  0.216
Epoch   1 Batch  228/538 - Train Accuracy:  0.785, Validation Accuracy:  0.795, Loss:  0.213
Epoch   1 Batch  229/538 - Train Accuracy:  0.825, Validation Accuracy:  0.802, Loss:  0.221
Epoch   1 Batch  230/538 - Train Accuracy:  0.810, Validation Accuracy:  0.791, Loss:  0.214
Epoch   1 Batch  231/538 - Train Accuracy:  0.823, Validation Accuracy:  0.802, Loss:  0.233
Epoch   1 Batch  232/538 - Train Accuracy:  0.816, Validation Accuracy:  0.792, Loss:  0.217
Epoch   1 Batch  233/538 - Train Accuracy:  0.847, Validation Accuracy:  0.798, Loss:  0.218
Epoch   1 Batch  234/538 - Train Accuracy:  0.807, Validation Accuracy:  0.811, Loss:  0.235
Epoch   1 Batch  235/538 - Train Accuracy:  0.840, Validation Accuracy:  0.794, Loss:  0.198
Epoch   1 Batch  236/538 - Train Accuracy:  0.808, Validation Accuracy:  0.804, Loss:  0.227
Epoch   1 Batch  237/538 - Train Accuracy:  0.841, Validation Accuracy:  0.797, Loss:  0.206
Epoch   1 Batch  238/538 - Train Accuracy:  0.844, Validation Accuracy:  0.810, Loss:  0.204
Epoch   1 Batch  239/538 - Train Accuracy:  0.827, Validation Accuracy:  0.816, Loss:  0.215
Epoch   1 Batch  240/538 - Train Accuracy:  0.821, Validation Accuracy:  0.817, Loss:  0.217
Epoch   1 Batch  241/538 - Train Accuracy:  0.810, Validation Accuracy:  0.809, Loss:  0.224
Epoch   1 Batch  242/538 - Train Accuracy:  0.846, Validation Accuracy:  0.811, Loss:  0.209
Epoch   1 Batch  243/538 - Train Accuracy:  0.842, Validation Accuracy:  0.813, Loss:  0.217
Epoch   1 Batch  244/538 - Train Accuracy:  0.818, Validation Accuracy:  0.815, Loss:  0.206
Epoch   1 Batch  245/538 - Train Accuracy:  0.816, Validation Accuracy:  0.821, Loss:  0.220
Epoch   1 Batch  246/538 - Train Accuracy:  0.829, Validation Accuracy:  0.814, Loss:  0.192
Epoch   1 Batch  247/538 - Train Accuracy:  0.832, Validation Accuracy:  0.806, Loss:  0.207
Epoch   1 Batch  248/538 - Train Accuracy:  0.840, Validation Accuracy:  0.803, Loss:  0.208
Epoch   1 Batch  249/538 - Train Accuracy:  0.826, Validation Accuracy:  0.812, Loss:  0.190
Epoch   1 Batch  250/538 - Train Accuracy:  0.841, Validation Accuracy:  0.812, Loss:  0.206
Epoch   1 Batch  251/538 - Train Accuracy:  0.843, Validation Accuracy:  0.820, Loss:  0.209
Epoch   1 Batch  252/538 - Train Accuracy:  0.851, Validation Accuracy:  0.816, Loss:  0.192
Epoch   1 Batch  253/538 - Train Accuracy:  0.821, Validation Accuracy:  0.816, Loss:  0.206
Epoch   1 Batch  254/538 - Train Accuracy:  0.803, Validation Accuracy:  0.810, Loss:  0.211
Epoch   1 Batch  255/538 - Train Accuracy:  0.828, Validation Accuracy:  0.809, Loss:  0.197
Epoch   1 Batch  256/538 - Train Accuracy:  0.819, Validation Accuracy:  0.805, Loss:  0.209
Epoch   1 Batch  257/538 - Train Accuracy:  0.858, Validation Accuracy:  0.809, Loss:  0.198
Epoch   1 Batch  258/538 - Train Accuracy:  0.847, Validation Accuracy:  0.814, Loss:  0.198
Epoch   1 Batch  259/538 - Train Accuracy:  0.861, Validation Accuracy:  0.817, Loss:  0.187
Epoch   1 Batch  260/538 - Train Accuracy:  0.804, Validation Accuracy:  0.815, Loss:  0.198
Epoch   1 Batch  261/538 - Train Accuracy:  0.831, Validation Accuracy:  0.826, Loss:  0.207
Epoch   1 Batch  262/538 - Train Accuracy:  0.850, Validation Accuracy:  0.820, Loss:  0.191
Epoch   1 Batch  263/538 - Train Accuracy:  0.837, Validation Accuracy:  0.813, Loss:  0.193
Epoch   1 Batch  264/538 - Train Accuracy:  0.800, Validation Accuracy:  0.818, Loss:  0.193
Epoch   1 Batch  265/538 - Train Accuracy:  0.814, Validation Accuracy:  0.810, Loss:  0.212
Epoch   1 Batch  266/538 - Train Accuracy:  0.836, Validation Accuracy:  0.819, Loss:  0.200
Epoch   1 Batch  267/538 - Train Accuracy:  0.857, Validation Accuracy:  0.811, Loss:  0.193
Epoch   1 Batch  268/538 - Train Accuracy:  0.847, Validation Accuracy:  0.790, Loss:  0.185
Epoch   1 Batch  269/538 - Train Accuracy:  0.823, Validation Accuracy:  0.797, Loss:  0.194
Epoch   1 Batch  270/538 - Train Accuracy:  0.843, Validation Accuracy:  0.806, Loss:  0.196
Epoch   1 Batch  271/538 - Train Accuracy:  0.846, Validation Accuracy:  0.828, Loss:  0.187
Epoch   1 Batch  272/538 - Train Accuracy:  0.828, Validation Accuracy:  0.829, Loss:  0.221
Epoch   1 Batch  273/538 - Train Accuracy:  0.852, Validation Accuracy:  0.846, Loss:  0.200
Epoch   1 Batch  274/538 - Train Accuracy:  0.814, Validation Accuracy:  0.836, Loss:  0.208
Epoch   1 Batch  275/538 - Train Accuracy:  0.838, Validation Accuracy:  0.835, Loss:  0.207
Epoch   1 Batch  276/538 - Train Accuracy:  0.846, Validation Accuracy:  0.837, Loss:  0.196
Epoch   1 Batch  277/538 - Train Accuracy:  0.836, Validation Accuracy:  0.829, Loss:  0.192
Epoch   1 Batch  278/538 - Train Accuracy:  0.877, Validation Accuracy:  0.829, Loss:  0.182
Epoch   1 Batch  279/538 - Train Accuracy:  0.833, Validation Accuracy:  0.826, Loss:  0.188
Epoch   1 Batch  280/538 - Train Accuracy:  0.866, Validation Accuracy:  0.816, Loss:  0.178
Epoch   1 Batch  281/538 - Train Accuracy:  0.834, Validation Accuracy:  0.826, Loss:  0.201
Epoch   1 Batch  282/538 - Train Accuracy:  0.849, Validation Accuracy:  0.822, Loss:  0.198
Epoch   1 Batch  283/538 - Train Accuracy:  0.836, Validation Accuracy:  0.831, Loss:  0.192
Epoch   1 Batch  284/538 - Train Accuracy:  0.835, Validation Accuracy:  0.826, Loss:  0.201
Epoch   1 Batch  285/538 - Train Accuracy:  0.836, Validation Accuracy:  0.828, Loss:  0.170
Epoch   1 Batch  286/538 - Train Accuracy:  0.822, Validation Accuracy:  0.839, Loss:  0.196
Epoch   1 Batch  287/538 - Train Accuracy:  0.863, Validation Accuracy:  0.835, Loss:  0.174
Epoch   1 Batch  288/538 - Train Accuracy:  0.845, Validation Accuracy:  0.836, Loss:  0.195
Epoch   1 Batch  289/538 - Train Accuracy:  0.850, Validation Accuracy:  0.838, Loss:  0.173
Epoch   1 Batch  290/538 - Train Accuracy:  0.854, Validation Accuracy:  0.839, Loss:  0.174
Epoch   1 Batch  291/538 - Train Accuracy:  0.846, Validation Accuracy:  0.824, Loss:  0.175
Epoch   1 Batch  292/538 - Train Accuracy:  0.871, Validation Accuracy:  0.827, Loss:  0.169
Epoch   1 Batch  293/538 - Train Accuracy:  0.864, Validation Accuracy:  0.826, Loss:  0.174
Epoch   1 Batch  294/538 - Train Accuracy:  0.830, Validation Accuracy:  0.831, Loss:  0.188
Epoch   1 Batch  295/538 - Train Accuracy:  0.863, Validation Accuracy:  0.829, Loss:  0.175
Epoch   1 Batch  296/538 - Train Accuracy:  0.829, Validation Accuracy:  0.820, Loss:  0.191
Epoch   1 Batch  297/538 - Train Accuracy:  0.855, Validation Accuracy:  0.833, Loss:  0.188
Epoch   1 Batch  298/538 - Train Accuracy:  0.839, Validation Accuracy:  0.841, Loss:  0.176
Epoch   1 Batch  299/538 - Train Accuracy:  0.858, Validation Accuracy:  0.839, Loss:  0.192
Epoch   1 Batch  300/538 - Train Accuracy:  0.847, Validation Accuracy:  0.833, Loss:  0.179
Epoch   1 Batch  301/538 - Train Accuracy:  0.830, Validation Accuracy:  0.836, Loss:  0.180
Epoch   1 Batch  302/538 - Train Accuracy:  0.850, Validation Accuracy:  0.838, Loss:  0.177
Epoch   1 Batch  303/538 - Train Accuracy:  0.863, Validation Accuracy:  0.851, Loss:  0.172
Epoch   1 Batch  304/538 - Train Accuracy:  0.850, Validation Accuracy:  0.862, Loss:  0.174
Epoch   1 Batch  305/538 - Train Accuracy:  0.862, Validation Accuracy:  0.860, Loss:  0.177
Epoch   1 Batch  306/538 - Train Accuracy:  0.842, Validation Accuracy:  0.850, Loss:  0.182
Epoch   1 Batch  307/538 - Train Accuracy:  0.851, Validation Accuracy:  0.842, Loss:  0.185
Epoch   1 Batch  308/538 - Train Accuracy:  0.860, Validation Accuracy:  0.848, Loss:  0.175
Epoch   1 Batch  309/538 - Train Accuracy:  0.870, Validation Accuracy:  0.853, Loss:  0.174
Epoch   1 Batch  310/538 - Train Accuracy:  0.849, Validation Accuracy:  0.843, Loss:  0.174
Epoch   1 Batch  311/538 - Train Accuracy:  0.842, Validation Accuracy:  0.857, Loss:  0.184
Epoch   1 Batch  312/538 - Train Accuracy:  0.854, Validation Accuracy:  0.836, Loss:  0.158
Epoch   1 Batch  313/538 - Train Accuracy:  0.839, Validation Accuracy:  0.843, Loss:  0.179
Epoch   1 Batch  314/538 - Train Accuracy:  0.864, Validation Accuracy:  0.859, Loss:  0.185
Epoch   1 Batch  315/538 - Train Accuracy:  0.844, Validation Accuracy:  0.845, Loss:  0.165
Epoch   1 Batch  316/538 - Train Accuracy:  0.859, Validation Accuracy:  0.849, Loss:  0.166
Epoch   1 Batch  317/538 - Train Accuracy:  0.862, Validation Accuracy:  0.843, Loss:  0.171
Epoch   1 Batch  318/538 - Train Accuracy:  0.866, Validation Accuracy:  0.844, Loss:  0.162
Epoch   1 Batch  319/538 - Train Accuracy:  0.857, Validation Accuracy:  0.846, Loss:  0.173
Epoch   1 Batch  320/538 - Train Accuracy:  0.851, Validation Accuracy:  0.832, Loss:  0.165
Epoch   1 Batch  321/538 - Train Accuracy:  0.863, Validation Accuracy:  0.854, Loss:  0.174
Epoch   1 Batch  322/538 - Train Accuracy:  0.858, Validation Accuracy:  0.846, Loss:  0.166
Epoch   1 Batch  323/538 - Train Accuracy:  0.876, Validation Accuracy:  0.832, Loss:  0.169
Epoch   1 Batch  324/538 - Train Accuracy:  0.824, Validation Accuracy:  0.840, Loss:  0.178
Epoch   1 Batch  325/538 - Train Accuracy:  0.868, Validation Accuracy:  0.841, Loss:  0.167
Epoch   1 Batch  326/538 - Train Accuracy:  0.876, Validation Accuracy:  0.844, Loss:  0.173
Epoch   1 Batch  327/538 - Train Accuracy:  0.856, Validation Accuracy:  0.847, Loss:  0.174
Epoch   1 Batch  328/538 - Train Accuracy:  0.863, Validation Accuracy:  0.853, Loss:  0.163
Epoch   1 Batch  329/538 - Train Accuracy:  0.866, Validation Accuracy:  0.848, Loss:  0.175
Epoch   1 Batch  330/538 - Train Accuracy:  0.880, Validation Accuracy:  0.840, Loss:  0.157
Epoch   1 Batch  331/538 - Train Accuracy:  0.843, Validation Accuracy:  0.836, Loss:  0.159
Epoch   1 Batch  332/538 - Train Accuracy:  0.843, Validation Accuracy:  0.816, Loss:  0.166
Epoch   1 Batch  333/538 - Train Accuracy:  0.842, Validation Accuracy:  0.843, Loss:  0.171
Epoch   1 Batch  334/538 - Train Accuracy:  0.866, Validation Accuracy:  0.851, Loss:  0.157
Epoch   1 Batch  335/538 - Train Accuracy:  0.849, Validation Accuracy:  0.847, Loss:  0.165
Epoch   1 Batch  336/538 - Train Accuracy:  0.876, Validation Accuracy:  0.856, Loss:  0.154
Epoch   1 Batch  337/538 - Train Accuracy:  0.878, Validation Accuracy:  0.853, Loss:  0.163
Epoch   1 Batch  338/538 - Train Accuracy:  0.853, Validation Accuracy:  0.853, Loss:  0.164
Epoch   1 Batch  339/538 - Train Accuracy:  0.857, Validation Accuracy:  0.849, Loss:  0.166
Epoch   1 Batch  340/538 - Train Accuracy:  0.860, Validation Accuracy:  0.857, Loss:  0.167
Epoch   1 Batch  341/538 - Train Accuracy:  0.860, Validation Accuracy:  0.853, Loss:  0.155
Epoch   1 Batch  342/538 - Train Accuracy:  0.856, Validation Accuracy:  0.852, Loss:  0.164
Epoch   1 Batch  343/538 - Train Accuracy:  0.860, Validation Accuracy:  0.850, Loss:  0.169
Epoch   1 Batch  344/538 - Train Accuracy:  0.882, Validation Accuracy:  0.857, Loss:  0.163
Epoch   1 Batch  345/538 - Train Accuracy:  0.857, Validation Accuracy:  0.857, Loss:  0.170
Epoch   1 Batch  346/538 - Train Accuracy:  0.847, Validation Accuracy:  0.847, Loss:  0.179
Epoch   1 Batch  347/538 - Train Accuracy:  0.866, Validation Accuracy:  0.840, Loss:  0.158
Epoch   1 Batch  348/538 - Train Accuracy:  0.877, Validation Accuracy:  0.849, Loss:  0.151
Epoch   1 Batch  349/538 - Train Accuracy:  0.876, Validation Accuracy:  0.842, Loss:  0.143
Epoch   1 Batch  350/538 - Train Accuracy:  0.874, Validation Accuracy:  0.849, Loss:  0.162
Epoch   1 Batch  351/538 - Train Accuracy:  0.861, Validation Accuracy:  0.851, Loss:  0.174
Epoch   1 Batch  352/538 - Train Accuracy:  0.851, Validation Accuracy:  0.846, Loss:  0.174
Epoch   1 Batch  353/538 - Train Accuracy:  0.860, Validation Accuracy:  0.851, Loss:  0.164
Epoch   1 Batch  354/538 - Train Accuracy:  0.850, Validation Accuracy:  0.854, Loss:  0.152
Epoch   1 Batch  355/538 - Train Accuracy:  0.864, Validation Accuracy:  0.859, Loss:  0.164
Epoch   1 Batch  356/538 - Train Accuracy:  0.872, Validation Accuracy:  0.869, Loss:  0.142
Epoch   1 Batch  357/538 - Train Accuracy:  0.870, Validation Accuracy:  0.867, Loss:  0.143
Epoch   1 Batch  358/538 - Train Accuracy:  0.889, Validation Accuracy:  0.862, Loss:  0.149
Epoch   1 Batch  359/538 - Train Accuracy:  0.869, Validation Accuracy:  0.872, Loss:  0.154
Epoch   1 Batch  360/538 - Train Accuracy:  0.850, Validation Accuracy:  0.870, Loss:  0.156
Epoch   1 Batch  361/538 - Train Accuracy:  0.893, Validation Accuracy:  0.869, Loss:  0.160
Epoch   1 Batch  362/538 - Train Accuracy:  0.891, Validation Accuracy:  0.862, Loss:  0.133
Epoch   1 Batch  363/538 - Train Accuracy:  0.865, Validation Accuracy:  0.876, Loss:  0.149
Epoch   1 Batch  364/538 - Train Accuracy:  0.860, Validation Accuracy:  0.883, Loss:  0.171
Epoch   1 Batch  365/538 - Train Accuracy:  0.855, Validation Accuracy:  0.885, Loss:  0.144
Epoch   1 Batch  366/538 - Train Accuracy:  0.880, Validation Accuracy:  0.866, Loss:  0.155
Epoch   1 Batch  367/538 - Train Accuracy:  0.897, Validation Accuracy:  0.876, Loss:  0.142
Epoch   1 Batch  368/538 - Train Accuracy:  0.883, Validation Accuracy:  0.863, Loss:  0.136
Epoch   1 Batch  369/538 - Train Accuracy:  0.894, Validation Accuracy:  0.878, Loss:  0.147
Epoch   1 Batch  370/538 - Train Accuracy:  0.859, Validation Accuracy:  0.865, Loss:  0.156
Epoch   1 Batch  371/538 - Train Accuracy:  0.882, Validation Accuracy:  0.870, Loss:  0.154
Epoch   1 Batch  372/538 - Train Accuracy:  0.887, Validation Accuracy:  0.859, Loss:  0.142
Epoch   1 Batch  373/538 - Train Accuracy:  0.896, Validation Accuracy:  0.865, Loss:  0.138
Epoch   1 Batch  374/538 - Train Accuracy:  0.875, Validation Accuracy:  0.859, Loss:  0.150
Epoch   1 Batch  375/538 - Train Accuracy:  0.895, Validation Accuracy:  0.866, Loss:  0.136
Epoch   1 Batch  376/538 - Train Accuracy:  0.868, Validation Accuracy:  0.853, Loss:  0.155
Epoch   1 Batch  377/538 - Train Accuracy:  0.891, Validation Accuracy:  0.858, Loss:  0.142
Epoch   1 Batch  378/538 - Train Accuracy:  0.880, Validation Accuracy:  0.852, Loss:  0.143
Epoch   1 Batch  379/538 - Train Accuracy:  0.889, Validation Accuracy:  0.862, Loss:  0.145
Epoch   1 Batch  380/538 - Train Accuracy:  0.879, Validation Accuracy:  0.862, Loss:  0.141
Epoch   1 Batch  381/538 - Train Accuracy:  0.890, Validation Accuracy:  0.868, Loss:  0.136
Epoch   1 Batch  382/538 - Train Accuracy:  0.882, Validation Accuracy:  0.869, Loss:  0.142
Epoch   1 Batch  383/538 - Train Accuracy:  0.887, Validation Accuracy:  0.857, Loss:  0.143
Epoch   1 Batch  384/538 - Train Accuracy:  0.880, Validation Accuracy:  0.868, Loss:  0.136
Epoch   1 Batch  385/538 - Train Accuracy:  0.874, Validation Accuracy:  0.875, Loss:  0.134
Epoch   1 Batch  386/538 - Train Accuracy:  0.884, Validation Accuracy:  0.870, Loss:  0.148
Epoch   1 Batch  387/538 - Train Accuracy:  0.885, Validation Accuracy:  0.880, Loss:  0.142
Epoch   1 Batch  388/538 - Train Accuracy:  0.892, Validation Accuracy:  0.877, Loss:  0.147
Epoch   1 Batch  389/538 - Train Accuracy:  0.871, Validation Accuracy:  0.872, Loss:  0.157
Epoch   1 Batch  390/538 - Train Accuracy:  0.899, Validation Accuracy:  0.865, Loss:  0.130
Epoch   1 Batch  391/538 - Train Accuracy:  0.886, Validation Accuracy:  0.869, Loss:  0.140
Epoch   1 Batch  392/538 - Train Accuracy:  0.873, Validation Accuracy:  0.865, Loss:  0.142
Epoch   1 Batch  393/538 - Train Accuracy:  0.890, Validation Accuracy:  0.868, Loss:  0.134
Epoch   1 Batch  394/538 - Train Accuracy:  0.846, Validation Accuracy:  0.868, Loss:  0.152
Epoch   1 Batch  395/538 - Train Accuracy:  0.867, Validation Accuracy:  0.871, Loss:  0.151
Epoch   1 Batch  396/538 - Train Accuracy:  0.882, Validation Accuracy:  0.873, Loss:  0.135
Epoch   1 Batch  397/538 - Train Accuracy:  0.871, Validation Accuracy:  0.863, Loss:  0.147
Epoch   1 Batch  398/538 - Train Accuracy:  0.879, Validation Accuracy:  0.869, Loss:  0.142
Epoch   1 Batch  399/538 - Train Accuracy:  0.860, Validation Accuracy:  0.856, Loss:  0.149
Epoch   1 Batch  400/538 - Train Accuracy:  0.888, Validation Accuracy:  0.854, Loss:  0.138
Epoch   1 Batch  401/538 - Train Accuracy:  0.877, Validation Accuracy:  0.859, Loss:  0.140
Epoch   1 Batch  402/538 - Train Accuracy:  0.878, Validation Accuracy:  0.860, Loss:  0.134
Epoch   1 Batch  403/538 - Train Accuracy:  0.887, Validation Accuracy:  0.864, Loss:  0.142
Epoch   1 Batch  404/538 - Train Accuracy:  0.869, Validation Accuracy:  0.862, Loss:  0.136
Epoch   1 Batch  405/538 - Train Accuracy:  0.847, Validation Accuracy:  0.857, Loss:  0.136
Epoch   1 Batch  406/538 - Train Accuracy:  0.881, Validation Accuracy:  0.860, Loss:  0.137
Epoch   1 Batch  407/538 - Train Accuracy:  0.899, Validation Accuracy:  0.868, Loss:  0.144
Epoch   1 Batch  408/538 - Train Accuracy:  0.877, Validation Accuracy:  0.874, Loss:  0.150
Epoch   1 Batch  409/538 - Train Accuracy:  0.845, Validation Accuracy:  0.867, Loss:  0.145
Epoch   1 Batch  410/538 - Train Accuracy:  0.887, Validation Accuracy:  0.867, Loss:  0.137
Epoch   1 Batch  411/538 - Train Accuracy:  0.900, Validation Accuracy:  0.880, Loss:  0.141
Epoch   1 Batch  412/538 - Train Accuracy:  0.879, Validation Accuracy:  0.873, Loss:  0.125
Epoch   1 Batch  413/538 - Train Accuracy:  0.874, Validation Accuracy:  0.863, Loss:  0.133
Epoch   1 Batch  414/538 - Train Accuracy:  0.853, Validation Accuracy:  0.868, Loss:  0.152
Epoch   1 Batch  415/538 - Train Accuracy:  0.859, Validation Accuracy:  0.871, Loss:  0.138
Epoch   1 Batch  416/538 - Train Accuracy:  0.877, Validation Accuracy:  0.870, Loss:  0.136
Epoch   1 Batch  417/538 - Train Accuracy:  0.888, Validation Accuracy:  0.870, Loss:  0.127
Epoch   1 Batch  418/538 - Train Accuracy:  0.890, Validation Accuracy:  0.872, Loss:  0.146
Epoch   1 Batch  419/538 - Train Accuracy:  0.895, Validation Accuracy:  0.877, Loss:  0.124
Epoch   1 Batch  420/538 - Train Accuracy:  0.889, Validation Accuracy:  0.868, Loss:  0.135
Epoch   1 Batch  421/538 - Train Accuracy:  0.887, Validation Accuracy:  0.863, Loss:  0.123
Epoch   1 Batch  422/538 - Train Accuracy:  0.888, Validation Accuracy:  0.863, Loss:  0.137
Epoch   1 Batch  423/538 - Train Accuracy:  0.899, Validation Accuracy:  0.874, Loss:  0.140
Epoch   1 Batch  424/538 - Train Accuracy:  0.866, Validation Accuracy:  0.870, Loss:  0.141
Epoch   1 Batch  425/538 - Train Accuracy:  0.874, Validation Accuracy:  0.881, Loss:  0.146
Epoch   1 Batch  426/538 - Train Accuracy:  0.907, Validation Accuracy:  0.878, Loss:  0.132
Epoch   1 Batch  427/538 - Train Accuracy:  0.863, Validation Accuracy:  0.878, Loss:  0.141
Epoch   1 Batch  428/538 - Train Accuracy:  0.885, Validation Accuracy:  0.868, Loss:  0.125
Epoch   1 Batch  429/538 - Train Accuracy:  0.890, Validation Accuracy:  0.870, Loss:  0.136
Epoch   1 Batch  430/538 - Train Accuracy:  0.875, Validation Accuracy:  0.873, Loss:  0.124
Epoch   1 Batch  431/538 - Train Accuracy:  0.890, Validation Accuracy:  0.871, Loss:  0.124
Epoch   1 Batch  432/538 - Train Accuracy:  0.887, Validation Accuracy:  0.880, Loss:  0.129
Epoch   1 Batch  433/538 - Train Accuracy:  0.869, Validation Accuracy:  0.881, Loss:  0.163
Epoch   1 Batch  434/538 - Train Accuracy:  0.836, Validation Accuracy:  0.867, Loss:  0.139
Epoch   1 Batch  435/538 - Train Accuracy:  0.879, Validation Accuracy:  0.873, Loss:  0.127
Epoch   1 Batch  436/538 - Train Accuracy:  0.864, Validation Accuracy:  0.871, Loss:  0.138
Epoch   1 Batch  437/538 - Train Accuracy:  0.890, Validation Accuracy:  0.879, Loss:  0.135
Epoch   1 Batch  438/538 - Train Accuracy:  0.899, Validation Accuracy:  0.884, Loss:  0.122
Epoch   1 Batch  439/538 - Train Accuracy:  0.919, Validation Accuracy:  0.887, Loss:  0.120
Epoch   1 Batch  440/538 - Train Accuracy:  0.875, Validation Accuracy:  0.876, Loss:  0.138
Epoch   1 Batch  441/538 - Train Accuracy:  0.862, Validation Accuracy:  0.876, Loss:  0.143
Epoch   1 Batch  442/538 - Train Accuracy:  0.906, Validation Accuracy:  0.876, Loss:  0.116
Epoch   1 Batch  443/538 - Train Accuracy:  0.902, Validation Accuracy:  0.877, Loss:  0.133
Epoch   1 Batch  444/538 - Train Accuracy:  0.892, Validation Accuracy:  0.872, Loss:  0.116
Epoch   1 Batch  445/538 - Train Accuracy:  0.901, Validation Accuracy:  0.882, Loss:  0.120
Epoch   1 Batch  446/538 - Train Accuracy:  0.902, Validation Accuracy:  0.885, Loss:  0.120
Epoch   1 Batch  447/538 - Train Accuracy:  0.874, Validation Accuracy:  0.881, Loss:  0.135
Epoch   1 Batch  448/538 - Train Accuracy:  0.890, Validation Accuracy:  0.882, Loss:  0.118
Epoch   1 Batch  449/538 - Train Accuracy:  0.900, Validation Accuracy:  0.890, Loss:  0.146
Epoch   1 Batch  450/538 - Train Accuracy:  0.872, Validation Accuracy:  0.889, Loss:  0.141
Epoch   1 Batch  451/538 - Train Accuracy:  0.876, Validation Accuracy:  0.879, Loss:  0.126
Epoch   1 Batch  452/538 - Train Accuracy:  0.873, Validation Accuracy:  0.874, Loss:  0.121
Epoch   1 Batch  453/538 - Train Accuracy:  0.879, Validation Accuracy:  0.873, Loss:  0.129
Epoch   1 Batch  454/538 - Train Accuracy:  0.891, Validation Accuracy:  0.881, Loss:  0.129
Epoch   1 Batch  455/538 - Train Accuracy:  0.895, Validation Accuracy:  0.880, Loss:  0.117
Epoch   1 Batch  456/538 - Train Accuracy:  0.915, Validation Accuracy:  0.880, Loss:  0.131
Epoch   1 Batch  457/538 - Train Accuracy:  0.877, Validation Accuracy:  0.883, Loss:  0.127
Epoch   1 Batch  458/538 - Train Accuracy:  0.897, Validation Accuracy:  0.875, Loss:  0.114
Epoch   1 Batch  459/538 - Train Accuracy:  0.896, Validation Accuracy:  0.880, Loss:  0.121
Epoch   1 Batch  460/538 - Train Accuracy:  0.857, Validation Accuracy:  0.888, Loss:  0.126
Epoch   1 Batch  461/538 - Train Accuracy:  0.899, Validation Accuracy:  0.879, Loss:  0.130
Epoch   1 Batch  462/538 - Train Accuracy:  0.895, Validation Accuracy:  0.881, Loss:  0.119
Epoch   1 Batch  463/538 - Train Accuracy:  0.871, Validation Accuracy:  0.884, Loss:  0.131
Epoch   1 Batch  464/538 - Train Accuracy:  0.888, Validation Accuracy:  0.881, Loss:  0.126
Epoch   1 Batch  465/538 - Train Accuracy:  0.881, Validation Accuracy:  0.883, Loss:  0.128
Epoch   1 Batch  466/538 - Train Accuracy:  0.881, Validation Accuracy:  0.894, Loss:  0.127
Epoch   1 Batch  467/538 - Train Accuracy:  0.913, Validation Accuracy:  0.895, Loss:  0.128
Epoch   1 Batch  468/538 - Train Accuracy:  0.906, Validation Accuracy:  0.894, Loss:  0.134
Epoch   1 Batch  469/538 - Train Accuracy:  0.905, Validation Accuracy:  0.872, Loss:  0.129
Epoch   1 Batch  470/538 - Train Accuracy:  0.898, Validation Accuracy:  0.870, Loss:  0.123
Epoch   1 Batch  471/538 - Train Accuracy:  0.891, Validation Accuracy:  0.873, Loss:  0.119
Epoch   1 Batch  472/538 - Train Accuracy:  0.929, Validation Accuracy:  0.879, Loss:  0.118
Epoch   1 Batch  473/538 - Train Accuracy:  0.851, Validation Accuracy:  0.882, Loss:  0.128
Epoch   1 Batch  474/538 - Train Accuracy:  0.895, Validation Accuracy:  0.887, Loss:  0.113
Epoch   1 Batch  475/538 - Train Accuracy:  0.903, Validation Accuracy:  0.888, Loss:  0.117
Epoch   1 Batch  476/538 - Train Accuracy:  0.870, Validation Accuracy:  0.885, Loss:  0.121
Epoch   1 Batch  477/538 - Train Accuracy:  0.884, Validation Accuracy:  0.882, Loss:  0.136
Epoch   1 Batch  478/538 - Train Accuracy:  0.902, Validation Accuracy:  0.882, Loss:  0.114
Epoch   1 Batch  479/538 - Train Accuracy:  0.895, Validation Accuracy:  0.883, Loss:  0.117
Epoch   1 Batch  480/538 - Train Accuracy:  0.902, Validation Accuracy:  0.877, Loss:  0.118
Epoch   1 Batch  481/538 - Train Accuracy:  0.895, Validation Accuracy:  0.872, Loss:  0.121
Epoch   1 Batch  482/538 - Train Accuracy:  0.888, Validation Accuracy:  0.886, Loss:  0.106
Epoch   1 Batch  483/538 - Train Accuracy:  0.866, Validation Accuracy:  0.881, Loss:  0.137
Epoch   1 Batch  484/538 - Train Accuracy:  0.891, Validation Accuracy:  0.881, Loss:  0.129
Epoch   1 Batch  485/538 - Train Accuracy:  0.905, Validation Accuracy:  0.875, Loss:  0.125
Epoch   1 Batch  486/538 - Train Accuracy:  0.898, Validation Accuracy:  0.892, Loss:  0.111
Epoch   1 Batch  487/538 - Train Accuracy:  0.904, Validation Accuracy:  0.890, Loss:  0.108
Epoch   1 Batch  488/538 - Train Accuracy:  0.896, Validation Accuracy:  0.878, Loss:  0.117
Epoch   1 Batch  489/538 - Train Accuracy:  0.870, Validation Accuracy:  0.876, Loss:  0.126
Epoch   1 Batch  490/538 - Train Accuracy:  0.893, Validation Accuracy:  0.889, Loss:  0.122
Epoch   1 Batch  491/538 - Train Accuracy:  0.858, Validation Accuracy:  0.883, Loss:  0.124
Epoch   1 Batch  492/538 - Train Accuracy:  0.904, Validation Accuracy:  0.883, Loss:  0.119
Epoch   1 Batch  493/538 - Train Accuracy:  0.872, Validation Accuracy:  0.868, Loss:  0.113
Epoch   1 Batch  494/538 - Train Accuracy:  0.881, Validation Accuracy:  0.889, Loss:  0.134
Epoch   1 Batch  495/538 - Train Accuracy:  0.885, Validation Accuracy:  0.880, Loss:  0.120
Epoch   1 Batch  496/538 - Train Accuracy:  0.895, Validation Accuracy:  0.892, Loss:  0.113
Epoch   1 Batch  497/538 - Train Accuracy:  0.902, Validation Accuracy:  0.901, Loss:  0.122
Epoch   1 Batch  498/538 - Train Accuracy:  0.885, Validation Accuracy:  0.897, Loss:  0.118
Epoch   1 Batch  499/538 - Train Accuracy:  0.894, Validation Accuracy:  0.899, Loss:  0.109
Epoch   1 Batch  500/538 - Train Accuracy:  0.906, Validation Accuracy:  0.891, Loss:  0.102
Epoch   1 Batch  501/538 - Train Accuracy:  0.924, Validation Accuracy:  0.881, Loss:  0.111
Epoch   1 Batch  502/538 - Train Accuracy:  0.897, Validation Accuracy:  0.881, Loss:  0.102
Epoch   1 Batch  503/538 - Train Accuracy:  0.924, Validation Accuracy:  0.892, Loss:  0.112
Epoch   1 Batch  504/538 - Train Accuracy:  0.921, Validation Accuracy:  0.898, Loss:  0.104
Epoch   1 Batch  505/538 - Train Accuracy:  0.892, Validation Accuracy:  0.883, Loss:  0.104
Epoch   1 Batch  506/538 - Train Accuracy:  0.888, Validation Accuracy:  0.880, Loss:  0.107
Epoch   1 Batch  507/538 - Train Accuracy:  0.859, Validation Accuracy:  0.895, Loss:  0.128
Epoch   1 Batch  508/538 - Train Accuracy:  0.890, Validation Accuracy:  0.900, Loss:  0.111
Epoch   1 Batch  509/538 - Train Accuracy:  0.887, Validation Accuracy:  0.898, Loss:  0.118
Epoch   1 Batch  510/538 - Train Accuracy:  0.898, Validation Accuracy:  0.895, Loss:  0.112
Epoch   1 Batch  511/538 - Train Accuracy:  0.886, Validation Accuracy:  0.894, Loss:  0.114
Epoch   1 Batch  512/538 - Train Accuracy:  0.904, Validation Accuracy:  0.890, Loss:  0.116
Epoch   1 Batch  513/538 - Train Accuracy:  0.878, Validation Accuracy:  0.885, Loss:  0.112
Epoch   1 Batch  514/538 - Train Accuracy:  0.892, Validation Accuracy:  0.885, Loss:  0.107
Epoch   1 Batch  515/538 - Train Accuracy:  0.893, Validation Accuracy:  0.889, Loss:  0.121
Epoch   1 Batch  516/538 - Train Accuracy:  0.869, Validation Accuracy:  0.887, Loss:  0.121
Epoch   1 Batch  517/538 - Train Accuracy:  0.917, Validation Accuracy:  0.879, Loss:  0.107
Epoch   1 Batch  518/538 - Train Accuracy:  0.880, Validation Accuracy:  0.886, Loss:  0.123
Epoch   1 Batch  519/538 - Train Accuracy:  0.899, Validation Accuracy:  0.894, Loss:  0.107
Epoch   1 Batch  520/538 - Train Accuracy:  0.894, Validation Accuracy:  0.890, Loss:  0.115
Epoch   1 Batch  521/538 - Train Accuracy:  0.902, Validation Accuracy:  0.881, Loss:  0.126
Epoch   1 Batch  522/538 - Train Accuracy:  0.887, Validation Accuracy:  0.900, Loss:  0.108
Epoch   1 Batch  523/538 - Train Accuracy:  0.899, Validation Accuracy:  0.902, Loss:  0.112
Epoch   1 Batch  524/538 - Train Accuracy:  0.890, Validation Accuracy:  0.892, Loss:  0.118
Epoch   1 Batch  525/538 - Train Accuracy:  0.903, Validation Accuracy:  0.887, Loss:  0.109
Epoch   1 Batch  526/538 - Train Accuracy:  0.890, Validation Accuracy:  0.890, Loss:  0.107
Epoch   1 Batch  527/538 - Train Accuracy:  0.916, Validation Accuracy:  0.893, Loss:  0.113
Epoch   1 Batch  528/538 - Train Accuracy:  0.887, Validation Accuracy:  0.894, Loss:  0.125
Epoch   1 Batch  529/538 - Train Accuracy:  0.870, Validation Accuracy:  0.884, Loss:  0.111
Epoch   1 Batch  530/538 - Train Accuracy:  0.879, Validation Accuracy:  0.885, Loss:  0.123
Epoch   1 Batch  531/538 - Train Accuracy:  0.904, Validation Accuracy:  0.884, Loss:  0.111
Epoch   1 Batch  532/538 - Train Accuracy:  0.902, Validation Accuracy:  0.887, Loss:  0.101
Epoch   1 Batch  533/538 - Train Accuracy:  0.895, Validation Accuracy:  0.890, Loss:  0.111
Epoch   1 Batch  534/538 - Train Accuracy:  0.896, Validation Accuracy:  0.892, Loss:  0.103
Epoch   1 Batch  535/538 - Train Accuracy:  0.913, Validation Accuracy:  0.879, Loss:  0.102
Epoch   1 Batch  536/538 - Train Accuracy:  0.899, Validation Accuracy:  0.879, Loss:  0.124
Epoch   2 Batch    0/538 - Train Accuracy:  0.916, Validation Accuracy:  0.884, Loss:  0.102
Epoch   2 Batch    1/538 - Train Accuracy:  0.911, Validation Accuracy:  0.881, Loss:  0.110
Epoch   2 Batch    2/538 - Train Accuracy:  0.903, Validation Accuracy:  0.887, Loss:  0.120
Epoch   2 Batch    3/538 - Train Accuracy:  0.902, Validation Accuracy:  0.890, Loss:  0.102
Epoch   2 Batch    4/538 - Train Accuracy:  0.882, Validation Accuracy:  0.892, Loss:  0.112
Epoch   2 Batch    5/538 - Train Accuracy:  0.887, Validation Accuracy:  0.888, Loss:  0.115
Epoch   2 Batch    6/538 - Train Accuracy:  0.908, Validation Accuracy:  0.895, Loss:  0.107
Epoch   2 Batch    7/538 - Train Accuracy:  0.910, Validation Accuracy:  0.892, Loss:  0.109
Epoch   2 Batch    8/538 - Train Accuracy:  0.898, Validation Accuracy:  0.895, Loss:  0.117
Epoch   2 Batch    9/538 - Train Accuracy:  0.893, Validation Accuracy:  0.884, Loss:  0.103
Epoch   2 Batch   10/538 - Train Accuracy:  0.889, Validation Accuracy:  0.876, Loss:  0.115
Epoch   2 Batch   11/538 - Train Accuracy:  0.903, Validation Accuracy:  0.871, Loss:  0.107
Epoch   2 Batch   12/538 - Train Accuracy:  0.893, Validation Accuracy:  0.881, Loss:  0.103
Epoch   2 Batch   13/538 - Train Accuracy:  0.910, Validation Accuracy:  0.873, Loss:  0.098
Epoch   2 Batch   14/538 - Train Accuracy:  0.900, Validation Accuracy:  0.877, Loss:  0.102
Epoch   2 Batch   15/538 - Train Accuracy:  0.912, Validation Accuracy:  0.892, Loss:  0.101
Epoch   2 Batch   16/538 - Train Accuracy:  0.894, Validation Accuracy:  0.902, Loss:  0.100
Epoch   2 Batch   17/538 - Train Accuracy:  0.897, Validation Accuracy:  0.902, Loss:  0.109
Epoch   2 Batch   18/538 - Train Accuracy:  0.915, Validation Accuracy:  0.903, Loss:  0.116
Epoch   2 Batch   19/538 - Train Accuracy:  0.884, Validation Accuracy:  0.899, Loss:  0.121
Epoch   2 Batch   20/538 - Train Accuracy:  0.903, Validation Accuracy:  0.901, Loss:  0.106
Epoch   2 Batch   21/538 - Train Accuracy:  0.915, Validation Accuracy:  0.894, Loss:  0.100
Epoch   2 Batch   22/538 - Train Accuracy:  0.891, Validation Accuracy:  0.885, Loss:  0.108
Epoch   2 Batch   23/538 - Train Accuracy:  0.886, Validation Accuracy:  0.888, Loss:  0.120
Epoch   2 Batch   24/538 - Train Accuracy:  0.908, Validation Accuracy:  0.895, Loss:  0.107
Epoch   2 Batch   25/538 - Train Accuracy:  0.905, Validation Accuracy:  0.892, Loss:  0.106
Epoch   2 Batch   26/538 - Train Accuracy:  0.893, Validation Accuracy:  0.893, Loss:  0.115
Epoch   2 Batch   27/538 - Train Accuracy:  0.892, Validation Accuracy:  0.904, Loss:  0.095
Epoch   2 Batch   28/538 - Train Accuracy:  0.873, Validation Accuracy:  0.896, Loss:  0.103
Epoch   2 Batch   29/538 - Train Accuracy:  0.908, Validation Accuracy:  0.892, Loss:  0.097
Epoch   2 Batch   30/538 - Train Accuracy:  0.888, Validation Accuracy:  0.885, Loss:  0.118
Epoch   2 Batch   31/538 - Train Accuracy:  0.914, Validation Accuracy:  0.880, Loss:  0.092
Epoch   2 Batch   32/538 - Train Accuracy:  0.895, Validation Accuracy:  0.884, Loss:  0.088
Epoch   2 Batch   33/538 - Train Accuracy:  0.899, Validation Accuracy:  0.877, Loss:  0.104
Epoch   2 Batch   34/538 - Train Accuracy:  0.880, Validation Accuracy:  0.880, Loss:  0.112
Epoch   2 Batch   35/538 - Train Accuracy:  0.895, Validation Accuracy:  0.880, Loss:  0.102
Epoch   2 Batch   36/538 - Train Accuracy:  0.912, Validation Accuracy:  0.882, Loss:  0.091
Epoch   2 Batch   37/538 - Train Accuracy:  0.898, Validation Accuracy:  0.892, Loss:  0.105
Epoch   2 Batch   38/538 - Train Accuracy:  0.905, Validation Accuracy:  0.900, Loss:  0.100
Epoch   2 Batch   39/538 - Train Accuracy:  0.915, Validation Accuracy:  0.898, Loss:  0.099
Epoch   2 Batch   40/538 - Train Accuracy:  0.909, Validation Accuracy:  0.897, Loss:  0.086
Epoch   2 Batch   41/538 - Train Accuracy:  0.915, Validation Accuracy:  0.897, Loss:  0.097
Epoch   2 Batch   42/538 - Train Accuracy:  0.891, Validation Accuracy:  0.901, Loss:  0.103
Epoch   2 Batch   43/538 - Train Accuracy:  0.884, Validation Accuracy:  0.914, Loss:  0.112
Epoch   2 Batch   44/538 - Train Accuracy:  0.889, Validation Accuracy:  0.904, Loss:  0.111
Epoch   2 Batch   45/538 - Train Accuracy:  0.898, Validation Accuracy:  0.899, Loss:  0.099
Epoch   2 Batch   46/538 - Train Accuracy:  0.925, Validation Accuracy:  0.904, Loss:  0.091
Epoch   2 Batch   47/538 - Train Accuracy:  0.899, Validation Accuracy:  0.893, Loss:  0.109
Epoch   2 Batch   48/538 - Train Accuracy:  0.909, Validation Accuracy:  0.900, Loss:  0.100
Epoch   2 Batch   49/538 - Train Accuracy:  0.919, Validation Accuracy:  0.895, Loss:  0.100
Epoch   2 Batch   50/538 - Train Accuracy:  0.897, Validation Accuracy:  0.892, Loss:  0.098
Epoch   2 Batch   51/538 - Train Accuracy:  0.896, Validation Accuracy:  0.893, Loss:  0.110
Epoch   2 Batch   52/538 - Train Accuracy:  0.900, Validation Accuracy:  0.898, Loss:  0.105
Epoch   2 Batch   53/538 - Train Accuracy:  0.890, Validation Accuracy:  0.903, Loss:  0.098
Epoch   2 Batch   54/538 - Train Accuracy:  0.908, Validation Accuracy:  0.900, Loss:  0.092
Epoch   2 Batch   55/538 - Train Accuracy:  0.898, Validation Accuracy:  0.897, Loss:  0.094
Epoch   2 Batch   56/538 - Train Accuracy:  0.878, Validation Accuracy:  0.897, Loss:  0.091
Epoch   2 Batch   57/538 - Train Accuracy:  0.869, Validation Accuracy:  0.892, Loss:  0.115
Epoch   2 Batch   58/538 - Train Accuracy:  0.875, Validation Accuracy:  0.899, Loss:  0.103
Epoch   2 Batch   59/538 - Train Accuracy:  0.897, Validation Accuracy:  0.890, Loss:  0.100
Epoch   2 Batch   60/538 - Train Accuracy:  0.916, Validation Accuracy:  0.896, Loss:  0.100
Epoch   2 Batch   61/538 - Train Accuracy:  0.906, Validation Accuracy:  0.895, Loss:  0.097
Epoch   2 Batch   62/538 - Train Accuracy:  0.907, Validation Accuracy:  0.898, Loss:  0.094
Epoch   2 Batch   63/538 - Train Accuracy:  0.911, Validation Accuracy:  0.895, Loss:  0.086
Epoch   2 Batch   64/538 - Train Accuracy:  0.892, Validation Accuracy:  0.897, Loss:  0.099
Epoch   2 Batch   65/538 - Train Accuracy:  0.876, Validation Accuracy:  0.898, Loss:  0.102
Epoch   2 Batch   66/538 - Train Accuracy:  0.914, Validation Accuracy:  0.896, Loss:  0.083
Epoch   2 Batch   67/538 - Train Accuracy:  0.915, Validation Accuracy:  0.896, Loss:  0.093
Epoch   2 Batch   68/538 - Train Accuracy:  0.890, Validation Accuracy:  0.907, Loss:  0.096
Epoch   2 Batch   69/538 - Train Accuracy:  0.905, Validation Accuracy:  0.906, Loss:  0.096
Epoch   2 Batch   70/538 - Train Accuracy:  0.893, Validation Accuracy:  0.904, Loss:  0.093
Epoch   2 Batch   71/538 - Train Accuracy:  0.905, Validation Accuracy:  0.912, Loss:  0.113
Epoch   2 Batch   72/538 - Train Accuracy:  0.903, Validation Accuracy:  0.905, Loss:  0.110
Epoch   2 Batch   73/538 - Train Accuracy:  0.893, Validation Accuracy:  0.903, Loss:  0.105
Epoch   2 Batch   74/538 - Train Accuracy:  0.917, Validation Accuracy:  0.905, Loss:  0.095
Epoch   2 Batch   75/538 - Train Accuracy:  0.907, Validation Accuracy:  0.914, Loss:  0.095
Epoch   2 Batch   76/538 - Train Accuracy:  0.908, Validation Accuracy:  0.913, Loss:  0.099
Epoch   2 Batch   77/538 - Train Accuracy:  0.904, Validation Accuracy:  0.910, Loss:  0.096
Epoch   2 Batch   78/538 - Train Accuracy:  0.900, Validation Accuracy:  0.906, Loss:  0.100
Epoch   2 Batch   79/538 - Train Accuracy:  0.908, Validation Accuracy:  0.903, Loss:  0.081
Epoch   2 Batch   80/538 - Train Accuracy:  0.900, Validation Accuracy:  0.898, Loss:  0.098
Epoch   2 Batch   81/538 - Train Accuracy:  0.902, Validation Accuracy:  0.902, Loss:  0.104
Epoch   2 Batch   82/538 - Train Accuracy:  0.897, Validation Accuracy:  0.906, Loss:  0.099
Epoch   2 Batch   83/538 - Train Accuracy:  0.883, Validation Accuracy:  0.901, Loss:  0.107
Epoch   2 Batch   84/538 - Train Accuracy:  0.900, Validation Accuracy:  0.892, Loss:  0.103
Epoch   2 Batch   85/538 - Train Accuracy:  0.923, Validation Accuracy:  0.887, Loss:  0.089
Epoch   2 Batch   86/538 - Train Accuracy:  0.900, Validation Accuracy:  0.885, Loss:  0.093
Epoch   2 Batch   87/538 - Train Accuracy:  0.904, Validation Accuracy:  0.897, Loss:  0.094
Epoch   2 Batch   88/538 - Train Accuracy:  0.918, Validation Accuracy:  0.915, Loss:  0.099
Epoch   2 Batch   89/538 - Train Accuracy:  0.911, Validation Accuracy:  0.913, Loss:  0.091
Epoch   2 Batch   90/538 - Train Accuracy:  0.895, Validation Accuracy:  0.898, Loss:  0.098
Epoch   2 Batch   91/538 - Train Accuracy:  0.904, Validation Accuracy:  0.913, Loss:  0.097
Epoch   2 Batch   92/538 - Train Accuracy:  0.906, Validation Accuracy:  0.912, Loss:  0.099
Epoch   2 Batch   93/538 - Train Accuracy:  0.897, Validation Accuracy:  0.908, Loss:  0.093
Epoch   2 Batch   94/538 - Train Accuracy:  0.917, Validation Accuracy:  0.901, Loss:  0.093
Epoch   2 Batch   95/538 - Train Accuracy:  0.890, Validation Accuracy:  0.901, Loss:  0.093
Epoch   2 Batch   96/538 - Train Accuracy:  0.914, Validation Accuracy:  0.906, Loss:  0.084
Epoch   2 Batch   97/538 - Train Accuracy:  0.924, Validation Accuracy:  0.905, Loss:  0.088
Epoch   2 Batch   98/538 - Train Accuracy:  0.916, Validation Accuracy:  0.901, Loss:  0.096
Epoch   2 Batch   99/538 - Train Accuracy:  0.900, Validation Accuracy:  0.897, Loss:  0.088
Epoch   2 Batch  100/538 - Train Accuracy:  0.896, Validation Accuracy:  0.906, Loss:  0.090
Epoch   2 Batch  101/538 - Train Accuracy:  0.877, Validation Accuracy:  0.904, Loss:  0.103
Epoch   2 Batch  102/538 - Train Accuracy:  0.886, Validation Accuracy:  0.902, Loss:  0.098
Epoch   2 Batch  103/538 - Train Accuracy:  0.904, Validation Accuracy:  0.904, Loss:  0.089
Epoch   2 Batch  104/538 - Train Accuracy:  0.899, Validation Accuracy:  0.908, Loss:  0.085
Epoch   2 Batch  105/538 - Train Accuracy:  0.920, Validation Accuracy:  0.908, Loss:  0.084
Epoch   2 Batch  106/538 - Train Accuracy:  0.907, Validation Accuracy:  0.914, Loss:  0.081
Epoch   2 Batch  107/538 - Train Accuracy:  0.890, Validation Accuracy:  0.914, Loss:  0.105
Epoch   2 Batch  108/538 - Train Accuracy:  0.914, Validation Accuracy:  0.904, Loss:  0.085
Epoch   2 Batch  109/538 - Train Accuracy:  0.923, Validation Accuracy:  0.903, Loss:  0.087
Epoch   2 Batch  110/538 - Train Accuracy:  0.905, Validation Accuracy:  0.906, Loss:  0.095
Epoch   2 Batch  111/538 - Train Accuracy:  0.899, Validation Accuracy:  0.918, Loss:  0.089
Epoch   2 Batch  112/538 - Train Accuracy:  0.913, Validation Accuracy:  0.911, Loss:  0.094
Epoch   2 Batch  113/538 - Train Accuracy:  0.889, Validation Accuracy:  0.909, Loss:  0.099
Epoch   2 Batch  114/538 - Train Accuracy:  0.900, Validation Accuracy:  0.906, Loss:  0.088
Epoch   2 Batch  115/538 - Train Accuracy:  0.914, Validation Accuracy:  0.906, Loss:  0.092
Epoch   2 Batch  116/538 - Train Accuracy:  0.904, Validation Accuracy:  0.907, Loss:  0.098
Epoch   2 Batch  117/538 - Train Accuracy:  0.900, Validation Accuracy:  0.904, Loss:  0.093
Epoch   2 Batch  118/538 - Train Accuracy:  0.905, Validation Accuracy:  0.906, Loss:  0.082
Epoch   2 Batch  119/538 - Train Accuracy:  0.929, Validation Accuracy:  0.903, Loss:  0.078
Epoch   2 Batch  120/538 - Train Accuracy:  0.922, Validation Accuracy:  0.896, Loss:  0.076
Epoch   2 Batch  121/538 - Train Accuracy:  0.908, Validation Accuracy:  0.901, Loss:  0.092
Epoch   2 Batch  122/538 - Train Accuracy:  0.899, Validation Accuracy:  0.904, Loss:  0.086
Epoch   2 Batch  123/538 - Train Accuracy:  0.916, Validation Accuracy:  0.905, Loss:  0.083
Epoch   2 Batch  124/538 - Train Accuracy:  0.922, Validation Accuracy:  0.907, Loss:  0.079
Epoch   2 Batch  125/538 - Train Accuracy:  0.898, Validation Accuracy:  0.902, Loss:  0.085
Epoch   2 Batch  126/538 - Train Accuracy:  0.904, Validation Accuracy:  0.909, Loss:  0.083
Epoch   2 Batch  127/538 - Train Accuracy:  0.896, Validation Accuracy:  0.912, Loss:  0.099
Epoch   2 Batch  128/538 - Train Accuracy:  0.921, Validation Accuracy:  0.911, Loss:  0.091
Epoch   2 Batch  129/538 - Train Accuracy:  0.913, Validation Accuracy:  0.910, Loss:  0.077
Epoch   2 Batch  130/538 - Train Accuracy:  0.908, Validation Accuracy:  0.914, Loss:  0.080
Epoch   2 Batch  131/538 - Train Accuracy:  0.931, Validation Accuracy:  0.907, Loss:  0.082
Epoch   2 Batch  132/538 - Train Accuracy:  0.890, Validation Accuracy:  0.908, Loss:  0.085
Epoch   2 Batch  133/538 - Train Accuracy:  0.904, Validation Accuracy:  0.903, Loss:  0.079
Epoch   2 Batch  134/538 - Train Accuracy:  0.891, Validation Accuracy:  0.901, Loss:  0.096
Epoch   2 Batch  135/538 - Train Accuracy:  0.906, Validation Accuracy:  0.903, Loss:  0.094
Epoch   2 Batch  136/538 - Train Accuracy:  0.895, Validation Accuracy:  0.900, Loss:  0.084
Epoch   2 Batch  137/538 - Train Accuracy:  0.879, Validation Accuracy:  0.901, Loss:  0.093
Epoch   2 Batch  138/538 - Train Accuracy:  0.898, Validation Accuracy:  0.897, Loss:  0.093
Epoch   2 Batch  139/538 - Train Accuracy:  0.896, Validation Accuracy:  0.899, Loss:  0.096
Epoch   2 Batch  140/538 - Train Accuracy:  0.888, Validation Accuracy:  0.899, Loss:  0.105
Epoch   2 Batch  141/538 - Train Accuracy:  0.908, Validation Accuracy:  0.898, Loss:  0.097
Epoch   2 Batch  142/538 - Train Accuracy:  0.915, Validation Accuracy:  0.907, Loss:  0.089
Epoch   2 Batch  143/538 - Train Accuracy:  0.930, Validation Accuracy:  0.908, Loss:  0.099
Epoch   2 Batch  144/538 - Train Accuracy:  0.915, Validation Accuracy:  0.905, Loss:  0.095
Epoch   2 Batch  145/538 - Train Accuracy:  0.890, Validation Accuracy:  0.909, Loss:  0.097
Epoch   2 Batch  146/538 - Train Accuracy:  0.913, Validation Accuracy:  0.919, Loss:  0.089
Epoch   2 Batch  147/538 - Train Accuracy:  0.917, Validation Accuracy:  0.920, Loss:  0.087
Epoch   2 Batch  148/538 - Train Accuracy:  0.891, Validation Accuracy:  0.917, Loss:  0.100
Epoch   2 Batch  149/538 - Train Accuracy:  0.923, Validation Accuracy:  0.914, Loss:  0.088
Epoch   2 Batch  150/538 - Train Accuracy:  0.924, Validation Accuracy:  0.916, Loss:  0.085
Epoch   2 Batch  151/538 - Train Accuracy:  0.917, Validation Accuracy:  0.919, Loss:  0.082
Epoch   2 Batch  152/538 - Train Accuracy:  0.907, Validation Accuracy:  0.916, Loss:  0.084
Epoch   2 Batch  153/538 - Train Accuracy:  0.902, Validation Accuracy:  0.921, Loss:  0.095
Epoch   2 Batch  154/538 - Train Accuracy:  0.915, Validation Accuracy:  0.899, Loss:  0.087
Epoch   2 Batch  155/538 - Train Accuracy:  0.903, Validation Accuracy:  0.900, Loss:  0.090
Epoch   2 Batch  156/538 - Train Accuracy:  0.912, Validation Accuracy:  0.920, Loss:  0.087
Epoch   2 Batch  157/538 - Train Accuracy:  0.916, Validation Accuracy:  0.915, Loss:  0.079
Epoch   2 Batch  158/538 - Train Accuracy:  0.911, Validation Accuracy:  0.918, Loss:  0.102
Epoch   2 Batch  159/538 - Train Accuracy:  0.918, Validation Accuracy:  0.892, Loss:  0.089
Epoch   2 Batch  160/538 - Train Accuracy:  0.890, Validation Accuracy:  0.897, Loss:  0.086
Epoch   2 Batch  161/538 - Train Accuracy:  0.908, Validation Accuracy:  0.910, Loss:  0.088
Epoch   2 Batch  162/538 - Train Accuracy:  0.916, Validation Accuracy:  0.911, Loss:  0.089
Epoch   2 Batch  163/538 - Train Accuracy:  0.892, Validation Accuracy:  0.917, Loss:  0.098
Epoch   2 Batch  164/538 - Train Accuracy:  0.901, Validation Accuracy:  0.911, Loss:  0.092
Epoch   2 Batch  165/538 - Train Accuracy:  0.910, Validation Accuracy:  0.910, Loss:  0.080
Epoch   2 Batch  166/538 - Train Accuracy:  0.933, Validation Accuracy:  0.910, Loss:  0.087
Epoch   2 Batch  167/538 - Train Accuracy:  0.908, Validation Accuracy:  0.902, Loss:  0.088
Epoch   2 Batch  168/538 - Train Accuracy:  0.882, Validation Accuracy:  0.901, Loss:  0.103
Epoch   2 Batch  169/538 - Train Accuracy:  0.914, Validation Accuracy:  0.903, Loss:  0.085
Epoch   2 Batch  170/538 - Train Accuracy:  0.897, Validation Accuracy:  0.900, Loss:  0.098
Epoch   2 Batch  171/538 - Train Accuracy:  0.914, Validation Accuracy:  0.900, Loss:  0.085
Epoch   2 Batch  172/538 - Train Accuracy:  0.903, Validation Accuracy:  0.896, Loss:  0.086
Epoch   2 Batch  173/538 - Train Accuracy:  0.906, Validation Accuracy:  0.898, Loss:  0.080
Epoch   2 Batch  174/538 - Train Accuracy:  0.912, Validation Accuracy:  0.909, Loss:  0.084
Epoch   2 Batch  175/538 - Train Accuracy:  0.920, Validation Accuracy:  0.898, Loss:  0.079
Epoch   2 Batch  176/538 - Train Accuracy:  0.889, Validation Accuracy:  0.895, Loss:  0.094
Epoch   2 Batch  177/538 - Train Accuracy:  0.896, Validation Accuracy:  0.895, Loss:  0.090
Epoch   2 Batch  178/538 - Train Accuracy:  0.894, Validation Accuracy:  0.901, Loss:  0.085
Epoch   2 Batch  179/538 - Train Accuracy:  0.919, Validation Accuracy:  0.908, Loss:  0.088
Epoch   2 Batch  180/538 - Train Accuracy:  0.915, Validation Accuracy:  0.899, Loss:  0.085
Epoch   2 Batch  181/538 - Train Accuracy:  0.905, Validation Accuracy:  0.900, Loss:  0.091
Epoch   2 Batch  182/538 - Train Accuracy:  0.925, Validation Accuracy:  0.908, Loss:  0.076
Epoch   2 Batch  183/538 - Train Accuracy:  0.923, Validation Accuracy:  0.920, Loss:  0.069
Epoch   2 Batch  184/538 - Train Accuracy:  0.926, Validation Accuracy:  0.922, Loss:  0.085
Epoch   2 Batch  185/538 - Train Accuracy:  0.930, Validation Accuracy:  0.912, Loss:  0.085
Epoch   2 Batch  186/538 - Train Accuracy:  0.912, Validation Accuracy:  0.899, Loss:  0.077
Epoch   2 Batch  187/538 - Train Accuracy:  0.932, Validation Accuracy:  0.909, Loss:  0.084
Epoch   2 Batch  188/538 - Train Accuracy:  0.918, Validation Accuracy:  0.907, Loss:  0.079
Epoch   2 Batch  189/538 - Train Accuracy:  0.912, Validation Accuracy:  0.909, Loss:  0.083
Epoch   2 Batch  190/538 - Train Accuracy:  0.899, Validation Accuracy:  0.911, Loss:  0.105
Epoch   2 Batch  191/538 - Train Accuracy:  0.926, Validation Accuracy:  0.917, Loss:  0.083
Epoch   2 Batch  192/538 - Train Accuracy:  0.918, Validation Accuracy:  0.911, Loss:  0.077
Epoch   2 Batch  193/538 - Train Accuracy:  0.905, Validation Accuracy:  0.906, Loss:  0.091
Epoch   2 Batch  194/538 - Train Accuracy:  0.883, Validation Accuracy:  0.907, Loss:  0.091
Epoch   2 Batch  195/538 - Train Accuracy:  0.925, Validation Accuracy:  0.909, Loss:  0.083
Epoch   2 Batch  196/538 - Train Accuracy:  0.916, Validation Accuracy:  0.914, Loss:  0.077
Epoch   2 Batch  197/538 - Train Accuracy:  0.928, Validation Accuracy:  0.908, Loss:  0.077
Epoch   2 Batch  198/538 - Train Accuracy:  0.917, Validation Accuracy:  0.915, Loss:  0.081
Epoch   2 Batch  199/538 - Train Accuracy:  0.900, Validation Accuracy:  0.916, Loss:  0.086
Epoch   2 Batch  200/538 - Train Accuracy:  0.911, Validation Accuracy:  0.915, Loss:  0.073
Epoch   2 Batch  201/538 - Train Accuracy:  0.908, Validation Accuracy:  0.902, Loss:  0.088
Epoch   2 Batch  202/538 - Train Accuracy:  0.925, Validation Accuracy:  0.902, Loss:  0.079
Epoch   2 Batch  203/538 - Train Accuracy:  0.904, Validation Accuracy:  0.909, Loss:  0.092
Epoch   2 Batch  204/538 - Train Accuracy:  0.901, Validation Accuracy:  0.908, Loss:  0.093
Epoch   2 Batch  205/538 - Train Accuracy:  0.923, Validation Accuracy:  0.906, Loss:  0.074
Epoch   2 Batch  206/538 - Train Accuracy:  0.893, Validation Accuracy:  0.907, Loss:  0.084
Epoch   2 Batch  207/538 - Train Accuracy:  0.914, Validation Accuracy:  0.915, Loss:  0.084
Epoch   2 Batch  208/538 - Train Accuracy:  0.929, Validation Accuracy:  0.909, Loss:  0.091
Epoch   2 Batch  209/538 - Train Accuracy:  0.931, Validation Accuracy:  0.917, Loss:  0.075
Epoch   2 Batch  210/538 - Train Accuracy:  0.901, Validation Accuracy:  0.914, Loss:  0.085
Epoch   2 Batch  211/538 - Train Accuracy:  0.904, Validation Accuracy:  0.932, Loss:  0.079
Epoch   2 Batch  212/538 - Train Accuracy:  0.909, Validation Accuracy:  0.929, Loss:  0.078
Epoch   2 Batch  213/538 - Train Accuracy:  0.924, Validation Accuracy:  0.918, Loss:  0.077
Epoch   2 Batch  214/538 - Train Accuracy:  0.924, Validation Accuracy:  0.919, Loss:  0.066
Epoch   2 Batch  215/538 - Train Accuracy:  0.925, Validation Accuracy:  0.919, Loss:  0.078
Epoch   2 Batch  216/538 - Train Accuracy:  0.913, Validation Accuracy:  0.922, Loss:  0.083
Epoch   2 Batch  217/538 - Train Accuracy:  0.924, Validation Accuracy:  0.925, Loss:  0.087
Epoch   2 Batch  218/538 - Train Accuracy:  0.922, Validation Accuracy:  0.913, Loss:  0.070
Epoch   2 Batch  219/538 - Train Accuracy:  0.903, Validation Accuracy:  0.904, Loss:  0.093
Epoch   2 Batch  220/538 - Train Accuracy:  0.907, Validation Accuracy:  0.900, Loss:  0.079
Epoch   2 Batch  221/538 - Train Accuracy:  0.928, Validation Accuracy:  0.914, Loss:  0.073
Epoch   2 Batch  222/538 - Train Accuracy:  0.897, Validation Accuracy:  0.910, Loss:  0.075
Epoch   2 Batch  223/538 - Train Accuracy:  0.911, Validation Accuracy:  0.901, Loss:  0.088
Epoch   2 Batch  224/538 - Train Accuracy:  0.917, Validation Accuracy:  0.890, Loss:  0.081
Epoch   2 Batch  225/538 - Train Accuracy:  0.927, Validation Accuracy:  0.911, Loss:  0.078
Epoch   2 Batch  226/538 - Train Accuracy:  0.911, Validation Accuracy:  0.914, Loss:  0.083
Epoch   2 Batch  227/538 - Train Accuracy:  0.920, Validation Accuracy:  0.921, Loss:  0.082
Epoch   2 Batch  228/538 - Train Accuracy:  0.897, Validation Accuracy:  0.923, Loss:  0.080
Epoch   2 Batch  229/538 - Train Accuracy:  0.917, Validation Accuracy:  0.923, Loss:  0.075
Epoch   2 Batch  230/538 - Train Accuracy:  0.897, Validation Accuracy:  0.917, Loss:  0.079
Epoch   2 Batch  231/538 - Train Accuracy:  0.912, Validation Accuracy:  0.925, Loss:  0.077
Epoch   2 Batch  232/538 - Train Accuracy:  0.908, Validation Accuracy:  0.926, Loss:  0.075
Epoch   2 Batch  233/538 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.080
Epoch   2 Batch  234/538 - Train Accuracy:  0.920, Validation Accuracy:  0.920, Loss:  0.078
Epoch   2 Batch  235/538 - Train Accuracy:  0.913, Validation Accuracy:  0.913, Loss:  0.064
Epoch   2 Batch  236/538 - Train Accuracy:  0.901, Validation Accuracy:  0.920, Loss:  0.080
Epoch   2 Batch  237/538 - Train Accuracy:  0.925, Validation Accuracy:  0.922, Loss:  0.067
Epoch   2 Batch  238/538 - Train Accuracy:  0.939, Validation Accuracy:  0.922, Loss:  0.073
Epoch   2 Batch  239/538 - Train Accuracy:  0.909, Validation Accuracy:  0.917, Loss:  0.080
Epoch   2 Batch  240/538 - Train Accuracy:  0.919, Validation Accuracy:  0.916, Loss:  0.079
Epoch   2 Batch  241/538 - Train Accuracy:  0.899, Validation Accuracy:  0.921, Loss:  0.077
Epoch   2 Batch  242/538 - Train Accuracy:  0.934, Validation Accuracy:  0.925, Loss:  0.070
Epoch   2 Batch  243/538 - Train Accuracy:  0.929, Validation Accuracy:  0.922, Loss:  0.068
Epoch   2 Batch  244/538 - Train Accuracy:  0.910, Validation Accuracy:  0.924, Loss:  0.068
Epoch   2 Batch  245/538 - Train Accuracy:  0.906, Validation Accuracy:  0.915, Loss:  0.078
Epoch   2 Batch  246/538 - Train Accuracy:  0.924, Validation Accuracy:  0.917, Loss:  0.066
Epoch   2 Batch  247/538 - Train Accuracy:  0.917, Validation Accuracy:  0.915, Loss:  0.074
Epoch   2 Batch  248/538 - Train Accuracy:  0.920, Validation Accuracy:  0.917, Loss:  0.075
Epoch   2 Batch  249/538 - Train Accuracy:  0.916, Validation Accuracy:  0.913, Loss:  0.066
Epoch   2 Batch  250/538 - Train Accuracy:  0.912, Validation Accuracy:  0.911, Loss:  0.072
Epoch   2 Batch  251/538 - Train Accuracy:  0.913, Validation Accuracy:  0.911, Loss:  0.066
Epoch   2 Batch  252/538 - Train Accuracy:  0.923, Validation Accuracy:  0.923, Loss:  0.067
Epoch   2 Batch  253/538 - Train Accuracy:  0.909, Validation Accuracy:  0.927, Loss:  0.071
Epoch   2 Batch  254/538 - Train Accuracy:  0.891, Validation Accuracy:  0.915, Loss:  0.079
Epoch   2 Batch  255/538 - Train Accuracy:  0.931, Validation Accuracy:  0.908, Loss:  0.066
Epoch   2 Batch  256/538 - Train Accuracy:  0.902, Validation Accuracy:  0.909, Loss:  0.075
Epoch   2 Batch  257/538 - Train Accuracy:  0.914, Validation Accuracy:  0.912, Loss:  0.070
Epoch   2 Batch  258/538 - Train Accuracy:  0.929, Validation Accuracy:  0.913, Loss:  0.070
Epoch   2 Batch  259/538 - Train Accuracy:  0.930, Validation Accuracy:  0.904, Loss:  0.067
Epoch   2 Batch  260/538 - Train Accuracy:  0.900, Validation Accuracy:  0.901, Loss:  0.079
Epoch   2 Batch  261/538 - Train Accuracy:  0.919, Validation Accuracy:  0.913, Loss:  0.074
Epoch   2 Batch  262/538 - Train Accuracy:  0.933, Validation Accuracy:  0.928, Loss:  0.066
Epoch   2 Batch  263/538 - Train Accuracy:  0.905, Validation Accuracy:  0.922, Loss:  0.068
Epoch   2 Batch  264/538 - Train Accuracy:  0.916, Validation Accuracy:  0.921, Loss:  0.080
Epoch   2 Batch  265/538 - Train Accuracy:  0.916, Validation Accuracy:  0.917, Loss:  0.081
Epoch   2 Batch  266/538 - Train Accuracy:  0.905, Validation Accuracy:  0.911, Loss:  0.077
Epoch   2 Batch  267/538 - Train Accuracy:  0.915, Validation Accuracy:  0.923, Loss:  0.069
Epoch   2 Batch  268/538 - Train Accuracy:  0.905, Validation Accuracy:  0.918, Loss:  0.064
Epoch   2 Batch  269/538 - Train Accuracy:  0.918, Validation Accuracy:  0.914, Loss:  0.077
Epoch   2 Batch  270/538 - Train Accuracy:  0.928, Validation Accuracy:  0.911, Loss:  0.066
Epoch   2 Batch  271/538 - Train Accuracy:  0.920, Validation Accuracy:  0.901, Loss:  0.060
Epoch   2 Batch  272/538 - Train Accuracy:  0.918, Validation Accuracy:  0.904, Loss:  0.078
Epoch   2 Batch  273/538 - Train Accuracy:  0.918, Validation Accuracy:  0.918, Loss:  0.071
Epoch   2 Batch  274/538 - Train Accuracy:  0.874, Validation Accuracy:  0.921, Loss:  0.078
Epoch   2 Batch  275/538 - Train Accuracy:  0.906, Validation Accuracy:  0.926, Loss:  0.078
Epoch   2 Batch  276/538 - Train Accuracy:  0.921, Validation Accuracy:  0.919, Loss:  0.078
Epoch   2 Batch  277/538 - Train Accuracy:  0.915, Validation Accuracy:  0.919, Loss:  0.062
Epoch   2 Batch  278/538 - Train Accuracy:  0.930, Validation Accuracy:  0.917, Loss:  0.065
Epoch   2 Batch  279/538 - Train Accuracy:  0.912, Validation Accuracy:  0.922, Loss:  0.069
Epoch   2 Batch  280/538 - Train Accuracy:  0.921, Validation Accuracy:  0.920, Loss:  0.063
Epoch   2 Batch  281/538 - Train Accuracy:  0.914, Validation Accuracy:  0.920, Loss:  0.078
Epoch   2 Batch  282/538 - Train Accuracy:  0.914, Validation Accuracy:  0.908, Loss:  0.082
Epoch   2 Batch  283/538 - Train Accuracy:  0.915, Validation Accuracy:  0.894, Loss:  0.070
Epoch   2 Batch  284/538 - Train Accuracy:  0.922, Validation Accuracy:  0.904, Loss:  0.076
Epoch   2 Batch  285/538 - Train Accuracy:  0.922, Validation Accuracy:  0.911, Loss:  0.063
Epoch   2 Batch  286/538 - Train Accuracy:  0.907, Validation Accuracy:  0.911, Loss:  0.077
Epoch   2 Batch  287/538 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  0.063
Epoch   2 Batch  288/538 - Train Accuracy:  0.935, Validation Accuracy:  0.918, Loss:  0.069
Epoch   2 Batch  289/538 - Train Accuracy:  0.917, Validation Accuracy:  0.918, Loss:  0.057
Epoch   2 Batch  290/538 - Train Accuracy:  0.939, Validation Accuracy:  0.921, Loss:  0.061
Epoch   2 Batch  291/538 - Train Accuracy:  0.924, Validation Accuracy:  0.924, Loss:  0.070
Epoch   2 Batch  292/538 - Train Accuracy:  0.933, Validation Accuracy:  0.929, Loss:  0.055
Epoch   2 Batch  293/538 - Train Accuracy:  0.935, Validation Accuracy:  0.929, Loss:  0.057
Epoch   2 Batch  294/538 - Train Accuracy:  0.921, Validation Accuracy:  0.930, Loss:  0.065
Epoch   2 Batch  295/538 - Train Accuracy:  0.930, Validation Accuracy:  0.929, Loss:  0.064
Epoch   2 Batch  296/538 - Train Accuracy:  0.905, Validation Accuracy:  0.930, Loss:  0.077
Epoch   2 Batch  297/538 - Train Accuracy:  0.930, Validation Accuracy:  0.927, Loss:  0.062
Epoch   2 Batch  298/538 - Train Accuracy:  0.922, Validation Accuracy:  0.924, Loss:  0.062
Epoch   2 Batch  299/538 - Train Accuracy:  0.917, Validation Accuracy:  0.927, Loss:  0.078
Epoch   2 Batch  300/538 - Train Accuracy:  0.920, Validation Accuracy:  0.926, Loss:  0.064
Epoch   2 Batch  301/538 - Train Accuracy:  0.918, Validation Accuracy:  0.924, Loss:  0.067
Epoch   2 Batch  302/538 - Train Accuracy:  0.924, Validation Accuracy:  0.921, Loss:  0.062
Epoch   2 Batch  303/538 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  0.068
Epoch   2 Batch  304/538 - Train Accuracy:  0.929, Validation Accuracy:  0.916, Loss:  0.068
Epoch   2 Batch  305/538 - Train Accuracy:  0.915, Validation Accuracy:  0.918, Loss:  0.066
Epoch   2 Batch  306/538 - Train Accuracy:  0.917, Validation Accuracy:  0.913, Loss:  0.072
Epoch   2 Batch  307/538 - Train Accuracy:  0.925, Validation Accuracy:  0.915, Loss:  0.065
Epoch   2 Batch  308/538 - Train Accuracy:  0.946, Validation Accuracy:  0.921, Loss:  0.061
Epoch   2 Batch  309/538 - Train Accuracy:  0.927, Validation Accuracy:  0.923, Loss:  0.052
Epoch   2 Batch  310/538 - Train Accuracy:  0.944, Validation Accuracy:  0.920, Loss:  0.070
Epoch   2 Batch  311/538 - Train Accuracy:  0.906, Validation Accuracy:  0.925, Loss:  0.069
Epoch   2 Batch  312/538 - Train Accuracy:  0.936, Validation Accuracy:  0.930, Loss:  0.055
Epoch   2 Batch  313/538 - Train Accuracy:  0.931, Validation Accuracy:  0.935, Loss:  0.061
Epoch   2 Batch  314/538 - Train Accuracy:  0.929, Validation Accuracy:  0.926, Loss:  0.064
Epoch   2 Batch  315/538 - Train Accuracy:  0.918, Validation Accuracy:  0.929, Loss:  0.060
Epoch   2 Batch  316/538 - Train Accuracy:  0.921, Validation Accuracy:  0.933, Loss:  0.054
Epoch   2 Batch  317/538 - Train Accuracy:  0.917, Validation Accuracy:  0.933, Loss:  0.064
Epoch   2 Batch  318/538 - Train Accuracy:  0.917, Validation Accuracy:  0.928, Loss:  0.057
Epoch   2 Batch  319/538 - Train Accuracy:  0.918, Validation Accuracy:  0.927, Loss:  0.068
Epoch   2 Batch  320/538 - Train Accuracy:  0.934, Validation Accuracy:  0.929, Loss:  0.058
Epoch   2 Batch  321/538 - Train Accuracy:  0.932, Validation Accuracy:  0.928, Loss:  0.059
Epoch   2 Batch  322/538 - Train Accuracy:  0.928, Validation Accuracy:  0.924, Loss:  0.060
Epoch   2 Batch  323/538 - Train Accuracy:  0.950, Validation Accuracy:  0.926, Loss:  0.054
Epoch   2 Batch  324/538 - Train Accuracy:  0.925, Validation Accuracy:  0.917, Loss:  0.065
Epoch   2 Batch  325/538 - Train Accuracy:  0.930, Validation Accuracy:  0.920, Loss:  0.059
Epoch   2 Batch  326/538 - Train Accuracy:  0.924, Validation Accuracy:  0.926, Loss:  0.060
Epoch   2 Batch  327/538 - Train Accuracy:  0.922, Validation Accuracy:  0.926, Loss:  0.066
Epoch   2 Batch  328/538 - Train Accuracy:  0.946, Validation Accuracy:  0.923, Loss:  0.053
Epoch   2 Batch  329/538 - Train Accuracy:  0.937, Validation Accuracy:  0.925, Loss:  0.060
Epoch   2 Batch  330/538 - Train Accuracy:  0.943, Validation Accuracy:  0.925, Loss:  0.060
Epoch   2 Batch  331/538 - Train Accuracy:  0.921, Validation Accuracy:  0.924, Loss:  0.058
Epoch   2 Batch  332/538 - Train Accuracy:  0.924, Validation Accuracy:  0.922, Loss:  0.060
Epoch   2 Batch  333/538 - Train Accuracy:  0.935, Validation Accuracy:  0.921, Loss:  0.059
Epoch   2 Batch  334/538 - Train Accuracy:  0.934, Validation Accuracy:  0.923, Loss:  0.057
Epoch   2 Batch  335/538 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.057
Epoch   2 Batch  336/538 - Train Accuracy:  0.932, Validation Accuracy:  0.932, Loss:  0.056
Epoch   2 Batch  337/538 - Train Accuracy:  0.928, Validation Accuracy:  0.932, Loss:  0.054
Epoch   2 Batch  338/538 - Train Accuracy:  0.917, Validation Accuracy:  0.926, Loss:  0.060
Epoch   2 Batch  339/538 - Train Accuracy:  0.930, Validation Accuracy:  0.928, Loss:  0.061
Epoch   2 Batch  340/538 - Train Accuracy:  0.907, Validation Accuracy:  0.939, Loss:  0.062
Epoch   2 Batch  341/538 - Train Accuracy:  0.917, Validation Accuracy:  0.935, Loss:  0.054
Epoch   2 Batch  342/538 - Train Accuracy:  0.909, Validation Accuracy:  0.936, Loss:  0.060
Epoch   2 Batch  343/538 - Train Accuracy:  0.950, Validation Accuracy:  0.933, Loss:  0.063
Epoch   2 Batch  344/538 - Train Accuracy:  0.929, Validation Accuracy:  0.932, Loss:  0.052
Epoch   2 Batch  345/538 - Train Accuracy:  0.923, Validation Accuracy:  0.929, Loss:  0.059
Epoch   2 Batch  346/538 - Train Accuracy:  0.902, Validation Accuracy:  0.922, Loss:  0.071
Epoch   2 Batch  347/538 - Train Accuracy:  0.928, Validation Accuracy:  0.929, Loss:  0.059
Epoch   2 Batch  348/538 - Train Accuracy:  0.932, Validation Accuracy:  0.928, Loss:  0.053
Epoch   2 Batch  349/538 - Train Accuracy:  0.941, Validation Accuracy:  0.932, Loss:  0.050
Epoch   2 Batch  350/538 - Train Accuracy:  0.933, Validation Accuracy:  0.929, Loss:  0.066
Epoch   2 Batch  351/538 - Train Accuracy:  0.928, Validation Accuracy:  0.925, Loss:  0.069
Epoch   2 Batch  352/538 - Train Accuracy:  0.897, Validation Accuracy:  0.930, Loss:  0.078
Epoch   2 Batch  353/538 - Train Accuracy:  0.919, Validation Accuracy:  0.922, Loss:  0.060
Epoch   2 Batch  354/538 - Train Accuracy:  0.903, Validation Accuracy:  0.923, Loss:  0.056
Epoch   2 Batch  355/538 - Train Accuracy:  0.929, Validation Accuracy:  0.920, Loss:  0.066
Epoch   2 Batch  356/538 - Train Accuracy:  0.925, Validation Accuracy:  0.919, Loss:  0.055
Epoch   2 Batch  357/538 - Train Accuracy:  0.930, Validation Accuracy:  0.921, Loss:  0.054
Epoch   2 Batch  358/538 - Train Accuracy:  0.934, Validation Accuracy:  0.920, Loss:  0.047
Epoch   2 Batch  359/538 - Train Accuracy:  0.918, Validation Accuracy:  0.924, Loss:  0.060
Epoch   2 Batch  360/538 - Train Accuracy:  0.929, Validation Accuracy:  0.920, Loss:  0.054
Epoch   2 Batch  361/538 - Train Accuracy:  0.922, Validation Accuracy:  0.926, Loss:  0.061
Epoch   2 Batch  362/538 - Train Accuracy:  0.941, Validation Accuracy:  0.920, Loss:  0.049
Epoch   2 Batch  363/538 - Train Accuracy:  0.920, Validation Accuracy:  0.920, Loss:  0.054
Epoch   2 Batch  364/538 - Train Accuracy:  0.920, Validation Accuracy:  0.926, Loss:  0.073
Epoch   2 Batch  365/538 - Train Accuracy:  0.913, Validation Accuracy:  0.925, Loss:  0.061
Epoch   2 Batch  366/538 - Train Accuracy:  0.938, Validation Accuracy:  0.935, Loss:  0.059
Epoch   2 Batch  367/538 - Train Accuracy:  0.938, Validation Accuracy:  0.929, Loss:  0.049
Epoch   2 Batch  368/538 - Train Accuracy:  0.931, Validation Accuracy:  0.927, Loss:  0.054
Epoch   2 Batch  369/538 - Train Accuracy:  0.923, Validation Accuracy:  0.915, Loss:  0.055
Epoch   2 Batch  370/538 - Train Accuracy:  0.916, Validation Accuracy:  0.917, Loss:  0.062
Epoch   2 Batch  371/538 - Train Accuracy:  0.934, Validation Accuracy:  0.911, Loss:  0.065
Epoch   2 Batch  372/538 - Train Accuracy:  0.939, Validation Accuracy:  0.922, Loss:  0.059
Epoch   2 Batch  373/538 - Train Accuracy:  0.926, Validation Accuracy:  0.925, Loss:  0.045
Epoch   2 Batch  374/538 - Train Accuracy:  0.932, Validation Accuracy:  0.933, Loss:  0.050
Epoch   2 Batch  375/538 - Train Accuracy:  0.932, Validation Accuracy:  0.930, Loss:  0.051
Epoch   2 Batch  376/538 - Train Accuracy:  0.926, Validation Accuracy:  0.927, Loss:  0.058
Epoch   2 Batch  377/538 - Train Accuracy:  0.934, Validation Accuracy:  0.931, Loss:  0.063
Epoch   2 Batch  378/538 - Train Accuracy:  0.931, Validation Accuracy:  0.925, Loss:  0.051
Epoch   2 Batch  379/538 - Train Accuracy:  0.919, Validation Accuracy:  0.920, Loss:  0.059
Epoch   2 Batch  380/538 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  0.053
Epoch   2 Batch  381/538 - Train Accuracy:  0.925, Validation Accuracy:  0.924, Loss:  0.055
Epoch   2 Batch  382/538 - Train Accuracy:  0.916, Validation Accuracy:  0.923, Loss:  0.056
Epoch   2 Batch  383/538 - Train Accuracy:  0.931, Validation Accuracy:  0.927, Loss:  0.054
Epoch   2 Batch  384/538 - Train Accuracy:  0.918, Validation Accuracy:  0.917, Loss:  0.057
Epoch   2 Batch  385/538 - Train Accuracy:  0.936, Validation Accuracy:  0.921, Loss:  0.051
Epoch   2 Batch  386/538 - Train Accuracy:  0.935, Validation Accuracy:  0.923, Loss:  0.064
Epoch   2 Batch  387/538 - Train Accuracy:  0.929, Validation Accuracy:  0.928, Loss:  0.055
Epoch   2 Batch  388/538 - Train Accuracy:  0.921, Validation Accuracy:  0.925, Loss:  0.058
Epoch   2 Batch  389/538 - Train Accuracy:  0.914, Validation Accuracy:  0.926, Loss:  0.062
Epoch   2 Batch  390/538 - Train Accuracy:  0.938, Validation Accuracy:  0.925, Loss:  0.046
Epoch   2 Batch  391/538 - Train Accuracy:  0.924, Validation Accuracy:  0.928, Loss:  0.050
Epoch   2 Batch  392/538 - Train Accuracy:  0.908, Validation Accuracy:  0.925, Loss:  0.055
Epoch   2 Batch  393/538 - Train Accuracy:  0.935, Validation Accuracy:  0.924, Loss:  0.053
Epoch   2 Batch  394/538 - Train Accuracy:  0.902, Validation Accuracy:  0.925, Loss:  0.065
Epoch   2 Batch  395/538 - Train Accuracy:  0.924, Validation Accuracy:  0.928, Loss:  0.062
Epoch   2 Batch  396/538 - Train Accuracy:  0.926, Validation Accuracy:  0.929, Loss:  0.049
Epoch   2 Batch  397/538 - Train Accuracy:  0.927, Validation Accuracy:  0.930, Loss:  0.065
Epoch   2 Batch  398/538 - Train Accuracy:  0.924, Validation Accuracy:  0.924, Loss:  0.052
Epoch   2 Batch  399/538 - Train Accuracy:  0.899, Validation Accuracy:  0.916, Loss:  0.062
Epoch   2 Batch  400/538 - Train Accuracy:  0.939, Validation Accuracy:  0.919, Loss:  0.060
Epoch   2 Batch  401/538 - Train Accuracy:  0.927, Validation Accuracy:  0.934, Loss:  0.056
Epoch   2 Batch  402/538 - Train Accuracy:  0.924, Validation Accuracy:  0.937, Loss:  0.052
Epoch   2 Batch  403/538 - Train Accuracy:  0.929, Validation Accuracy:  0.939, Loss:  0.063
Epoch   2 Batch  404/538 - Train Accuracy:  0.930, Validation Accuracy:  0.944, Loss:  0.061
Epoch   2 Batch  405/538 - Train Accuracy:  0.928, Validation Accuracy:  0.925, Loss:  0.049
Epoch   2 Batch  406/538 - Train Accuracy:  0.929, Validation Accuracy:  0.917, Loss:  0.060
Epoch   2 Batch  407/538 - Train Accuracy:  0.932, Validation Accuracy:  0.926, Loss:  0.064
Epoch   2 Batch  408/538 - Train Accuracy:  0.921, Validation Accuracy:  0.932, Loss:  0.060
Epoch   2 Batch  409/538 - Train Accuracy:  0.913, Validation Accuracy:  0.927, Loss:  0.055
Epoch   2 Batch  410/538 - Train Accuracy:  0.937, Validation Accuracy:  0.930, Loss:  0.059
Epoch   2 Batch  411/538 - Train Accuracy:  0.927, Validation Accuracy:  0.919, Loss:  0.055
Epoch   2 Batch  412/538 - Train Accuracy:  0.914, Validation Accuracy:  0.923, Loss:  0.052
Epoch   2 Batch  413/538 - Train Accuracy:  0.922, Validation Accuracy:  0.935, Loss:  0.054
Epoch   2 Batch  414/538 - Train Accuracy:  0.909, Validation Accuracy:  0.930, Loss:  0.073
Epoch   2 Batch  415/538 - Train Accuracy:  0.901, Validation Accuracy:  0.930, Loss:  0.057
Epoch   2 Batch  416/538 - Train Accuracy:  0.933, Validation Accuracy:  0.927, Loss:  0.053
Epoch   2 Batch  417/538 - Train Accuracy:  0.927, Validation Accuracy:  0.931, Loss:  0.052
Epoch   2 Batch  418/538 - Train Accuracy:  0.937, Validation Accuracy:  0.924, Loss:  0.059
Epoch   2 Batch  419/538 - Train Accuracy:  0.930, Validation Accuracy:  0.925, Loss:  0.046
Epoch   2 Batch  420/538 - Train Accuracy:  0.939, Validation Accuracy:  0.927, Loss:  0.057
Epoch   2 Batch  421/538 - Train Accuracy:  0.937, Validation Accuracy:  0.929, Loss:  0.048
Epoch   2 Batch  422/538 - Train Accuracy:  0.926, Validation Accuracy:  0.926, Loss:  0.059
Epoch   2 Batch  423/538 - Train Accuracy:  0.942, Validation Accuracy:  0.930, Loss:  0.060
Epoch   2 Batch  424/538 - Train Accuracy:  0.924, Validation Accuracy:  0.934, Loss:  0.060
Epoch   2 Batch  425/538 - Train Accuracy:  0.915, Validation Accuracy:  0.932, Loss:  0.067
Epoch   2 Batch  426/538 - Train Accuracy:  0.934, Validation Accuracy:  0.924, Loss:  0.053
Epoch   2 Batch  427/538 - Train Accuracy:  0.924, Validation Accuracy:  0.919, Loss:  0.057
Epoch   2 Batch  428/538 - Train Accuracy:  0.930, Validation Accuracy:  0.923, Loss:  0.046
Epoch   2 Batch  429/538 - Train Accuracy:  0.935, Validation Accuracy:  0.918, Loss:  0.057
Epoch   2 Batch  430/538 - Train Accuracy:  0.929, Validation Accuracy:  0.922, Loss:  0.052
Epoch   2 Batch  431/538 - Train Accuracy:  0.924, Validation Accuracy:  0.920, Loss:  0.050
Epoch   2 Batch  432/538 - Train Accuracy:  0.918, Validation Accuracy:  0.919, Loss:  0.055
Epoch   2 Batch  433/538 - Train Accuracy:  0.916, Validation Accuracy:  0.915, Loss:  0.075
Epoch   2 Batch  434/538 - Train Accuracy:  0.917, Validation Accuracy:  0.912, Loss:  0.057
Epoch   2 Batch  435/538 - Train Accuracy:  0.918, Validation Accuracy:  0.914, Loss:  0.050
Epoch   2 Batch  436/538 - Train Accuracy:  0.909, Validation Accuracy:  0.912, Loss:  0.062
Epoch   2 Batch  437/538 - Train Accuracy:  0.932, Validation Accuracy:  0.916, Loss:  0.055
Epoch   2 Batch  438/538 - Train Accuracy:  0.930, Validation Accuracy:  0.926, Loss:  0.049
Epoch   2 Batch  439/538 - Train Accuracy:  0.943, Validation Accuracy:  0.926, Loss:  0.048
Epoch   2 Batch  440/538 - Train Accuracy:  0.921, Validation Accuracy:  0.930, Loss:  0.058
Epoch   2 Batch  441/538 - Train Accuracy:  0.915, Validation Accuracy:  0.933, Loss:  0.063
Epoch   2 Batch  442/538 - Train Accuracy:  0.944, Validation Accuracy:  0.920, Loss:  0.044
Epoch   2 Batch  443/538 - Train Accuracy:  0.926, Validation Accuracy:  0.911, Loss:  0.051
Epoch   2 Batch  444/538 - Train Accuracy:  0.921, Validation Accuracy:  0.911, Loss:  0.054
Epoch   2 Batch  445/538 - Train Accuracy:  0.940, Validation Accuracy:  0.930, Loss:  0.052
Epoch   2 Batch  446/538 - Train Accuracy:  0.923, Validation Accuracy:  0.931, Loss:  0.051
Epoch   2 Batch  447/538 - Train Accuracy:  0.904, Validation Accuracy:  0.932, Loss:  0.056
Epoch   2 Batch  448/538 - Train Accuracy:  0.939, Validation Accuracy:  0.935, Loss:  0.048
Epoch   2 Batch  449/538 - Train Accuracy:  0.941, Validation Accuracy:  0.933, Loss:  0.062
Epoch   2 Batch  450/538 - Train Accuracy:  0.914, Validation Accuracy:  0.927, Loss:  0.064
Epoch   2 Batch  451/538 - Train Accuracy:  0.918, Validation Accuracy:  0.927, Loss:  0.049
Epoch   2 Batch  452/538 - Train Accuracy:  0.950, Validation Accuracy:  0.920, Loss:  0.046
Epoch   2 Batch  453/538 - Train Accuracy:  0.920, Validation Accuracy:  0.927, Loss:  0.056
Epoch   2 Batch  454/538 - Train Accuracy:  0.933, Validation Accuracy:  0.928, Loss:  0.056
Epoch   2 Batch  455/538 - Train Accuracy:  0.931, Validation Accuracy:  0.942, Loss:  0.052
Epoch   2 Batch  456/538 - Train Accuracy:  0.921, Validation Accuracy:  0.941, Loss:  0.070
Epoch   2 Batch  457/538 - Train Accuracy:  0.925, Validation Accuracy:  0.937, Loss:  0.051
Epoch   2 Batch  458/538 - Train Accuracy:  0.928, Validation Accuracy:  0.936, Loss:  0.047
Epoch   2 Batch  459/538 - Train Accuracy:  0.913, Validation Accuracy:  0.931, Loss:  0.049
Epoch   2 Batch  460/538 - Train Accuracy:  0.913, Validation Accuracy:  0.927, Loss:  0.060
Epoch   2 Batch  461/538 - Train Accuracy:  0.947, Validation Accuracy:  0.938, Loss:  0.058
Epoch   2 Batch  462/538 - Train Accuracy:  0.922, Validation Accuracy:  0.924, Loss:  0.047
Epoch   2 Batch  463/538 - Train Accuracy:  0.911, Validation Accuracy:  0.925, Loss:  0.057
Epoch   2 Batch  464/538 - Train Accuracy:  0.940, Validation Accuracy:  0.927, Loss:  0.048
Epoch   2 Batch  465/538 - Train Accuracy:  0.927, Validation Accuracy:  0.934, Loss:  0.050
Epoch   2 Batch  466/538 - Train Accuracy:  0.915, Validation Accuracy:  0.935, Loss:  0.049
Epoch   2 Batch  467/538 - Train Accuracy:  0.941, Validation Accuracy:  0.933, Loss:  0.052
Epoch   2 Batch  468/538 - Train Accuracy:  0.942, Validation Accuracy:  0.932, Loss:  0.059
Epoch   2 Batch  469/538 - Train Accuracy:  0.927, Validation Accuracy:  0.932, Loss:  0.052
Epoch   2 Batch  470/538 - Train Accuracy:  0.926, Validation Accuracy:  0.935, Loss:  0.054
Epoch   2 Batch  471/538 - Train Accuracy:  0.950, Validation Accuracy:  0.928, Loss:  0.043
Epoch   2 Batch  472/538 - Train Accuracy:  0.964, Validation Accuracy:  0.931, Loss:  0.040
Epoch   2 Batch  473/538 - Train Accuracy:  0.910, Validation Accuracy:  0.933, Loss:  0.052
Epoch   2 Batch  474/538 - Train Accuracy:  0.950, Validation Accuracy:  0.933, Loss:  0.044
Epoch   2 Batch  475/538 - Train Accuracy:  0.947, Validation Accuracy:  0.931, Loss:  0.049
Epoch   2 Batch  476/538 - Train Accuracy:  0.922, Validation Accuracy:  0.929, Loss:  0.050
Epoch   2 Batch  477/538 - Train Accuracy:  0.928, Validation Accuracy:  0.935, Loss:  0.055
Epoch   2 Batch  478/538 - Train Accuracy:  0.944, Validation Accuracy:  0.931, Loss:  0.046
Epoch   2 Batch  479/538 - Train Accuracy:  0.935, Validation Accuracy:  0.931, Loss:  0.045
Epoch   2 Batch  480/538 - Train Accuracy:  0.940, Validation Accuracy:  0.924, Loss:  0.051
Epoch   2 Batch  481/538 - Train Accuracy:  0.938, Validation Accuracy:  0.926, Loss:  0.058
Epoch   2 Batch  482/538 - Train Accuracy:  0.928, Validation Accuracy:  0.928, Loss:  0.047
Epoch   2 Batch  483/538 - Train Accuracy:  0.911, Validation Accuracy:  0.933, Loss:  0.057
Epoch   2 Batch  484/538 - Train Accuracy:  0.930, Validation Accuracy:  0.925, Loss:  0.059
Epoch   2 Batch  485/538 - Train Accuracy:  0.930, Validation Accuracy:  0.917, Loss:  0.057
Epoch   2 Batch  486/538 - Train Accuracy:  0.927, Validation Accuracy:  0.934, Loss:  0.044
Epoch   2 Batch  487/538 - Train Accuracy:  0.932, Validation Accuracy:  0.935, Loss:  0.045
Epoch   2 Batch  488/538 - Train Accuracy:  0.950, Validation Accuracy:  0.927, Loss:  0.039
Epoch   2 Batch  489/538 - Train Accuracy:  0.914, Validation Accuracy:  0.935, Loss:  0.056
Epoch   2 Batch  490/538 - Train Accuracy:  0.922, Validation Accuracy:  0.933, Loss:  0.048
Epoch   2 Batch  491/538 - Train Accuracy:  0.897, Validation Accuracy:  0.928, Loss:  0.054
Epoch   2 Batch  492/538 - Train Accuracy:  0.947, Validation Accuracy:  0.918, Loss:  0.046
Epoch   2 Batch  493/538 - Train Accuracy:  0.928, Validation Accuracy:  0.920, Loss:  0.051
Epoch   2 Batch  494/538 - Train Accuracy:  0.925, Validation Accuracy:  0.918, Loss:  0.054
Epoch   2 Batch  495/538 - Train Accuracy:  0.934, Validation Accuracy:  0.930, Loss:  0.055
Epoch   2 Batch  496/538 - Train Accuracy:  0.943, Validation Accuracy:  0.930, Loss:  0.047
Epoch   2 Batch  497/538 - Train Accuracy:  0.938, Validation Accuracy:  0.929, Loss:  0.047
Epoch   2 Batch  498/538 - Train Accuracy:  0.935, Validation Accuracy:  0.925, Loss:  0.045
Epoch   2 Batch  499/538 - Train Accuracy:  0.931, Validation Accuracy:  0.922, Loss:  0.050
Epoch   2 Batch  500/538 - Train Accuracy:  0.947, Validation Accuracy:  0.918, Loss:  0.040
Epoch   2 Batch  501/538 - Train Accuracy:  0.947, Validation Accuracy:  0.922, Loss:  0.047
Epoch   2 Batch  502/538 - Train Accuracy:  0.933, Validation Accuracy:  0.923, Loss:  0.043
Epoch   2 Batch  503/538 - Train Accuracy:  0.944, Validation Accuracy:  0.929, Loss:  0.050
Epoch   2 Batch  504/538 - Train Accuracy:  0.952, Validation Accuracy:  0.931, Loss:  0.037
Epoch   2 Batch  505/538 - Train Accuracy:  0.948, Validation Accuracy:  0.931, Loss:  0.038
Epoch   2 Batch  506/538 - Train Accuracy:  0.949, Validation Accuracy:  0.934, Loss:  0.039
Epoch   2 Batch  507/538 - Train Accuracy:  0.910, Validation Accuracy:  0.934, Loss:  0.052
Epoch   2 Batch  508/538 - Train Accuracy:  0.928, Validation Accuracy:  0.936, Loss:  0.047
Epoch   2 Batch  509/538 - Train Accuracy:  0.949, Validation Accuracy:  0.931, Loss:  0.051
Epoch   2 Batch  510/538 - Train Accuracy:  0.937, Validation Accuracy:  0.936, Loss:  0.047
Epoch   2 Batch  511/538 - Train Accuracy:  0.926, Validation Accuracy:  0.940, Loss:  0.052
Epoch   2 Batch  512/538 - Train Accuracy:  0.937, Validation Accuracy:  0.938, Loss:  0.049
Epoch   2 Batch  513/538 - Train Accuracy:  0.915, Validation Accuracy:  0.938, Loss:  0.045
Epoch   2 Batch  514/538 - Train Accuracy:  0.925, Validation Accuracy:  0.940, Loss:  0.047
Epoch   2 Batch  515/538 - Train Accuracy:  0.925, Validation Accuracy:  0.940, Loss:  0.054
Epoch   2 Batch  516/538 - Train Accuracy:  0.916, Validation Accuracy:  0.938, Loss:  0.051
Epoch   2 Batch  517/538 - Train Accuracy:  0.938, Validation Accuracy:  0.928, Loss:  0.044
Epoch   2 Batch  518/538 - Train Accuracy:  0.928, Validation Accuracy:  0.927, Loss:  0.054
Epoch   2 Batch  519/538 - Train Accuracy:  0.940, Validation Accuracy:  0.931, Loss:  0.053
Epoch   2 Batch  520/538 - Train Accuracy:  0.932, Validation Accuracy:  0.929, Loss:  0.054
Epoch   2 Batch  521/538 - Train Accuracy:  0.940, Validation Accuracy:  0.928, Loss:  0.060
Epoch   2 Batch  522/538 - Train Accuracy:  0.935, Validation Accuracy:  0.924, Loss:  0.046
Epoch   2 Batch  523/538 - Train Accuracy:  0.941, Validation Accuracy:  0.924, Loss:  0.046
Epoch   2 Batch  524/538 - Train Accuracy:  0.921, Validation Accuracy:  0.924, Loss:  0.047
Epoch   2 Batch  525/538 - Train Accuracy:  0.938, Validation Accuracy:  0.922, Loss:  0.052
Epoch   2 Batch  526/538 - Train Accuracy:  0.931, Validation Accuracy:  0.926, Loss:  0.052
Epoch   2 Batch  527/538 - Train Accuracy:  0.931, Validation Accuracy:  0.935, Loss:  0.048
Epoch   2 Batch  528/538 - Train Accuracy:  0.927, Validation Accuracy:  0.930, Loss:  0.049
Epoch   2 Batch  529/538 - Train Accuracy:  0.911, Validation Accuracy:  0.936, Loss:  0.050
Epoch   2 Batch  530/538 - Train Accuracy:  0.912, Validation Accuracy:  0.931, Loss:  0.061
Epoch   2 Batch  531/538 - Train Accuracy:  0.932, Validation Accuracy:  0.931, Loss:  0.053
Epoch   2 Batch  532/538 - Train Accuracy:  0.928, Validation Accuracy:  0.935, Loss:  0.045
Epoch   2 Batch  533/538 - Train Accuracy:  0.933, Validation Accuracy:  0.930, Loss:  0.048
Epoch   2 Batch  534/538 - Train Accuracy:  0.942, Validation Accuracy:  0.925, Loss:  0.035
Epoch   2 Batch  535/538 - Train Accuracy:  0.947, Validation Accuracy:  0.920, Loss:  0.046
Epoch   2 Batch  536/538 - Train Accuracy:  0.929, Validation Accuracy:  0.921, Loss:  0.060
Epoch   3 Batch    0/538 - Train Accuracy:  0.956, Validation Accuracy:  0.912, Loss:  0.041
Epoch   3 Batch    1/538 - Train Accuracy:  0.946, Validation Accuracy:  0.915, Loss:  0.049
Epoch   3 Batch    2/538 - Train Accuracy:  0.937, Validation Accuracy:  0.923, Loss:  0.055
Epoch   3 Batch    3/538 - Train Accuracy:  0.946, Validation Accuracy:  0.932, Loss:  0.044
Epoch   3 Batch    4/538 - Train Accuracy:  0.932, Validation Accuracy:  0.938, Loss:  0.046
Epoch   3 Batch    5/538 - Train Accuracy:  0.925, Validation Accuracy:  0.936, Loss:  0.053
Epoch   3 Batch    6/538 - Train Accuracy:  0.939, Validation Accuracy:  0.931, Loss:  0.049
Epoch   3 Batch    7/538 - Train Accuracy:  0.939, Validation Accuracy:  0.936, Loss:  0.050
Epoch   3 Batch    8/538 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.048
Epoch   3 Batch    9/538 - Train Accuracy:  0.925, Validation Accuracy:  0.940, Loss:  0.045
Epoch   3 Batch   10/538 - Train Accuracy:  0.922, Validation Accuracy:  0.935, Loss:  0.049
Epoch   3 Batch   11/538 - Train Accuracy:  0.935, Validation Accuracy:  0.939, Loss:  0.048
Epoch   3 Batch   12/538 - Train Accuracy:  0.939, Validation Accuracy:  0.935, Loss:  0.048
Epoch   3 Batch   13/538 - Train Accuracy:  0.955, Validation Accuracy:  0.936, Loss:  0.045
Epoch   3 Batch   14/538 - Train Accuracy:  0.928, Validation Accuracy:  0.939, Loss:  0.045
Epoch   3 Batch   15/538 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  0.046
Epoch   3 Batch   16/538 - Train Accuracy:  0.931, Validation Accuracy:  0.947, Loss:  0.045
Epoch   3 Batch   17/538 - Train Accuracy:  0.942, Validation Accuracy:  0.953, Loss:  0.048
Epoch   3 Batch   18/538 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.053
Epoch   3 Batch   19/538 - Train Accuracy:  0.926, Validation Accuracy:  0.949, Loss:  0.052
Epoch   3 Batch   20/538 - Train Accuracy:  0.935, Validation Accuracy:  0.949, Loss:  0.054
Epoch   3 Batch   21/538 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.037
Epoch   3 Batch   22/538 - Train Accuracy:  0.932, Validation Accuracy:  0.953, Loss:  0.043
Epoch   3 Batch   23/538 - Train Accuracy:  0.932, Validation Accuracy:  0.945, Loss:  0.059
Epoch   3 Batch   24/538 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  0.050
Epoch   3 Batch   25/538 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.048
Epoch   3 Batch   26/538 - Train Accuracy:  0.929, Validation Accuracy:  0.940, Loss:  0.057
Epoch   3 Batch   27/538 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.038
Epoch   3 Batch   28/538 - Train Accuracy:  0.921, Validation Accuracy:  0.952, Loss:  0.045
Epoch   3 Batch   29/538 - Train Accuracy:  0.941, Validation Accuracy:  0.950, Loss:  0.037
Epoch   3 Batch   30/538 - Train Accuracy:  0.929, Validation Accuracy:  0.950, Loss:  0.052
Epoch   3 Batch   31/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.035
Epoch   3 Batch   32/538 - Train Accuracy:  0.938, Validation Accuracy:  0.942, Loss:  0.033
Epoch   3 Batch   33/538 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  0.049
Epoch   3 Batch   34/538 - Train Accuracy:  0.926, Validation Accuracy:  0.944, Loss:  0.054
Epoch   3 Batch   35/538 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.042
Epoch   3 Batch   36/538 - Train Accuracy:  0.935, Validation Accuracy:  0.939, Loss:  0.041
Epoch   3 Batch   37/538 - Train Accuracy:  0.932, Validation Accuracy:  0.933, Loss:  0.050
Epoch   3 Batch   38/538 - Train Accuracy:  0.943, Validation Accuracy:  0.931, Loss:  0.043
Epoch   3 Batch   39/538 - Train Accuracy:  0.937, Validation Accuracy:  0.938, Loss:  0.047
Epoch   3 Batch   40/538 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.036
Epoch   3 Batch   41/538 - Train Accuracy:  0.938, Validation Accuracy:  0.937, Loss:  0.044
Epoch   3 Batch   42/538 - Train Accuracy:  0.945, Validation Accuracy:  0.933, Loss:  0.047
Epoch   3 Batch   43/538 - Train Accuracy:  0.921, Validation Accuracy:  0.934, Loss:  0.055
Epoch   3 Batch   44/538 - Train Accuracy:  0.938, Validation Accuracy:  0.942, Loss:  0.048
Epoch   3 Batch   45/538 - Train Accuracy:  0.937, Validation Accuracy:  0.940, Loss:  0.048
Epoch   3 Batch   46/538 - Train Accuracy:  0.955, Validation Accuracy:  0.944, Loss:  0.039
Epoch   3 Batch   47/538 - Train Accuracy:  0.935, Validation Accuracy:  0.937, Loss:  0.049
Epoch   3 Batch   48/538 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.047
Epoch   3 Batch   49/538 - Train Accuracy:  0.948, Validation Accuracy:  0.932, Loss:  0.047
Epoch   3 Batch   50/538 - Train Accuracy:  0.934, Validation Accuracy:  0.941, Loss:  0.043
Epoch   3 Batch   51/538 - Train Accuracy:  0.925, Validation Accuracy:  0.934, Loss:  0.052
Epoch   3 Batch   52/538 - Train Accuracy:  0.929, Validation Accuracy:  0.931, Loss:  0.049
Epoch   3 Batch   53/538 - Train Accuracy:  0.913, Validation Accuracy:  0.936, Loss:  0.047
Epoch   3 Batch   54/538 - Train Accuracy:  0.956, Validation Accuracy:  0.932, Loss:  0.038
Epoch   3 Batch   55/538 - Train Accuracy:  0.937, Validation Accuracy:  0.934, Loss:  0.049
Epoch   3 Batch   56/538 - Train Accuracy:  0.938, Validation Accuracy:  0.944, Loss:  0.046
Epoch   3 Batch   57/538 - Train Accuracy:  0.893, Validation Accuracy:  0.936, Loss:  0.060
Epoch   3 Batch   58/538 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.043
Epoch   3 Batch   59/538 - Train Accuracy:  0.931, Validation Accuracy:  0.936, Loss:  0.048
Epoch   3 Batch   60/538 - Train Accuracy:  0.936, Validation Accuracy:  0.947, Loss:  0.048
Epoch   3 Batch   61/538 - Train Accuracy:  0.938, Validation Accuracy:  0.942, Loss:  0.046
Epoch   3 Batch   62/538 - Train Accuracy:  0.933, Validation Accuracy:  0.942, Loss:  0.048
Epoch   3 Batch   63/538 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.044
Epoch   3 Batch   64/538 - Train Accuracy:  0.935, Validation Accuracy:  0.930, Loss:  0.048
Epoch   3 Batch   65/538 - Train Accuracy:  0.921, Validation Accuracy:  0.935, Loss:  0.043
Epoch   3 Batch   66/538 - Train Accuracy:  0.942, Validation Accuracy:  0.938, Loss:  0.035
Epoch   3 Batch   67/538 - Train Accuracy:  0.957, Validation Accuracy:  0.936, Loss:  0.046
Epoch   3 Batch   68/538 - Train Accuracy:  0.929, Validation Accuracy:  0.936, Loss:  0.040
Epoch   3 Batch   69/538 - Train Accuracy:  0.931, Validation Accuracy:  0.930, Loss:  0.044
Epoch   3 Batch   70/538 - Train Accuracy:  0.945, Validation Accuracy:  0.932, Loss:  0.040
Epoch   3 Batch   71/538 - Train Accuracy:  0.923, Validation Accuracy:  0.937, Loss:  0.055
Epoch   3 Batch   72/538 - Train Accuracy:  0.946, Validation Accuracy:  0.935, Loss:  0.059
Epoch   3 Batch   73/538 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  0.042
Epoch   3 Batch   74/538 - Train Accuracy:  0.922, Validation Accuracy:  0.921, Loss:  0.041
Epoch   3 Batch   75/538 - Train Accuracy:  0.924, Validation Accuracy:  0.924, Loss:  0.046
Epoch   3 Batch   76/538 - Train Accuracy:  0.938, Validation Accuracy:  0.931, Loss:  0.051
Epoch   3 Batch   77/538 - Train Accuracy:  0.937, Validation Accuracy:  0.930, Loss:  0.038
Epoch   3 Batch   78/538 - Train Accuracy:  0.930, Validation Accuracy:  0.930, Loss:  0.051
Epoch   3 Batch   79/538 - Train Accuracy:  0.932, Validation Accuracy:  0.931, Loss:  0.038
Epoch   3 Batch   80/538 - Train Accuracy:  0.936, Validation Accuracy:  0.939, Loss:  0.045
Epoch   3 Batch   81/538 - Train Accuracy:  0.919, Validation Accuracy:  0.935, Loss:  0.048
Epoch   3 Batch   82/538 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.043
Epoch   3 Batch   83/538 - Train Accuracy:  0.922, Validation Accuracy:  0.936, Loss:  0.053
Epoch   3 Batch   84/538 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  0.051
Epoch   3 Batch   85/538 - Train Accuracy:  0.963, Validation Accuracy:  0.936, Loss:  0.039
Epoch   3 Batch   86/538 - Train Accuracy:  0.946, Validation Accuracy:  0.934, Loss:  0.038
Epoch   3 Batch   87/538 - Train Accuracy:  0.930, Validation Accuracy:  0.936, Loss:  0.045
Epoch   3 Batch   88/538 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.046
Epoch   3 Batch   89/538 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  0.045
Epoch   3 Batch   90/538 - Train Accuracy:  0.924, Validation Accuracy:  0.938, Loss:  0.056
Epoch   3 Batch   91/538 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.044
Epoch   3 Batch   92/538 - Train Accuracy:  0.939, Validation Accuracy:  0.931, Loss:  0.044
Epoch   3 Batch   93/538 - Train Accuracy:  0.928, Validation Accuracy:  0.931, Loss:  0.039
Epoch   3 Batch   94/538 - Train Accuracy:  0.941, Validation Accuracy:  0.936, Loss:  0.041
Epoch   3 Batch   95/538 - Train Accuracy:  0.922, Validation Accuracy:  0.940, Loss:  0.038
Epoch   3 Batch   96/538 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.039
Epoch   3 Batch   97/538 - Train Accuracy:  0.936, Validation Accuracy:  0.940, Loss:  0.038
Epoch   3 Batch   98/538 - Train Accuracy:  0.947, Validation Accuracy:  0.939, Loss:  0.047
Epoch   3 Batch   99/538 - Train Accuracy:  0.932, Validation Accuracy:  0.938, Loss:  0.039
Epoch   3 Batch  100/538 - Train Accuracy:  0.944, Validation Accuracy:  0.938, Loss:  0.040
Epoch   3 Batch  101/538 - Train Accuracy:  0.918, Validation Accuracy:  0.937, Loss:  0.054
Epoch   3 Batch  102/538 - Train Accuracy:  0.917, Validation Accuracy:  0.935, Loss:  0.048
Epoch   3 Batch  103/538 - Train Accuracy:  0.923, Validation Accuracy:  0.935, Loss:  0.041
Epoch   3 Batch  104/538 - Train Accuracy:  0.942, Validation Accuracy:  0.932, Loss:  0.037
Epoch   3 Batch  105/538 - Train Accuracy:  0.936, Validation Accuracy:  0.935, Loss:  0.040
Epoch   3 Batch  106/538 - Train Accuracy:  0.924, Validation Accuracy:  0.939, Loss:  0.037
Epoch   3 Batch  107/538 - Train Accuracy:  0.920, Validation Accuracy:  0.941, Loss:  0.047
Epoch   3 Batch  108/538 - Train Accuracy:  0.945, Validation Accuracy:  0.946, Loss:  0.042
Epoch   3 Batch  109/538 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.036
Epoch   3 Batch  110/538 - Train Accuracy:  0.933, Validation Accuracy:  0.941, Loss:  0.042
Epoch   3 Batch  111/538 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.038
Epoch   3 Batch  112/538 - Train Accuracy:  0.929, Validation Accuracy:  0.943, Loss:  0.047
Epoch   3 Batch  113/538 - Train Accuracy:  0.924, Validation Accuracy:  0.936, Loss:  0.045
Epoch   3 Batch  114/538 - Train Accuracy:  0.942, Validation Accuracy:  0.925, Loss:  0.042
Epoch   3 Batch  115/538 - Train Accuracy:  0.942, Validation Accuracy:  0.926, Loss:  0.041
Epoch   3 Batch  116/538 - Train Accuracy:  0.923, Validation Accuracy:  0.933, Loss:  0.050
Epoch   3 Batch  117/538 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  0.049
Epoch   3 Batch  118/538 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.037
Epoch   3 Batch  119/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch  120/538 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.033
Epoch   3 Batch  121/538 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.043
Epoch   3 Batch  122/538 - Train Accuracy:  0.940, Validation Accuracy:  0.943, Loss:  0.040
Epoch   3 Batch  123/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.041
Epoch   3 Batch  124/538 - Train Accuracy:  0.942, Validation Accuracy:  0.943, Loss:  0.045
Epoch   3 Batch  125/538 - Train Accuracy:  0.940, Validation Accuracy:  0.943, Loss:  0.048
Epoch   3 Batch  126/538 - Train Accuracy:  0.920, Validation Accuracy:  0.940, Loss:  0.046
Epoch   3 Batch  127/538 - Train Accuracy:  0.920, Validation Accuracy:  0.941, Loss:  0.057
Epoch   3 Batch  128/538 - Train Accuracy:  0.951, Validation Accuracy:  0.943, Loss:  0.042
Epoch   3 Batch  129/538 - Train Accuracy:  0.952, Validation Accuracy:  0.938, Loss:  0.034
Epoch   3 Batch  130/538 - Train Accuracy:  0.940, Validation Accuracy:  0.934, Loss:  0.045
Epoch   3 Batch  131/538 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.037
Epoch   3 Batch  132/538 - Train Accuracy:  0.930, Validation Accuracy:  0.942, Loss:  0.046
Epoch   3 Batch  133/538 - Train Accuracy:  0.928, Validation Accuracy:  0.938, Loss:  0.041
Epoch   3 Batch  134/538 - Train Accuracy:  0.925, Validation Accuracy:  0.933, Loss:  0.054
Epoch   3 Batch  135/538 - Train Accuracy:  0.935, Validation Accuracy:  0.937, Loss:  0.051
Epoch   3 Batch  136/538 - Train Accuracy:  0.932, Validation Accuracy:  0.930, Loss:  0.041
Epoch   3 Batch  137/538 - Train Accuracy:  0.922, Validation Accuracy:  0.926, Loss:  0.048
Epoch   3 Batch  138/538 - Train Accuracy:  0.939, Validation Accuracy:  0.930, Loss:  0.042
Epoch   3 Batch  139/538 - Train Accuracy:  0.924, Validation Accuracy:  0.933, Loss:  0.047
Epoch   3 Batch  140/538 - Train Accuracy:  0.939, Validation Accuracy:  0.937, Loss:  0.057
Epoch   3 Batch  141/538 - Train Accuracy:  0.945, Validation Accuracy:  0.939, Loss:  0.053
Epoch   3 Batch  142/538 - Train Accuracy:  0.937, Validation Accuracy:  0.942, Loss:  0.046
Epoch   3 Batch  143/538 - Train Accuracy:  0.947, Validation Accuracy:  0.936, Loss:  0.052
Epoch   3 Batch  144/538 - Train Accuracy:  0.935, Validation Accuracy:  0.941, Loss:  0.048
Epoch   3 Batch  145/538 - Train Accuracy:  0.921, Validation Accuracy:  0.938, Loss:  0.055
Epoch   3 Batch  146/538 - Train Accuracy:  0.939, Validation Accuracy:  0.934, Loss:  0.045
Epoch   3 Batch  147/538 - Train Accuracy:  0.945, Validation Accuracy:  0.930, Loss:  0.044
Epoch   3 Batch  148/538 - Train Accuracy:  0.921, Validation Accuracy:  0.931, Loss:  0.055
Epoch   3 Batch  149/538 - Train Accuracy:  0.946, Validation Accuracy:  0.931, Loss:  0.044
Epoch   3 Batch  150/538 - Train Accuracy:  0.950, Validation Accuracy:  0.929, Loss:  0.041
Epoch   3 Batch  151/538 - Train Accuracy:  0.931, Validation Accuracy:  0.928, Loss:  0.043
Epoch   3 Batch  152/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  0.046
Epoch   3 Batch  153/538 - Train Accuracy:  0.935, Validation Accuracy:  0.937, Loss:  0.050
Epoch   3 Batch  154/538 - Train Accuracy:  0.928, Validation Accuracy:  0.934, Loss:  0.042
Epoch   3 Batch  155/538 - Train Accuracy:  0.940, Validation Accuracy:  0.929, Loss:  0.043
Epoch   3 Batch  156/538 - Train Accuracy:  0.952, Validation Accuracy:  0.932, Loss:  0.037
Epoch   3 Batch  157/538 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.041
Epoch   3 Batch  158/538 - Train Accuracy:  0.957, Validation Accuracy:  0.942, Loss:  0.049
Epoch   3 Batch  159/538 - Train Accuracy:  0.932, Validation Accuracy:  0.928, Loss:  0.046
Epoch   3 Batch  160/538 - Train Accuracy:  0.906, Validation Accuracy:  0.918, Loss:  0.042
Epoch   3 Batch  161/538 - Train Accuracy:  0.934, Validation Accuracy:  0.923, Loss:  0.045
Epoch   3 Batch  162/538 - Train Accuracy:  0.940, Validation Accuracy:  0.927, Loss:  0.049
Epoch   3 Batch  163/538 - Train Accuracy:  0.920, Validation Accuracy:  0.936, Loss:  0.053
Epoch   3 Batch  164/538 - Train Accuracy:  0.927, Validation Accuracy:  0.940, Loss:  0.055
Epoch   3 Batch  165/538 - Train Accuracy:  0.926, Validation Accuracy:  0.933, Loss:  0.036
Epoch   3 Batch  166/538 - Train Accuracy:  0.961, Validation Accuracy:  0.924, Loss:  0.037
Epoch   3 Batch  167/538 - Train Accuracy:  0.923, Validation Accuracy:  0.923, Loss:  0.056
Epoch   3 Batch  168/538 - Train Accuracy:  0.905, Validation Accuracy:  0.931, Loss:  0.059
Epoch   3 Batch  169/538 - Train Accuracy:  0.946, Validation Accuracy:  0.927, Loss:  0.033
Epoch   3 Batch  170/538 - Train Accuracy:  0.931, Validation Accuracy:  0.936, Loss:  0.051
Epoch   3 Batch  171/538 - Train Accuracy:  0.924, Validation Accuracy:  0.939, Loss:  0.042
Epoch   3 Batch  172/538 - Train Accuracy:  0.925, Validation Accuracy:  0.941, Loss:  0.042
Epoch   3 Batch  173/538 - Train Accuracy:  0.940, Validation Accuracy:  0.936, Loss:  0.036
Epoch   3 Batch  174/538 - Train Accuracy:  0.926, Validation Accuracy:  0.934, Loss:  0.045
Epoch   3 Batch  175/538 - Train Accuracy:  0.930, Validation Accuracy:  0.941, Loss:  0.039
Epoch   3 Batch  176/538 - Train Accuracy:  0.931, Validation Accuracy:  0.944, Loss:  0.049
Epoch   3 Batch  177/538 - Train Accuracy:  0.939, Validation Accuracy:  0.941, Loss:  0.041
Epoch   3 Batch  178/538 - Train Accuracy:  0.929, Validation Accuracy:  0.937, Loss:  0.044
Epoch   3 Batch  179/538 - Train Accuracy:  0.950, Validation Accuracy:  0.924, Loss:  0.035
Epoch   3 Batch  180/538 - Train Accuracy:  0.940, Validation Accuracy:  0.920, Loss:  0.040
Epoch   3 Batch  181/538 - Train Accuracy:  0.942, Validation Accuracy:  0.928, Loss:  0.048
Epoch   3 Batch  182/538 - Train Accuracy:  0.941, Validation Accuracy:  0.923, Loss:  0.040
Epoch   3 Batch  183/538 - Train Accuracy:  0.956, Validation Accuracy:  0.921, Loss:  0.035
Epoch   3 Batch  184/538 - Train Accuracy:  0.940, Validation Accuracy:  0.928, Loss:  0.044
Epoch   3 Batch  185/538 - Train Accuracy:  0.957, Validation Accuracy:  0.913, Loss:  0.035
Epoch   3 Batch  186/538 - Train Accuracy:  0.936, Validation Accuracy:  0.922, Loss:  0.040
Epoch   3 Batch  187/538 - Train Accuracy:  0.933, Validation Accuracy:  0.933, Loss:  0.049
Epoch   3 Batch  188/538 - Train Accuracy:  0.942, Validation Accuracy:  0.934, Loss:  0.037
Epoch   3 Batch  189/538 - Train Accuracy:  0.946, Validation Accuracy:  0.941, Loss:  0.046
Epoch   3 Batch  190/538 - Train Accuracy:  0.935, Validation Accuracy:  0.935, Loss:  0.054
Epoch   3 Batch  191/538 - Train Accuracy:  0.956, Validation Accuracy:  0.933, Loss:  0.038
Epoch   3 Batch  192/538 - Train Accuracy:  0.938, Validation Accuracy:  0.930, Loss:  0.041
Epoch   3 Batch  193/538 - Train Accuracy:  0.939, Validation Accuracy:  0.938, Loss:  0.047
Epoch   3 Batch  194/538 - Train Accuracy:  0.915, Validation Accuracy:  0.933, Loss:  0.047
Epoch   3 Batch  195/538 - Train Accuracy:  0.941, Validation Accuracy:  0.929, Loss:  0.051
Epoch   3 Batch  196/538 - Train Accuracy:  0.938, Validation Accuracy:  0.936, Loss:  0.036
Epoch   3 Batch  197/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.039
Epoch   3 Batch  198/538 - Train Accuracy:  0.956, Validation Accuracy:  0.932, Loss:  0.040
Epoch   3 Batch  199/538 - Train Accuracy:  0.925, Validation Accuracy:  0.935, Loss:  0.043
Epoch   3 Batch  200/538 - Train Accuracy:  0.949, Validation Accuracy:  0.938, Loss:  0.035
Epoch   3 Batch  201/538 - Train Accuracy:  0.933, Validation Accuracy:  0.944, Loss:  0.049
Epoch   3 Batch  202/538 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.040
Epoch   3 Batch  203/538 - Train Accuracy:  0.926, Validation Accuracy:  0.940, Loss:  0.050
Epoch   3 Batch  204/538 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  0.050
Epoch   3 Batch  205/538 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  0.041
Epoch   3 Batch  206/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  0.038
Epoch   3 Batch  207/538 - Train Accuracy:  0.950, Validation Accuracy:  0.944, Loss:  0.042
Epoch   3 Batch  208/538 - Train Accuracy:  0.942, Validation Accuracy:  0.948, Loss:  0.055
Epoch   3 Batch  209/538 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  0.037
Epoch   3 Batch  210/538 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.043
Epoch   3 Batch  211/538 - Train Accuracy:  0.932, Validation Accuracy:  0.950, Loss:  0.046
Epoch   3 Batch  212/538 - Train Accuracy:  0.935, Validation Accuracy:  0.951, Loss:  0.045
Epoch   3 Batch  213/538 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.038
Epoch   3 Batch  214/538 - Train Accuracy:  0.944, Validation Accuracy:  0.951, Loss:  0.033
Epoch   3 Batch  215/538 - Train Accuracy:  0.938, Validation Accuracy:  0.954, Loss:  0.037
Epoch   3 Batch  216/538 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  0.042
Epoch   3 Batch  217/538 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  0.047
Epoch   3 Batch  218/538 - Train Accuracy:  0.951, Validation Accuracy:  0.946, Loss:  0.033
Epoch   3 Batch  219/538 - Train Accuracy:  0.925, Validation Accuracy:  0.942, Loss:  0.049
Epoch   3 Batch  220/538 - Train Accuracy:  0.916, Validation Accuracy:  0.947, Loss:  0.046
Epoch   3 Batch  221/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.035
Epoch   3 Batch  222/538 - Train Accuracy:  0.923, Validation Accuracy:  0.948, Loss:  0.037
Epoch   3 Batch  223/538 - Train Accuracy:  0.922, Validation Accuracy:  0.937, Loss:  0.045
Epoch   3 Batch  224/538 - Train Accuracy:  0.928, Validation Accuracy:  0.932, Loss:  0.048
Epoch   3 Batch  225/538 - Train Accuracy:  0.948, Validation Accuracy:  0.928, Loss:  0.038
Epoch   3 Batch  226/538 - Train Accuracy:  0.934, Validation Accuracy:  0.929, Loss:  0.041
Epoch   3 Batch  227/538 - Train Accuracy:  0.940, Validation Accuracy:  0.932, Loss:  0.045
Epoch   3 Batch  228/538 - Train Accuracy:  0.929, Validation Accuracy:  0.934, Loss:  0.042
Epoch   3 Batch  229/538 - Train Accuracy:  0.948, Validation Accuracy:  0.936, Loss:  0.039
Epoch   3 Batch  230/538 - Train Accuracy:  0.927, Validation Accuracy:  0.933, Loss:  0.041
Epoch   3 Batch  231/538 - Train Accuracy:  0.944, Validation Accuracy:  0.932, Loss:  0.043
Epoch   3 Batch  232/538 - Train Accuracy:  0.933, Validation Accuracy:  0.932, Loss:  0.035
Epoch   3 Batch  233/538 - Train Accuracy:  0.948, Validation Accuracy:  0.935, Loss:  0.040
Epoch   3 Batch  234/538 - Train Accuracy:  0.946, Validation Accuracy:  0.930, Loss:  0.041
Epoch   3 Batch  235/538 - Train Accuracy:  0.941, Validation Accuracy:  0.947, Loss:  0.038
Epoch   3 Batch  236/538 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.040
Epoch   3 Batch  237/538 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  238/538 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  0.041
Epoch   3 Batch  239/538 - Train Accuracy:  0.939, Validation Accuracy:  0.941, Loss:  0.040
Epoch   3 Batch  240/538 - Train Accuracy:  0.938, Validation Accuracy:  0.942, Loss:  0.044
Epoch   3 Batch  241/538 - Train Accuracy:  0.931, Validation Accuracy:  0.937, Loss:  0.041
Epoch   3 Batch  242/538 - Train Accuracy:  0.960, Validation Accuracy:  0.935, Loss:  0.037
Epoch   3 Batch  243/538 - Train Accuracy:  0.947, Validation Accuracy:  0.925, Loss:  0.033
Epoch   3 Batch  244/538 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  0.035
Epoch   3 Batch  245/538 - Train Accuracy:  0.934, Validation Accuracy:  0.927, Loss:  0.043
Epoch   3 Batch  246/538 - Train Accuracy:  0.953, Validation Accuracy:  0.928, Loss:  0.030
Epoch   3 Batch  247/538 - Train Accuracy:  0.933, Validation Accuracy:  0.930, Loss:  0.033
Epoch   3 Batch  248/538 - Train Accuracy:  0.931, Validation Accuracy:  0.932, Loss:  0.043
Epoch   3 Batch  249/538 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.031
Epoch   3 Batch  250/538 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  0.040
Epoch   3 Batch  251/538 - Train Accuracy:  0.937, Validation Accuracy:  0.945, Loss:  0.037
Epoch   3 Batch  252/538 - Train Accuracy:  0.955, Validation Accuracy:  0.934, Loss:  0.038
Epoch   3 Batch  253/538 - Train Accuracy:  0.919, Validation Accuracy:  0.934, Loss:  0.041
Epoch   3 Batch  254/538 - Train Accuracy:  0.939, Validation Accuracy:  0.935, Loss:  0.044
Epoch   3 Batch  255/538 - Train Accuracy:  0.959, Validation Accuracy:  0.933, Loss:  0.033
Epoch   3 Batch  256/538 - Train Accuracy:  0.927, Validation Accuracy:  0.936, Loss:  0.043
Epoch   3 Batch  257/538 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  0.036
Epoch   3 Batch  258/538 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.037
Epoch   3 Batch  259/538 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  0.036
Epoch   3 Batch  260/538 - Train Accuracy:  0.928, Validation Accuracy:  0.944, Loss:  0.045
Epoch   3 Batch  261/538 - Train Accuracy:  0.933, Validation Accuracy:  0.936, Loss:  0.043
Epoch   3 Batch  262/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  0.040
Epoch   3 Batch  263/538 - Train Accuracy:  0.931, Validation Accuracy:  0.938, Loss:  0.038
Epoch   3 Batch  264/538 - Train Accuracy:  0.931, Validation Accuracy:  0.934, Loss:  0.053
Epoch   3 Batch  265/538 - Train Accuracy:  0.931, Validation Accuracy:  0.940, Loss:  0.050
Epoch   3 Batch  266/538 - Train Accuracy:  0.925, Validation Accuracy:  0.938, Loss:  0.041
Epoch   3 Batch  267/538 - Train Accuracy:  0.932, Validation Accuracy:  0.932, Loss:  0.036
Epoch   3 Batch  268/538 - Train Accuracy:  0.936, Validation Accuracy:  0.935, Loss:  0.031
Epoch   3 Batch  269/538 - Train Accuracy:  0.945, Validation Accuracy:  0.937, Loss:  0.043
Epoch   3 Batch  270/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  0.033
Epoch   3 Batch  271/538 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  0.034
Epoch   3 Batch  272/538 - Train Accuracy:  0.939, Validation Accuracy:  0.945, Loss:  0.043
Epoch   3 Batch  273/538 - Train Accuracy:  0.939, Validation Accuracy:  0.932, Loss:  0.040
Epoch   3 Batch  274/538 - Train Accuracy:  0.912, Validation Accuracy:  0.926, Loss:  0.047
Epoch   3 Batch  275/538 - Train Accuracy:  0.945, Validation Accuracy:  0.927, Loss:  0.052
Epoch   3 Batch  276/538 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.042
Epoch   3 Batch  277/538 - Train Accuracy:  0.945, Validation Accuracy:  0.938, Loss:  0.038
Epoch   3 Batch  278/538 - Train Accuracy:  0.937, Validation Accuracy:  0.936, Loss:  0.035
Epoch   3 Batch  279/538 - Train Accuracy:  0.942, Validation Accuracy:  0.939, Loss:  0.035
Epoch   3 Batch  280/538 - Train Accuracy:  0.943, Validation Accuracy:  0.931, Loss:  0.033
Epoch   3 Batch  281/538 - Train Accuracy:  0.924, Validation Accuracy:  0.927, Loss:  0.049
Epoch   3 Batch  282/538 - Train Accuracy:  0.946, Validation Accuracy:  0.925, Loss:  0.044
Epoch   3 Batch  283/538 - Train Accuracy:  0.952, Validation Accuracy:  0.930, Loss:  0.037
Epoch   3 Batch  284/538 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  0.046
Epoch   3 Batch  285/538 - Train Accuracy:  0.941, Validation Accuracy:  0.934, Loss:  0.037
Epoch   3 Batch  286/538 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  0.044
Epoch   3 Batch  287/538 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.032
Epoch   3 Batch  288/538 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.039
Epoch   3 Batch  289/538 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.033
Epoch   3 Batch  290/538 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.033
Epoch   3 Batch  291/538 - Train Accuracy:  0.947, Validation Accuracy:  0.946, Loss:  0.041
Epoch   3 Batch  292/538 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.032
Epoch   3 Batch  293/538 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.036
Epoch   3 Batch  294/538 - Train Accuracy:  0.947, Validation Accuracy:  0.949, Loss:  0.039
Epoch   3 Batch  295/538 - Train Accuracy:  0.946, Validation Accuracy:  0.946, Loss:  0.038
Epoch   3 Batch  296/538 - Train Accuracy:  0.938, Validation Accuracy:  0.943, Loss:  0.053
Epoch   3 Batch  297/538 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  0.037
Epoch   3 Batch  298/538 - Train Accuracy:  0.943, Validation Accuracy:  0.952, Loss:  0.037
Epoch   3 Batch  299/538 - Train Accuracy:  0.930, Validation Accuracy:  0.947, Loss:  0.047
Epoch   3 Batch  300/538 - Train Accuracy:  0.932, Validation Accuracy:  0.940, Loss:  0.043
Epoch   3 Batch  301/538 - Train Accuracy:  0.939, Validation Accuracy:  0.947, Loss:  0.042
Epoch   3 Batch  302/538 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.039
Epoch   3 Batch  303/538 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  0.042
Epoch   3 Batch  304/538 - Train Accuracy:  0.942, Validation Accuracy:  0.948, Loss:  0.039
Epoch   3 Batch  305/538 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.035
Epoch   3 Batch  306/538 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.038
Epoch   3 Batch  307/538 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.036
Epoch   3 Batch  308/538 - Train Accuracy:  0.950, Validation Accuracy:  0.943, Loss:  0.038
Epoch   3 Batch  309/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  0.031
Epoch   3 Batch  310/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  0.044
Epoch   3 Batch  311/538 - Train Accuracy:  0.926, Validation Accuracy:  0.941, Loss:  0.045
Epoch   3 Batch  312/538 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.033
Epoch   3 Batch  313/538 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.038
Epoch   3 Batch  314/538 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.039
Epoch   3 Batch  315/538 - Train Accuracy:  0.937, Validation Accuracy:  0.948, Loss:  0.037
Epoch   3 Batch  316/538 - Train Accuracy:  0.927, Validation Accuracy:  0.945, Loss:  0.033
Epoch   3 Batch  317/538 - Train Accuracy:  0.941, Validation Accuracy:  0.942, Loss:  0.040
Epoch   3 Batch  318/538 - Train Accuracy:  0.930, Validation Accuracy:  0.946, Loss:  0.034
Epoch   3 Batch  319/538 - Train Accuracy:  0.931, Validation Accuracy:  0.942, Loss:  0.045
Epoch   3 Batch  320/538 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  0.034
Epoch   3 Batch  321/538 - Train Accuracy:  0.944, Validation Accuracy:  0.953, Loss:  0.029
Epoch   3 Batch  322/538 - Train Accuracy:  0.942, Validation Accuracy:  0.951, Loss:  0.039
Epoch   3 Batch  323/538 - Train Accuracy:  0.946, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  324/538 - Train Accuracy:  0.944, Validation Accuracy:  0.947, Loss:  0.038
Epoch   3 Batch  325/538 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.037
Epoch   3 Batch  326/538 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  0.038
Epoch   3 Batch  327/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.043
Epoch   3 Batch  328/538 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.033
Epoch   3 Batch  329/538 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  0.035
Epoch   3 Batch  330/538 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.037
Epoch   3 Batch  331/538 - Train Accuracy:  0.941, Validation Accuracy:  0.953, Loss:  0.033
Epoch   3 Batch  332/538 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.038
Epoch   3 Batch  333/538 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.035
Epoch   3 Batch  334/538 - Train Accuracy:  0.945, Validation Accuracy:  0.934, Loss:  0.031
Epoch   3 Batch  335/538 - Train Accuracy:  0.948, Validation Accuracy:  0.935, Loss:  0.037
Epoch   3 Batch  336/538 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.033
Epoch   3 Batch  337/538 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  0.038
Epoch   3 Batch  338/538 - Train Accuracy:  0.944, Validation Accuracy:  0.962, Loss:  0.036
Epoch   3 Batch  339/538 - Train Accuracy:  0.941, Validation Accuracy:  0.960, Loss:  0.038
Epoch   3 Batch  340/538 - Train Accuracy:  0.932, Validation Accuracy:  0.954, Loss:  0.036
Epoch   3 Batch  341/538 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.035
Epoch   3 Batch  342/538 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  0.036
Epoch   3 Batch  343/538 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.036
Epoch   3 Batch  344/538 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  0.031
Epoch   3 Batch  345/538 - Train Accuracy:  0.952, Validation Accuracy:  0.943, Loss:  0.032
Epoch   3 Batch  346/538 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.042
Epoch   3 Batch  347/538 - Train Accuracy:  0.958, Validation Accuracy:  0.943, Loss:  0.031
Epoch   3 Batch  348/538 - Train Accuracy:  0.933, Validation Accuracy:  0.945, Loss:  0.030
Epoch   3 Batch  349/538 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  0.029
Epoch   3 Batch  350/538 - Train Accuracy:  0.944, Validation Accuracy:  0.942, Loss:  0.044
Epoch   3 Batch  351/538 - Train Accuracy:  0.936, Validation Accuracy:  0.942, Loss:  0.045
Epoch   3 Batch  352/538 - Train Accuracy:  0.915, Validation Accuracy:  0.947, Loss:  0.056
Epoch   3 Batch  353/538 - Train Accuracy:  0.933, Validation Accuracy:  0.946, Loss:  0.038
Epoch   3 Batch  354/538 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.035
Epoch   3 Batch  355/538 - Train Accuracy:  0.957, Validation Accuracy:  0.944, Loss:  0.037
Epoch   3 Batch  356/538 - Train Accuracy:  0.950, Validation Accuracy:  0.948, Loss:  0.034
Epoch   3 Batch  357/538 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  0.033
Epoch   3 Batch  358/538 - Train Accuracy:  0.938, Validation Accuracy:  0.948, Loss:  0.033
Epoch   3 Batch  359/538 - Train Accuracy:  0.937, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch  360/538 - Train Accuracy:  0.942, Validation Accuracy:  0.948, Loss:  0.034
Epoch   3 Batch  361/538 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.035
Epoch   3 Batch  362/538 - Train Accuracy:  0.950, Validation Accuracy:  0.950, Loss:  0.029
Epoch   3 Batch  363/538 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  0.035
Epoch   3 Batch  364/538 - Train Accuracy:  0.934, Validation Accuracy:  0.948, Loss:  0.044
Epoch   3 Batch  365/538 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  0.036
Epoch   3 Batch  366/538 - Train Accuracy:  0.940, Validation Accuracy:  0.951, Loss:  0.038
Epoch   3 Batch  367/538 - Train Accuracy:  0.950, Validation Accuracy:  0.953, Loss:  0.032
Epoch   3 Batch  368/538 - Train Accuracy:  0.952, Validation Accuracy:  0.950, Loss:  0.034
Epoch   3 Batch  369/538 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.031
Epoch   3 Batch  370/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.035
Epoch   3 Batch  371/538 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  0.037
Epoch   3 Batch  372/538 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  0.034
Epoch   3 Batch  373/538 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  0.029
Epoch   3 Batch  374/538 - Train Accuracy:  0.961, Validation Accuracy:  0.944, Loss:  0.035
Epoch   3 Batch  375/538 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.034
Epoch   3 Batch  376/538 - Train Accuracy:  0.934, Validation Accuracy:  0.941, Loss:  0.037
Epoch   3 Batch  377/538 - Train Accuracy:  0.955, Validation Accuracy:  0.938, Loss:  0.036
Epoch   3 Batch  378/538 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  0.032
Epoch   3 Batch  379/538 - Train Accuracy:  0.937, Validation Accuracy:  0.940, Loss:  0.040
Epoch   3 Batch  380/538 - Train Accuracy:  0.947, Validation Accuracy:  0.939, Loss:  0.030
Epoch   3 Batch  381/538 - Train Accuracy:  0.953, Validation Accuracy:  0.939, Loss:  0.033
Epoch   3 Batch  382/538 - Train Accuracy:  0.936, Validation Accuracy:  0.941, Loss:  0.042
Epoch   3 Batch  383/538 - Train Accuracy:  0.942, Validation Accuracy:  0.951, Loss:  0.036
Epoch   3 Batch  384/538 - Train Accuracy:  0.937, Validation Accuracy:  0.945, Loss:  0.036
Epoch   3 Batch  385/538 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.034
Epoch   3 Batch  386/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.036
Epoch   3 Batch  387/538 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.034
Epoch   3 Batch  388/538 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  0.038
Epoch   3 Batch  389/538 - Train Accuracy:  0.926, Validation Accuracy:  0.940, Loss:  0.045
Epoch   3 Batch  390/538 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.031
Epoch   3 Batch  391/538 - Train Accuracy:  0.928, Validation Accuracy:  0.938, Loss:  0.033
Epoch   3 Batch  392/538 - Train Accuracy:  0.945, Validation Accuracy:  0.939, Loss:  0.031
Epoch   3 Batch  393/538 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.035
Epoch   3 Batch  394/538 - Train Accuracy:  0.932, Validation Accuracy:  0.935, Loss:  0.038
Epoch   3 Batch  395/538 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.041
Epoch   3 Batch  396/538 - Train Accuracy:  0.942, Validation Accuracy:  0.937, Loss:  0.032
Epoch   3 Batch  397/538 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.039
Epoch   3 Batch  398/538 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  0.034
Epoch   3 Batch  399/538 - Train Accuracy:  0.940, Validation Accuracy:  0.938, Loss:  0.033
Epoch   3 Batch  400/538 - Train Accuracy:  0.957, Validation Accuracy:  0.938, Loss:  0.038
Epoch   3 Batch  401/538 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.032
Epoch   3 Batch  402/538 - Train Accuracy:  0.951, Validation Accuracy:  0.943, Loss:  0.033
Epoch   3 Batch  403/538 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.040
Epoch   3 Batch  404/538 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.037
Epoch   3 Batch  405/538 - Train Accuracy:  0.944, Validation Accuracy:  0.942, Loss:  0.036
Epoch   3 Batch  406/538 - Train Accuracy:  0.945, Validation Accuracy:  0.951, Loss:  0.035
Epoch   3 Batch  407/538 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.038
Epoch   3 Batch  408/538 - Train Accuracy:  0.930, Validation Accuracy:  0.944, Loss:  0.042
Epoch   3 Batch  409/538 - Train Accuracy:  0.943, Validation Accuracy:  0.943, Loss:  0.037
Epoch   3 Batch  410/538 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch  411/538 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  0.039
Epoch   3 Batch  412/538 - Train Accuracy:  0.935, Validation Accuracy:  0.941, Loss:  0.034
Epoch   3 Batch  413/538 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.030
Epoch   3 Batch  414/538 - Train Accuracy:  0.921, Validation Accuracy:  0.938, Loss:  0.048
Epoch   3 Batch  415/538 - Train Accuracy:  0.934, Validation Accuracy:  0.944, Loss:  0.036
Epoch   3 Batch  416/538 - Train Accuracy:  0.944, Validation Accuracy:  0.947, Loss:  0.038
Epoch   3 Batch  417/538 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.030
Epoch   3 Batch  418/538 - Train Accuracy:  0.944, Validation Accuracy:  0.944, Loss:  0.039
Epoch   3 Batch  419/538 - Train Accuracy:  0.950, Validation Accuracy:  0.944, Loss:  0.031
Epoch   3 Batch  420/538 - Train Accuracy:  0.952, Validation Accuracy:  0.942, Loss:  0.041
Epoch   3 Batch  421/538 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  0.033
Epoch   3 Batch  422/538 - Train Accuracy:  0.939, Validation Accuracy:  0.939, Loss:  0.038
Epoch   3 Batch  423/538 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.036
Epoch   3 Batch  424/538 - Train Accuracy:  0.944, Validation Accuracy:  0.946, Loss:  0.039
Epoch   3 Batch  425/538 - Train Accuracy:  0.936, Validation Accuracy:  0.950, Loss:  0.043
Epoch   3 Batch  426/538 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  0.034
Epoch   3 Batch  427/538 - Train Accuracy:  0.938, Validation Accuracy:  0.951, Loss:  0.038
Epoch   3 Batch  428/538 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.029
Epoch   3 Batch  429/538 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  0.037
Epoch   3 Batch  430/538 - Train Accuracy:  0.941, Validation Accuracy:  0.950, Loss:  0.034
Epoch   3 Batch  431/538 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.036
Epoch   3 Batch  432/538 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  0.040
Epoch   3 Batch  433/538 - Train Accuracy:  0.930, Validation Accuracy:  0.940, Loss:  0.058
Epoch   3 Batch  434/538 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  0.035
Epoch   3 Batch  435/538 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.031
Epoch   3 Batch  436/538 - Train Accuracy:  0.927, Validation Accuracy:  0.940, Loss:  0.038
Epoch   3 Batch  437/538 - Train Accuracy:  0.956, Validation Accuracy:  0.937, Loss:  0.031
Epoch   3 Batch  438/538 - Train Accuracy:  0.949, Validation Accuracy:  0.937, Loss:  0.031
Epoch   3 Batch  439/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.037
Epoch   3 Batch  440/538 - Train Accuracy:  0.953, Validation Accuracy:  0.942, Loss:  0.041
Epoch   3 Batch  441/538 - Train Accuracy:  0.918, Validation Accuracy:  0.942, Loss:  0.042
Epoch   3 Batch  442/538 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  0.028
Epoch   3 Batch  443/538 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.040
Epoch   3 Batch  444/538 - Train Accuracy:  0.943, Validation Accuracy:  0.935, Loss:  0.035
Epoch   3 Batch  445/538 - Train Accuracy:  0.967, Validation Accuracy:  0.938, Loss:  0.029
Epoch   3 Batch  446/538 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  0.036
Epoch   3 Batch  447/538 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  0.035
Epoch   3 Batch  448/538 - Train Accuracy:  0.945, Validation Accuracy:  0.951, Loss:  0.031
Epoch   3 Batch  449/538 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.042
Epoch   3 Batch  450/538 - Train Accuracy:  0.924, Validation Accuracy:  0.948, Loss:  0.043
Epoch   3 Batch  451/538 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.035
Epoch   3 Batch  452/538 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.033
Epoch   3 Batch  453/538 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.043
Epoch   3 Batch  454/538 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.039
Epoch   3 Batch  455/538 - Train Accuracy:  0.945, Validation Accuracy:  0.955, Loss:  0.040
Epoch   3 Batch  456/538 - Train Accuracy:  0.939, Validation Accuracy:  0.953, Loss:  0.055
Epoch   3 Batch  457/538 - Train Accuracy:  0.948, Validation Accuracy:  0.953, Loss:  0.034
Epoch   3 Batch  458/538 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.036
Epoch   3 Batch  459/538 - Train Accuracy:  0.941, Validation Accuracy:  0.950, Loss:  0.032
Epoch   3 Batch  460/538 - Train Accuracy:  0.935, Validation Accuracy:  0.949, Loss:  0.039
Epoch   3 Batch  461/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.041
Epoch   3 Batch  462/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.033
Epoch   3 Batch  463/538 - Train Accuracy:  0.938, Validation Accuracy:  0.950, Loss:  0.041
Epoch   3 Batch  464/538 - Train Accuracy:  0.946, Validation Accuracy:  0.949, Loss:  0.034
Epoch   3 Batch  465/538 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  466/538 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.041
Epoch   3 Batch  467/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  0.038
Epoch   3 Batch  468/538 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.037
Epoch   3 Batch  469/538 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  0.037
Epoch   3 Batch  470/538 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  0.038
Epoch   3 Batch  471/538 - Train Accuracy:  0.964, Validation Accuracy:  0.943, Loss:  0.029
Epoch   3 Batch  472/538 - Train Accuracy:  0.966, Validation Accuracy:  0.939, Loss:  0.026
Epoch   3 Batch  473/538 - Train Accuracy:  0.930, Validation Accuracy:  0.939, Loss:  0.034
Epoch   3 Batch  474/538 - Train Accuracy:  0.953, Validation Accuracy:  0.939, Loss:  0.034
Epoch   3 Batch  475/538 - Train Accuracy:  0.954, Validation Accuracy:  0.942, Loss:  0.034
Epoch   3 Batch  476/538 - Train Accuracy:  0.945, Validation Accuracy:  0.943, Loss:  0.032
Epoch   3 Batch  477/538 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.040
Epoch   3 Batch  478/538 - Train Accuracy:  0.959, Validation Accuracy:  0.943, Loss:  0.033
Epoch   3 Batch  479/538 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  0.037
Epoch   3 Batch  480/538 - Train Accuracy:  0.961, Validation Accuracy:  0.944, Loss:  0.032
Epoch   3 Batch  481/538 - Train Accuracy:  0.959, Validation Accuracy:  0.943, Loss:  0.040
Epoch   3 Batch  482/538 - Train Accuracy:  0.944, Validation Accuracy:  0.943, Loss:  0.029
Epoch   3 Batch  483/538 - Train Accuracy:  0.932, Validation Accuracy:  0.943, Loss:  0.042
Epoch   3 Batch  484/538 - Train Accuracy:  0.947, Validation Accuracy:  0.945, Loss:  0.041
Epoch   3 Batch  485/538 - Train Accuracy:  0.945, Validation Accuracy:  0.944, Loss:  0.038
Epoch   3 Batch  486/538 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  0.032
Epoch   3 Batch  487/538 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.027
Epoch   3 Batch  488/538 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  489/538 - Train Accuracy:  0.934, Validation Accuracy:  0.946, Loss:  0.039
Epoch   3 Batch  490/538 - Train Accuracy:  0.933, Validation Accuracy:  0.944, Loss:  0.035
Epoch   3 Batch  491/538 - Train Accuracy:  0.921, Validation Accuracy:  0.947, Loss:  0.039
Epoch   3 Batch  492/538 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.028
Epoch   3 Batch  493/538 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  0.033
Epoch   3 Batch  494/538 - Train Accuracy:  0.945, Validation Accuracy:  0.943, Loss:  0.042
Epoch   3 Batch  495/538 - Train Accuracy:  0.942, Validation Accuracy:  0.948, Loss:  0.037
Epoch   3 Batch  496/538 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.033
Epoch   3 Batch  497/538 - Train Accuracy:  0.953, Validation Accuracy:  0.938, Loss:  0.034
Epoch   3 Batch  498/538 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  0.031
Epoch   3 Batch  499/538 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  0.034
Epoch   3 Batch  500/538 - Train Accuracy:  0.953, Validation Accuracy:  0.936, Loss:  0.028
Epoch   3 Batch  501/538 - Train Accuracy:  0.959, Validation Accuracy:  0.940, Loss:  0.037
Epoch   3 Batch  502/538 - Train Accuracy:  0.936, Validation Accuracy:  0.937, Loss:  0.036
Epoch   3 Batch  503/538 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.035
Epoch   3 Batch  504/538 - Train Accuracy:  0.966, Validation Accuracy:  0.940, Loss:  0.029
Epoch   3 Batch  505/538 - Train Accuracy:  0.963, Validation Accuracy:  0.945, Loss:  0.028
Epoch   3 Batch  506/538 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.028
Epoch   3 Batch  507/538 - Train Accuracy:  0.936, Validation Accuracy:  0.951, Loss:  0.038
Epoch   3 Batch  508/538 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  0.035
Epoch   3 Batch  509/538 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  0.036
Epoch   3 Batch  510/538 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.032
Epoch   3 Batch  511/538 - Train Accuracy:  0.941, Validation Accuracy:  0.936, Loss:  0.036
Epoch   3 Batch  512/538 - Train Accuracy:  0.941, Validation Accuracy:  0.941, Loss:  0.036
Epoch   3 Batch  513/538 - Train Accuracy:  0.945, Validation Accuracy:  0.946, Loss:  0.034
Epoch   3 Batch  514/538 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  0.034
Epoch   3 Batch  515/538 - Train Accuracy:  0.937, Validation Accuracy:  0.949, Loss:  0.044
Epoch   3 Batch  516/538 - Train Accuracy:  0.930, Validation Accuracy:  0.944, Loss:  0.034
Epoch   3 Batch  517/538 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  0.034
Epoch   3 Batch  518/538 - Train Accuracy:  0.944, Validation Accuracy:  0.937, Loss:  0.039
Epoch   3 Batch  519/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.038
Epoch   3 Batch  520/538 - Train Accuracy:  0.951, Validation Accuracy:  0.946, Loss:  0.032
Epoch   3 Batch  521/538 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.038
Epoch   3 Batch  522/538 - Train Accuracy:  0.940, Validation Accuracy:  0.947, Loss:  0.029
Epoch   3 Batch  523/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  0.035
Epoch   3 Batch  524/538 - Train Accuracy:  0.948, Validation Accuracy:  0.941, Loss:  0.033
Epoch   3 Batch  525/538 - Train Accuracy:  0.945, Validation Accuracy:  0.936, Loss:  0.038
Epoch   3 Batch  526/538 - Train Accuracy:  0.936, Validation Accuracy:  0.941, Loss:  0.032
Epoch   3 Batch  527/538 - Train Accuracy:  0.934, Validation Accuracy:  0.942, Loss:  0.036
Epoch   3 Batch  528/538 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.032
Epoch   3 Batch  529/538 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.035
Epoch   3 Batch  530/538 - Train Accuracy:  0.931, Validation Accuracy:  0.941, Loss:  0.037
Epoch   3 Batch  531/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.038
Epoch   3 Batch  532/538 - Train Accuracy:  0.937, Validation Accuracy:  0.939, Loss:  0.036
Epoch   3 Batch  533/538 - Train Accuracy:  0.940, Validation Accuracy:  0.939, Loss:  0.034
Epoch   3 Batch  534/538 - Train Accuracy:  0.949, Validation Accuracy:  0.935, Loss:  0.025
Epoch   3 Batch  535/538 - Train Accuracy:  0.958, Validation Accuracy:  0.939, Loss:  0.035
Epoch   3 Batch  536/538 - Train Accuracy:  0.961, Validation Accuracy:  0.941, Loss:  0.040
Epoch   4 Batch    0/538 - Train Accuracy:  0.956, Validation Accuracy:  0.944, Loss:  0.029
Epoch   4 Batch    1/538 - Train Accuracy:  0.961, Validation Accuracy:  0.943, Loss:  0.034
Epoch   4 Batch    2/538 - Train Accuracy:  0.952, Validation Accuracy:  0.943, Loss:  0.038
Epoch   4 Batch    3/538 - Train Accuracy:  0.946, Validation Accuracy:  0.935, Loss:  0.030
Epoch   4 Batch    4/538 - Train Accuracy:  0.962, Validation Accuracy:  0.934, Loss:  0.033
Epoch   4 Batch    5/538 - Train Accuracy:  0.937, Validation Accuracy:  0.935, Loss:  0.037
Epoch   4 Batch    6/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  0.029
Epoch   4 Batch    7/538 - Train Accuracy:  0.950, Validation Accuracy:  0.943, Loss:  0.037
Epoch   4 Batch    8/538 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  0.036
Epoch   4 Batch    9/538 - Train Accuracy:  0.937, Validation Accuracy:  0.944, Loss:  0.032
Epoch   4 Batch   10/538 - Train Accuracy:  0.944, Validation Accuracy:  0.943, Loss:  0.038
Epoch   4 Batch   11/538 - Train Accuracy:  0.943, Validation Accuracy:  0.946, Loss:  0.036
Epoch   4 Batch   12/538 - Train Accuracy:  0.942, Validation Accuracy:  0.949, Loss:  0.033
Epoch   4 Batch   13/538 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.028
Epoch   4 Batch   14/538 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.030
Epoch   4 Batch   15/538 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.034
Epoch   4 Batch   16/538 - Train Accuracy:  0.949, Validation Accuracy:  0.948, Loss:  0.031
Epoch   4 Batch   17/538 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.033
Epoch   4 Batch   18/538 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.041
Epoch   4 Batch   19/538 - Train Accuracy:  0.944, Validation Accuracy:  0.953, Loss:  0.035
Epoch   4 Batch   20/538 - Train Accuracy:  0.953, Validation Accuracy:  0.955, Loss:  0.035
Epoch   4 Batch   21/538 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.023
Epoch   4 Batch   22/538 - Train Accuracy:  0.944, Validation Accuracy:  0.949, Loss:  0.035
Epoch   4 Batch   23/538 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.040
Epoch   4 Batch   24/538 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.040
Epoch   4 Batch   25/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.035
Epoch   4 Batch   26/538 - Train Accuracy:  0.944, Validation Accuracy:  0.942, Loss:  0.042
Epoch   4 Batch   27/538 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch   28/538 - Train Accuracy:  0.935, Validation Accuracy:  0.939, Loss:  0.031
Epoch   4 Batch   29/538 - Train Accuracy:  0.945, Validation Accuracy:  0.934, Loss:  0.028
Epoch   4 Batch   30/538 - Train Accuracy:  0.933, Validation Accuracy:  0.936, Loss:  0.037
Epoch   4 Batch   31/538 - Train Accuracy:  0.954, Validation Accuracy:  0.938, Loss:  0.027
Epoch   4 Batch   32/538 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.024
Epoch   4 Batch   33/538 - Train Accuracy:  0.940, Validation Accuracy:  0.939, Loss:  0.035
Epoch   4 Batch   34/538 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.041
Epoch   4 Batch   35/538 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.032
Epoch   4 Batch   36/538 - Train Accuracy:  0.942, Validation Accuracy:  0.945, Loss:  0.027
Epoch   4 Batch   37/538 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.040
Epoch   4 Batch   38/538 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.033
Epoch   4 Batch   39/538 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.035
Epoch   4 Batch   40/538 - Train Accuracy:  0.952, Validation Accuracy:  0.943, Loss:  0.028
Epoch   4 Batch   41/538 - Train Accuracy:  0.960, Validation Accuracy:  0.945, Loss:  0.032
Epoch   4 Batch   42/538 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch   43/538 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  0.041
Epoch   4 Batch   44/538 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  0.031
Epoch   4 Batch   45/538 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.037
Epoch   4 Batch   46/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.025
Epoch   4 Batch   47/538 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.033
Epoch   4 Batch   48/538 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.035
Epoch   4 Batch   49/538 - Train Accuracy:  0.953, Validation Accuracy:  0.947, Loss:  0.031
Epoch   4 Batch   50/538 - Train Accuracy:  0.939, Validation Accuracy:  0.950, Loss:  0.031
Epoch   4 Batch   51/538 - Train Accuracy:  0.947, Validation Accuracy:  0.946, Loss:  0.037
Epoch   4 Batch   52/538 - Train Accuracy:  0.960, Validation Accuracy:  0.947, Loss:  0.031
Epoch   4 Batch   53/538 - Train Accuracy:  0.922, Validation Accuracy:  0.947, Loss:  0.035
Epoch   4 Batch   54/538 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  0.025
Epoch   4 Batch   55/538 - Train Accuracy:  0.942, Validation Accuracy:  0.950, Loss:  0.029
Epoch   4 Batch   56/538 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  0.034
Epoch   4 Batch   57/538 - Train Accuracy:  0.926, Validation Accuracy:  0.945, Loss:  0.040
Epoch   4 Batch   58/538 - Train Accuracy:  0.931, Validation Accuracy:  0.940, Loss:  0.034
Epoch   4 Batch   59/538 - Train Accuracy:  0.939, Validation Accuracy:  0.941, Loss:  0.032
Epoch   4 Batch   60/538 - Train Accuracy:  0.940, Validation Accuracy:  0.943, Loss:  0.033
Epoch   4 Batch   61/538 - Train Accuracy:  0.944, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch   62/538 - Train Accuracy:  0.948, Validation Accuracy:  0.953, Loss:  0.034
Epoch   4 Batch   63/538 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  0.029
Epoch   4 Batch   64/538 - Train Accuracy:  0.939, Validation Accuracy:  0.952, Loss:  0.035
Epoch   4 Batch   65/538 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  0.033
Epoch   4 Batch   66/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.024
Epoch   4 Batch   67/538 - Train Accuracy:  0.957, Validation Accuracy:  0.948, Loss:  0.031
Epoch   4 Batch   68/538 - Train Accuracy:  0.941, Validation Accuracy:  0.951, Loss:  0.029
Epoch   4 Batch   69/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.031
Epoch   4 Batch   70/538 - Train Accuracy:  0.950, Validation Accuracy:  0.948, Loss:  0.029
Epoch   4 Batch   71/538 - Train Accuracy:  0.948, Validation Accuracy:  0.952, Loss:  0.039
Epoch   4 Batch   72/538 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.045
Epoch   4 Batch   73/538 - Train Accuracy:  0.941, Validation Accuracy:  0.950, Loss:  0.034
Epoch   4 Batch   74/538 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.034
Epoch   4 Batch   75/538 - Train Accuracy:  0.940, Validation Accuracy:  0.948, Loss:  0.032
Epoch   4 Batch   76/538 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.032
Epoch   4 Batch   77/538 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  0.028
Epoch   4 Batch   78/538 - Train Accuracy:  0.936, Validation Accuracy:  0.941, Loss:  0.032
Epoch   4 Batch   79/538 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.028
Epoch   4 Batch   80/538 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  0.032
Epoch   4 Batch   81/538 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.036
Epoch   4 Batch   82/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  0.032
Epoch   4 Batch   83/538 - Train Accuracy:  0.929, Validation Accuracy:  0.945, Loss:  0.037
Epoch   4 Batch   84/538 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  0.033
Epoch   4 Batch   85/538 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  0.028
Epoch   4 Batch   86/538 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  0.032
Epoch   4 Batch   87/538 - Train Accuracy:  0.934, Validation Accuracy:  0.954, Loss:  0.031
Epoch   4 Batch   88/538 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  0.029
Epoch   4 Batch   89/538 - Train Accuracy:  0.954, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch   90/538 - Train Accuracy:  0.934, Validation Accuracy:  0.943, Loss:  0.042
Epoch   4 Batch   91/538 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.031
Epoch   4 Batch   92/538 - Train Accuracy:  0.944, Validation Accuracy:  0.944, Loss:  0.036
Epoch   4 Batch   93/538 - Train Accuracy:  0.953, Validation Accuracy:  0.937, Loss:  0.029
Epoch   4 Batch   94/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.028
Epoch   4 Batch   95/538 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  0.033
Epoch   4 Batch   96/538 - Train Accuracy:  0.959, Validation Accuracy:  0.942, Loss:  0.024
Epoch   4 Batch   97/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.026
Epoch   4 Batch   98/538 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.038
Epoch   4 Batch   99/538 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.030
Epoch   4 Batch  100/538 - Train Accuracy:  0.956, Validation Accuracy:  0.944, Loss:  0.030
Epoch   4 Batch  101/538 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  0.045
Epoch   4 Batch  102/538 - Train Accuracy:  0.936, Validation Accuracy:  0.947, Loss:  0.034
Epoch   4 Batch  103/538 - Train Accuracy:  0.944, Validation Accuracy:  0.951, Loss:  0.030
Epoch   4 Batch  104/538 - Train Accuracy:  0.963, Validation Accuracy:  0.948, Loss:  0.025
Epoch   4 Batch  105/538 - Train Accuracy:  0.948, Validation Accuracy:  0.950, Loss:  0.025
Epoch   4 Batch  106/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.024
Epoch   4 Batch  107/538 - Train Accuracy:  0.934, Validation Accuracy:  0.953, Loss:  0.034
Epoch   4 Batch  108/538 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.028
Epoch   4 Batch  109/538 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  110/538 - Train Accuracy:  0.947, Validation Accuracy:  0.946, Loss:  0.029
Epoch   4 Batch  111/538 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  0.027
Epoch   4 Batch  112/538 - Train Accuracy:  0.945, Validation Accuracy:  0.943, Loss:  0.037
Epoch   4 Batch  113/538 - Train Accuracy:  0.932, Validation Accuracy:  0.942, Loss:  0.034
Epoch   4 Batch  114/538 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  0.028
Epoch   4 Batch  115/538 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  0.033
Epoch   4 Batch  116/538 - Train Accuracy:  0.953, Validation Accuracy:  0.947, Loss:  0.038
Epoch   4 Batch  117/538 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.035
Epoch   4 Batch  118/538 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  0.027
Epoch   4 Batch  119/538 - Train Accuracy:  0.960, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  120/538 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.025
Epoch   4 Batch  121/538 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  122/538 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  123/538 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.031
Epoch   4 Batch  124/538 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.033
Epoch   4 Batch  125/538 - Train Accuracy:  0.947, Validation Accuracy:  0.943, Loss:  0.037
Epoch   4 Batch  126/538 - Train Accuracy:  0.937, Validation Accuracy:  0.946, Loss:  0.032
Epoch   4 Batch  127/538 - Train Accuracy:  0.940, Validation Accuracy:  0.947, Loss:  0.038
Epoch   4 Batch  128/538 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  0.033
Epoch   4 Batch  129/538 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  0.023
Epoch   4 Batch  130/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.029
Epoch   4 Batch  131/538 - Train Accuracy:  0.970, Validation Accuracy:  0.944, Loss:  0.026
Epoch   4 Batch  132/538 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.030
Epoch   4 Batch  133/538 - Train Accuracy:  0.941, Validation Accuracy:  0.947, Loss:  0.031
Epoch   4 Batch  134/538 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  0.039
Epoch   4 Batch  135/538 - Train Accuracy:  0.936, Validation Accuracy:  0.937, Loss:  0.035
Epoch   4 Batch  136/538 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.031
Epoch   4 Batch  137/538 - Train Accuracy:  0.944, Validation Accuracy:  0.928, Loss:  0.037
Epoch   4 Batch  138/538 - Train Accuracy:  0.947, Validation Accuracy:  0.930, Loss:  0.033
Epoch   4 Batch  139/538 - Train Accuracy:  0.945, Validation Accuracy:  0.935, Loss:  0.034
Epoch   4 Batch  140/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.038
Epoch   4 Batch  141/538 - Train Accuracy:  0.958, Validation Accuracy:  0.941, Loss:  0.035
Epoch   4 Batch  142/538 - Train Accuracy:  0.951, Validation Accuracy:  0.935, Loss:  0.029
Epoch   4 Batch  143/538 - Train Accuracy:  0.955, Validation Accuracy:  0.933, Loss:  0.035
Epoch   4 Batch  144/538 - Train Accuracy:  0.954, Validation Accuracy:  0.933, Loss:  0.038
Epoch   4 Batch  145/538 - Train Accuracy:  0.941, Validation Accuracy:  0.934, Loss:  0.039
Epoch   4 Batch  146/538 - Train Accuracy:  0.949, Validation Accuracy:  0.938, Loss:  0.029
Epoch   4 Batch  147/538 - Train Accuracy:  0.956, Validation Accuracy:  0.941, Loss:  0.029
Epoch   4 Batch  148/538 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  0.038
Epoch   4 Batch  149/538 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.028
Epoch   4 Batch  150/538 - Train Accuracy:  0.961, Validation Accuracy:  0.941, Loss:  0.031
Epoch   4 Batch  151/538 - Train Accuracy:  0.942, Validation Accuracy:  0.943, Loss:  0.032
Epoch   4 Batch  152/538 - Train Accuracy:  0.950, Validation Accuracy:  0.944, Loss:  0.036
Epoch   4 Batch  153/538 - Train Accuracy:  0.942, Validation Accuracy:  0.949, Loss:  0.032
Epoch   4 Batch  154/538 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.025
Epoch   4 Batch  155/538 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  0.030
Epoch   4 Batch  156/538 - Train Accuracy:  0.962, Validation Accuracy:  0.944, Loss:  0.032
Epoch   4 Batch  157/538 - Train Accuracy:  0.952, Validation Accuracy:  0.946, Loss:  0.032
Epoch   4 Batch  158/538 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  0.032
Epoch   4 Batch  159/538 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.036
Epoch   4 Batch  160/538 - Train Accuracy:  0.940, Validation Accuracy:  0.947, Loss:  0.031
Epoch   4 Batch  161/538 - Train Accuracy:  0.953, Validation Accuracy:  0.947, Loss:  0.029
Epoch   4 Batch  162/538 - Train Accuracy:  0.957, Validation Accuracy:  0.943, Loss:  0.032
Epoch   4 Batch  163/538 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.039
Epoch   4 Batch  164/538 - Train Accuracy:  0.952, Validation Accuracy:  0.946, Loss:  0.031
Epoch   4 Batch  165/538 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.028
Epoch   4 Batch  166/538 - Train Accuracy:  0.964, Validation Accuracy:  0.946, Loss:  0.024
Epoch   4 Batch  167/538 - Train Accuracy:  0.945, Validation Accuracy:  0.948, Loss:  0.043
Epoch   4 Batch  168/538 - Train Accuracy:  0.925, Validation Accuracy:  0.949, Loss:  0.035
Epoch   4 Batch  169/538 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.025
Epoch   4 Batch  170/538 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.035
Epoch   4 Batch  171/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.031
Epoch   4 Batch  172/538 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  0.031
Epoch   4 Batch  173/538 - Train Accuracy:  0.950, Validation Accuracy:  0.943, Loss:  0.023
Epoch   4 Batch  174/538 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  0.032
Epoch   4 Batch  175/538 - Train Accuracy:  0.964, Validation Accuracy:  0.943, Loss:  0.030
Epoch   4 Batch  176/538 - Train Accuracy:  0.965, Validation Accuracy:  0.941, Loss:  0.034
Epoch   4 Batch  177/538 - Train Accuracy:  0.957, Validation Accuracy:  0.943, Loss:  0.032
Epoch   4 Batch  178/538 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.033
Epoch   4 Batch  179/538 - Train Accuracy:  0.956, Validation Accuracy:  0.941, Loss:  0.026
Epoch   4 Batch  180/538 - Train Accuracy:  0.955, Validation Accuracy:  0.939, Loss:  0.032
Epoch   4 Batch  181/538 - Train Accuracy:  0.949, Validation Accuracy:  0.932, Loss:  0.034
Epoch   4 Batch  182/538 - Train Accuracy:  0.945, Validation Accuracy:  0.935, Loss:  0.026
Epoch   4 Batch  183/538 - Train Accuracy:  0.966, Validation Accuracy:  0.930, Loss:  0.025
Epoch   4 Batch  184/538 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  0.031
Epoch   4 Batch  185/538 - Train Accuracy:  0.971, Validation Accuracy:  0.943, Loss:  0.021
Epoch   4 Batch  186/538 - Train Accuracy:  0.949, Validation Accuracy:  0.938, Loss:  0.027
Epoch   4 Batch  187/538 - Train Accuracy:  0.956, Validation Accuracy:  0.946, Loss:  0.032
Epoch   4 Batch  188/538 - Train Accuracy:  0.949, Validation Accuracy:  0.940, Loss:  0.026
Epoch   4 Batch  189/538 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.035
Epoch   4 Batch  190/538 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.040
Epoch   4 Batch  191/538 - Train Accuracy:  0.969, Validation Accuracy:  0.936, Loss:  0.027
Epoch   4 Batch  192/538 - Train Accuracy:  0.957, Validation Accuracy:  0.936, Loss:  0.027
Epoch   4 Batch  193/538 - Train Accuracy:  0.961, Validation Accuracy:  0.939, Loss:  0.030
Epoch   4 Batch  194/538 - Train Accuracy:  0.922, Validation Accuracy:  0.939, Loss:  0.038
Epoch   4 Batch  195/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.037
Epoch   4 Batch  196/538 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  0.023
Epoch   4 Batch  197/538 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  0.026
Epoch   4 Batch  198/538 - Train Accuracy:  0.949, Validation Accuracy:  0.948, Loss:  0.032
Epoch   4 Batch  199/538 - Train Accuracy:  0.930, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  200/538 - Train Accuracy:  0.962, Validation Accuracy:  0.948, Loss:  0.024
Epoch   4 Batch  201/538 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  0.037
Epoch   4 Batch  202/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.031
Epoch   4 Batch  203/538 - Train Accuracy:  0.943, Validation Accuracy:  0.946, Loss:  0.033
Epoch   4 Batch  204/538 - Train Accuracy:  0.955, Validation Accuracy:  0.936, Loss:  0.037
Epoch   4 Batch  205/538 - Train Accuracy:  0.946, Validation Accuracy:  0.935, Loss:  0.031
Epoch   4 Batch  206/538 - Train Accuracy:  0.963, Validation Accuracy:  0.933, Loss:  0.031
Epoch   4 Batch  207/538 - Train Accuracy:  0.961, Validation Accuracy:  0.934, Loss:  0.033
Epoch   4 Batch  208/538 - Train Accuracy:  0.948, Validation Accuracy:  0.937, Loss:  0.039
Epoch   4 Batch  209/538 - Train Accuracy:  0.960, Validation Accuracy:  0.946, Loss:  0.025
Epoch   4 Batch  210/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  0.030
Epoch   4 Batch  211/538 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  0.034
Epoch   4 Batch  212/538 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.033
Epoch   4 Batch  213/538 - Train Accuracy:  0.956, Validation Accuracy:  0.943, Loss:  0.027
Epoch   4 Batch  214/538 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  215/538 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.028
Epoch   4 Batch  216/538 - Train Accuracy:  0.953, Validation Accuracy:  0.942, Loss:  0.032
Epoch   4 Batch  217/538 - Train Accuracy:  0.953, Validation Accuracy:  0.942, Loss:  0.035
Epoch   4 Batch  218/538 - Train Accuracy:  0.954, Validation Accuracy:  0.941, Loss:  0.028
Epoch   4 Batch  219/538 - Train Accuracy:  0.949, Validation Accuracy:  0.942, Loss:  0.032
Epoch   4 Batch  220/538 - Train Accuracy:  0.937, Validation Accuracy:  0.945, Loss:  0.033
Epoch   4 Batch  221/538 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.026
Epoch   4 Batch  222/538 - Train Accuracy:  0.946, Validation Accuracy:  0.938, Loss:  0.026
Epoch   4 Batch  223/538 - Train Accuracy:  0.942, Validation Accuracy:  0.935, Loss:  0.030
Epoch   4 Batch  224/538 - Train Accuracy:  0.946, Validation Accuracy:  0.935, Loss:  0.036
Epoch   4 Batch  225/538 - Train Accuracy:  0.951, Validation Accuracy:  0.938, Loss:  0.031
Epoch   4 Batch  226/538 - Train Accuracy:  0.938, Validation Accuracy:  0.937, Loss:  0.034
Epoch   4 Batch  227/538 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  0.035
Epoch   4 Batch  228/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.031
Epoch   4 Batch  229/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  0.031
Epoch   4 Batch  230/538 - Train Accuracy:  0.941, Validation Accuracy:  0.942, Loss:  0.033
Epoch   4 Batch  231/538 - Train Accuracy:  0.954, Validation Accuracy:  0.944, Loss:  0.035
Epoch   4 Batch  232/538 - Train Accuracy:  0.939, Validation Accuracy:  0.935, Loss:  0.028
Epoch   4 Batch  233/538 - Train Accuracy:  0.959, Validation Accuracy:  0.939, Loss:  0.032
Epoch   4 Batch  234/538 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.036
Epoch   4 Batch  235/538 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  0.025
Epoch   4 Batch  236/538 - Train Accuracy:  0.946, Validation Accuracy:  0.949, Loss:  0.031
Epoch   4 Batch  237/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.031
Epoch   4 Batch  238/538 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  239/538 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  0.031
Epoch   4 Batch  240/538 - Train Accuracy:  0.935, Validation Accuracy:  0.942, Loss:  0.035
Epoch   4 Batch  241/538 - Train Accuracy:  0.938, Validation Accuracy:  0.948, Loss:  0.038
Epoch   4 Batch  242/538 - Train Accuracy:  0.966, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch  243/538 - Train Accuracy:  0.961, Validation Accuracy:  0.944, Loss:  0.025
Epoch   4 Batch  244/538 - Train Accuracy:  0.937, Validation Accuracy:  0.950, Loss:  0.029
Epoch   4 Batch  245/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  0.036
Epoch   4 Batch  246/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch  247/538 - Train Accuracy:  0.937, Validation Accuracy:  0.950, Loss:  0.031
Epoch   4 Batch  248/538 - Train Accuracy:  0.938, Validation Accuracy:  0.947, Loss:  0.039
Epoch   4 Batch  249/538 - Train Accuracy:  0.953, Validation Accuracy:  0.934, Loss:  0.024
Epoch   4 Batch  250/538 - Train Accuracy:  0.940, Validation Accuracy:  0.937, Loss:  0.028
Epoch   4 Batch  251/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  0.029
Epoch   4 Batch  252/538 - Train Accuracy:  0.946, Validation Accuracy:  0.943, Loss:  0.035
Epoch   4 Batch  253/538 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.026
Epoch   4 Batch  254/538 - Train Accuracy:  0.936, Validation Accuracy:  0.941, Loss:  0.037
Epoch   4 Batch  255/538 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch  256/538 - Train Accuracy:  0.925, Validation Accuracy:  0.946, Loss:  0.035
Epoch   4 Batch  257/538 - Train Accuracy:  0.964, Validation Accuracy:  0.946, Loss:  0.031
Epoch   4 Batch  258/538 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  0.031
Epoch   4 Batch  259/538 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  0.030
Epoch   4 Batch  260/538 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.030
Epoch   4 Batch  261/538 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.040
Epoch   4 Batch  262/538 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  0.034
Epoch   4 Batch  263/538 - Train Accuracy:  0.942, Validation Accuracy:  0.945, Loss:  0.033
Epoch   4 Batch  264/538 - Train Accuracy:  0.937, Validation Accuracy:  0.943, Loss:  0.039
Epoch   4 Batch  265/538 - Train Accuracy:  0.939, Validation Accuracy:  0.946, Loss:  0.038
Epoch   4 Batch  266/538 - Train Accuracy:  0.936, Validation Accuracy:  0.949, Loss:  0.030
Epoch   4 Batch  267/538 - Train Accuracy:  0.929, Validation Accuracy:  0.945, Loss:  0.032
Epoch   4 Batch  268/538 - Train Accuracy:  0.945, Validation Accuracy:  0.939, Loss:  0.026
Epoch   4 Batch  269/538 - Train Accuracy:  0.949, Validation Accuracy:  0.933, Loss:  0.032
Epoch   4 Batch  270/538 - Train Accuracy:  0.968, Validation Accuracy:  0.930, Loss:  0.024
Epoch   4 Batch  271/538 - Train Accuracy:  0.952, Validation Accuracy:  0.932, Loss:  0.023
Epoch   4 Batch  272/538 - Train Accuracy:  0.954, Validation Accuracy:  0.944, Loss:  0.031
Epoch   4 Batch  273/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.032
Epoch   4 Batch  274/538 - Train Accuracy:  0.925, Validation Accuracy:  0.950, Loss:  0.040
Epoch   4 Batch  275/538 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  0.032
Epoch   4 Batch  276/538 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.038
Epoch   4 Batch  277/538 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  0.025
Epoch   4 Batch  278/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  0.022
Epoch   4 Batch  279/538 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  0.030
Epoch   4 Batch  280/538 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  0.023
Epoch   4 Batch  281/538 - Train Accuracy:  0.935, Validation Accuracy:  0.942, Loss:  0.035
Epoch   4 Batch  282/538 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.029
Epoch   4 Batch  283/538 - Train Accuracy:  0.963, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  284/538 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.035
Epoch   4 Batch  285/538 - Train Accuracy:  0.955, Validation Accuracy:  0.935, Loss:  0.028
Epoch   4 Batch  286/538 - Train Accuracy:  0.943, Validation Accuracy:  0.934, Loss:  0.040
Epoch   4 Batch  287/538 - Train Accuracy:  0.955, Validation Accuracy:  0.936, Loss:  0.022
Epoch   4 Batch  288/538 - Train Accuracy:  0.955, Validation Accuracy:  0.939, Loss:  0.027
Epoch   4 Batch  289/538 - Train Accuracy:  0.959, Validation Accuracy:  0.938, Loss:  0.022
Epoch   4 Batch  290/538 - Train Accuracy:  0.968, Validation Accuracy:  0.938, Loss:  0.023
Epoch   4 Batch  291/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.029
Epoch   4 Batch  292/538 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.019
Epoch   4 Batch  293/538 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.027
Epoch   4 Batch  294/538 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  0.028
Epoch   4 Batch  295/538 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  0.028
Epoch   4 Batch  296/538 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  0.040
Epoch   4 Batch  297/538 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.030
Epoch   4 Batch  298/538 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  0.028
Epoch   4 Batch  299/538 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  0.041
Epoch   4 Batch  300/538 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.033
Epoch   4 Batch  301/538 - Train Accuracy:  0.948, Validation Accuracy:  0.951, Loss:  0.030
Epoch   4 Batch  302/538 - Train Accuracy:  0.972, Validation Accuracy:  0.950, Loss:  0.028
Epoch   4 Batch  303/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.032
Epoch   4 Batch  304/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.027
Epoch   4 Batch  305/538 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  0.027
Epoch   4 Batch  306/538 - Train Accuracy:  0.964, Validation Accuracy:  0.946, Loss:  0.030
Epoch   4 Batch  307/538 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.024
Epoch   4 Batch  308/538 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  309/538 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.022
Epoch   4 Batch  310/538 - Train Accuracy:  0.967, Validation Accuracy:  0.947, Loss:  0.035
Epoch   4 Batch  311/538 - Train Accuracy:  0.935, Validation Accuracy:  0.949, Loss:  0.033
Epoch   4 Batch  312/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.023
Epoch   4 Batch  313/538 - Train Accuracy:  0.948, Validation Accuracy:  0.950, Loss:  0.029
Epoch   4 Batch  314/538 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.030
Epoch   4 Batch  315/538 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  0.028
Epoch   4 Batch  316/538 - Train Accuracy:  0.950, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  317/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.028
Epoch   4 Batch  318/538 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  0.029
Epoch   4 Batch  319/538 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.032
Epoch   4 Batch  320/538 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  0.025
Epoch   4 Batch  321/538 - Train Accuracy:  0.950, Validation Accuracy:  0.953, Loss:  0.024
Epoch   4 Batch  322/538 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.032
Epoch   4 Batch  323/538 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.027
Epoch   4 Batch  324/538 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.027
Epoch   4 Batch  325/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.025
Epoch   4 Batch  326/538 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  327/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.033
Epoch   4 Batch  328/538 - Train Accuracy:  0.969, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch  329/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.028
Epoch   4 Batch  330/538 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.027
Epoch   4 Batch  331/538 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch  332/538 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  0.029
Epoch   4 Batch  333/538 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.028
Epoch   4 Batch  334/538 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.023
Epoch   4 Batch  335/538 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.029
Epoch   4 Batch  336/538 - Train Accuracy:  0.947, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  337/538 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.032
Epoch   4 Batch  338/538 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  0.028
Epoch   4 Batch  339/538 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  0.025
Epoch   4 Batch  340/538 - Train Accuracy:  0.940, Validation Accuracy:  0.949, Loss:  0.028
Epoch   4 Batch  341/538 - Train Accuracy:  0.949, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  342/538 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  0.033
Epoch   4 Batch  343/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.025
Epoch   4 Batch  344/538 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.024
Epoch   4 Batch  345/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  0.029
Epoch   4 Batch  346/538 - Train Accuracy:  0.948, Validation Accuracy:  0.953, Loss:  0.032
Epoch   4 Batch  347/538 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  348/538 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.024
Epoch   4 Batch  349/538 - Train Accuracy:  0.956, Validation Accuracy:  0.944, Loss:  0.025
Epoch   4 Batch  350/538 - Train Accuracy:  0.949, Validation Accuracy:  0.954, Loss:  0.035
Epoch   4 Batch  351/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  0.033
Epoch   4 Batch  352/538 - Train Accuracy:  0.936, Validation Accuracy:  0.953, Loss:  0.043
Epoch   4 Batch  353/538 - Train Accuracy:  0.939, Validation Accuracy:  0.956, Loss:  0.028
Epoch   4 Batch  354/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.028
Epoch   4 Batch  355/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  0.032
Epoch   4 Batch  356/538 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.022
Epoch   4 Batch  357/538 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  0.022
Epoch   4 Batch  358/538 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  359/538 - Train Accuracy:  0.943, Validation Accuracy:  0.955, Loss:  0.028
Epoch   4 Batch  360/538 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch  361/538 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  0.028
Epoch   4 Batch  362/538 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.021
Epoch   4 Batch  363/538 - Train Accuracy:  0.945, Validation Accuracy:  0.957, Loss:  0.031
Epoch   4 Batch  364/538 - Train Accuracy:  0.935, Validation Accuracy:  0.949, Loss:  0.040
Epoch   4 Batch  365/538 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.027
Epoch   4 Batch  366/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.026
Epoch   4 Batch  367/538 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.024
Epoch   4 Batch  368/538 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  369/538 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  0.023
Epoch   4 Batch  370/538 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.030
Epoch   4 Batch  371/538 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.026
Epoch   4 Batch  372/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.030
Epoch   4 Batch  373/538 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.022
Epoch   4 Batch  374/538 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  0.023
Epoch   4 Batch  375/538 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  0.025
Epoch   4 Batch  376/538 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  0.026
Epoch   4 Batch  377/538 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  0.028
Epoch   4 Batch  378/538 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.021
Epoch   4 Batch  379/538 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  0.028
Epoch   4 Batch  380/538 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.028
Epoch   4 Batch  381/538 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  382/538 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.030
Epoch   4 Batch  383/538 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.027
Epoch   4 Batch  384/538 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  0.028
Epoch   4 Batch  385/538 - Train Accuracy:  0.960, Validation Accuracy:  0.944, Loss:  0.029
Epoch   4 Batch  386/538 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  387/538 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  0.029
Epoch   4 Batch  388/538 - Train Accuracy:  0.949, Validation Accuracy:  0.942, Loss:  0.027
Epoch   4 Batch  389/538 - Train Accuracy:  0.936, Validation Accuracy:  0.944, Loss:  0.038
Epoch   4 Batch  390/538 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  0.025
Epoch   4 Batch  391/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.027
Epoch   4 Batch  392/538 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  0.024
Epoch   4 Batch  393/538 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch  394/538 - Train Accuracy:  0.951, Validation Accuracy:  0.943, Loss:  0.028
Epoch   4 Batch  395/538 - Train Accuracy:  0.940, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  396/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch  397/538 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  398/538 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.027
Epoch   4 Batch  399/538 - Train Accuracy:  0.944, Validation Accuracy:  0.952, Loss:  0.033
Epoch   4 Batch  400/538 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  0.028
Epoch   4 Batch  401/538 - Train Accuracy:  0.978, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch  402/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  0.026
Epoch   4 Batch  403/538 - Train Accuracy:  0.940, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  404/538 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.033
Epoch   4 Batch  405/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch  406/538 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.032
Epoch   4 Batch  407/538 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  0.027
Epoch   4 Batch  408/538 - Train Accuracy:  0.946, Validation Accuracy:  0.957, Loss:  0.028
Epoch   4 Batch  409/538 - Train Accuracy:  0.941, Validation Accuracy:  0.954, Loss:  0.027
Epoch   4 Batch  410/538 - Train Accuracy:  0.970, Validation Accuracy:  0.950, Loss:  0.024
Epoch   4 Batch  411/538 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  0.027
Epoch   4 Batch  412/538 - Train Accuracy:  0.963, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  413/538 - Train Accuracy:  0.953, Validation Accuracy:  0.940, Loss:  0.022
Epoch   4 Batch  414/538 - Train Accuracy:  0.939, Validation Accuracy:  0.940, Loss:  0.037
Epoch   4 Batch  415/538 - Train Accuracy:  0.945, Validation Accuracy:  0.937, Loss:  0.026
Epoch   4 Batch  416/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  0.032
Epoch   4 Batch  417/538 - Train Accuracy:  0.960, Validation Accuracy:  0.943, Loss:  0.029
Epoch   4 Batch  418/538 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.032
Epoch   4 Batch  419/538 - Train Accuracy:  0.961, Validation Accuracy:  0.942, Loss:  0.025
Epoch   4 Batch  420/538 - Train Accuracy:  0.960, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  421/538 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  0.023
Epoch   4 Batch  422/538 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  0.032
Epoch   4 Batch  423/538 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  424/538 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  0.031
Epoch   4 Batch  425/538 - Train Accuracy:  0.940, Validation Accuracy:  0.948, Loss:  0.039
Epoch   4 Batch  426/538 - Train Accuracy:  0.947, Validation Accuracy:  0.948, Loss:  0.031
Epoch   4 Batch  427/538 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.029
Epoch   4 Batch  428/538 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  0.021
Epoch   4 Batch  429/538 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.028
Epoch   4 Batch  430/538 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  0.031
Epoch   4 Batch  431/538 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  432/538 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.033
Epoch   4 Batch  433/538 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  0.044
Epoch   4 Batch  434/538 - Train Accuracy:  0.938, Validation Accuracy:  0.948, Loss:  0.029
Epoch   4 Batch  435/538 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  436/538 - Train Accuracy:  0.939, Validation Accuracy:  0.944, Loss:  0.033
Epoch   4 Batch  437/538 - Train Accuracy:  0.966, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  438/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.026
Epoch   4 Batch  439/538 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.027
Epoch   4 Batch  440/538 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.029
Epoch   4 Batch  441/538 - Train Accuracy:  0.937, Validation Accuracy:  0.953, Loss:  0.029
Epoch   4 Batch  442/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  443/538 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.027
Epoch   4 Batch  444/538 - Train Accuracy:  0.962, Validation Accuracy:  0.941, Loss:  0.025
Epoch   4 Batch  445/538 - Train Accuracy:  0.968, Validation Accuracy:  0.945, Loss:  0.023
Epoch   4 Batch  446/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.023
Epoch   4 Batch  447/538 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.023
Epoch   4 Batch  448/538 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  0.026
Epoch   4 Batch  449/538 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.030
Epoch   4 Batch  450/538 - Train Accuracy:  0.935, Validation Accuracy:  0.945, Loss:  0.036
Epoch   4 Batch  451/538 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.027
Epoch   4 Batch  452/538 - Train Accuracy:  0.963, Validation Accuracy:  0.942, Loss:  0.023
Epoch   4 Batch  453/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.031
Epoch   4 Batch  454/538 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.032
Epoch   4 Batch  455/538 - Train Accuracy:  0.954, Validation Accuracy:  0.942, Loss:  0.029
Epoch   4 Batch  456/538 - Train Accuracy:  0.954, Validation Accuracy:  0.945, Loss:  0.047
Epoch   4 Batch  457/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.028
Epoch   4 Batch  458/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.028
Epoch   4 Batch  459/538 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  460/538 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.026
Epoch   4 Batch  461/538 - Train Accuracy:  0.966, Validation Accuracy:  0.956, Loss:  0.026
Epoch   4 Batch  462/538 - Train Accuracy:  0.954, Validation Accuracy:  0.959, Loss:  0.022
Epoch   4 Batch  463/538 - Train Accuracy:  0.939, Validation Accuracy:  0.955, Loss:  0.030
Epoch   4 Batch  464/538 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  0.023
Epoch   4 Batch  465/538 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  466/538 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  0.026
Epoch   4 Batch  467/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.027
Epoch   4 Batch  468/538 - Train Accuracy:  0.970, Validation Accuracy:  0.946, Loss:  0.032
Epoch   4 Batch  469/538 - Train Accuracy:  0.956, Validation Accuracy:  0.946, Loss:  0.029
Epoch   4 Batch  470/538 - Train Accuracy:  0.958, Validation Accuracy:  0.943, Loss:  0.026
Epoch   4 Batch  471/538 - Train Accuracy:  0.974, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch  472/538 - Train Accuracy:  0.981, Validation Accuracy:  0.952, Loss:  0.019
Epoch   4 Batch  473/538 - Train Accuracy:  0.941, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  474/538 - Train Accuracy:  0.959, Validation Accuracy:  0.945, Loss:  0.020
Epoch   4 Batch  475/538 - Train Accuracy:  0.965, Validation Accuracy:  0.945, Loss:  0.023
Epoch   4 Batch  476/538 - Train Accuracy:  0.952, Validation Accuracy:  0.943, Loss:  0.027
Epoch   4 Batch  477/538 - Train Accuracy:  0.949, Validation Accuracy:  0.946, Loss:  0.029
Epoch   4 Batch  478/538 - Train Accuracy:  0.959, Validation Accuracy:  0.948, Loss:  0.024
Epoch   4 Batch  479/538 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  0.029
Epoch   4 Batch  480/538 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.024
Epoch   4 Batch  481/538 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  0.030
Epoch   4 Batch  482/538 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  0.029
Epoch   4 Batch  483/538 - Train Accuracy:  0.948, Validation Accuracy:  0.951, Loss:  0.032
Epoch   4 Batch  484/538 - Train Accuracy:  0.952, Validation Accuracy:  0.951, Loss:  0.031
Epoch   4 Batch  485/538 - Train Accuracy:  0.959, Validation Accuracy:  0.948, Loss:  0.031
Epoch   4 Batch  486/538 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  487/538 - Train Accuracy:  0.954, Validation Accuracy:  0.945, Loss:  0.023
Epoch   4 Batch  488/538 - Train Accuracy:  0.966, Validation Accuracy:  0.947, Loss:  0.020
Epoch   4 Batch  489/538 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.027
Epoch   4 Batch  490/538 - Train Accuracy:  0.944, Validation Accuracy:  0.949, Loss:  0.025
Epoch   4 Batch  491/538 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  0.028
Epoch   4 Batch  492/538 - Train Accuracy:  0.964, Validation Accuracy:  0.944, Loss:  0.024
Epoch   4 Batch  493/538 - Train Accuracy:  0.942, Validation Accuracy:  0.945, Loss:  0.027
Epoch   4 Batch  494/538 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  495/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.030
Epoch   4 Batch  496/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  497/538 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.022
Epoch   4 Batch  498/538 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  0.023
Epoch   4 Batch  499/538 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.029
Epoch   4 Batch  500/538 - Train Accuracy:  0.969, Validation Accuracy:  0.947, Loss:  0.018
Epoch   4 Batch  501/538 - Train Accuracy:  0.967, Validation Accuracy:  0.945, Loss:  0.026
Epoch   4 Batch  502/538 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  0.027
Epoch   4 Batch  503/538 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  0.027
Epoch   4 Batch  504/538 - Train Accuracy:  0.966, Validation Accuracy:  0.946, Loss:  0.019
Epoch   4 Batch  505/538 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  0.021
Epoch   4 Batch  506/538 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  0.025
Epoch   4 Batch  507/538 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.027
Epoch   4 Batch  508/538 - Train Accuracy:  0.950, Validation Accuracy:  0.948, Loss:  0.025
Epoch   4 Batch  509/538 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  0.023
Epoch   4 Batch  510/538 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.022
Epoch   4 Batch  511/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.027
Epoch   4 Batch  512/538 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.026
Epoch   4 Batch  513/538 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.024
Epoch   4 Batch  514/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  0.022
Epoch   4 Batch  515/538 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.031
Epoch   4 Batch  516/538 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  517/538 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.022
Epoch   4 Batch  518/538 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.029
Epoch   4 Batch  519/538 - Train Accuracy:  0.962, Validation Accuracy:  0.942, Loss:  0.025
Epoch   4 Batch  520/538 - Train Accuracy:  0.951, Validation Accuracy:  0.948, Loss:  0.030
Epoch   4 Batch  521/538 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.030
Epoch   4 Batch  522/538 - Train Accuracy:  0.955, Validation Accuracy:  0.952, Loss:  0.026
Epoch   4 Batch  523/538 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.030
Epoch   4 Batch  524/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.023
Epoch   4 Batch  525/538 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.028
Epoch   4 Batch  526/538 - Train Accuracy:  0.959, Validation Accuracy:  0.946, Loss:  0.024
Epoch   4 Batch  527/538 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  0.024
Epoch   4 Batch  528/538 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.029
Epoch   4 Batch  529/538 - Train Accuracy:  0.940, Validation Accuracy:  0.951, Loss:  0.030
Epoch   4 Batch  530/538 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  0.028
Epoch   4 Batch  531/538 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.029
Epoch   4 Batch  532/538 - Train Accuracy:  0.942, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  533/538 - Train Accuracy:  0.953, Validation Accuracy:  0.947, Loss:  0.026
Epoch   4 Batch  534/538 - Train Accuracy:  0.959, Validation Accuracy:  0.945, Loss:  0.020
Epoch   4 Batch  535/538 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.029
Epoch   4 Batch  536/538 - Train Accuracy:  0.969, Validation Accuracy:  0.947, Loss:  0.036
Model Trained and Saved

保存参数

保存 batch_size 和 save_path 参数以进行推论（for inference）。



In [24]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Save parameters for checkpoint
helper.save_params(save_path)

检查点



In [25]:

    
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import tensorflow as tf
import numpy as np
import helper
import problem_unittests as tests

_, (source_vocab_to_int, target_vocab_to_int), (source_int_to_vocab, target_int_to_vocab) = helper.load_preprocess()
load_path = helper.load_params()

句子到序列

要向模型提供要翻译的句子，你首先需要预处理该句子。实现函数 sentence_to_seq() 以预处理新的句子。

将句子转换为小写形式
使用 vocab_to_int 将单词转换为 id
- 如果单词不在词汇表中，将其转换为<UNK> 单词 id



In [26]:

    
def sentence_to_seq(sentence, vocab_to_int):
    """
    Convert a sentence to a sequence of ids
    :param sentence: String
    :param vocab_to_int: Dictionary to go from the words to an id
    :return: List of word ids
    """
    # TODO: Implement Function
    return [vocab_to_int.get(word, vocab_to_int["<UNK>"]) for word in sentence.lower().split()]


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_sentence_to_seq(sentence_to_seq)









    



Tests Passed

翻译

将 translate_sentence 从英语翻译成法语。



In [27]:

    
translate_sentence = 'he saw a old yellow truck .'


"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
translate_sentence = sentence_to_seq(translate_sentence, source_vocab_to_int)

loaded_graph = tf.Graph()
with tf.Session(graph=loaded_graph) as sess:
    # Load saved model
    loader = tf.train.import_meta_graph(load_path + '.meta')
    loader.restore(sess, load_path)

    input_data = loaded_graph.get_tensor_by_name('input:0')
    logits = loaded_graph.get_tensor_by_name('logits:0')
    keep_prob = loaded_graph.get_tensor_by_name('keep_prob:0')

    translate_logits = sess.run(logits, {input_data: [translate_sentence], keep_prob: 1.0})[0]

print('Input')
print('  Word Ids:      {}'.format([i for i in translate_sentence]))
print('  English Words: {}'.format([source_int_to_vocab[i] for i in translate_sentence]))

print('\nPrediction')
print('  Word Ids:      {}'.format([i for i in np.argmax(translate_logits, 1)]))
print('  French Words: {}'.format([target_int_to_vocab[i] for i in np.argmax(translate_logits, 1)]))









    



Input
  Word Ids:      [89, 25, 120, 221, 95, 64, 126]
  English Words: ['he', 'saw', 'a', 'old', 'yellow', 'truck', '.']

Prediction
  Word Ids:      [171, 42, 346, 259, 278, 317, 348, 322, 1]
  French Words: ['il', 'a', 'vu', 'un', 'vieux', 'camion', 'jaune', '.', '<EOS>']

不完美的翻译

你可能注意到了，某些句子的翻译质量比其他的要好。因为你使用的数据集只有 227 个英语单词，但实际生活中有数千个单词，只有使用这些单词的句子结果才会比较理想。对于此项目，不需要达到完美的翻译。但是，如果你想创建更好的翻译模型，则需要更好的数据。

你可以使用 WMT10 French-English corpus 语料库训练模型。该数据集拥有更多的词汇，讨论的话题也更丰富。但是，训练时间要好多天的时间，所以确保你有 GPU 并且对于我们提供的数据集，你的神经网络性能很棒。提交此项目后，别忘了研究下 WMT10 语料库。

提交项目

提交项目时，确保先运行所有单元，然后再保存记事本。保存记事本文件为 “dlnd_language_translation.ipynb”，再通过菜单中的“文件” ->“下载为”将其另存为 HTML 格式。提交的项目文档中需包含“helper.py”和“problem_unittests.py”文件。