Language Translation

In this project, you’re going to take a peek into the realm of neural network machine translation. You’ll be training a sequence to sequence model on a dataset of English and French sentences that can translate new sentences from English to French.

Get the Data

Since translating the whole language of English to French will take lots of time to train, we have provided you with a small portion of the English corpus.


In [4]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import helper
import problem_unittests as tests

source_path = 'data/small_vocab_en'
target_path = 'data/small_vocab_fr'
source_text = helper.load_data(source_path)
target_text = helper.load_data(target_path)

Explore the Data

Play around with view_sentence_range to view different parts of the data.


In [2]:
view_sentence_range = (0, 10)

"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import numpy as np

print('Dataset Stats')
print('Roughly the number of unique words: {}'.format(len({word: None for word in source_text.split()})))

sentences = source_text.split('\n')
word_counts = [len(sentence.split()) for sentence in sentences]
print('Number of sentences: {}'.format(len(sentences)))
print('Average number of words in a sentence: {}'.format(np.average(word_counts)))

print()
print('English sentences {} to {}:'.format(*view_sentence_range))
print('\n'.join(source_text.split('\n')[view_sentence_range[0]:view_sentence_range[1]]))
print()
print('French sentences {} to {}:'.format(*view_sentence_range))
print('\n'.join(target_text.split('\n')[view_sentence_range[0]:view_sentence_range[1]]))


Dataset Stats
Roughly the number of unique words: 227
Number of sentences: 137861
Average number of words in a sentence: 13.225277634719028

English sentences 0 to 10:
new jersey is sometimes quiet during autumn , and it is snowy in april .
the united states is usually chilly during july , and it is usually freezing in november .
california is usually quiet during march , and it is usually hot in june .
the united states is sometimes mild during june , and it is cold in september .
your least liked fruit is the grape , but my least liked is the apple .
his favorite fruit is the orange , but my favorite is the grape .
paris is relaxing during december , but it is usually chilly in july .
new jersey is busy during spring , and it is never hot in march .
our least liked fruit is the lemon , but my least liked is the grape .
the united states is sometimes busy during january , and it is sometimes warm in november .

French sentences 0 to 10:
new jersey est parfois calme pendant l' automne , et il est neigeux en avril .
les états-unis est généralement froid en juillet , et il gèle habituellement en novembre .
california est généralement calme en mars , et il est généralement chaud en juin .
les états-unis est parfois légère en juin , et il fait froid en septembre .
votre moins aimé fruit est le raisin , mais mon moins aimé est la pomme .
son fruit préféré est l'orange , mais mon préféré est le raisin .
paris est relaxant en décembre , mais il est généralement froid en juillet .
new jersey est occupé au printemps , et il est jamais chaude en mars .
notre fruit est moins aimé le citron , mais mon moins aimé est le raisin .
les états-unis est parfois occupé en janvier , et il est parfois chaud en novembre .

Implement Preprocessing Function

Text to Word Ids

As you did with other RNNs, you must turn the text into a number so the computer can understand it. In the function text_to_ids(), you'll turn source_text and target_text from words to ids. However, you need to add the <EOS> word id at the end of each sentence from target_text. This will help the neural network predict when the sentence should end.

You can get the <EOS> word id by doing:

target_vocab_to_int['<EOS>']

You can get other word ids using source_vocab_to_int and target_vocab_to_int.


In [7]:
def text_to_ids(source_text, target_text, source_vocab_to_int, target_vocab_to_int):
    """
    Convert source and target text to proper word ids
    :param source_text: String that contains all the source text.
    :param target_text: String that contains all the target text.
    :param source_vocab_to_int: Dictionary to go from the source words to an id
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :return: A tuple of lists (source_id_text, target_id_text)
    """
    # TODO: Implement Function
    source_id_text = [[source_vocab_to_int.get(word, source_vocab_to_int['<UNK>']) for word in line.split()] for line in source_text.split('\n')]
    target_id_text = [[target_vocab_to_int.get(word, target_vocab_to_int['<UNK>']) for word in line.split()] for line in target_text.split('\n')]
    for i in range(len(target_id_text)):
        target_id_text[i].append(target_vocab_to_int['<EOS>'])        
    return source_id_text, target_id_text

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_text_to_ids(text_to_ids)


Tests Passed

Preprocess all the data and save it

Running the code cell below will preprocess all the data and save it to file.


In [8]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
helper.preprocess_and_save_data(source_path, target_path, text_to_ids)

Check Point

This is your first checkpoint. If you ever decide to come back to this notebook or have to restart the notebook, you can start from here. The preprocessed data has been saved to disk.


In [1]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import numpy as np
import helper

(source_int_text, target_int_text), (source_vocab_to_int, target_vocab_to_int), _ = helper.load_preprocess()

Check the Version of TensorFlow and Access to GPU

This will check to make sure you have the correct version of TensorFlow and access to a GPU


In [2]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
from distutils.version import LooseVersion
import warnings
import tensorflow as tf

# Check TensorFlow Version
assert LooseVersion(tf.__version__) in [LooseVersion('1.0.0'), LooseVersion('1.0.1')], 'This project requires TensorFlow version 1.0  You are using {}'.format(tf.__version__)
print('TensorFlow Version: {}'.format(tf.__version__))

# Check for a GPU
if not tf.test.gpu_device_name():
    warnings.warn('No GPU found. Please use a GPU to train your neural network.')
else:
    print('Default GPU Device: {}'.format(tf.test.gpu_device_name()))


TensorFlow Version: 1.0.0
/Users/nimisholiapuram/anaconda3/envs/py3/lib/python3.6/site-packages/ipykernel/__main__.py:14: UserWarning: No GPU found. Please use a GPU to train your neural network.

Build the Neural Network

You'll build the components necessary to build a Sequence-to-Sequence model by implementing the following functions below:

  • model_inputs
  • process_decoding_input
  • encoding_layer
  • decoding_layer_train
  • decoding_layer_infer
  • decoding_layer
  • seq2seq_model

Input

Implement the model_inputs() function to create TF Placeholders for the Neural Network. It should create the following placeholders:

  • Input text placeholder named "input" using the TF Placeholder name parameter with rank 2.
  • Targets placeholder with rank 2.
  • Learning rate placeholder with rank 0.
  • Keep probability placeholder named "keep_prob" using the TF Placeholder name parameter with rank 0.

Return the placeholders in the following the tuple (Input, Targets, Learing Rate, Keep Probability)


In [5]:
def model_inputs():
    """
    Create TF Placeholders for input, targets, and learning rate.
    :return: Tuple (input, targets, learning rate, keep probability)
    """
    # TODO: Implement Function
    # TODO - Should this be string or int32 ?
    input = tf.placeholder(tf.int32, [None, None], name='input')
    targets = tf.placeholder(tf.int32, [None, None])
    learning_rate = tf.placeholder(tf.float32)
    keep_prob = tf.placeholder(tf.float32, name='keep_prob')
    return input, targets, learning_rate, keep_prob

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_model_inputs(model_inputs)


Tests Passed

Process Decoding Input

Implement process_decoding_input using TensorFlow to remove the last word id from each batch in target_data and concat the GO ID to the beginning of each batch.


In [6]:
def process_decoding_input(target_data, target_vocab_to_int, batch_size):
    """
    Preprocess target data for dencoding
    :param target_data: Target Placehoder
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :param batch_size: Batch Size
    :return: Preprocessed target data
    """
    # TODO: Implement Function
    ending = tf.strided_slice(target_data, [0, 0], [batch_size, -1], [1, 1])
    dec_input = tf.concat([tf.fill([batch_size, 1], target_vocab_to_int['<GO>']), ending], 1)
    return dec_input

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_process_decoding_input(process_decoding_input)


Tests Passed

Encoding

Implement encoding_layer() to create a Encoder RNN layer using tf.nn.dynamic_rnn().


In [7]:
def encoding_layer(rnn_inputs, rnn_size, num_layers, keep_prob):
    """
    Create encoding layer
    :param rnn_inputs: Inputs for the RNN
    :param rnn_size: RNN Size
    :param num_layers: Number of layers
    :param keep_prob: Dropout keep probability
    :return: RNN state
    """
    # TODO: Implement Function
    lstm = tf.contrib.rnn.BasicLSTMCell(rnn_size)
    drop = tf.contrib.rnn.DropoutWrapper(lstm, output_keep_prob=keep_prob)
    rnn_cell = tf.contrib.rnn.MultiRNNCell([drop] * num_layers)
    _, rnn_state = tf.nn.dynamic_rnn(rnn_cell, rnn_inputs, dtype=tf.float32)
    return rnn_state

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_encoding_layer(encoding_layer)


Tests Passed

Decoding - Training

Create training logits using tf.contrib.seq2seq.simple_decoder_fn_train() and tf.contrib.seq2seq.dynamic_rnn_decoder(). Apply the output_fn to the tf.contrib.seq2seq.dynamic_rnn_decoder() outputs.


In [8]:
def decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope,
                         output_fn, keep_prob):
    """
    Create a decoding layer for training
    :param encoder_state: Encoder State
    :param dec_cell: Decoder RNN Cell
    :param dec_embed_input: Decoder embedded input
    :param sequence_length: Sequence Length
    :param decoding_scope: TenorFlow Variable Scope for decoding
    :param output_fn: Function to apply the output layer
    :param keep_prob: Dropout keep probability
    :return: Train Logits
    """
    # TODO: Implement Function
    train_decoder_fn = tf.contrib.seq2seq.simple_decoder_fn_train(encoder_state)
    train_pred, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(
        dec_cell, train_decoder_fn, dec_embed_input, sequence_length, scope=decoding_scope)
    drop = tf.nn.dropout(train_pred, keep_prob)
    train_logits =  output_fn(drop)
    return train_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_decoding_layer_train(decoding_layer_train)


Tests Passed

In [9]:
def decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, start_of_sequence_id, end_of_sequence_id,
                         maximum_length, vocab_size, decoding_scope, output_fn, keep_prob):
    """
    Create a decoding layer for inference
    :param encoder_state: Encoder state
    :param dec_cell: Decoder RNN Cell
    :param dec_embeddings: Decoder embeddings
    :param start_of_sequence_id: GO ID
    :param end_of_sequence_id: EOS Id
    :param maximum_length: The maximum allowed time steps to decode
    :param vocab_size: Size of vocabulary
    :param decoding_scope: TensorFlow Variable Scope for decoding
    :param output_fn: Function to apply the output layer
    :param keep_prob: Dropout keep probability
    :return: Inference Logits
    """
    # TODO: Implement Function
    infer_decoder_fn = tf.contrib.seq2seq.simple_decoder_fn_inference(
        output_fn, encoder_state, dec_embeddings, start_of_sequence_id, end_of_sequence_id, 
        maximum_length, vocab_size)
    inference_logits, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(dec_cell, infer_decoder_fn, scope=decoding_scope)
    # Ignoring keep_prob as we would not want to use dropout during inference
    return inference_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_decoding_layer_infer(decoding_layer_infer)


Tests Passed

Build the Decoding Layer

Implement decoding_layer() to create a Decoder RNN layer.

  • Create RNN cell for decoding using rnn_size and num_layers.
  • Create the output fuction using lambda to transform it's input, logits, to class logits.
  • Use the your decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope, output_fn, keep_prob) function to get the training logits.
  • Use your decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, start_of_sequence_id, end_of_sequence_id, maximum_length, vocab_size, decoding_scope, output_fn, keep_prob) function to get the inference logits.

Note: You'll need to use tf.variable_scope to share variables between training and inference.


In [10]:
def decoding_layer(dec_embed_input, dec_embeddings, encoder_state, vocab_size, sequence_length, rnn_size,
                   num_layers, target_vocab_to_int, keep_prob):
    """
    Create decoding layer
    :param dec_embed_input: Decoder embedded input
    :param dec_embeddings: Decoder embeddings
    :param encoder_state: The encoded state
    :param vocab_size: Size of vocabulary
    :param sequence_length: Sequence Length
    :param rnn_size: RNN Size
    :param num_layers: Number of layers
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :param keep_prob: Dropout keep probability
    :return: Tuple of (Training Logits, Inference Logits)
    """
    # TODO: Implement Function
    with tf.variable_scope("decoding") as decoding_scope:
        lstm = tf.contrib.rnn.BasicLSTMCell(rnn_size)
        drop = tf.contrib.rnn.DropoutWrapper(lstm, output_keep_prob=keep_prob)
        dec_cell = tf.contrib.rnn.MultiRNNCell([drop] * num_layers)
    
        weights = tf.truncated_normal_initializer(stddev=0.1)
        biases = tf.zeros_initializer()
        
        output_fn = lambda x: tf.contrib.layers.fully_connected(x, vocab_size, None,
                                                                scope=decoding_scope,
                                                                weights_initializer=weights,
                                                                biases_initializer=biases)
        
        train_logits = decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length,
                                               decoding_scope, output_fn, keep_prob)
        
        decoding_scope.reuse_variables()
        
        infer_logits = decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, target_vocab_to_int['<GO>'],
                                                target_vocab_to_int['<EOS>'], sequence_length - 1, vocab_size,
                                                decoding_scope, output_fn, keep_prob)
    return train_logits, infer_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_decoding_layer(decoding_layer)


Tests Passed

Build the Neural Network

Apply the functions you implemented above to:

  • Apply embedding to the input data for the encoder.
  • Encode the input using your encoding_layer(rnn_inputs, rnn_size, num_layers, keep_prob).
  • Process target data using your process_decoding_input(target_data, target_vocab_to_int, batch_size) function.
  • Apply embedding to the target data for the decoder.
  • Decode the encoded input using your decoding_layer(dec_embed_input, dec_embeddings, encoder_state, vocab_size, sequence_length, rnn_size, num_layers, target_vocab_to_int, keep_prob).

In [11]:
def seq2seq_model(input_data, target_data, keep_prob, batch_size, sequence_length, source_vocab_size, target_vocab_size,
                  enc_embedding_size, dec_embedding_size, rnn_size, num_layers, target_vocab_to_int):
    """
    Build the Sequence-to-Sequence part of the neural network
    :param input_data: Input placeholder
    :param target_data: Target placeholder
    :param keep_prob: Dropout keep probability placeholder
    :param batch_size: Batch Size
    :param sequence_length: Sequence Length
    :param source_vocab_size: Source vocabulary size
    :param target_vocab_size: Target vocabulary size
    :param enc_embedding_size: Decoder embedding size
    :param dec_embedding_size: Encoder embedding size
    :param rnn_size: RNN Size
    :param num_layers: Number of layers
    :param target_vocab_to_int: Dictionary to go from the target words to an id
    :return: Tuple of (Training Logits, Inference Logits)
    """
    # TODO: Implement Function
    enc_embed_input = tf.contrib.layers.embed_sequence(input_data, source_vocab_size, enc_embedding_size,
                                                       initializer = tf.random_uniform_initializer(-1,1))
    
    enc_state = encoding_layer(enc_embed_input, rnn_size, num_layers, keep_prob)
    
    dec_input = process_decoding_input(target_data, target_vocab_to_int, batch_size)
    
    dec_embeddings = tf.Variable(tf.random_uniform([target_vocab_size, dec_embedding_size], -1, 1))
    dec_embed_input = tf.nn.embedding_lookup(dec_embeddings, dec_input)
    
    train_logits, infer_logits = decoding_layer(dec_embed_input, dec_embeddings, enc_state, target_vocab_size,
                                                sequence_length, rnn_size, num_layers, target_vocab_to_int, keep_prob)
    return train_logits, infer_logits


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_seq2seq_model(seq2seq_model)


Tests Passed

Neural Network Training

Hyperparameters

Tune the following parameters:

  • Set epochs to the number of epochs.
  • Set batch_size to the batch size.
  • Set rnn_size to the size of the RNNs.
  • Set num_layers to the number of layers.
  • Set encoding_embedding_size to the size of the embedding for the encoder.
  • Set decoding_embedding_size to the size of the embedding for the decoder.
  • Set learning_rate to the learning rate.
  • Set keep_probability to the Dropout keep probability

In [12]:
# Number of Epochs - test up to 30
epochs = 5
# Batch Size
batch_size = 128
# RNN Size
rnn_size = 256
# Number of Layers
num_layers = 2
# Embedding Size
encoding_embedding_size = 64
decoding_embedding_size = 64
# Learning Rate
learning_rate = 0.001
# Dropout Keep Probability
keep_probability = 0.75

Build the Graph

Build the graph using the neural network you implemented.


In [13]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
save_path = 'checkpoints/dev'
(source_int_text, target_int_text), (source_vocab_to_int, target_vocab_to_int), _ = helper.load_preprocess()
max_source_sentence_length = max([len(sentence) for sentence in source_int_text])

train_graph = tf.Graph()
with train_graph.as_default():
    input_data, targets, lr, keep_prob = model_inputs()
    sequence_length = tf.placeholder_with_default(max_source_sentence_length, None, name='sequence_length')
    input_shape = tf.shape(input_data)
    
    train_logits, inference_logits = seq2seq_model(
        tf.reverse(input_data, [-1]), targets, keep_prob, batch_size, sequence_length, len(source_vocab_to_int), len(target_vocab_to_int),
        encoding_embedding_size, decoding_embedding_size, rnn_size, num_layers, target_vocab_to_int)

    tf.identity(inference_logits, 'logits')
    with tf.name_scope("optimization"):
        # Loss function
        cost = tf.contrib.seq2seq.sequence_loss(
            train_logits,
            targets,
            tf.ones([input_shape[0], sequence_length]))

        # Optimizer
        optimizer = tf.train.AdamOptimizer(lr)

        # Gradient Clipping
        gradients = optimizer.compute_gradients(cost)
        capped_gradients = [(tf.clip_by_value(grad, -1., 1.), var) for grad, var in gradients if grad is not None]
        train_op = optimizer.apply_gradients(capped_gradients)

Train

Train the neural network on the preprocessed data. If you have a hard time getting a good loss, check the forms to see if anyone is having the same problem.


In [14]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import time

def get_accuracy(target, logits):
    """
    Calculate accuracy
    """
    max_seq = max(target.shape[1], logits.shape[1])
    if max_seq - target.shape[1]:
        target = np.pad(
            target,
            [(0,0),(0,max_seq - target.shape[1])],
            'constant')
    if max_seq - logits.shape[1]:
        logits = np.pad(
            logits,
            [(0,0),(0,max_seq - logits.shape[1]), (0,0)],
            'constant')

    return np.mean(np.equal(target, np.argmax(logits, 2)))

train_source = source_int_text[batch_size:]
train_target = target_int_text[batch_size:]

valid_source = helper.pad_sentence_batch(source_int_text[:batch_size])
valid_target = helper.pad_sentence_batch(target_int_text[:batch_size])

with tf.Session(graph=train_graph) as sess:
    sess.run(tf.global_variables_initializer())

    for epoch_i in range(epochs):
        for batch_i, (source_batch, target_batch) in enumerate(
                helper.batch_data(train_source, train_target, batch_size)):
            start_time = time.time()
            
            _, loss = sess.run(
                [train_op, cost],
                {input_data: source_batch,
                 targets: target_batch,
                 lr: learning_rate,
                 sequence_length: target_batch.shape[1],
                 keep_prob: keep_probability})
            
            batch_train_logits = sess.run(
                inference_logits,
                {input_data: source_batch, keep_prob: 1.0})
            batch_valid_logits = sess.run(
                inference_logits,
                {input_data: valid_source, keep_prob: 1.0})
                
            train_acc = get_accuracy(target_batch, batch_train_logits)
            valid_acc = get_accuracy(np.array(valid_target), batch_valid_logits)
            end_time = time.time()
            print('Epoch {:>3} Batch {:>4}/{} - Train Accuracy: {:>6.3f}, Validation Accuracy: {:>6.3f}, Loss: {:>6.3f}'
                  .format(epoch_i, batch_i, len(source_int_text) // batch_size, train_acc, valid_acc, loss))

    # Save Model
    saver = tf.train.Saver()
    saver.save(sess, save_path)
    print('Model Trained and Saved')


Epoch   0 Batch    0/1077 - Train Accuracy:  0.304, Validation Accuracy:  0.323, Loss:  5.905
Epoch   0 Batch    1/1077 - Train Accuracy:  0.255, Validation Accuracy:  0.335, Loss:  5.748
Epoch   0 Batch    2/1077 - Train Accuracy:  0.244, Validation Accuracy:  0.335, Loss:  5.553
Epoch   0 Batch    3/1077 - Train Accuracy:  0.270, Validation Accuracy:  0.335, Loss:  5.110
Epoch   0 Batch    4/1077 - Train Accuracy:  0.259, Validation Accuracy:  0.335, Loss:  4.561
Epoch   0 Batch    5/1077 - Train Accuracy:  0.295, Validation Accuracy:  0.336, Loss:  4.199
Epoch   0 Batch    6/1077 - Train Accuracy:  0.279, Validation Accuracy:  0.337, Loss:  4.065
Epoch   0 Batch    7/1077 - Train Accuracy:  0.265, Validation Accuracy:  0.346, Loss:  3.988
Epoch   0 Batch    8/1077 - Train Accuracy:  0.272, Validation Accuracy:  0.344, Loss:  3.890
Epoch   0 Batch    9/1077 - Train Accuracy:  0.292, Validation Accuracy:  0.355, Loss:  3.713
Epoch   0 Batch   10/1077 - Train Accuracy:  0.275, Validation Accuracy:  0.377, Loss:  3.757
Epoch   0 Batch   11/1077 - Train Accuracy:  0.344, Validation Accuracy:  0.386, Loss:  3.415
Epoch   0 Batch   12/1077 - Train Accuracy:  0.331, Validation Accuracy:  0.395, Loss:  3.432
Epoch   0 Batch   13/1077 - Train Accuracy:  0.375, Validation Accuracy:  0.402, Loss:  3.209
Epoch   0 Batch   14/1077 - Train Accuracy:  0.345, Validation Accuracy:  0.386, Loss:  3.193
Epoch   0 Batch   15/1077 - Train Accuracy:  0.324, Validation Accuracy:  0.391, Loss:  3.264
Epoch   0 Batch   16/1077 - Train Accuracy:  0.348, Validation Accuracy:  0.393, Loss:  3.172
Epoch   0 Batch   17/1077 - Train Accuracy:  0.357, Validation Accuracy:  0.402, Loss:  3.101
Epoch   0 Batch   18/1077 - Train Accuracy:  0.340, Validation Accuracy:  0.407, Loss:  3.120
Epoch   0 Batch   19/1077 - Train Accuracy:  0.353, Validation Accuracy:  0.401, Loss:  3.009
Epoch   0 Batch   20/1077 - Train Accuracy:  0.350, Validation Accuracy:  0.406, Loss:  2.995
Epoch   0 Batch   21/1077 - Train Accuracy:  0.329, Validation Accuracy:  0.411, Loss:  3.077
Epoch   0 Batch   22/1077 - Train Accuracy:  0.357, Validation Accuracy:  0.427, Loss:  3.004
Epoch   0 Batch   23/1077 - Train Accuracy:  0.362, Validation Accuracy:  0.425, Loss:  2.977
Epoch   0 Batch   24/1077 - Train Accuracy:  0.357, Validation Accuracy:  0.420, Loss:  2.881
Epoch   0 Batch   25/1077 - Train Accuracy:  0.335, Validation Accuracy:  0.409, Loss:  2.924
Epoch   0 Batch   26/1077 - Train Accuracy:  0.332, Validation Accuracy:  0.411, Loss:  2.909
Epoch   0 Batch   27/1077 - Train Accuracy:  0.402, Validation Accuracy:  0.421, Loss:  2.635
Epoch   0 Batch   28/1077 - Train Accuracy:  0.382, Validation Accuracy:  0.428, Loss:  2.744
Epoch   0 Batch   29/1077 - Train Accuracy:  0.363, Validation Accuracy:  0.417, Loss:  2.731
Epoch   0 Batch   30/1077 - Train Accuracy:  0.356, Validation Accuracy:  0.424, Loss:  2.722
Epoch   0 Batch   31/1077 - Train Accuracy:  0.371, Validation Accuracy:  0.437, Loss:  2.741
Epoch   0 Batch   32/1077 - Train Accuracy:  0.428, Validation Accuracy:  0.434, Loss:  2.510
Epoch   0 Batch   33/1077 - Train Accuracy:  0.391, Validation Accuracy:  0.435, Loss:  2.547
Epoch   0 Batch   34/1077 - Train Accuracy:  0.371, Validation Accuracy:  0.438, Loss:  2.649
Epoch   0 Batch   35/1077 - Train Accuracy:  0.378, Validation Accuracy:  0.444, Loss:  2.606
Epoch   0 Batch   36/1077 - Train Accuracy:  0.404, Validation Accuracy:  0.455, Loss:  2.524
Epoch   0 Batch   37/1077 - Train Accuracy:  0.376, Validation Accuracy:  0.435, Loss:  2.588
Epoch   0 Batch   38/1077 - Train Accuracy:  0.334, Validation Accuracy:  0.424, Loss:  2.710
Epoch   0 Batch   39/1077 - Train Accuracy:  0.385, Validation Accuracy:  0.444, Loss:  2.545
Epoch   0 Batch   40/1077 - Train Accuracy:  0.386, Validation Accuracy:  0.447, Loss:  2.487
Epoch   0 Batch   41/1077 - Train Accuracy:  0.383, Validation Accuracy:  0.420, Loss:  2.423
Epoch   0 Batch   42/1077 - Train Accuracy:  0.382, Validation Accuracy:  0.431, Loss:  2.423
Epoch   0 Batch   43/1077 - Train Accuracy:  0.372, Validation Accuracy:  0.440, Loss:  2.433
Epoch   0 Batch   44/1077 - Train Accuracy:  0.350, Validation Accuracy:  0.457, Loss:  2.529
Epoch   0 Batch   45/1077 - Train Accuracy:  0.375, Validation Accuracy:  0.442, Loss:  2.383
Epoch   0 Batch   46/1077 - Train Accuracy:  0.364, Validation Accuracy:  0.437, Loss:  2.398
Epoch   0 Batch   47/1077 - Train Accuracy:  0.408, Validation Accuracy:  0.454, Loss:  2.265
Epoch   0 Batch   48/1077 - Train Accuracy:  0.408, Validation Accuracy:  0.455, Loss:  2.271
Epoch   0 Batch   49/1077 - Train Accuracy:  0.388, Validation Accuracy:  0.430, Loss:  2.267
Epoch   0 Batch   50/1077 - Train Accuracy:  0.380, Validation Accuracy:  0.446, Loss:  2.298
Epoch   0 Batch   51/1077 - Train Accuracy:  0.414, Validation Accuracy:  0.459, Loss:  2.141
Epoch   0 Batch   52/1077 - Train Accuracy:  0.371, Validation Accuracy:  0.447, Loss:  2.226
Epoch   0 Batch   53/1077 - Train Accuracy:  0.370, Validation Accuracy:  0.426, Loss:  2.163
Epoch   0 Batch   54/1077 - Train Accuracy:  0.369, Validation Accuracy:  0.461, Loss:  2.321
Epoch   0 Batch   55/1077 - Train Accuracy:  0.445, Validation Accuracy:  0.461, Loss:  2.077
Epoch   0 Batch   56/1077 - Train Accuracy:  0.384, Validation Accuracy:  0.445, Loss:  2.111
Epoch   0 Batch   57/1077 - Train Accuracy:  0.451, Validation Accuracy:  0.455, Loss:  1.879
Epoch   0 Batch   58/1077 - Train Accuracy:  0.407, Validation Accuracy:  0.467, Loss:  2.062
Epoch   0 Batch   59/1077 - Train Accuracy:  0.345, Validation Accuracy:  0.450, Loss:  2.183
Epoch   0 Batch   60/1077 - Train Accuracy:  0.409, Validation Accuracy:  0.459, Loss:  1.997
Epoch   0 Batch   61/1077 - Train Accuracy:  0.405, Validation Accuracy:  0.468, Loss:  2.015
Epoch   0 Batch   62/1077 - Train Accuracy:  0.362, Validation Accuracy:  0.448, Loss:  2.138
Epoch   0 Batch   63/1077 - Train Accuracy:  0.390, Validation Accuracy:  0.425, Loss:  1.885
Epoch   0 Batch   64/1077 - Train Accuracy:  0.386, Validation Accuracy:  0.453, Loss:  1.958
Epoch   0 Batch   65/1077 - Train Accuracy:  0.366, Validation Accuracy:  0.459, Loss:  2.036
Epoch   0 Batch   66/1077 - Train Accuracy:  0.375, Validation Accuracy:  0.458, Loss:  1.925
Epoch   0 Batch   67/1077 - Train Accuracy:  0.422, Validation Accuracy:  0.441, Loss:  1.857
Epoch   0 Batch   68/1077 - Train Accuracy:  0.374, Validation Accuracy:  0.444, Loss:  1.943
Epoch   0 Batch   69/1077 - Train Accuracy:  0.425, Validation Accuracy:  0.454, Loss:  1.924
Epoch   0 Batch   70/1077 - Train Accuracy:  0.352, Validation Accuracy:  0.446, Loss:  1.966
Epoch   0 Batch   71/1077 - Train Accuracy:  0.362, Validation Accuracy:  0.438, Loss:  1.835
Epoch   0 Batch   72/1077 - Train Accuracy:  0.375, Validation Accuracy:  0.462, Loss:  1.848
Epoch   0 Batch   73/1077 - Train Accuracy:  0.385, Validation Accuracy:  0.463, Loss:  1.838
Epoch   0 Batch   74/1077 - Train Accuracy:  0.410, Validation Accuracy:  0.450, Loss:  1.702
Epoch   0 Batch   75/1077 - Train Accuracy:  0.388, Validation Accuracy:  0.442, Loss:  1.762
Epoch   0 Batch   76/1077 - Train Accuracy:  0.394, Validation Accuracy:  0.471, Loss:  1.779
Epoch   0 Batch   77/1077 - Train Accuracy:  0.406, Validation Accuracy:  0.484, Loss:  1.812
Epoch   0 Batch   78/1077 - Train Accuracy:  0.362, Validation Accuracy:  0.468, Loss:  1.845
Epoch   0 Batch   79/1077 - Train Accuracy:  0.378, Validation Accuracy:  0.456, Loss:  1.816
Epoch   0 Batch   80/1077 - Train Accuracy:  0.366, Validation Accuracy:  0.437, Loss:  1.742
Epoch   0 Batch   81/1077 - Train Accuracy:  0.399, Validation Accuracy:  0.446, Loss:  1.728
Epoch   0 Batch   82/1077 - Train Accuracy:  0.434, Validation Accuracy:  0.447, Loss:  1.557
Epoch   0 Batch   83/1077 - Train Accuracy:  0.352, Validation Accuracy:  0.451, Loss:  1.840
Epoch   0 Batch   84/1077 - Train Accuracy:  0.397, Validation Accuracy:  0.459, Loss:  1.699
Epoch   0 Batch   85/1077 - Train Accuracy:  0.411, Validation Accuracy:  0.463, Loss:  1.631
Epoch   0 Batch   86/1077 - Train Accuracy:  0.390, Validation Accuracy:  0.452, Loss:  1.731
Epoch   0 Batch   87/1077 - Train Accuracy:  0.400, Validation Accuracy:  0.442, Loss:  1.693
Epoch   0 Batch   88/1077 - Train Accuracy:  0.406, Validation Accuracy:  0.456, Loss:  1.696
Epoch   0 Batch   89/1077 - Train Accuracy:  0.390, Validation Accuracy:  0.456, Loss:  1.656
Epoch   0 Batch   90/1077 - Train Accuracy:  0.391, Validation Accuracy:  0.455, Loss:  1.711
Epoch   0 Batch   91/1077 - Train Accuracy:  0.467, Validation Accuracy:  0.455, Loss:  1.521
Epoch   0 Batch   92/1077 - Train Accuracy:  0.403, Validation Accuracy:  0.468, Loss:  1.632
Epoch   0 Batch   93/1077 - Train Accuracy:  0.404, Validation Accuracy:  0.471, Loss:  1.658
Epoch   0 Batch   94/1077 - Train Accuracy:  0.411, Validation Accuracy:  0.467, Loss:  1.593
Epoch   0 Batch   95/1077 - Train Accuracy:  0.430, Validation Accuracy:  0.454, Loss:  1.607
Epoch   0 Batch   96/1077 - Train Accuracy:  0.396, Validation Accuracy:  0.445, Loss:  1.612
Epoch   0 Batch   97/1077 - Train Accuracy:  0.429, Validation Accuracy:  0.458, Loss:  1.604
Epoch   0 Batch   98/1077 - Train Accuracy:  0.482, Validation Accuracy:  0.486, Loss:  1.534
Epoch   0 Batch   99/1077 - Train Accuracy:  0.409, Validation Accuracy:  0.462, Loss:  1.649
Epoch   0 Batch  100/1077 - Train Accuracy:  0.416, Validation Accuracy:  0.461, Loss:  1.568
Epoch   0 Batch  101/1077 - Train Accuracy:  0.388, Validation Accuracy:  0.457, Loss:  1.537
Epoch   0 Batch  102/1077 - Train Accuracy:  0.448, Validation Accuracy:  0.484, Loss:  1.528
Epoch   0 Batch  103/1077 - Train Accuracy:  0.374, Validation Accuracy:  0.464, Loss:  1.643
Epoch   0 Batch  104/1077 - Train Accuracy:  0.382, Validation Accuracy:  0.492, Loss:  1.625
Epoch   0 Batch  105/1077 - Train Accuracy:  0.473, Validation Accuracy:  0.501, Loss:  1.517
Epoch   0 Batch  106/1077 - Train Accuracy:  0.414, Validation Accuracy:  0.462, Loss:  1.658
Epoch   0 Batch  107/1077 - Train Accuracy:  0.393, Validation Accuracy:  0.431, Loss:  1.463
Epoch   0 Batch  108/1077 - Train Accuracy:  0.435, Validation Accuracy:  0.447, Loss:  1.371
Epoch   0 Batch  109/1077 - Train Accuracy:  0.433, Validation Accuracy:  0.460, Loss:  1.512
Epoch   0 Batch  110/1077 - Train Accuracy:  0.421, Validation Accuracy:  0.453, Loss:  1.471
Epoch   0 Batch  111/1077 - Train Accuracy:  0.381, Validation Accuracy:  0.449, Loss:  1.490
Epoch   0 Batch  112/1077 - Train Accuracy:  0.425, Validation Accuracy:  0.466, Loss:  1.524
Epoch   0 Batch  113/1077 - Train Accuracy:  0.432, Validation Accuracy:  0.472, Loss:  1.530
Epoch   0 Batch  114/1077 - Train Accuracy:  0.432, Validation Accuracy:  0.464, Loss:  1.436
Epoch   0 Batch  115/1077 - Train Accuracy:  0.391, Validation Accuracy:  0.452, Loss:  1.529
Epoch   0 Batch  116/1077 - Train Accuracy:  0.420, Validation Accuracy:  0.473, Loss:  1.489
Epoch   0 Batch  117/1077 - Train Accuracy:  0.416, Validation Accuracy:  0.484, Loss:  1.511
Epoch   0 Batch  118/1077 - Train Accuracy:  0.369, Validation Accuracy:  0.468, Loss:  1.517
Epoch   0 Batch  119/1077 - Train Accuracy:  0.400, Validation Accuracy:  0.453, Loss:  1.412
Epoch   0 Batch  120/1077 - Train Accuracy:  0.406, Validation Accuracy:  0.462, Loss:  1.438
Epoch   0 Batch  121/1077 - Train Accuracy:  0.420, Validation Accuracy:  0.474, Loss:  1.398
Epoch   0 Batch  122/1077 - Train Accuracy:  0.453, Validation Accuracy:  0.486, Loss:  1.393
Epoch   0 Batch  123/1077 - Train Accuracy:  0.456, Validation Accuracy:  0.481, Loss:  1.359
Epoch   0 Batch  124/1077 - Train Accuracy:  0.408, Validation Accuracy:  0.466, Loss:  1.415
Epoch   0 Batch  125/1077 - Train Accuracy:  0.434, Validation Accuracy:  0.453, Loss:  1.391
Epoch   0 Batch  126/1077 - Train Accuracy:  0.439, Validation Accuracy:  0.460, Loss:  1.318
Epoch   0 Batch  127/1077 - Train Accuracy:  0.425, Validation Accuracy:  0.457, Loss:  1.400
Epoch   0 Batch  128/1077 - Train Accuracy:  0.453, Validation Accuracy:  0.473, Loss:  1.318
Epoch   0 Batch  129/1077 - Train Accuracy:  0.471, Validation Accuracy:  0.490, Loss:  1.430
Epoch   0 Batch  130/1077 - Train Accuracy:  0.462, Validation Accuracy:  0.494, Loss:  1.299
Epoch   0 Batch  131/1077 - Train Accuracy:  0.433, Validation Accuracy:  0.487, Loss:  1.390
Epoch   0 Batch  132/1077 - Train Accuracy:  0.418, Validation Accuracy:  0.479, Loss:  1.413
Epoch   0 Batch  133/1077 - Train Accuracy:  0.419, Validation Accuracy:  0.480, Loss:  1.363
Epoch   0 Batch  134/1077 - Train Accuracy:  0.444, Validation Accuracy:  0.480, Loss:  1.315
Epoch   0 Batch  135/1077 - Train Accuracy:  0.416, Validation Accuracy:  0.476, Loss:  1.408
Epoch   0 Batch  136/1077 - Train Accuracy:  0.442, Validation Accuracy:  0.478, Loss:  1.332
Epoch   0 Batch  137/1077 - Train Accuracy:  0.501, Validation Accuracy:  0.488, Loss:  1.203
Epoch   0 Batch  138/1077 - Train Accuracy:  0.438, Validation Accuracy:  0.488, Loss:  1.278
Epoch   0 Batch  139/1077 - Train Accuracy:  0.455, Validation Accuracy:  0.486, Loss:  1.302
Epoch   0 Batch  140/1077 - Train Accuracy:  0.419, Validation Accuracy:  0.487, Loss:  1.392
Epoch   0 Batch  141/1077 - Train Accuracy:  0.466, Validation Accuracy:  0.495, Loss:  1.346
Epoch   0 Batch  142/1077 - Train Accuracy:  0.501, Validation Accuracy:  0.502, Loss:  1.216
Epoch   0 Batch  143/1077 - Train Accuracy:  0.464, Validation Accuracy:  0.509, Loss:  1.290
Epoch   0 Batch  144/1077 - Train Accuracy:  0.416, Validation Accuracy:  0.500, Loss:  1.363
Epoch   0 Batch  145/1077 - Train Accuracy:  0.529, Validation Accuracy:  0.525, Loss:  1.227
Epoch   0 Batch  146/1077 - Train Accuracy:  0.475, Validation Accuracy:  0.508, Loss:  1.251
Epoch   0 Batch  147/1077 - Train Accuracy:  0.420, Validation Accuracy:  0.489, Loss:  1.283
Epoch   0 Batch  148/1077 - Train Accuracy:  0.462, Validation Accuracy:  0.495, Loss:  1.269
Epoch   0 Batch  149/1077 - Train Accuracy:  0.472, Validation Accuracy:  0.519, Loss:  1.290
Epoch   0 Batch  150/1077 - Train Accuracy:  0.488, Validation Accuracy:  0.480, Loss:  1.195
Epoch   0 Batch  151/1077 - Train Accuracy:  0.471, Validation Accuracy:  0.472, Loss:  1.212
Epoch   0 Batch  152/1077 - Train Accuracy:  0.471, Validation Accuracy:  0.493, Loss:  1.283
Epoch   0 Batch  153/1077 - Train Accuracy:  0.475, Validation Accuracy:  0.505, Loss:  1.298
Epoch   0 Batch  154/1077 - Train Accuracy:  0.415, Validation Accuracy:  0.474, Loss:  1.319
Epoch   0 Batch  155/1077 - Train Accuracy:  0.481, Validation Accuracy:  0.512, Loss:  1.225
Epoch   0 Batch  156/1077 - Train Accuracy:  0.474, Validation Accuracy:  0.540, Loss:  1.223
Epoch   0 Batch  157/1077 - Train Accuracy:  0.516, Validation Accuracy:  0.557, Loss:  1.229
Epoch   0 Batch  158/1077 - Train Accuracy:  0.494, Validation Accuracy:  0.522, Loss:  1.250
Epoch   0 Batch  159/1077 - Train Accuracy:  0.512, Validation Accuracy:  0.517, Loss:  1.122
Epoch   0 Batch  160/1077 - Train Accuracy:  0.507, Validation Accuracy:  0.529, Loss:  1.185
Epoch   0 Batch  161/1077 - Train Accuracy:  0.473, Validation Accuracy:  0.525, Loss:  1.217
Epoch   0 Batch  162/1077 - Train Accuracy:  0.464, Validation Accuracy:  0.513, Loss:  1.227
Epoch   0 Batch  163/1077 - Train Accuracy:  0.491, Validation Accuracy:  0.554, Loss:  1.237
Epoch   0 Batch  164/1077 - Train Accuracy:  0.523, Validation Accuracy:  0.574, Loss:  1.211
Epoch   0 Batch  165/1077 - Train Accuracy:  0.498, Validation Accuracy:  0.537, Loss:  1.163
Epoch   0 Batch  166/1077 - Train Accuracy:  0.527, Validation Accuracy:  0.538, Loss:  1.159
Epoch   0 Batch  167/1077 - Train Accuracy:  0.516, Validation Accuracy:  0.565, Loss:  1.196
Epoch   0 Batch  168/1077 - Train Accuracy:  0.506, Validation Accuracy:  0.565, Loss:  1.227
Epoch   0 Batch  169/1077 - Train Accuracy:  0.530, Validation Accuracy:  0.545, Loss:  1.133
Epoch   0 Batch  170/1077 - Train Accuracy:  0.467, Validation Accuracy:  0.528, Loss:  1.179
Epoch   0 Batch  171/1077 - Train Accuracy:  0.523, Validation Accuracy:  0.519, Loss:  1.073
Epoch   0 Batch  172/1077 - Train Accuracy:  0.514, Validation Accuracy:  0.531, Loss:  1.088
Epoch   0 Batch  173/1077 - Train Accuracy:  0.484, Validation Accuracy:  0.565, Loss:  1.243
Epoch   0 Batch  174/1077 - Train Accuracy:  0.544, Validation Accuracy:  0.560, Loss:  1.128
Epoch   0 Batch  175/1077 - Train Accuracy:  0.549, Validation Accuracy:  0.580, Loss:  1.124
Epoch   0 Batch  176/1077 - Train Accuracy:  0.527, Validation Accuracy:  0.571, Loss:  1.117
Epoch   0 Batch  177/1077 - Train Accuracy:  0.493, Validation Accuracy:  0.570, Loss:  1.222
Epoch   0 Batch  178/1077 - Train Accuracy:  0.503, Validation Accuracy:  0.516, Loss:  1.103
Epoch   0 Batch  179/1077 - Train Accuracy:  0.543, Validation Accuracy:  0.568, Loss:  1.185
Epoch   0 Batch  180/1077 - Train Accuracy:  0.532, Validation Accuracy:  0.566, Loss:  1.125
Epoch   0 Batch  181/1077 - Train Accuracy:  0.554, Validation Accuracy:  0.578, Loss:  1.144
Epoch   0 Batch  182/1077 - Train Accuracy:  0.498, Validation Accuracy:  0.530, Loss:  1.087
Epoch   0 Batch  183/1077 - Train Accuracy:  0.507, Validation Accuracy:  0.575, Loss:  1.172
Epoch   0 Batch  184/1077 - Train Accuracy:  0.565, Validation Accuracy:  0.574, Loss:  1.056
Epoch   0 Batch  185/1077 - Train Accuracy:  0.508, Validation Accuracy:  0.575, Loss:  1.096
Epoch   0 Batch  186/1077 - Train Accuracy:  0.512, Validation Accuracy:  0.560, Loss:  1.155
Epoch   0 Batch  187/1077 - Train Accuracy:  0.504, Validation Accuracy:  0.566, Loss:  1.082
Epoch   0 Batch  188/1077 - Train Accuracy:  0.516, Validation Accuracy:  0.547, Loss:  1.056
Epoch   0 Batch  189/1077 - Train Accuracy:  0.501, Validation Accuracy:  0.545, Loss:  1.085
Epoch   0 Batch  190/1077 - Train Accuracy:  0.541, Validation Accuracy:  0.576, Loss:  1.067
Epoch   0 Batch  191/1077 - Train Accuracy:  0.562, Validation Accuracy:  0.573, Loss:  0.960
Epoch   0 Batch  192/1077 - Train Accuracy:  0.513, Validation Accuracy:  0.546, Loss:  1.064
Epoch   0 Batch  193/1077 - Train Accuracy:  0.525, Validation Accuracy:  0.565, Loss:  1.025
Epoch   0 Batch  194/1077 - Train Accuracy:  0.547, Validation Accuracy:  0.574, Loss:  0.986
Epoch   0 Batch  195/1077 - Train Accuracy:  0.495, Validation Accuracy:  0.578, Loss:  1.025
Epoch   0 Batch  196/1077 - Train Accuracy:  0.544, Validation Accuracy:  0.567, Loss:  1.025
Epoch   0 Batch  197/1077 - Train Accuracy:  0.502, Validation Accuracy:  0.560, Loss:  1.039
Epoch   0 Batch  198/1077 - Train Accuracy:  0.558, Validation Accuracy:  0.559, Loss:  0.966
Epoch   0 Batch  199/1077 - Train Accuracy:  0.538, Validation Accuracy:  0.558, Loss:  1.025
Epoch   0 Batch  200/1077 - Train Accuracy:  0.503, Validation Accuracy:  0.572, Loss:  1.075
Epoch   0 Batch  201/1077 - Train Accuracy:  0.560, Validation Accuracy:  0.591, Loss:  0.981
Epoch   0 Batch  202/1077 - Train Accuracy:  0.560, Validation Accuracy:  0.581, Loss:  1.008
Epoch   0 Batch  203/1077 - Train Accuracy:  0.525, Validation Accuracy:  0.585, Loss:  1.024
Epoch   0 Batch  204/1077 - Train Accuracy:  0.550, Validation Accuracy:  0.579, Loss:  1.006
Epoch   0 Batch  205/1077 - Train Accuracy:  0.540, Validation Accuracy:  0.574, Loss:  1.031
Epoch   0 Batch  206/1077 - Train Accuracy:  0.517, Validation Accuracy:  0.572, Loss:  0.995
Epoch   0 Batch  207/1077 - Train Accuracy:  0.531, Validation Accuracy:  0.570, Loss:  1.020
Epoch   0 Batch  208/1077 - Train Accuracy:  0.559, Validation Accuracy:  0.576, Loss:  1.009
Epoch   0 Batch  209/1077 - Train Accuracy:  0.558, Validation Accuracy:  0.579, Loss:  0.909
Epoch   0 Batch  210/1077 - Train Accuracy:  0.569, Validation Accuracy:  0.596, Loss:  1.014
Epoch   0 Batch  211/1077 - Train Accuracy:  0.527, Validation Accuracy:  0.594, Loss:  0.962
Epoch   0 Batch  212/1077 - Train Accuracy:  0.563, Validation Accuracy:  0.596, Loss:  0.933
Epoch   0 Batch  213/1077 - Train Accuracy:  0.578, Validation Accuracy:  0.598, Loss:  0.925
Epoch   0 Batch  214/1077 - Train Accuracy:  0.559, Validation Accuracy:  0.587, Loss:  0.983
Epoch   0 Batch  215/1077 - Train Accuracy:  0.538, Validation Accuracy:  0.588, Loss:  0.993
Epoch   0 Batch  216/1077 - Train Accuracy:  0.546, Validation Accuracy:  0.584, Loss:  1.002
Epoch   0 Batch  217/1077 - Train Accuracy:  0.570, Validation Accuracy:  0.578, Loss:  0.937
Epoch   0 Batch  218/1077 - Train Accuracy:  0.528, Validation Accuracy:  0.575, Loss:  1.043
Epoch   0 Batch  219/1077 - Train Accuracy:  0.589, Validation Accuracy:  0.583, Loss:  0.942
Epoch   0 Batch  220/1077 - Train Accuracy:  0.550, Validation Accuracy:  0.595, Loss:  0.955
Epoch   0 Batch  221/1077 - Train Accuracy:  0.573, Validation Accuracy:  0.599, Loss:  0.997
Epoch   0 Batch  222/1077 - Train Accuracy:  0.537, Validation Accuracy:  0.603, Loss:  1.004
Epoch   0 Batch  223/1077 - Train Accuracy:  0.604, Validation Accuracy:  0.605, Loss:  0.880
Epoch   0 Batch  224/1077 - Train Accuracy:  0.592, Validation Accuracy:  0.603, Loss:  0.937
Epoch   0 Batch  225/1077 - Train Accuracy:  0.560, Validation Accuracy:  0.605, Loss:  0.975
Epoch   0 Batch  226/1077 - Train Accuracy:  0.570, Validation Accuracy:  0.607, Loss:  0.923
Epoch   0 Batch  227/1077 - Train Accuracy:  0.537, Validation Accuracy:  0.594, Loss:  0.972
Epoch   0 Batch  228/1077 - Train Accuracy:  0.607, Validation Accuracy:  0.596, Loss:  0.915
Epoch   0 Batch  229/1077 - Train Accuracy:  0.611, Validation Accuracy:  0.600, Loss:  0.935
Epoch   0 Batch  230/1077 - Train Accuracy:  0.595, Validation Accuracy:  0.600, Loss:  0.892
Epoch   0 Batch  231/1077 - Train Accuracy:  0.573, Validation Accuracy:  0.603, Loss:  0.917
Epoch   0 Batch  232/1077 - Train Accuracy:  0.565, Validation Accuracy:  0.602, Loss:  0.952
Epoch   0 Batch  233/1077 - Train Accuracy:  0.554, Validation Accuracy:  0.590, Loss:  0.997
Epoch   0 Batch  234/1077 - Train Accuracy:  0.583, Validation Accuracy:  0.587, Loss:  0.904
Epoch   0 Batch  235/1077 - Train Accuracy:  0.597, Validation Accuracy:  0.583, Loss:  0.845
Epoch   0 Batch  236/1077 - Train Accuracy:  0.571, Validation Accuracy:  0.588, Loss:  0.941
Epoch   0 Batch  237/1077 - Train Accuracy:  0.588, Validation Accuracy:  0.591, Loss:  0.821
Epoch   0 Batch  238/1077 - Train Accuracy:  0.588, Validation Accuracy:  0.598, Loss:  0.929
Epoch   0 Batch  239/1077 - Train Accuracy:  0.596, Validation Accuracy:  0.606, Loss:  0.815
Epoch   0 Batch  240/1077 - Train Accuracy:  0.577, Validation Accuracy:  0.603, Loss:  0.898
Epoch   0 Batch  241/1077 - Train Accuracy:  0.616, Validation Accuracy:  0.603, Loss:  0.830
Epoch   0 Batch  242/1077 - Train Accuracy:  0.562, Validation Accuracy:  0.602, Loss:  0.884
Epoch   0 Batch  243/1077 - Train Accuracy:  0.533, Validation Accuracy:  0.602, Loss:  0.884
Epoch   0 Batch  244/1077 - Train Accuracy:  0.643, Validation Accuracy:  0.604, Loss:  0.838
Epoch   0 Batch  245/1077 - Train Accuracy:  0.589, Validation Accuracy:  0.605, Loss:  0.836
Epoch   0 Batch  246/1077 - Train Accuracy:  0.583, Validation Accuracy:  0.597, Loss:  0.865
Epoch   0 Batch  247/1077 - Train Accuracy:  0.606, Validation Accuracy:  0.598, Loss:  0.821
Epoch   0 Batch  248/1077 - Train Accuracy:  0.576, Validation Accuracy:  0.604, Loss:  0.857
Epoch   0 Batch  249/1077 - Train Accuracy:  0.590, Validation Accuracy:  0.607, Loss:  0.842
Epoch   0 Batch  250/1077 - Train Accuracy:  0.575, Validation Accuracy:  0.597, Loss:  0.790
Epoch   0 Batch  251/1077 - Train Accuracy:  0.590, Validation Accuracy:  0.610, Loss:  0.838
Epoch   0 Batch  252/1077 - Train Accuracy:  0.573, Validation Accuracy:  0.613, Loss:  0.835
Epoch   0 Batch  253/1077 - Train Accuracy:  0.614, Validation Accuracy:  0.605, Loss:  0.831
Epoch   0 Batch  254/1077 - Train Accuracy:  0.575, Validation Accuracy:  0.604, Loss:  0.863
Epoch   0 Batch  255/1077 - Train Accuracy:  0.567, Validation Accuracy:  0.602, Loss:  0.863
Epoch   0 Batch  256/1077 - Train Accuracy:  0.547, Validation Accuracy:  0.605, Loss:  0.881
Epoch   0 Batch  257/1077 - Train Accuracy:  0.603, Validation Accuracy:  0.604, Loss:  0.809
Epoch   0 Batch  258/1077 - Train Accuracy:  0.595, Validation Accuracy:  0.605, Loss:  0.816
Epoch   0 Batch  259/1077 - Train Accuracy:  0.563, Validation Accuracy:  0.606, Loss:  0.841
Epoch   0 Batch  260/1077 - Train Accuracy:  0.585, Validation Accuracy:  0.591, Loss:  0.799
Epoch   0 Batch  261/1077 - Train Accuracy:  0.565, Validation Accuracy:  0.586, Loss:  0.827
Epoch   0 Batch  262/1077 - Train Accuracy:  0.592, Validation Accuracy:  0.596, Loss:  0.825
Epoch   0 Batch  263/1077 - Train Accuracy:  0.614, Validation Accuracy:  0.603, Loss:  0.793
Epoch   0 Batch  264/1077 - Train Accuracy:  0.581, Validation Accuracy:  0.602, Loss:  0.836
Epoch   0 Batch  265/1077 - Train Accuracy:  0.576, Validation Accuracy:  0.603, Loss:  0.825
Epoch   0 Batch  266/1077 - Train Accuracy:  0.605, Validation Accuracy:  0.610, Loss:  0.787
Epoch   0 Batch  267/1077 - Train Accuracy:  0.591, Validation Accuracy:  0.619, Loss:  0.756
Epoch   0 Batch  268/1077 - Train Accuracy:  0.604, Validation Accuracy:  0.614, Loss:  0.827
Epoch   0 Batch  269/1077 - Train Accuracy:  0.563, Validation Accuracy:  0.604, Loss:  0.892
Epoch   0 Batch  270/1077 - Train Accuracy:  0.563, Validation Accuracy:  0.598, Loss:  0.850
Epoch   0 Batch  271/1077 - Train Accuracy:  0.591, Validation Accuracy:  0.596, Loss:  0.821
Epoch   0 Batch  272/1077 - Train Accuracy:  0.593, Validation Accuracy:  0.596, Loss:  0.819
Epoch   0 Batch  273/1077 - Train Accuracy:  0.585, Validation Accuracy:  0.605, Loss:  0.798
Epoch   0 Batch  274/1077 - Train Accuracy:  0.598, Validation Accuracy:  0.604, Loss:  0.781
Epoch   0 Batch  275/1077 - Train Accuracy:  0.578, Validation Accuracy:  0.594, Loss:  0.776
Epoch   0 Batch  276/1077 - Train Accuracy:  0.542, Validation Accuracy:  0.593, Loss:  0.853
Epoch   0 Batch  277/1077 - Train Accuracy:  0.601, Validation Accuracy:  0.598, Loss:  0.746
Epoch   0 Batch  278/1077 - Train Accuracy:  0.579, Validation Accuracy:  0.594, Loss:  0.853
Epoch   0 Batch  279/1077 - Train Accuracy:  0.587, Validation Accuracy:  0.612, Loss:  0.872
Epoch   0 Batch  280/1077 - Train Accuracy:  0.617, Validation Accuracy:  0.611, Loss:  0.821
Epoch   0 Batch  281/1077 - Train Accuracy:  0.587, Validation Accuracy:  0.610, Loss:  0.852
Epoch   0 Batch  282/1077 - Train Accuracy:  0.562, Validation Accuracy:  0.607, Loss:  0.846
Epoch   0 Batch  283/1077 - Train Accuracy:  0.609, Validation Accuracy:  0.594, Loss:  0.818
Epoch   0 Batch  284/1077 - Train Accuracy:  0.583, Validation Accuracy:  0.606, Loss:  0.834
Epoch   0 Batch  285/1077 - Train Accuracy:  0.627, Validation Accuracy:  0.611, Loss:  0.758
Epoch   0 Batch  286/1077 - Train Accuracy:  0.643, Validation Accuracy:  0.614, Loss:  0.738
Epoch   0 Batch  287/1077 - Train Accuracy:  0.613, Validation Accuracy:  0.615, Loss:  0.777
Epoch   0 Batch  288/1077 - Train Accuracy:  0.576, Validation Accuracy:  0.613, Loss:  0.801
Epoch   0 Batch  289/1077 - Train Accuracy:  0.620, Validation Accuracy:  0.606, Loss:  0.780
Epoch   0 Batch  290/1077 - Train Accuracy:  0.573, Validation Accuracy:  0.607, Loss:  0.827
Epoch   0 Batch  291/1077 - Train Accuracy:  0.584, Validation Accuracy:  0.614, Loss:  0.810
Epoch   0 Batch  292/1077 - Train Accuracy:  0.626, Validation Accuracy:  0.612, Loss:  0.773
Epoch   0 Batch  293/1077 - Train Accuracy:  0.567, Validation Accuracy:  0.615, Loss:  0.819
Epoch   0 Batch  294/1077 - Train Accuracy:  0.627, Validation Accuracy:  0.613, Loss:  0.714
Epoch   0 Batch  295/1077 - Train Accuracy:  0.585, Validation Accuracy:  0.608, Loss:  0.836
Epoch   0 Batch  296/1077 - Train Accuracy:  0.621, Validation Accuracy:  0.612, Loss:  0.735
Epoch   0 Batch  297/1077 - Train Accuracy:  0.591, Validation Accuracy:  0.609, Loss:  0.811
Epoch   0 Batch  298/1077 - Train Accuracy:  0.581, Validation Accuracy:  0.611, Loss:  0.831
Epoch   0 Batch  299/1077 - Train Accuracy:  0.591, Validation Accuracy:  0.615, Loss:  0.738
Epoch   0 Batch  300/1077 - Train Accuracy:  0.572, Validation Accuracy:  0.611, Loss:  0.785
Epoch   0 Batch  301/1077 - Train Accuracy:  0.593, Validation Accuracy:  0.621, Loss:  0.756
Epoch   0 Batch  302/1077 - Train Accuracy:  0.647, Validation Accuracy:  0.623, Loss:  0.773
Epoch   0 Batch  303/1077 - Train Accuracy:  0.587, Validation Accuracy:  0.617, Loss:  0.787
Epoch   0 Batch  304/1077 - Train Accuracy:  0.602, Validation Accuracy:  0.616, Loss:  0.703
Epoch   0 Batch  305/1077 - Train Accuracy:  0.624, Validation Accuracy:  0.611, Loss:  0.754
Epoch   0 Batch  306/1077 - Train Accuracy:  0.611, Validation Accuracy:  0.612, Loss:  0.718
Epoch   0 Batch  307/1077 - Train Accuracy:  0.587, Validation Accuracy:  0.607, Loss:  0.742
Epoch   0 Batch  308/1077 - Train Accuracy:  0.564, Validation Accuracy:  0.597, Loss:  0.806
Epoch   0 Batch  309/1077 - Train Accuracy:  0.624, Validation Accuracy:  0.609, Loss:  0.712
Epoch   0 Batch  310/1077 - Train Accuracy:  0.601, Validation Accuracy:  0.621, Loss:  0.748
Epoch   0 Batch  311/1077 - Train Accuracy:  0.663, Validation Accuracy:  0.625, Loss:  0.712
Epoch   0 Batch  312/1077 - Train Accuracy:  0.622, Validation Accuracy:  0.626, Loss:  0.781
Epoch   0 Batch  313/1077 - Train Accuracy:  0.590, Validation Accuracy:  0.628, Loss:  0.728
Epoch   0 Batch  314/1077 - Train Accuracy:  0.629, Validation Accuracy:  0.620, Loss:  0.729
Epoch   0 Batch  315/1077 - Train Accuracy:  0.597, Validation Accuracy:  0.614, Loss:  0.682
Epoch   0 Batch  316/1077 - Train Accuracy:  0.612, Validation Accuracy:  0.610, Loss:  0.709
Epoch   0 Batch  317/1077 - Train Accuracy:  0.619, Validation Accuracy:  0.616, Loss:  0.795
Epoch   0 Batch  318/1077 - Train Accuracy:  0.591, Validation Accuracy:  0.626, Loss:  0.729
Epoch   0 Batch  319/1077 - Train Accuracy:  0.600, Validation Accuracy:  0.623, Loss:  0.742
Epoch   0 Batch  320/1077 - Train Accuracy:  0.609, Validation Accuracy:  0.618, Loss:  0.735
Epoch   0 Batch  321/1077 - Train Accuracy:  0.610, Validation Accuracy:  0.623, Loss:  0.722
Epoch   0 Batch  322/1077 - Train Accuracy:  0.589, Validation Accuracy:  0.624, Loss:  0.701
Epoch   0 Batch  323/1077 - Train Accuracy:  0.624, Validation Accuracy:  0.624, Loss:  0.735
Epoch   0 Batch  324/1077 - Train Accuracy:  0.599, Validation Accuracy:  0.626, Loss:  0.710
Epoch   0 Batch  325/1077 - Train Accuracy:  0.648, Validation Accuracy:  0.628, Loss:  0.706
Epoch   0 Batch  326/1077 - Train Accuracy:  0.637, Validation Accuracy:  0.618, Loss:  0.700
Epoch   0 Batch  327/1077 - Train Accuracy:  0.609, Validation Accuracy:  0.618, Loss:  0.740
Epoch   0 Batch  328/1077 - Train Accuracy:  0.641, Validation Accuracy:  0.618, Loss:  0.747
Epoch   0 Batch  329/1077 - Train Accuracy:  0.593, Validation Accuracy:  0.622, Loss:  0.750
Epoch   0 Batch  330/1077 - Train Accuracy:  0.641, Validation Accuracy:  0.627, Loss:  0.713
Epoch   0 Batch  331/1077 - Train Accuracy:  0.623, Validation Accuracy:  0.625, Loss:  0.727
Epoch   0 Batch  332/1077 - Train Accuracy:  0.587, Validation Accuracy:  0.629, Loss:  0.667
Epoch   0 Batch  333/1077 - Train Accuracy:  0.638, Validation Accuracy:  0.624, Loss:  0.719
Epoch   0 Batch  334/1077 - Train Accuracy:  0.597, Validation Accuracy:  0.618, Loss:  0.742
Epoch   0 Batch  335/1077 - Train Accuracy:  0.638, Validation Accuracy:  0.618, Loss:  0.669
Epoch   0 Batch  336/1077 - Train Accuracy:  0.601, Validation Accuracy:  0.617, Loss:  0.737
Epoch   0 Batch  337/1077 - Train Accuracy:  0.587, Validation Accuracy:  0.629, Loss:  0.741
Epoch   0 Batch  338/1077 - Train Accuracy:  0.632, Validation Accuracy:  0.622, Loss:  0.735
Epoch   0 Batch  339/1077 - Train Accuracy:  0.620, Validation Accuracy:  0.624, Loss:  0.691
Epoch   0 Batch  340/1077 - Train Accuracy:  0.572, Validation Accuracy:  0.625, Loss:  0.717
Epoch   0 Batch  341/1077 - Train Accuracy:  0.629, Validation Accuracy:  0.626, Loss:  0.739
Epoch   0 Batch  342/1077 - Train Accuracy:  0.621, Validation Accuracy:  0.618, Loss:  0.662
Epoch   0 Batch  343/1077 - Train Accuracy:  0.592, Validation Accuracy:  0.618, Loss:  0.715
Epoch   0 Batch  344/1077 - Train Accuracy:  0.623, Validation Accuracy:  0.620, Loss:  0.713
Epoch   0 Batch  345/1077 - Train Accuracy:  0.628, Validation Accuracy:  0.620, Loss:  0.665
Epoch   0 Batch  346/1077 - Train Accuracy:  0.589, Validation Accuracy:  0.620, Loss:  0.703
Epoch   0 Batch  347/1077 - Train Accuracy:  0.616, Validation Accuracy:  0.617, Loss:  0.662
Epoch   0 Batch  348/1077 - Train Accuracy:  0.594, Validation Accuracy:  0.623, Loss:  0.664
Epoch   0 Batch  349/1077 - Train Accuracy:  0.604, Validation Accuracy:  0.623, Loss:  0.695
Epoch   0 Batch  350/1077 - Train Accuracy:  0.599, Validation Accuracy:  0.631, Loss:  0.732
Epoch   0 Batch  351/1077 - Train Accuracy:  0.593, Validation Accuracy:  0.641, Loss:  0.735
Epoch   0 Batch  352/1077 - Train Accuracy:  0.612, Validation Accuracy:  0.622, Loss:  0.704
Epoch   0 Batch  353/1077 - Train Accuracy:  0.570, Validation Accuracy:  0.623, Loss:  0.753
Epoch   0 Batch  354/1077 - Train Accuracy:  0.619, Validation Accuracy:  0.637, Loss:  0.720
Epoch   0 Batch  355/1077 - Train Accuracy:  0.618, Validation Accuracy:  0.626, Loss:  0.673
Epoch   0 Batch  356/1077 - Train Accuracy:  0.600, Validation Accuracy:  0.636, Loss:  0.698
Epoch   0 Batch  357/1077 - Train Accuracy:  0.627, Validation Accuracy:  0.644, Loss:  0.658
Epoch   0 Batch  358/1077 - Train Accuracy:  0.597, Validation Accuracy:  0.630, Loss:  0.730
Epoch   0 Batch  359/1077 - Train Accuracy:  0.626, Validation Accuracy:  0.622, Loss:  0.682
Epoch   0 Batch  360/1077 - Train Accuracy:  0.625, Validation Accuracy:  0.621, Loss:  0.676
Epoch   0 Batch  361/1077 - Train Accuracy:  0.637, Validation Accuracy:  0.629, Loss:  0.708
Epoch   0 Batch  362/1077 - Train Accuracy:  0.656, Validation Accuracy:  0.643, Loss:  0.681
Epoch   0 Batch  363/1077 - Train Accuracy:  0.605, Validation Accuracy:  0.635, Loss:  0.700
Epoch   0 Batch  364/1077 - Train Accuracy:  0.637, Validation Accuracy:  0.621, Loss:  0.698
Epoch   0 Batch  365/1077 - Train Accuracy:  0.589, Validation Accuracy:  0.626, Loss:  0.674
Epoch   0 Batch  366/1077 - Train Accuracy:  0.617, Validation Accuracy:  0.622, Loss:  0.693
Epoch   0 Batch  367/1077 - Train Accuracy:  0.640, Validation Accuracy:  0.636, Loss:  0.616
Epoch   0 Batch  368/1077 - Train Accuracy:  0.650, Validation Accuracy:  0.633, Loss:  0.667
Epoch   0 Batch  369/1077 - Train Accuracy:  0.603, Validation Accuracy:  0.641, Loss:  0.655
Epoch   0 Batch  370/1077 - Train Accuracy:  0.643, Validation Accuracy:  0.654, Loss:  0.632
Epoch   0 Batch  371/1077 - Train Accuracy:  0.638, Validation Accuracy:  0.642, Loss:  0.661
Epoch   0 Batch  372/1077 - Train Accuracy:  0.616, Validation Accuracy:  0.638, Loss:  0.653
Epoch   0 Batch  373/1077 - Train Accuracy:  0.648, Validation Accuracy:  0.621, Loss:  0.613
Epoch   0 Batch  374/1077 - Train Accuracy:  0.569, Validation Accuracy:  0.631, Loss:  0.736
Epoch   0 Batch  375/1077 - Train Accuracy:  0.650, Validation Accuracy:  0.647, Loss:  0.636
Epoch   0 Batch  376/1077 - Train Accuracy:  0.631, Validation Accuracy:  0.639, Loss:  0.634
Epoch   0 Batch  377/1077 - Train Accuracy:  0.609, Validation Accuracy:  0.653, Loss:  0.676
Epoch   0 Batch  378/1077 - Train Accuracy:  0.602, Validation Accuracy:  0.635, Loss:  0.637
Epoch   0 Batch  379/1077 - Train Accuracy:  0.635, Validation Accuracy:  0.633, Loss:  0.675
Epoch   0 Batch  380/1077 - Train Accuracy:  0.626, Validation Accuracy:  0.622, Loss:  0.656
Epoch   0 Batch  381/1077 - Train Accuracy:  0.636, Validation Accuracy:  0.644, Loss:  0.678
Epoch   0 Batch  382/1077 - Train Accuracy:  0.627, Validation Accuracy:  0.651, Loss:  0.676
Epoch   0 Batch  383/1077 - Train Accuracy:  0.639, Validation Accuracy:  0.639, Loss:  0.644
Epoch   0 Batch  384/1077 - Train Accuracy:  0.650, Validation Accuracy:  0.645, Loss:  0.652
Epoch   0 Batch  385/1077 - Train Accuracy:  0.605, Validation Accuracy:  0.645, Loss:  0.665
Epoch   0 Batch  386/1077 - Train Accuracy:  0.600, Validation Accuracy:  0.645, Loss:  0.639
Epoch   0 Batch  387/1077 - Train Accuracy:  0.664, Validation Accuracy:  0.643, Loss:  0.662
Epoch   0 Batch  388/1077 - Train Accuracy:  0.637, Validation Accuracy:  0.652, Loss:  0.629
Epoch   0 Batch  389/1077 - Train Accuracy:  0.646, Validation Accuracy:  0.642, Loss:  0.647
Epoch   0 Batch  390/1077 - Train Accuracy:  0.612, Validation Accuracy:  0.653, Loss:  0.676
Epoch   0 Batch  391/1077 - Train Accuracy:  0.658, Validation Accuracy:  0.653, Loss:  0.624
Epoch   0 Batch  392/1077 - Train Accuracy:  0.637, Validation Accuracy:  0.647, Loss:  0.654
Epoch   0 Batch  393/1077 - Train Accuracy:  0.669, Validation Accuracy:  0.647, Loss:  0.607
Epoch   0 Batch  394/1077 - Train Accuracy:  0.613, Validation Accuracy:  0.651, Loss:  0.660
Epoch   0 Batch  395/1077 - Train Accuracy:  0.634, Validation Accuracy:  0.653, Loss:  0.621
Epoch   0 Batch  396/1077 - Train Accuracy:  0.617, Validation Accuracy:  0.647, Loss:  0.652
Epoch   0 Batch  397/1077 - Train Accuracy:  0.667, Validation Accuracy:  0.639, Loss:  0.638
Epoch   0 Batch  398/1077 - Train Accuracy:  0.638, Validation Accuracy:  0.652, Loss:  0.692
Epoch   0 Batch  399/1077 - Train Accuracy:  0.568, Validation Accuracy:  0.655, Loss:  0.699
Epoch   0 Batch  400/1077 - Train Accuracy:  0.641, Validation Accuracy:  0.650, Loss:  0.635
Epoch   0 Batch  401/1077 - Train Accuracy:  0.620, Validation Accuracy:  0.649, Loss:  0.643
Epoch   0 Batch  402/1077 - Train Accuracy:  0.676, Validation Accuracy:  0.658, Loss:  0.611
Epoch   0 Batch  403/1077 - Train Accuracy:  0.639, Validation Accuracy:  0.675, Loss:  0.663
Epoch   0 Batch  404/1077 - Train Accuracy:  0.668, Validation Accuracy:  0.676, Loss:  0.609
Epoch   0 Batch  405/1077 - Train Accuracy:  0.641, Validation Accuracy:  0.665, Loss:  0.673
Epoch   0 Batch  406/1077 - Train Accuracy:  0.705, Validation Accuracy:  0.669, Loss:  0.627
Epoch   0 Batch  407/1077 - Train Accuracy:  0.620, Validation Accuracy:  0.676, Loss:  0.682
Epoch   0 Batch  408/1077 - Train Accuracy:  0.647, Validation Accuracy:  0.669, Loss:  0.617
Epoch   0 Batch  409/1077 - Train Accuracy:  0.632, Validation Accuracy:  0.663, Loss:  0.644
Epoch   0 Batch  410/1077 - Train Accuracy:  0.607, Validation Accuracy:  0.653, Loss:  0.659
Epoch   0 Batch  411/1077 - Train Accuracy:  0.666, Validation Accuracy:  0.658, Loss:  0.610
Epoch   0 Batch  412/1077 - Train Accuracy:  0.647, Validation Accuracy:  0.662, Loss:  0.610
Epoch   0 Batch  413/1077 - Train Accuracy:  0.635, Validation Accuracy:  0.668, Loss:  0.640
Epoch   0 Batch  414/1077 - Train Accuracy:  0.607, Validation Accuracy:  0.675, Loss:  0.656
Epoch   0 Batch  415/1077 - Train Accuracy:  0.657, Validation Accuracy:  0.669, Loss:  0.602
Epoch   0 Batch  416/1077 - Train Accuracy:  0.636, Validation Accuracy:  0.665, Loss:  0.635
Epoch   0 Batch  417/1077 - Train Accuracy:  0.645, Validation Accuracy:  0.669, Loss:  0.654
Epoch   0 Batch  418/1077 - Train Accuracy:  0.654, Validation Accuracy:  0.684, Loss:  0.600
Epoch   0 Batch  419/1077 - Train Accuracy:  0.646, Validation Accuracy:  0.679, Loss:  0.615
Epoch   0 Batch  420/1077 - Train Accuracy:  0.659, Validation Accuracy:  0.679, Loss:  0.597
Epoch   0 Batch  421/1077 - Train Accuracy:  0.613, Validation Accuracy:  0.675, Loss:  0.653
Epoch   0 Batch  422/1077 - Train Accuracy:  0.664, Validation Accuracy:  0.667, Loss:  0.574
Epoch   0 Batch  423/1077 - Train Accuracy:  0.691, Validation Accuracy:  0.665, Loss:  0.625
Epoch   0 Batch  424/1077 - Train Accuracy:  0.622, Validation Accuracy:  0.675, Loss:  0.627
Epoch   0 Batch  425/1077 - Train Accuracy:  0.647, Validation Accuracy:  0.672, Loss:  0.591
Epoch   0 Batch  426/1077 - Train Accuracy:  0.625, Validation Accuracy:  0.663, Loss:  0.634
Epoch   0 Batch  427/1077 - Train Accuracy:  0.619, Validation Accuracy:  0.671, Loss:  0.601
Epoch   0 Batch  428/1077 - Train Accuracy:  0.658, Validation Accuracy:  0.674, Loss:  0.589
Epoch   0 Batch  429/1077 - Train Accuracy:  0.652, Validation Accuracy:  0.675, Loss:  0.586
Epoch   0 Batch  430/1077 - Train Accuracy:  0.652, Validation Accuracy:  0.660, Loss:  0.620
Epoch   0 Batch  431/1077 - Train Accuracy:  0.617, Validation Accuracy:  0.658, Loss:  0.590
Epoch   0 Batch  432/1077 - Train Accuracy:  0.670, Validation Accuracy:  0.674, Loss:  0.628
Epoch   0 Batch  433/1077 - Train Accuracy:  0.656, Validation Accuracy:  0.665, Loss:  0.606
Epoch   0 Batch  434/1077 - Train Accuracy:  0.620, Validation Accuracy:  0.673, Loss:  0.620
Epoch   0 Batch  435/1077 - Train Accuracy:  0.672, Validation Accuracy:  0.661, Loss:  0.631
Epoch   0 Batch  436/1077 - Train Accuracy:  0.675, Validation Accuracy:  0.650, Loss:  0.585
Epoch   0 Batch  437/1077 - Train Accuracy:  0.627, Validation Accuracy:  0.661, Loss:  0.596
Epoch   0 Batch  438/1077 - Train Accuracy:  0.635, Validation Accuracy:  0.669, Loss:  0.600
Epoch   0 Batch  439/1077 - Train Accuracy:  0.659, Validation Accuracy:  0.667, Loss:  0.619
Epoch   0 Batch  440/1077 - Train Accuracy:  0.641, Validation Accuracy:  0.680, Loss:  0.625
Epoch   0 Batch  441/1077 - Train Accuracy:  0.591, Validation Accuracy:  0.676, Loss:  0.604
Epoch   0 Batch  442/1077 - Train Accuracy:  0.665, Validation Accuracy:  0.671, Loss:  0.581
Epoch   0 Batch  443/1077 - Train Accuracy:  0.680, Validation Accuracy:  0.663, Loss:  0.563
Epoch   0 Batch  444/1077 - Train Accuracy:  0.630, Validation Accuracy:  0.665, Loss:  0.605
Epoch   0 Batch  445/1077 - Train Accuracy:  0.628, Validation Accuracy:  0.668, Loss:  0.631
Epoch   0 Batch  446/1077 - Train Accuracy:  0.681, Validation Accuracy:  0.675, Loss:  0.544
Epoch   0 Batch  447/1077 - Train Accuracy:  0.662, Validation Accuracy:  0.678, Loss:  0.588
Epoch   0 Batch  448/1077 - Train Accuracy:  0.641, Validation Accuracy:  0.677, Loss:  0.633
Epoch   0 Batch  449/1077 - Train Accuracy:  0.660, Validation Accuracy:  0.674, Loss:  0.621
Epoch   0 Batch  450/1077 - Train Accuracy:  0.633, Validation Accuracy:  0.681, Loss:  0.579
Epoch   0 Batch  451/1077 - Train Accuracy:  0.636, Validation Accuracy:  0.684, Loss:  0.565
Epoch   0 Batch  452/1077 - Train Accuracy:  0.686, Validation Accuracy:  0.683, Loss:  0.590
Epoch   0 Batch  453/1077 - Train Accuracy:  0.639, Validation Accuracy:  0.681, Loss:  0.565
Epoch   0 Batch  454/1077 - Train Accuracy:  0.649, Validation Accuracy:  0.690, Loss:  0.595
Epoch   0 Batch  455/1077 - Train Accuracy:  0.655, Validation Accuracy:  0.678, Loss:  0.573
Epoch   0 Batch  456/1077 - Train Accuracy:  0.668, Validation Accuracy:  0.678, Loss:  0.582
Epoch   0 Batch  457/1077 - Train Accuracy:  0.672, Validation Accuracy:  0.683, Loss:  0.542
Epoch   0 Batch  458/1077 - Train Accuracy:  0.658, Validation Accuracy:  0.678, Loss:  0.600
Epoch   0 Batch  459/1077 - Train Accuracy:  0.683, Validation Accuracy:  0.656, Loss:  0.562
Epoch   0 Batch  460/1077 - Train Accuracy:  0.642, Validation Accuracy:  0.673, Loss:  0.596
Epoch   0 Batch  461/1077 - Train Accuracy:  0.659, Validation Accuracy:  0.670, Loss:  0.594
Epoch   0 Batch  462/1077 - Train Accuracy:  0.679, Validation Accuracy:  0.677, Loss:  0.567
Epoch   0 Batch  463/1077 - Train Accuracy:  0.631, Validation Accuracy:  0.698, Loss:  0.586
Epoch   0 Batch  464/1077 - Train Accuracy:  0.706, Validation Accuracy:  0.684, Loss:  0.560
Epoch   0 Batch  465/1077 - Train Accuracy:  0.665, Validation Accuracy:  0.676, Loss:  0.626
Epoch   0 Batch  466/1077 - Train Accuracy:  0.680, Validation Accuracy:  0.672, Loss:  0.559
Epoch   0 Batch  467/1077 - Train Accuracy:  0.727, Validation Accuracy:  0.663, Loss:  0.575
Epoch   0 Batch  468/1077 - Train Accuracy:  0.677, Validation Accuracy:  0.680, Loss:  0.598
Epoch   0 Batch  469/1077 - Train Accuracy:  0.644, Validation Accuracy:  0.677, Loss:  0.587
Epoch   0 Batch  470/1077 - Train Accuracy:  0.678, Validation Accuracy:  0.685, Loss:  0.604
Epoch   0 Batch  471/1077 - Train Accuracy:  0.696, Validation Accuracy:  0.688, Loss:  0.553
Epoch   0 Batch  472/1077 - Train Accuracy:  0.688, Validation Accuracy:  0.667, Loss:  0.554
Epoch   0 Batch  473/1077 - Train Accuracy:  0.650, Validation Accuracy:  0.674, Loss:  0.584
Epoch   0 Batch  474/1077 - Train Accuracy:  0.667, Validation Accuracy:  0.680, Loss:  0.575
Epoch   0 Batch  475/1077 - Train Accuracy:  0.680, Validation Accuracy:  0.672, Loss:  0.554
Epoch   0 Batch  476/1077 - Train Accuracy:  0.634, Validation Accuracy:  0.692, Loss:  0.569
Epoch   0 Batch  477/1077 - Train Accuracy:  0.716, Validation Accuracy:  0.679, Loss:  0.547
Epoch   0 Batch  478/1077 - Train Accuracy:  0.689, Validation Accuracy:  0.683, Loss:  0.578
Epoch   0 Batch  479/1077 - Train Accuracy:  0.662, Validation Accuracy:  0.690, Loss:  0.601
Epoch   0 Batch  480/1077 - Train Accuracy:  0.678, Validation Accuracy:  0.684, Loss:  0.571
Epoch   0 Batch  481/1077 - Train Accuracy:  0.659, Validation Accuracy:  0.679, Loss:  0.567
Epoch   0 Batch  482/1077 - Train Accuracy:  0.648, Validation Accuracy:  0.683, Loss:  0.621
Epoch   0 Batch  483/1077 - Train Accuracy:  0.644, Validation Accuracy:  0.683, Loss:  0.563
Epoch   0 Batch  484/1077 - Train Accuracy:  0.672, Validation Accuracy:  0.690, Loss:  0.551
Epoch   0 Batch  485/1077 - Train Accuracy:  0.724, Validation Accuracy:  0.695, Loss:  0.564
Epoch   0 Batch  486/1077 - Train Accuracy:  0.659, Validation Accuracy:  0.682, Loss:  0.568
Epoch   0 Batch  487/1077 - Train Accuracy:  0.664, Validation Accuracy:  0.681, Loss:  0.578
Epoch   0 Batch  488/1077 - Train Accuracy:  0.665, Validation Accuracy:  0.685, Loss:  0.573
Epoch   0 Batch  489/1077 - Train Accuracy:  0.685, Validation Accuracy:  0.681, Loss:  0.532
Epoch   0 Batch  490/1077 - Train Accuracy:  0.663, Validation Accuracy:  0.697, Loss:  0.561
Epoch   0 Batch  491/1077 - Train Accuracy:  0.698, Validation Accuracy:  0.689, Loss:  0.569
Epoch   0 Batch  492/1077 - Train Accuracy:  0.685, Validation Accuracy:  0.674, Loss:  0.570
Epoch   0 Batch  493/1077 - Train Accuracy:  0.705, Validation Accuracy:  0.688, Loss:  0.514
Epoch   0 Batch  494/1077 - Train Accuracy:  0.698, Validation Accuracy:  0.688, Loss:  0.516
Epoch   0 Batch  495/1077 - Train Accuracy:  0.684, Validation Accuracy:  0.686, Loss:  0.545
Epoch   0 Batch  496/1077 - Train Accuracy:  0.662, Validation Accuracy:  0.695, Loss:  0.568
Epoch   0 Batch  497/1077 - Train Accuracy:  0.667, Validation Accuracy:  0.685, Loss:  0.597
Epoch   0 Batch  498/1077 - Train Accuracy:  0.721, Validation Accuracy:  0.696, Loss:  0.532
Epoch   0 Batch  499/1077 - Train Accuracy:  0.664, Validation Accuracy:  0.692, Loss:  0.534
Epoch   0 Batch  500/1077 - Train Accuracy:  0.703, Validation Accuracy:  0.682, Loss:  0.542
Epoch   0 Batch  501/1077 - Train Accuracy:  0.683, Validation Accuracy:  0.681, Loss:  0.532
Epoch   0 Batch  502/1077 - Train Accuracy:  0.701, Validation Accuracy:  0.678, Loss:  0.545
Epoch   0 Batch  503/1077 - Train Accuracy:  0.714, Validation Accuracy:  0.683, Loss:  0.543
Epoch   0 Batch  504/1077 - Train Accuracy:  0.673, Validation Accuracy:  0.686, Loss:  0.542
Epoch   0 Batch  505/1077 - Train Accuracy:  0.716, Validation Accuracy:  0.694, Loss:  0.495
Epoch   0 Batch  506/1077 - Train Accuracy:  0.674, Validation Accuracy:  0.694, Loss:  0.549
Epoch   0 Batch  507/1077 - Train Accuracy:  0.656, Validation Accuracy:  0.676, Loss:  0.521
Epoch   0 Batch  508/1077 - Train Accuracy:  0.688, Validation Accuracy:  0.681, Loss:  0.506
Epoch   0 Batch  509/1077 - Train Accuracy:  0.675, Validation Accuracy:  0.680, Loss:  0.556
Epoch   0 Batch  510/1077 - Train Accuracy:  0.666, Validation Accuracy:  0.679, Loss:  0.542
Epoch   0 Batch  511/1077 - Train Accuracy:  0.660, Validation Accuracy:  0.681, Loss:  0.548
Epoch   0 Batch  512/1077 - Train Accuracy:  0.732, Validation Accuracy:  0.698, Loss:  0.524
Epoch   0 Batch  513/1077 - Train Accuracy:  0.688, Validation Accuracy:  0.695, Loss:  0.537
Epoch   0 Batch  514/1077 - Train Accuracy:  0.661, Validation Accuracy:  0.689, Loss:  0.543
Epoch   0 Batch  515/1077 - Train Accuracy:  0.694, Validation Accuracy:  0.701, Loss:  0.547
Epoch   0 Batch  516/1077 - Train Accuracy:  0.720, Validation Accuracy:  0.711, Loss:  0.511
Epoch   0 Batch  517/1077 - Train Accuracy:  0.722, Validation Accuracy:  0.717, Loss:  0.524
Epoch   0 Batch  518/1077 - Train Accuracy:  0.677, Validation Accuracy:  0.718, Loss:  0.515
Epoch   0 Batch  519/1077 - Train Accuracy:  0.698, Validation Accuracy:  0.713, Loss:  0.529
Epoch   0 Batch  520/1077 - Train Accuracy:  0.725, Validation Accuracy:  0.696, Loss:  0.514
Epoch   0 Batch  521/1077 - Train Accuracy:  0.704, Validation Accuracy:  0.714, Loss:  0.507
Epoch   0 Batch  522/1077 - Train Accuracy:  0.674, Validation Accuracy:  0.708, Loss:  0.555
Epoch   0 Batch  523/1077 - Train Accuracy:  0.701, Validation Accuracy:  0.689, Loss:  0.532
Epoch   0 Batch  524/1077 - Train Accuracy:  0.691, Validation Accuracy:  0.703, Loss:  0.527
Epoch   0 Batch  525/1077 - Train Accuracy:  0.705, Validation Accuracy:  0.694, Loss:  0.514
Epoch   0 Batch  526/1077 - Train Accuracy:  0.730, Validation Accuracy:  0.696, Loss:  0.518
Epoch   0 Batch  527/1077 - Train Accuracy:  0.669, Validation Accuracy:  0.710, Loss:  0.554
Epoch   0 Batch  528/1077 - Train Accuracy:  0.694, Validation Accuracy:  0.695, Loss:  0.514
Epoch   0 Batch  529/1077 - Train Accuracy:  0.681, Validation Accuracy:  0.719, Loss:  0.513
Epoch   0 Batch  530/1077 - Train Accuracy:  0.680, Validation Accuracy:  0.719, Loss:  0.519
Epoch   0 Batch  531/1077 - Train Accuracy:  0.706, Validation Accuracy:  0.724, Loss:  0.518
Epoch   0 Batch  532/1077 - Train Accuracy:  0.697, Validation Accuracy:  0.727, Loss:  0.536
Epoch   0 Batch  533/1077 - Train Accuracy:  0.721, Validation Accuracy:  0.725, Loss:  0.532
Epoch   0 Batch  534/1077 - Train Accuracy:  0.690, Validation Accuracy:  0.718, Loss:  0.500
Epoch   0 Batch  535/1077 - Train Accuracy:  0.716, Validation Accuracy:  0.708, Loss:  0.517
Epoch   0 Batch  536/1077 - Train Accuracy:  0.723, Validation Accuracy:  0.723, Loss:  0.514
Epoch   0 Batch  537/1077 - Train Accuracy:  0.714, Validation Accuracy:  0.723, Loss:  0.510
Epoch   0 Batch  538/1077 - Train Accuracy:  0.750, Validation Accuracy:  0.717, Loss:  0.456
Epoch   0 Batch  539/1077 - Train Accuracy:  0.729, Validation Accuracy:  0.705, Loss:  0.512
Epoch   0 Batch  540/1077 - Train Accuracy:  0.696, Validation Accuracy:  0.703, Loss:  0.482
Epoch   0 Batch  541/1077 - Train Accuracy:  0.680, Validation Accuracy:  0.714, Loss:  0.506
Epoch   0 Batch  542/1077 - Train Accuracy:  0.700, Validation Accuracy:  0.711, Loss:  0.510
Epoch   0 Batch  543/1077 - Train Accuracy:  0.701, Validation Accuracy:  0.708, Loss:  0.518
Epoch   0 Batch  544/1077 - Train Accuracy:  0.709, Validation Accuracy:  0.711, Loss:  0.481
Epoch   0 Batch  545/1077 - Train Accuracy:  0.705, Validation Accuracy:  0.703, Loss:  0.523
Epoch   0 Batch  546/1077 - Train Accuracy:  0.685, Validation Accuracy:  0.710, Loss:  0.542
Epoch   0 Batch  547/1077 - Train Accuracy:  0.750, Validation Accuracy:  0.718, Loss:  0.497
Epoch   0 Batch  548/1077 - Train Accuracy:  0.732, Validation Accuracy:  0.721, Loss:  0.497
Epoch   0 Batch  549/1077 - Train Accuracy:  0.679, Validation Accuracy:  0.724, Loss:  0.538
Epoch   0 Batch  550/1077 - Train Accuracy:  0.672, Validation Accuracy:  0.724, Loss:  0.526
Epoch   0 Batch  551/1077 - Train Accuracy:  0.709, Validation Accuracy:  0.722, Loss:  0.496
Epoch   0 Batch  552/1077 - Train Accuracy:  0.716, Validation Accuracy:  0.716, Loss:  0.525
Epoch   0 Batch  553/1077 - Train Accuracy:  0.723, Validation Accuracy:  0.716, Loss:  0.493
Epoch   0 Batch  554/1077 - Train Accuracy:  0.682, Validation Accuracy:  0.732, Loss:  0.505
Epoch   0 Batch  555/1077 - Train Accuracy:  0.705, Validation Accuracy:  0.725, Loss:  0.506
Epoch   0 Batch  556/1077 - Train Accuracy:  0.710, Validation Accuracy:  0.711, Loss:  0.480
Epoch   0 Batch  557/1077 - Train Accuracy:  0.759, Validation Accuracy:  0.718, Loss:  0.506
Epoch   0 Batch  558/1077 - Train Accuracy:  0.739, Validation Accuracy:  0.725, Loss:  0.474
Epoch   0 Batch  559/1077 - Train Accuracy:  0.704, Validation Accuracy:  0.724, Loss:  0.501
Epoch   0 Batch  560/1077 - Train Accuracy:  0.710, Validation Accuracy:  0.713, Loss:  0.476
Epoch   0 Batch  561/1077 - Train Accuracy:  0.730, Validation Accuracy:  0.714, Loss:  0.467
Epoch   0 Batch  562/1077 - Train Accuracy:  0.757, Validation Accuracy:  0.704, Loss:  0.456
Epoch   0 Batch  563/1077 - Train Accuracy:  0.700, Validation Accuracy:  0.704, Loss:  0.514
Epoch   0 Batch  564/1077 - Train Accuracy:  0.681, Validation Accuracy:  0.717, Loss:  0.533
Epoch   0 Batch  565/1077 - Train Accuracy:  0.722, Validation Accuracy:  0.722, Loss:  0.491
Epoch   0 Batch  566/1077 - Train Accuracy:  0.731, Validation Accuracy:  0.714, Loss:  0.507
Epoch   0 Batch  567/1077 - Train Accuracy:  0.706, Validation Accuracy:  0.694, Loss:  0.485
Epoch   0 Batch  568/1077 - Train Accuracy:  0.727, Validation Accuracy:  0.688, Loss:  0.487
Epoch   0 Batch  569/1077 - Train Accuracy:  0.723, Validation Accuracy:  0.711, Loss:  0.492
Epoch   0 Batch  570/1077 - Train Accuracy:  0.717, Validation Accuracy:  0.706, Loss:  0.516
Epoch   0 Batch  571/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.699, Loss:  0.456
Epoch   0 Batch  572/1077 - Train Accuracy:  0.700, Validation Accuracy:  0.703, Loss:  0.443
Epoch   0 Batch  573/1077 - Train Accuracy:  0.700, Validation Accuracy:  0.699, Loss:  0.492
Epoch   0 Batch  574/1077 - Train Accuracy:  0.669, Validation Accuracy:  0.712, Loss:  0.522
Epoch   0 Batch  575/1077 - Train Accuracy:  0.727, Validation Accuracy:  0.696, Loss:  0.473
Epoch   0 Batch  576/1077 - Train Accuracy:  0.736, Validation Accuracy:  0.717, Loss:  0.485
Epoch   0 Batch  577/1077 - Train Accuracy:  0.729, Validation Accuracy:  0.729, Loss:  0.503
Epoch   0 Batch  578/1077 - Train Accuracy:  0.725, Validation Accuracy:  0.734, Loss:  0.471
Epoch   0 Batch  579/1077 - Train Accuracy:  0.733, Validation Accuracy:  0.702, Loss:  0.462
Epoch   0 Batch  580/1077 - Train Accuracy:  0.717, Validation Accuracy:  0.699, Loss:  0.446
Epoch   0 Batch  581/1077 - Train Accuracy:  0.720, Validation Accuracy:  0.710, Loss:  0.458
Epoch   0 Batch  582/1077 - Train Accuracy:  0.743, Validation Accuracy:  0.719, Loss:  0.473
Epoch   0 Batch  583/1077 - Train Accuracy:  0.742, Validation Accuracy:  0.725, Loss:  0.498
Epoch   0 Batch  584/1077 - Train Accuracy:  0.711, Validation Accuracy:  0.722, Loss:  0.468
Epoch   0 Batch  585/1077 - Train Accuracy:  0.736, Validation Accuracy:  0.706, Loss:  0.425
Epoch   0 Batch  586/1077 - Train Accuracy:  0.698, Validation Accuracy:  0.714, Loss:  0.500
Epoch   0 Batch  587/1077 - Train Accuracy:  0.729, Validation Accuracy:  0.716, Loss:  0.441
Epoch   0 Batch  588/1077 - Train Accuracy:  0.688, Validation Accuracy:  0.706, Loss:  0.480
Epoch   0 Batch  589/1077 - Train Accuracy:  0.731, Validation Accuracy:  0.713, Loss:  0.481
Epoch   0 Batch  590/1077 - Train Accuracy:  0.681, Validation Accuracy:  0.709, Loss:  0.483
Epoch   0 Batch  591/1077 - Train Accuracy:  0.715, Validation Accuracy:  0.715, Loss:  0.431
Epoch   0 Batch  592/1077 - Train Accuracy:  0.723, Validation Accuracy:  0.721, Loss:  0.482
Epoch   0 Batch  593/1077 - Train Accuracy:  0.733, Validation Accuracy:  0.726, Loss:  0.449
Epoch   0 Batch  594/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.720, Loss:  0.484
Epoch   0 Batch  595/1077 - Train Accuracy:  0.725, Validation Accuracy:  0.714, Loss:  0.463
Epoch   0 Batch  596/1077 - Train Accuracy:  0.721, Validation Accuracy:  0.716, Loss:  0.465
Epoch   0 Batch  597/1077 - Train Accuracy:  0.718, Validation Accuracy:  0.720, Loss:  0.457
Epoch   0 Batch  598/1077 - Train Accuracy:  0.747, Validation Accuracy:  0.735, Loss:  0.450
Epoch   0 Batch  599/1077 - Train Accuracy:  0.720, Validation Accuracy:  0.727, Loss:  0.512
Epoch   0 Batch  600/1077 - Train Accuracy:  0.743, Validation Accuracy:  0.732, Loss:  0.423
Epoch   0 Batch  601/1077 - Train Accuracy:  0.727, Validation Accuracy:  0.730, Loss:  0.443
Epoch   0 Batch  602/1077 - Train Accuracy:  0.750, Validation Accuracy:  0.715, Loss:  0.436
Epoch   0 Batch  603/1077 - Train Accuracy:  0.739, Validation Accuracy:  0.727, Loss:  0.457
Epoch   0 Batch  604/1077 - Train Accuracy:  0.732, Validation Accuracy:  0.737, Loss:  0.474
Epoch   0 Batch  605/1077 - Train Accuracy:  0.749, Validation Accuracy:  0.732, Loss:  0.499
Epoch   0 Batch  606/1077 - Train Accuracy:  0.755, Validation Accuracy:  0.727, Loss:  0.409
Epoch   0 Batch  607/1077 - Train Accuracy:  0.767, Validation Accuracy:  0.726, Loss:  0.433
Epoch   0 Batch  608/1077 - Train Accuracy:  0.744, Validation Accuracy:  0.730, Loss:  0.470
Epoch   0 Batch  609/1077 - Train Accuracy:  0.743, Validation Accuracy:  0.728, Loss:  0.456
Epoch   0 Batch  610/1077 - Train Accuracy:  0.749, Validation Accuracy:  0.731, Loss:  0.461
Epoch   0 Batch  611/1077 - Train Accuracy:  0.738, Validation Accuracy:  0.722, Loss:  0.431
Epoch   0 Batch  612/1077 - Train Accuracy:  0.744, Validation Accuracy:  0.732, Loss:  0.426
Epoch   0 Batch  613/1077 - Train Accuracy:  0.749, Validation Accuracy:  0.737, Loss:  0.461
Epoch   0 Batch  614/1077 - Train Accuracy:  0.756, Validation Accuracy:  0.723, Loss:  0.430
Epoch   0 Batch  615/1077 - Train Accuracy:  0.759, Validation Accuracy:  0.724, Loss:  0.443
Epoch   0 Batch  616/1077 - Train Accuracy:  0.731, Validation Accuracy:  0.738, Loss:  0.458
Epoch   0 Batch  617/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.739, Loss:  0.427
Epoch   0 Batch  618/1077 - Train Accuracy:  0.737, Validation Accuracy:  0.738, Loss:  0.449
Epoch   0 Batch  619/1077 - Train Accuracy:  0.731, Validation Accuracy:  0.732, Loss:  0.444
Epoch   0 Batch  620/1077 - Train Accuracy:  0.734, Validation Accuracy:  0.744, Loss:  0.436
Epoch   0 Batch  621/1077 - Train Accuracy:  0.755, Validation Accuracy:  0.732, Loss:  0.425
Epoch   0 Batch  622/1077 - Train Accuracy:  0.757, Validation Accuracy:  0.743, Loss:  0.465
Epoch   0 Batch  623/1077 - Train Accuracy:  0.732, Validation Accuracy:  0.748, Loss:  0.448
Epoch   0 Batch  624/1077 - Train Accuracy:  0.764, Validation Accuracy:  0.743, Loss:  0.425
Epoch   0 Batch  625/1077 - Train Accuracy:  0.755, Validation Accuracy:  0.741, Loss:  0.449
Epoch   0 Batch  626/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.753, Loss:  0.400
Epoch   0 Batch  627/1077 - Train Accuracy:  0.752, Validation Accuracy:  0.748, Loss:  0.436
Epoch   0 Batch  628/1077 - Train Accuracy:  0.725, Validation Accuracy:  0.738, Loss:  0.464
Epoch   0 Batch  629/1077 - Train Accuracy:  0.732, Validation Accuracy:  0.730, Loss:  0.468
Epoch   0 Batch  630/1077 - Train Accuracy:  0.735, Validation Accuracy:  0.740, Loss:  0.441
Epoch   0 Batch  631/1077 - Train Accuracy:  0.730, Validation Accuracy:  0.741, Loss:  0.419
Epoch   0 Batch  632/1077 - Train Accuracy:  0.742, Validation Accuracy:  0.735, Loss:  0.424
Epoch   0 Batch  633/1077 - Train Accuracy:  0.785, Validation Accuracy:  0.743, Loss:  0.437
Epoch   0 Batch  634/1077 - Train Accuracy:  0.761, Validation Accuracy:  0.744, Loss:  0.393
Epoch   0 Batch  635/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.745, Loss:  0.461
Epoch   0 Batch  636/1077 - Train Accuracy:  0.780, Validation Accuracy:  0.742, Loss:  0.421
Epoch   0 Batch  637/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.744, Loss:  0.430
Epoch   0 Batch  638/1077 - Train Accuracy:  0.731, Validation Accuracy:  0.746, Loss:  0.402
Epoch   0 Batch  639/1077 - Train Accuracy:  0.755, Validation Accuracy:  0.741, Loss:  0.436
Epoch   0 Batch  640/1077 - Train Accuracy:  0.734, Validation Accuracy:  0.742, Loss:  0.413
Epoch   0 Batch  641/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.753, Loss:  0.408
Epoch   0 Batch  642/1077 - Train Accuracy:  0.743, Validation Accuracy:  0.737, Loss:  0.428
Epoch   0 Batch  643/1077 - Train Accuracy:  0.768, Validation Accuracy:  0.738, Loss:  0.391
Epoch   0 Batch  644/1077 - Train Accuracy:  0.775, Validation Accuracy:  0.744, Loss:  0.423
Epoch   0 Batch  645/1077 - Train Accuracy:  0.775, Validation Accuracy:  0.741, Loss:  0.406
Epoch   0 Batch  646/1077 - Train Accuracy:  0.768, Validation Accuracy:  0.749, Loss:  0.399
Epoch   0 Batch  647/1077 - Train Accuracy:  0.770, Validation Accuracy:  0.745, Loss:  0.423
Epoch   0 Batch  648/1077 - Train Accuracy:  0.783, Validation Accuracy:  0.745, Loss:  0.396
Epoch   0 Batch  649/1077 - Train Accuracy:  0.742, Validation Accuracy:  0.750, Loss:  0.441
Epoch   0 Batch  650/1077 - Train Accuracy:  0.742, Validation Accuracy:  0.741, Loss:  0.427
Epoch   0 Batch  651/1077 - Train Accuracy:  0.792, Validation Accuracy:  0.743, Loss:  0.387
Epoch   0 Batch  652/1077 - Train Accuracy:  0.755, Validation Accuracy:  0.739, Loss:  0.435
Epoch   0 Batch  653/1077 - Train Accuracy:  0.786, Validation Accuracy:  0.739, Loss:  0.404
Epoch   0 Batch  654/1077 - Train Accuracy:  0.770, Validation Accuracy:  0.747, Loss:  0.407
Epoch   0 Batch  655/1077 - Train Accuracy:  0.765, Validation Accuracy:  0.743, Loss:  0.431
Epoch   0 Batch  656/1077 - Train Accuracy:  0.760, Validation Accuracy:  0.743, Loss:  0.412
Epoch   0 Batch  657/1077 - Train Accuracy:  0.783, Validation Accuracy:  0.743, Loss:  0.410
Epoch   0 Batch  658/1077 - Train Accuracy:  0.782, Validation Accuracy:  0.746, Loss:  0.376
Epoch   0 Batch  659/1077 - Train Accuracy:  0.796, Validation Accuracy:  0.745, Loss:  0.398
Epoch   0 Batch  660/1077 - Train Accuracy:  0.762, Validation Accuracy:  0.742, Loss:  0.412
Epoch   0 Batch  661/1077 - Train Accuracy:  0.790, Validation Accuracy:  0.752, Loss:  0.381
Epoch   0 Batch  662/1077 - Train Accuracy:  0.770, Validation Accuracy:  0.746, Loss:  0.384
Epoch   0 Batch  663/1077 - Train Accuracy:  0.770, Validation Accuracy:  0.738, Loss:  0.391
Epoch   0 Batch  664/1077 - Train Accuracy:  0.754, Validation Accuracy:  0.761, Loss:  0.397
Epoch   0 Batch  665/1077 - Train Accuracy:  0.789, Validation Accuracy:  0.760, Loss:  0.381
Epoch   0 Batch  666/1077 - Train Accuracy:  0.765, Validation Accuracy:  0.767, Loss:  0.432
Epoch   0 Batch  667/1077 - Train Accuracy:  0.737, Validation Accuracy:  0.756, Loss:  0.429
Epoch   0 Batch  668/1077 - Train Accuracy:  0.758, Validation Accuracy:  0.758, Loss:  0.382
Epoch   0 Batch  669/1077 - Train Accuracy:  0.760, Validation Accuracy:  0.769, Loss:  0.394
Epoch   0 Batch  670/1077 - Train Accuracy:  0.806, Validation Accuracy:  0.757, Loss:  0.382
Epoch   0 Batch  671/1077 - Train Accuracy:  0.747, Validation Accuracy:  0.768, Loss:  0.420
Epoch   0 Batch  672/1077 - Train Accuracy:  0.763, Validation Accuracy:  0.765, Loss:  0.388
Epoch   0 Batch  673/1077 - Train Accuracy:  0.771, Validation Accuracy:  0.768, Loss:  0.365
Epoch   0 Batch  674/1077 - Train Accuracy:  0.815, Validation Accuracy:  0.764, Loss:  0.384
Epoch   0 Batch  675/1077 - Train Accuracy:  0.778, Validation Accuracy:  0.765, Loss:  0.392
Epoch   0 Batch  676/1077 - Train Accuracy:  0.763, Validation Accuracy:  0.755, Loss:  0.397
Epoch   0 Batch  677/1077 - Train Accuracy:  0.752, Validation Accuracy:  0.759, Loss:  0.426
Epoch   0 Batch  678/1077 - Train Accuracy:  0.761, Validation Accuracy:  0.762, Loss:  0.375
Epoch   0 Batch  679/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.766, Loss:  0.399
Epoch   0 Batch  680/1077 - Train Accuracy:  0.767, Validation Accuracy:  0.747, Loss:  0.380
Epoch   0 Batch  681/1077 - Train Accuracy:  0.783, Validation Accuracy:  0.747, Loss:  0.408
Epoch   0 Batch  682/1077 - Train Accuracy:  0.748, Validation Accuracy:  0.753, Loss:  0.388
Epoch   0 Batch  683/1077 - Train Accuracy:  0.745, Validation Accuracy:  0.756, Loss:  0.386
Epoch   0 Batch  684/1077 - Train Accuracy:  0.771, Validation Accuracy:  0.759, Loss:  0.394
Epoch   0 Batch  685/1077 - Train Accuracy:  0.764, Validation Accuracy:  0.761, Loss:  0.401
Epoch   0 Batch  686/1077 - Train Accuracy:  0.794, Validation Accuracy:  0.770, Loss:  0.364
Epoch   0 Batch  687/1077 - Train Accuracy:  0.797, Validation Accuracy:  0.765, Loss:  0.409
Epoch   0 Batch  688/1077 - Train Accuracy:  0.787, Validation Accuracy:  0.768, Loss:  0.387
Epoch   0 Batch  689/1077 - Train Accuracy:  0.820, Validation Accuracy:  0.775, Loss:  0.365
Epoch   0 Batch  690/1077 - Train Accuracy:  0.788, Validation Accuracy:  0.775, Loss:  0.386
Epoch   0 Batch  691/1077 - Train Accuracy:  0.781, Validation Accuracy:  0.770, Loss:  0.426
Epoch   0 Batch  692/1077 - Train Accuracy:  0.798, Validation Accuracy:  0.764, Loss:  0.362
Epoch   0 Batch  693/1077 - Train Accuracy:  0.741, Validation Accuracy:  0.766, Loss:  0.450
Epoch   0 Batch  694/1077 - Train Accuracy:  0.790, Validation Accuracy:  0.768, Loss:  0.368
Epoch   0 Batch  695/1077 - Train Accuracy:  0.774, Validation Accuracy:  0.773, Loss:  0.361
Epoch   0 Batch  696/1077 - Train Accuracy:  0.754, Validation Accuracy:  0.768, Loss:  0.412
Epoch   0 Batch  697/1077 - Train Accuracy:  0.793, Validation Accuracy:  0.776, Loss:  0.373
Epoch   0 Batch  698/1077 - Train Accuracy:  0.759, Validation Accuracy:  0.763, Loss:  0.359
Epoch   0 Batch  699/1077 - Train Accuracy:  0.756, Validation Accuracy:  0.771, Loss:  0.383
Epoch   0 Batch  700/1077 - Train Accuracy:  0.754, Validation Accuracy:  0.776, Loss:  0.362
Epoch   0 Batch  701/1077 - Train Accuracy:  0.765, Validation Accuracy:  0.788, Loss:  0.387
Epoch   0 Batch  702/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.782, Loss:  0.379
Epoch   0 Batch  703/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.783, Loss:  0.374
Epoch   0 Batch  704/1077 - Train Accuracy:  0.760, Validation Accuracy:  0.783, Loss:  0.393
Epoch   0 Batch  705/1077 - Train Accuracy:  0.799, Validation Accuracy:  0.784, Loss:  0.413
Epoch   0 Batch  706/1077 - Train Accuracy:  0.757, Validation Accuracy:  0.778, Loss:  0.374
Epoch   0 Batch  707/1077 - Train Accuracy:  0.783, Validation Accuracy:  0.775, Loss:  0.393
Epoch   0 Batch  708/1077 - Train Accuracy:  0.790, Validation Accuracy:  0.771, Loss:  0.388
Epoch   0 Batch  709/1077 - Train Accuracy:  0.774, Validation Accuracy:  0.765, Loss:  0.396
Epoch   0 Batch  710/1077 - Train Accuracy:  0.793, Validation Accuracy:  0.765, Loss:  0.380
Epoch   0 Batch  711/1077 - Train Accuracy:  0.778, Validation Accuracy:  0.764, Loss:  0.396
Epoch   0 Batch  712/1077 - Train Accuracy:  0.802, Validation Accuracy:  0.766, Loss:  0.340
Epoch   0 Batch  713/1077 - Train Accuracy:  0.801, Validation Accuracy:  0.764, Loss:  0.329
Epoch   0 Batch  714/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.763, Loss:  0.350
Epoch   0 Batch  715/1077 - Train Accuracy:  0.775, Validation Accuracy:  0.765, Loss:  0.398
Epoch   0 Batch  716/1077 - Train Accuracy:  0.815, Validation Accuracy:  0.765, Loss:  0.346
Epoch   0 Batch  717/1077 - Train Accuracy:  0.807, Validation Accuracy:  0.769, Loss:  0.367
Epoch   0 Batch  718/1077 - Train Accuracy:  0.780, Validation Accuracy:  0.777, Loss:  0.370
Epoch   0 Batch  719/1077 - Train Accuracy:  0.760, Validation Accuracy:  0.770, Loss:  0.360
Epoch   0 Batch  720/1077 - Train Accuracy:  0.748, Validation Accuracy:  0.766, Loss:  0.401
Epoch   0 Batch  721/1077 - Train Accuracy:  0.774, Validation Accuracy:  0.761, Loss:  0.390
Epoch   0 Batch  722/1077 - Train Accuracy:  0.779, Validation Accuracy:  0.767, Loss:  0.345
Epoch   0 Batch  723/1077 - Train Accuracy:  0.807, Validation Accuracy:  0.761, Loss:  0.345
Epoch   0 Batch  724/1077 - Train Accuracy:  0.817, Validation Accuracy:  0.773, Loss:  0.380
Epoch   0 Batch  725/1077 - Train Accuracy:  0.816, Validation Accuracy:  0.772, Loss:  0.314
Epoch   0 Batch  726/1077 - Train Accuracy:  0.779, Validation Accuracy:  0.782, Loss:  0.356
Epoch   0 Batch  727/1077 - Train Accuracy:  0.800, Validation Accuracy:  0.773, Loss:  0.344
Epoch   0 Batch  728/1077 - Train Accuracy:  0.781, Validation Accuracy:  0.768, Loss:  0.368
Epoch   0 Batch  729/1077 - Train Accuracy:  0.772, Validation Accuracy:  0.770, Loss:  0.394
Epoch   0 Batch  730/1077 - Train Accuracy:  0.804, Validation Accuracy:  0.746, Loss:  0.366
Epoch   0 Batch  731/1077 - Train Accuracy:  0.763, Validation Accuracy:  0.745, Loss:  0.353
Epoch   0 Batch  732/1077 - Train Accuracy:  0.764, Validation Accuracy:  0.753, Loss:  0.379
Epoch   0 Batch  733/1077 - Train Accuracy:  0.804, Validation Accuracy:  0.754, Loss:  0.358
Epoch   0 Batch  734/1077 - Train Accuracy:  0.812, Validation Accuracy:  0.758, Loss:  0.364
Epoch   0 Batch  735/1077 - Train Accuracy:  0.788, Validation Accuracy:  0.760, Loss:  0.349
Epoch   0 Batch  736/1077 - Train Accuracy:  0.819, Validation Accuracy:  0.775, Loss:  0.334
Epoch   0 Batch  737/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.779, Loss:  0.375
Epoch   0 Batch  738/1077 - Train Accuracy:  0.818, Validation Accuracy:  0.772, Loss:  0.305
Epoch   0 Batch  739/1077 - Train Accuracy:  0.816, Validation Accuracy:  0.778, Loss:  0.356
Epoch   0 Batch  740/1077 - Train Accuracy:  0.812, Validation Accuracy:  0.784, Loss:  0.336
Epoch   0 Batch  741/1077 - Train Accuracy:  0.805, Validation Accuracy:  0.779, Loss:  0.356
Epoch   0 Batch  742/1077 - Train Accuracy:  0.806, Validation Accuracy:  0.781, Loss:  0.341
Epoch   0 Batch  743/1077 - Train Accuracy:  0.792, Validation Accuracy:  0.783, Loss:  0.352
Epoch   0 Batch  744/1077 - Train Accuracy:  0.804, Validation Accuracy:  0.793, Loss:  0.335
Epoch   0 Batch  745/1077 - Train Accuracy:  0.811, Validation Accuracy:  0.785, Loss:  0.345
Epoch   0 Batch  746/1077 - Train Accuracy:  0.831, Validation Accuracy:  0.783, Loss:  0.329
Epoch   0 Batch  747/1077 - Train Accuracy:  0.817, Validation Accuracy:  0.781, Loss:  0.306
Epoch   0 Batch  748/1077 - Train Accuracy:  0.780, Validation Accuracy:  0.778, Loss:  0.346
Epoch   0 Batch  749/1077 - Train Accuracy:  0.780, Validation Accuracy:  0.787, Loss:  0.367
Epoch   0 Batch  750/1077 - Train Accuracy:  0.797, Validation Accuracy:  0.788, Loss:  0.329
Epoch   0 Batch  751/1077 - Train Accuracy:  0.823, Validation Accuracy:  0.797, Loss:  0.333
Epoch   0 Batch  752/1077 - Train Accuracy:  0.783, Validation Accuracy:  0.796, Loss:  0.322
Epoch   0 Batch  753/1077 - Train Accuracy:  0.818, Validation Accuracy:  0.783, Loss:  0.338
Epoch   0 Batch  754/1077 - Train Accuracy:  0.809, Validation Accuracy:  0.782, Loss:  0.356
Epoch   0 Batch  755/1077 - Train Accuracy:  0.837, Validation Accuracy:  0.788, Loss:  0.333
Epoch   0 Batch  756/1077 - Train Accuracy:  0.796, Validation Accuracy:  0.788, Loss:  0.332
Epoch   0 Batch  757/1077 - Train Accuracy:  0.805, Validation Accuracy:  0.779, Loss:  0.337
Epoch   0 Batch  758/1077 - Train Accuracy:  0.830, Validation Accuracy:  0.785, Loss:  0.324
Epoch   0 Batch  759/1077 - Train Accuracy:  0.828, Validation Accuracy:  0.788, Loss:  0.304
Epoch   0 Batch  760/1077 - Train Accuracy:  0.777, Validation Accuracy:  0.786, Loss:  0.350
Epoch   0 Batch  761/1077 - Train Accuracy:  0.787, Validation Accuracy:  0.803, Loss:  0.333
Epoch   0 Batch  762/1077 - Train Accuracy:  0.828, Validation Accuracy:  0.793, Loss:  0.319
Epoch   0 Batch  763/1077 - Train Accuracy:  0.814, Validation Accuracy:  0.786, Loss:  0.315
Epoch   0 Batch  764/1077 - Train Accuracy:  0.803, Validation Accuracy:  0.787, Loss:  0.337
Epoch   0 Batch  765/1077 - Train Accuracy:  0.800, Validation Accuracy:  0.790, Loss:  0.310
Epoch   0 Batch  766/1077 - Train Accuracy:  0.809, Validation Accuracy:  0.793, Loss:  0.338
Epoch   0 Batch  767/1077 - Train Accuracy:  0.827, Validation Accuracy:  0.809, Loss:  0.325
Epoch   0 Batch  768/1077 - Train Accuracy:  0.795, Validation Accuracy:  0.801, Loss:  0.325
Epoch   0 Batch  769/1077 - Train Accuracy:  0.820, Validation Accuracy:  0.786, Loss:  0.330
Epoch   0 Batch  770/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.784, Loss:  0.322
Epoch   0 Batch  771/1077 - Train Accuracy:  0.821, Validation Accuracy:  0.771, Loss:  0.335
Epoch   0 Batch  772/1077 - Train Accuracy:  0.827, Validation Accuracy:  0.782, Loss:  0.298
Epoch   0 Batch  773/1077 - Train Accuracy:  0.820, Validation Accuracy:  0.784, Loss:  0.314
Epoch   0 Batch  774/1077 - Train Accuracy:  0.794, Validation Accuracy:  0.791, Loss:  0.335
Epoch   0 Batch  775/1077 - Train Accuracy:  0.825, Validation Accuracy:  0.795, Loss:  0.316
Epoch   0 Batch  776/1077 - Train Accuracy:  0.799, Validation Accuracy:  0.783, Loss:  0.308
Epoch   0 Batch  777/1077 - Train Accuracy:  0.807, Validation Accuracy:  0.789, Loss:  0.344
Epoch   0 Batch  778/1077 - Train Accuracy:  0.814, Validation Accuracy:  0.797, Loss:  0.302
Epoch   0 Batch  779/1077 - Train Accuracy:  0.783, Validation Accuracy:  0.796, Loss:  0.334
Epoch   0 Batch  780/1077 - Train Accuracy:  0.782, Validation Accuracy:  0.800, Loss:  0.342
Epoch   0 Batch  781/1077 - Train Accuracy:  0.848, Validation Accuracy:  0.806, Loss:  0.282
Epoch   0 Batch  782/1077 - Train Accuracy:  0.812, Validation Accuracy:  0.788, Loss:  0.314
Epoch   0 Batch  783/1077 - Train Accuracy:  0.799, Validation Accuracy:  0.780, Loss:  0.330
Epoch   0 Batch  784/1077 - Train Accuracy:  0.832, Validation Accuracy:  0.790, Loss:  0.303
Epoch   0 Batch  785/1077 - Train Accuracy:  0.840, Validation Accuracy:  0.790, Loss:  0.286
Epoch   0 Batch  786/1077 - Train Accuracy:  0.766, Validation Accuracy:  0.790, Loss:  0.322
Epoch   0 Batch  787/1077 - Train Accuracy:  0.851, Validation Accuracy:  0.795, Loss:  0.297
Epoch   0 Batch  788/1077 - Train Accuracy:  0.834, Validation Accuracy:  0.809, Loss:  0.291
Epoch   0 Batch  789/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.805, Loss:  0.309
Epoch   0 Batch  790/1077 - Train Accuracy:  0.768, Validation Accuracy:  0.794, Loss:  0.314
Epoch   0 Batch  791/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.791, Loss:  0.320
Epoch   0 Batch  792/1077 - Train Accuracy:  0.796, Validation Accuracy:  0.796, Loss:  0.321
Epoch   0 Batch  793/1077 - Train Accuracy:  0.831, Validation Accuracy:  0.798, Loss:  0.297
Epoch   0 Batch  794/1077 - Train Accuracy:  0.805, Validation Accuracy:  0.810, Loss:  0.285
Epoch   0 Batch  795/1077 - Train Accuracy:  0.813, Validation Accuracy:  0.803, Loss:  0.320
Epoch   0 Batch  796/1077 - Train Accuracy:  0.819, Validation Accuracy:  0.786, Loss:  0.304
Epoch   0 Batch  797/1077 - Train Accuracy:  0.845, Validation Accuracy:  0.801, Loss:  0.298
Epoch   0 Batch  798/1077 - Train Accuracy:  0.820, Validation Accuracy:  0.797, Loss:  0.313
Epoch   0 Batch  799/1077 - Train Accuracy:  0.779, Validation Accuracy:  0.785, Loss:  0.336
Epoch   0 Batch  800/1077 - Train Accuracy:  0.794, Validation Accuracy:  0.794, Loss:  0.328
Epoch   0 Batch  801/1077 - Train Accuracy:  0.811, Validation Accuracy:  0.800, Loss:  0.302
Epoch   0 Batch  802/1077 - Train Accuracy:  0.840, Validation Accuracy:  0.783, Loss:  0.290
Epoch   0 Batch  803/1077 - Train Accuracy:  0.806, Validation Accuracy:  0.775, Loss:  0.308
Epoch   0 Batch  804/1077 - Train Accuracy:  0.844, Validation Accuracy:  0.786, Loss:  0.282
Epoch   0 Batch  805/1077 - Train Accuracy:  0.798, Validation Accuracy:  0.796, Loss:  0.305
Epoch   0 Batch  806/1077 - Train Accuracy:  0.842, Validation Accuracy:  0.814, Loss:  0.300
Epoch   0 Batch  807/1077 - Train Accuracy:  0.825, Validation Accuracy:  0.807, Loss:  0.285
Epoch   0 Batch  808/1077 - Train Accuracy:  0.840, Validation Accuracy:  0.800, Loss:  0.324
Epoch   0 Batch  809/1077 - Train Accuracy:  0.802, Validation Accuracy:  0.797, Loss:  0.327
Epoch   0 Batch  810/1077 - Train Accuracy:  0.827, Validation Accuracy:  0.798, Loss:  0.274
Epoch   0 Batch  811/1077 - Train Accuracy:  0.823, Validation Accuracy:  0.797, Loss:  0.267
Epoch   0 Batch  812/1077 - Train Accuracy:  0.801, Validation Accuracy:  0.805, Loss:  0.304
Epoch   0 Batch  813/1077 - Train Accuracy:  0.829, Validation Accuracy:  0.800, Loss:  0.279
Epoch   0 Batch  814/1077 - Train Accuracy:  0.823, Validation Accuracy:  0.805, Loss:  0.287
Epoch   0 Batch  815/1077 - Train Accuracy:  0.812, Validation Accuracy:  0.791, Loss:  0.279
Epoch   0 Batch  816/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.812, Loss:  0.323
Epoch   0 Batch  817/1077 - Train Accuracy:  0.833, Validation Accuracy:  0.821, Loss:  0.314
Epoch   0 Batch  818/1077 - Train Accuracy:  0.797, Validation Accuracy:  0.813, Loss:  0.300
Epoch   0 Batch  819/1077 - Train Accuracy:  0.823, Validation Accuracy:  0.808, Loss:  0.289
Epoch   0 Batch  820/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.790, Loss:  0.298
Epoch   0 Batch  821/1077 - Train Accuracy:  0.844, Validation Accuracy:  0.786, Loss:  0.297
Epoch   0 Batch  822/1077 - Train Accuracy:  0.826, Validation Accuracy:  0.788, Loss:  0.294
Epoch   0 Batch  823/1077 - Train Accuracy:  0.845, Validation Accuracy:  0.802, Loss:  0.281
Epoch   0 Batch  824/1077 - Train Accuracy:  0.815, Validation Accuracy:  0.797, Loss:  0.272
Epoch   0 Batch  825/1077 - Train Accuracy:  0.824, Validation Accuracy:  0.800, Loss:  0.280
Epoch   0 Batch  826/1077 - Train Accuracy:  0.820, Validation Accuracy:  0.815, Loss:  0.268
Epoch   0 Batch  827/1077 - Train Accuracy:  0.830, Validation Accuracy:  0.803, Loss:  0.299
Epoch   0 Batch  828/1077 - Train Accuracy:  0.832, Validation Accuracy:  0.806, Loss:  0.273
Epoch   0 Batch  829/1077 - Train Accuracy:  0.809, Validation Accuracy:  0.809, Loss:  0.292
Epoch   0 Batch  830/1077 - Train Accuracy:  0.816, Validation Accuracy:  0.810, Loss:  0.270
Epoch   0 Batch  831/1077 - Train Accuracy:  0.789, Validation Accuracy:  0.813, Loss:  0.286
Epoch   0 Batch  832/1077 - Train Accuracy:  0.836, Validation Accuracy:  0.796, Loss:  0.265
Epoch   0 Batch  833/1077 - Train Accuracy:  0.824, Validation Accuracy:  0.805, Loss:  0.287
Epoch   0 Batch  834/1077 - Train Accuracy:  0.851, Validation Accuracy:  0.819, Loss:  0.268
Epoch   0 Batch  835/1077 - Train Accuracy:  0.836, Validation Accuracy:  0.824, Loss:  0.287
Epoch   0 Batch  836/1077 - Train Accuracy:  0.831, Validation Accuracy:  0.812, Loss:  0.287
Epoch   0 Batch  837/1077 - Train Accuracy:  0.834, Validation Accuracy:  0.810, Loss:  0.300
Epoch   0 Batch  838/1077 - Train Accuracy:  0.856, Validation Accuracy:  0.803, Loss:  0.254
Epoch   0 Batch  839/1077 - Train Accuracy:  0.861, Validation Accuracy:  0.804, Loss:  0.238
Epoch   0 Batch  840/1077 - Train Accuracy:  0.857, Validation Accuracy:  0.808, Loss:  0.248
Epoch   0 Batch  841/1077 - Train Accuracy:  0.850, Validation Accuracy:  0.797, Loss:  0.270
Epoch   0 Batch  842/1077 - Train Accuracy:  0.857, Validation Accuracy:  0.808, Loss:  0.255
Epoch   0 Batch  843/1077 - Train Accuracy:  0.831, Validation Accuracy:  0.813, Loss:  0.249
Epoch   0 Batch  844/1077 - Train Accuracy:  0.848, Validation Accuracy:  0.816, Loss:  0.239
Epoch   0 Batch  845/1077 - Train Accuracy:  0.842, Validation Accuracy:  0.806, Loss:  0.256
Epoch   0 Batch  846/1077 - Train Accuracy:  0.812, Validation Accuracy:  0.805, Loss:  0.276
Epoch   0 Batch  847/1077 - Train Accuracy:  0.852, Validation Accuracy:  0.814, Loss:  0.276
Epoch   0 Batch  848/1077 - Train Accuracy:  0.855, Validation Accuracy:  0.816, Loss:  0.269
Epoch   0 Batch  849/1077 - Train Accuracy:  0.838, Validation Accuracy:  0.802, Loss:  0.256
Epoch   0 Batch  850/1077 - Train Accuracy:  0.813, Validation Accuracy:  0.813, Loss:  0.297
Epoch   0 Batch  851/1077 - Train Accuracy:  0.838, Validation Accuracy:  0.817, Loss:  0.259
Epoch   0 Batch  852/1077 - Train Accuracy:  0.805, Validation Accuracy:  0.823, Loss:  0.302
Epoch   0 Batch  853/1077 - Train Accuracy:  0.849, Validation Accuracy:  0.820, Loss:  0.249
Epoch   0 Batch  854/1077 - Train Accuracy:  0.823, Validation Accuracy:  0.824, Loss:  0.276
Epoch   0 Batch  855/1077 - Train Accuracy:  0.827, Validation Accuracy:  0.817, Loss:  0.275
Epoch   0 Batch  856/1077 - Train Accuracy:  0.823, Validation Accuracy:  0.813, Loss:  0.284
Epoch   0 Batch  857/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.820, Loss:  0.266
Epoch   0 Batch  858/1077 - Train Accuracy:  0.859, Validation Accuracy:  0.820, Loss:  0.247
Epoch   0 Batch  859/1077 - Train Accuracy:  0.848, Validation Accuracy:  0.821, Loss:  0.290
Epoch   0 Batch  860/1077 - Train Accuracy:  0.825, Validation Accuracy:  0.827, Loss:  0.270
Epoch   0 Batch  861/1077 - Train Accuracy:  0.841, Validation Accuracy:  0.833, Loss:  0.259
Epoch   0 Batch  862/1077 - Train Accuracy:  0.844, Validation Accuracy:  0.817, Loss:  0.246
Epoch   0 Batch  863/1077 - Train Accuracy:  0.875, Validation Accuracy:  0.824, Loss:  0.253
Epoch   0 Batch  864/1077 - Train Accuracy:  0.840, Validation Accuracy:  0.824, Loss:  0.265
Epoch   0 Batch  865/1077 - Train Accuracy:  0.885, Validation Accuracy:  0.816, Loss:  0.253
Epoch   0 Batch  866/1077 - Train Accuracy:  0.843, Validation Accuracy:  0.814, Loss:  0.256
Epoch   0 Batch  867/1077 - Train Accuracy:  0.810, Validation Accuracy:  0.809, Loss:  0.296
Epoch   0 Batch  868/1077 - Train Accuracy:  0.830, Validation Accuracy:  0.805, Loss:  0.269
Epoch   0 Batch  869/1077 - Train Accuracy:  0.831, Validation Accuracy:  0.794, Loss:  0.265
Epoch   0 Batch  870/1077 - Train Accuracy:  0.791, Validation Accuracy:  0.817, Loss:  0.254
Epoch   0 Batch  871/1077 - Train Accuracy:  0.838, Validation Accuracy:  0.813, Loss:  0.246
Epoch   0 Batch  872/1077 - Train Accuracy:  0.873, Validation Accuracy:  0.820, Loss:  0.245
Epoch   0 Batch  873/1077 - Train Accuracy:  0.836, Validation Accuracy:  0.828, Loss:  0.261
Epoch   0 Batch  874/1077 - Train Accuracy:  0.816, Validation Accuracy:  0.835, Loss:  0.269
Epoch   0 Batch  875/1077 - Train Accuracy:  0.848, Validation Accuracy:  0.827, Loss:  0.269
Epoch   0 Batch  876/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.825, Loss:  0.252
Epoch   0 Batch  877/1077 - Train Accuracy:  0.855, Validation Accuracy:  0.817, Loss:  0.238
Epoch   0 Batch  878/1077 - Train Accuracy:  0.874, Validation Accuracy:  0.821, Loss:  0.234
Epoch   0 Batch  879/1077 - Train Accuracy:  0.868, Validation Accuracy:  0.832, Loss:  0.223
Epoch   0 Batch  880/1077 - Train Accuracy:  0.874, Validation Accuracy:  0.832, Loss:  0.247
Epoch   0 Batch  881/1077 - Train Accuracy:  0.832, Validation Accuracy:  0.837, Loss:  0.274
Epoch   0 Batch  882/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.836, Loss:  0.250
Epoch   0 Batch  883/1077 - Train Accuracy:  0.835, Validation Accuracy:  0.837, Loss:  0.291
Epoch   0 Batch  884/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.843, Loss:  0.234
Epoch   0 Batch  885/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.833, Loss:  0.207
Epoch   0 Batch  886/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.825, Loss:  0.243
Epoch   0 Batch  887/1077 - Train Accuracy:  0.852, Validation Accuracy:  0.820, Loss:  0.264
Epoch   0 Batch  888/1077 - Train Accuracy:  0.862, Validation Accuracy:  0.814, Loss:  0.229
Epoch   0 Batch  889/1077 - Train Accuracy:  0.861, Validation Accuracy:  0.820, Loss:  0.228
Epoch   0 Batch  890/1077 - Train Accuracy:  0.883, Validation Accuracy:  0.827, Loss:  0.241
Epoch   0 Batch  891/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.821, Loss:  0.234
Epoch   0 Batch  892/1077 - Train Accuracy:  0.868, Validation Accuracy:  0.826, Loss:  0.236
Epoch   0 Batch  893/1077 - Train Accuracy:  0.837, Validation Accuracy:  0.836, Loss:  0.241
Epoch   0 Batch  894/1077 - Train Accuracy:  0.849, Validation Accuracy:  0.832, Loss:  0.229
Epoch   0 Batch  895/1077 - Train Accuracy:  0.852, Validation Accuracy:  0.838, Loss:  0.233
Epoch   0 Batch  896/1077 - Train Accuracy:  0.833, Validation Accuracy:  0.841, Loss:  0.257
Epoch   0 Batch  897/1077 - Train Accuracy:  0.854, Validation Accuracy:  0.840, Loss:  0.213
Epoch   0 Batch  898/1077 - Train Accuracy:  0.836, Validation Accuracy:  0.849, Loss:  0.218
Epoch   0 Batch  899/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.844, Loss:  0.252
Epoch   0 Batch  900/1077 - Train Accuracy:  0.874, Validation Accuracy:  0.829, Loss:  0.244
Epoch   0 Batch  901/1077 - Train Accuracy:  0.837, Validation Accuracy:  0.825, Loss:  0.252
Epoch   0 Batch  902/1077 - Train Accuracy:  0.852, Validation Accuracy:  0.836, Loss:  0.240
Epoch   0 Batch  903/1077 - Train Accuracy:  0.846, Validation Accuracy:  0.838, Loss:  0.253
Epoch   0 Batch  904/1077 - Train Accuracy:  0.807, Validation Accuracy:  0.830, Loss:  0.235
Epoch   0 Batch  905/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.829, Loss:  0.196
Epoch   0 Batch  906/1077 - Train Accuracy:  0.849, Validation Accuracy:  0.838, Loss:  0.226
Epoch   0 Batch  907/1077 - Train Accuracy:  0.861, Validation Accuracy:  0.839, Loss:  0.228
Epoch   0 Batch  908/1077 - Train Accuracy:  0.839, Validation Accuracy:  0.848, Loss:  0.241
Epoch   0 Batch  909/1077 - Train Accuracy:  0.854, Validation Accuracy:  0.839, Loss:  0.242
Epoch   0 Batch  910/1077 - Train Accuracy:  0.843, Validation Accuracy:  0.836, Loss:  0.222
Epoch   0 Batch  911/1077 - Train Accuracy:  0.867, Validation Accuracy:  0.835, Loss:  0.219
Epoch   0 Batch  912/1077 - Train Accuracy:  0.863, Validation Accuracy:  0.832, Loss:  0.219
Epoch   0 Batch  913/1077 - Train Accuracy:  0.859, Validation Accuracy:  0.823, Loss:  0.261
Epoch   0 Batch  914/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.835, Loss:  0.224
Epoch   0 Batch  915/1077 - Train Accuracy:  0.833, Validation Accuracy:  0.847, Loss:  0.234
Epoch   0 Batch  916/1077 - Train Accuracy:  0.866, Validation Accuracy:  0.858, Loss:  0.246
Epoch   0 Batch  917/1077 - Train Accuracy:  0.865, Validation Accuracy:  0.835, Loss:  0.210
Epoch   0 Batch  918/1077 - Train Accuracy:  0.853, Validation Accuracy:  0.814, Loss:  0.202
Epoch   0 Batch  919/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.826, Loss:  0.205
Epoch   0 Batch  920/1077 - Train Accuracy:  0.862, Validation Accuracy:  0.831, Loss:  0.229
Epoch   0 Batch  921/1077 - Train Accuracy:  0.835, Validation Accuracy:  0.841, Loss:  0.227
Epoch   0 Batch  922/1077 - Train Accuracy:  0.837, Validation Accuracy:  0.840, Loss:  0.228
Epoch   0 Batch  923/1077 - Train Accuracy:  0.841, Validation Accuracy:  0.839, Loss:  0.203
Epoch   0 Batch  924/1077 - Train Accuracy:  0.873, Validation Accuracy:  0.838, Loss:  0.249
Epoch   0 Batch  925/1077 - Train Accuracy:  0.871, Validation Accuracy:  0.833, Loss:  0.205
Epoch   0 Batch  926/1077 - Train Accuracy:  0.862, Validation Accuracy:  0.838, Loss:  0.235
Epoch   0 Batch  927/1077 - Train Accuracy:  0.843, Validation Accuracy:  0.839, Loss:  0.223
Epoch   0 Batch  928/1077 - Train Accuracy:  0.846, Validation Accuracy:  0.838, Loss:  0.222
Epoch   0 Batch  929/1077 - Train Accuracy:  0.863, Validation Accuracy:  0.820, Loss:  0.215
Epoch   0 Batch  930/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.818, Loss:  0.210
Epoch   0 Batch  931/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.819, Loss:  0.208
Epoch   0 Batch  932/1077 - Train Accuracy:  0.842, Validation Accuracy:  0.831, Loss:  0.222
Epoch   0 Batch  933/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.828, Loss:  0.208
Epoch   0 Batch  934/1077 - Train Accuracy:  0.854, Validation Accuracy:  0.817, Loss:  0.203
Epoch   0 Batch  935/1077 - Train Accuracy:  0.879, Validation Accuracy:  0.834, Loss:  0.226
Epoch   0 Batch  936/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.838, Loss:  0.221
Epoch   0 Batch  937/1077 - Train Accuracy:  0.879, Validation Accuracy:  0.842, Loss:  0.233
Epoch   0 Batch  938/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.836, Loss:  0.221
Epoch   0 Batch  939/1077 - Train Accuracy:  0.854, Validation Accuracy:  0.832, Loss:  0.229
Epoch   0 Batch  940/1077 - Train Accuracy:  0.859, Validation Accuracy:  0.823, Loss:  0.204
Epoch   0 Batch  941/1077 - Train Accuracy:  0.857, Validation Accuracy:  0.824, Loss:  0.198
Epoch   0 Batch  942/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.831, Loss:  0.200
Epoch   0 Batch  943/1077 - Train Accuracy:  0.873, Validation Accuracy:  0.826, Loss:  0.223
Epoch   0 Batch  944/1077 - Train Accuracy:  0.855, Validation Accuracy:  0.841, Loss:  0.205
Epoch   0 Batch  945/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.841, Loss:  0.201
Epoch   0 Batch  946/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.841, Loss:  0.203
Epoch   0 Batch  947/1077 - Train Accuracy:  0.807, Validation Accuracy:  0.844, Loss:  0.240
Epoch   0 Batch  948/1077 - Train Accuracy:  0.855, Validation Accuracy:  0.849, Loss:  0.196
Epoch   0 Batch  949/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.841, Loss:  0.187
Epoch   0 Batch  950/1077 - Train Accuracy:  0.865, Validation Accuracy:  0.843, Loss:  0.195
Epoch   0 Batch  951/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.833, Loss:  0.214
Epoch   0 Batch  952/1077 - Train Accuracy:  0.871, Validation Accuracy:  0.835, Loss:  0.191
Epoch   0 Batch  953/1077 - Train Accuracy:  0.883, Validation Accuracy:  0.844, Loss:  0.202
Epoch   0 Batch  954/1077 - Train Accuracy:  0.855, Validation Accuracy:  0.832, Loss:  0.212
Epoch   0 Batch  955/1077 - Train Accuracy:  0.859, Validation Accuracy:  0.843, Loss:  0.215
Epoch   0 Batch  956/1077 - Train Accuracy:  0.858, Validation Accuracy:  0.850, Loss:  0.214
Epoch   0 Batch  957/1077 - Train Accuracy:  0.897, Validation Accuracy:  0.849, Loss:  0.175
Epoch   0 Batch  958/1077 - Train Accuracy:  0.847, Validation Accuracy:  0.852, Loss:  0.213
Epoch   0 Batch  959/1077 - Train Accuracy:  0.872, Validation Accuracy:  0.840, Loss:  0.200
Epoch   0 Batch  960/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.834, Loss:  0.198
Epoch   0 Batch  961/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.821, Loss:  0.197
Epoch   0 Batch  962/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.826, Loss:  0.193
Epoch   0 Batch  963/1077 - Train Accuracy:  0.876, Validation Accuracy:  0.832, Loss:  0.237
Epoch   0 Batch  964/1077 - Train Accuracy:  0.871, Validation Accuracy:  0.831, Loss:  0.196
Epoch   0 Batch  965/1077 - Train Accuracy:  0.833, Validation Accuracy:  0.830, Loss:  0.212
Epoch   0 Batch  966/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.829, Loss:  0.179
Epoch   0 Batch  967/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.831, Loss:  0.216
Epoch   0 Batch  968/1077 - Train Accuracy:  0.838, Validation Accuracy:  0.840, Loss:  0.229
Epoch   0 Batch  969/1077 - Train Accuracy:  0.859, Validation Accuracy:  0.841, Loss:  0.219
Epoch   0 Batch  970/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.832, Loss:  0.209
Epoch   0 Batch  971/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.834, Loss:  0.199
Epoch   0 Batch  972/1077 - Train Accuracy:  0.859, Validation Accuracy:  0.838, Loss:  0.189
Epoch   0 Batch  973/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.860, Loss:  0.175
Epoch   0 Batch  974/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.841, Loss:  0.167
Epoch   0 Batch  975/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.829, Loss:  0.173
Epoch   0 Batch  976/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.831, Loss:  0.184
Epoch   0 Batch  977/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.829, Loss:  0.167
Epoch   0 Batch  978/1077 - Train Accuracy:  0.879, Validation Accuracy:  0.828, Loss:  0.205
Epoch   0 Batch  979/1077 - Train Accuracy:  0.840, Validation Accuracy:  0.827, Loss:  0.199
Epoch   0 Batch  980/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.830, Loss:  0.197
Epoch   0 Batch  981/1077 - Train Accuracy:  0.857, Validation Accuracy:  0.843, Loss:  0.190
Epoch   0 Batch  982/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.845, Loss:  0.194
Epoch   0 Batch  983/1077 - Train Accuracy:  0.861, Validation Accuracy:  0.850, Loss:  0.193
Epoch   0 Batch  984/1077 - Train Accuracy:  0.841, Validation Accuracy:  0.839, Loss:  0.218
Epoch   0 Batch  985/1077 - Train Accuracy:  0.883, Validation Accuracy:  0.849, Loss:  0.192
Epoch   0 Batch  986/1077 - Train Accuracy:  0.844, Validation Accuracy:  0.860, Loss:  0.189
Epoch   0 Batch  987/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.855, Loss:  0.179
Epoch   0 Batch  988/1077 - Train Accuracy:  0.852, Validation Accuracy:  0.850, Loss:  0.193
Epoch   0 Batch  989/1077 - Train Accuracy:  0.869, Validation Accuracy:  0.858, Loss:  0.195
Epoch   0 Batch  990/1077 - Train Accuracy:  0.871, Validation Accuracy:  0.849, Loss:  0.200
Epoch   0 Batch  991/1077 - Train Accuracy:  0.875, Validation Accuracy:  0.857, Loss:  0.206
Epoch   0 Batch  992/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.853, Loss:  0.176
Epoch   0 Batch  993/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.854, Loss:  0.168
Epoch   0 Batch  994/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.849, Loss:  0.182
Epoch   0 Batch  995/1077 - Train Accuracy:  0.872, Validation Accuracy:  0.850, Loss:  0.195
Epoch   0 Batch  996/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.860, Loss:  0.179
Epoch   0 Batch  997/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.860, Loss:  0.182
Epoch   0 Batch  998/1077 - Train Accuracy:  0.868, Validation Accuracy:  0.854, Loss:  0.177
Epoch   0 Batch  999/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.857, Loss:  0.190
Epoch   0 Batch 1000/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.852, Loss:  0.175
Epoch   0 Batch 1001/1077 - Train Accuracy:  0.876, Validation Accuracy:  0.854, Loss:  0.160
Epoch   0 Batch 1002/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.839, Loss:  0.168
Epoch   0 Batch 1003/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.835, Loss:  0.194
Epoch   0 Batch 1004/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.846, Loss:  0.184
Epoch   0 Batch 1005/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.847, Loss:  0.163
Epoch   0 Batch 1006/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.842, Loss:  0.152
Epoch   0 Batch 1007/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.844, Loss:  0.155
Epoch   0 Batch 1008/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.859, Loss:  0.218
Epoch   0 Batch 1009/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.867, Loss:  0.144
Epoch   0 Batch 1010/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.858, Loss:  0.167
Epoch   0 Batch 1011/1077 - Train Accuracy:  0.865, Validation Accuracy:  0.838, Loss:  0.165
Epoch   0 Batch 1012/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.832, Loss:  0.156
Epoch   0 Batch 1013/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.853, Loss:  0.159
Epoch   0 Batch 1014/1077 - Train Accuracy:  0.869, Validation Accuracy:  0.846, Loss:  0.172
Epoch   0 Batch 1015/1077 - Train Accuracy:  0.866, Validation Accuracy:  0.849, Loss:  0.199
Epoch   0 Batch 1016/1077 - Train Accuracy:  0.866, Validation Accuracy:  0.847, Loss:  0.168
Epoch   0 Batch 1017/1077 - Train Accuracy:  0.888, Validation Accuracy:  0.848, Loss:  0.168
Epoch   0 Batch 1018/1077 - Train Accuracy:  0.850, Validation Accuracy:  0.843, Loss:  0.158
Epoch   0 Batch 1019/1077 - Train Accuracy:  0.863, Validation Accuracy:  0.854, Loss:  0.188
Epoch   0 Batch 1020/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.853, Loss:  0.158
Epoch   0 Batch 1021/1077 - Train Accuracy:  0.875, Validation Accuracy:  0.857, Loss:  0.167
Epoch   0 Batch 1022/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.844, Loss:  0.150
Epoch   0 Batch 1023/1077 - Train Accuracy:  0.881, Validation Accuracy:  0.838, Loss:  0.159
Epoch   0 Batch 1024/1077 - Train Accuracy:  0.845, Validation Accuracy:  0.851, Loss:  0.188
Epoch   0 Batch 1025/1077 - Train Accuracy:  0.847, Validation Accuracy:  0.855, Loss:  0.171
Epoch   0 Batch 1026/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.860, Loss:  0.164
Epoch   0 Batch 1027/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.860, Loss:  0.166
Epoch   0 Batch 1028/1077 - Train Accuracy:  0.860, Validation Accuracy:  0.862, Loss:  0.159
Epoch   0 Batch 1029/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.861, Loss:  0.156
Epoch   0 Batch 1030/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.856, Loss:  0.175
Epoch   0 Batch 1031/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.854, Loss:  0.174
Epoch   0 Batch 1032/1077 - Train Accuracy:  0.869, Validation Accuracy:  0.847, Loss:  0.185
Epoch   0 Batch 1033/1077 - Train Accuracy:  0.817, Validation Accuracy:  0.849, Loss:  0.177
Epoch   0 Batch 1034/1077 - Train Accuracy:  0.845, Validation Accuracy:  0.863, Loss:  0.168
Epoch   0 Batch 1035/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.853, Loss:  0.130
Epoch   0 Batch 1036/1077 - Train Accuracy:  0.881, Validation Accuracy:  0.857, Loss:  0.172
Epoch   0 Batch 1037/1077 - Train Accuracy:  0.873, Validation Accuracy:  0.860, Loss:  0.173
Epoch   0 Batch 1038/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.852, Loss:  0.190
Epoch   0 Batch 1039/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.853, Loss:  0.163
Epoch   0 Batch 1040/1077 - Train Accuracy:  0.875, Validation Accuracy:  0.850, Loss:  0.173
Epoch   0 Batch 1041/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.848, Loss:  0.157
Epoch   0 Batch 1042/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.848, Loss:  0.153
Epoch   0 Batch 1043/1077 - Train Accuracy:  0.869, Validation Accuracy:  0.855, Loss:  0.183
Epoch   0 Batch 1044/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.852, Loss:  0.176
Epoch   0 Batch 1045/1077 - Train Accuracy:  0.857, Validation Accuracy:  0.855, Loss:  0.155
Epoch   0 Batch 1046/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.859, Loss:  0.135
Epoch   0 Batch 1047/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.881, Loss:  0.155
Epoch   0 Batch 1048/1077 - Train Accuracy:  0.888, Validation Accuracy:  0.871, Loss:  0.142
Epoch   0 Batch 1049/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.860, Loss:  0.167
Epoch   0 Batch 1050/1077 - Train Accuracy:  0.877, Validation Accuracy:  0.843, Loss:  0.144
Epoch   0 Batch 1051/1077 - Train Accuracy:  0.897, Validation Accuracy:  0.846, Loss:  0.159
Epoch   0 Batch 1052/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.849, Loss:  0.150
Epoch   0 Batch 1053/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.849, Loss:  0.154
Epoch   0 Batch 1054/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.855, Loss:  0.165
Epoch   0 Batch 1055/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.859, Loss:  0.165
Epoch   0 Batch 1056/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.869, Loss:  0.151
Epoch   0 Batch 1057/1077 - Train Accuracy:  0.874, Validation Accuracy:  0.860, Loss:  0.164
Epoch   0 Batch 1058/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.848, Loss:  0.164
Epoch   0 Batch 1059/1077 - Train Accuracy:  0.852, Validation Accuracy:  0.847, Loss:  0.184
Epoch   0 Batch 1060/1077 - Train Accuracy:  0.863, Validation Accuracy:  0.848, Loss:  0.142
Epoch   0 Batch 1061/1077 - Train Accuracy:  0.869, Validation Accuracy:  0.852, Loss:  0.180
Epoch   0 Batch 1062/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.865, Loss:  0.161
Epoch   0 Batch 1063/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.866, Loss:  0.157
Epoch   0 Batch 1064/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.871, Loss:  0.149
Epoch   0 Batch 1065/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.869, Loss:  0.146
Epoch   0 Batch 1066/1077 - Train Accuracy:  0.882, Validation Accuracy:  0.872, Loss:  0.142
Epoch   0 Batch 1067/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.867, Loss:  0.155
Epoch   0 Batch 1068/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.858, Loss:  0.129
Epoch   0 Batch 1069/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.859, Loss:  0.119
Epoch   0 Batch 1070/1077 - Train Accuracy:  0.867, Validation Accuracy:  0.866, Loss:  0.156
Epoch   0 Batch 1071/1077 - Train Accuracy:  0.877, Validation Accuracy:  0.872, Loss:  0.140
Epoch   0 Batch 1072/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.872, Loss:  0.144
Epoch   0 Batch 1073/1077 - Train Accuracy:  0.871, Validation Accuracy:  0.877, Loss:  0.162
Epoch   0 Batch 1074/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.865, Loss:  0.159
Epoch   0 Batch 1075/1077 - Train Accuracy:  0.897, Validation Accuracy:  0.867, Loss:  0.160
Epoch   1 Batch    0/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.858, Loss:  0.125
Epoch   1 Batch    1/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.866, Loss:  0.124
Epoch   1 Batch    2/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.876, Loss:  0.149
Epoch   1 Batch    3/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.873, Loss:  0.136
Epoch   1 Batch    4/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.873, Loss:  0.133
Epoch   1 Batch    5/1077 - Train Accuracy:  0.877, Validation Accuracy:  0.874, Loss:  0.183
Epoch   1 Batch    6/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.874, Loss:  0.145
Epoch   1 Batch    7/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.858, Loss:  0.138
Epoch   1 Batch    8/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.850, Loss:  0.138
Epoch   1 Batch    9/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.858, Loss:  0.141
Epoch   1 Batch   10/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.859, Loss:  0.156
Epoch   1 Batch   11/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.855, Loss:  0.140
Epoch   1 Batch   12/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.850, Loss:  0.153
Epoch   1 Batch   13/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.848, Loss:  0.147
Epoch   1 Batch   14/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.864, Loss:  0.120
Epoch   1 Batch   15/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.862, Loss:  0.144
Epoch   1 Batch   16/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.870, Loss:  0.159
Epoch   1 Batch   17/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.868, Loss:  0.145
Epoch   1 Batch   18/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.863, Loss:  0.126
Epoch   1 Batch   19/1077 - Train Accuracy:  0.866, Validation Accuracy:  0.871, Loss:  0.141
Epoch   1 Batch   20/1077 - Train Accuracy:  0.874, Validation Accuracy:  0.868, Loss:  0.117
Epoch   1 Batch   21/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.858, Loss:  0.137
Epoch   1 Batch   22/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.870, Loss:  0.142
Epoch   1 Batch   23/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.868, Loss:  0.130
Epoch   1 Batch   24/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.872, Loss:  0.129
Epoch   1 Batch   25/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.873, Loss:  0.121
Epoch   1 Batch   26/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.882, Loss:  0.148
Epoch   1 Batch   27/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.882, Loss:  0.113
Epoch   1 Batch   28/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.873, Loss:  0.136
Epoch   1 Batch   29/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.866, Loss:  0.124
Epoch   1 Batch   30/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.873, Loss:  0.132
Epoch   1 Batch   31/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.881, Loss:  0.130
Epoch   1 Batch   32/1077 - Train Accuracy:  0.885, Validation Accuracy:  0.885, Loss:  0.141
Epoch   1 Batch   33/1077 - Train Accuracy:  0.865, Validation Accuracy:  0.878, Loss:  0.131
Epoch   1 Batch   34/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.886, Loss:  0.124
Epoch   1 Batch   35/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.895, Loss:  0.124
Epoch   1 Batch   36/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.859, Loss:  0.136
Epoch   1 Batch   37/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.856, Loss:  0.121
Epoch   1 Batch   38/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.843, Loss:  0.144
Epoch   1 Batch   39/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.843, Loss:  0.153
Epoch   1 Batch   40/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.844, Loss:  0.114
Epoch   1 Batch   41/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.871, Loss:  0.125
Epoch   1 Batch   42/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.877, Loss:  0.153
Epoch   1 Batch   43/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.872, Loss:  0.101
Epoch   1 Batch   44/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.860, Loss:  0.125
Epoch   1 Batch   45/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.857, Loss:  0.128
Epoch   1 Batch   46/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.856, Loss:  0.134
Epoch   1 Batch   47/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.860, Loss:  0.137
Epoch   1 Batch   48/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.873, Loss:  0.172
Epoch   1 Batch   49/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.876, Loss:  0.134
Epoch   1 Batch   50/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.866, Loss:  0.122
Epoch   1 Batch   51/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.862, Loss:  0.131
Epoch   1 Batch   52/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.868, Loss:  0.137
Epoch   1 Batch   53/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.863, Loss:  0.135
Epoch   1 Batch   54/1077 - Train Accuracy:  0.839, Validation Accuracy:  0.873, Loss:  0.173
Epoch   1 Batch   55/1077 - Train Accuracy:  0.893, Validation Accuracy:  0.871, Loss:  0.117
Epoch   1 Batch   56/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.873, Loss:  0.118
Epoch   1 Batch   57/1077 - Train Accuracy:  0.873, Validation Accuracy:  0.866, Loss:  0.117
Epoch   1 Batch   58/1077 - Train Accuracy:  0.864, Validation Accuracy:  0.873, Loss:  0.124
Epoch   1 Batch   59/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.854, Loss:  0.137
Epoch   1 Batch   60/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.858, Loss:  0.109
Epoch   1 Batch   61/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.860, Loss:  0.141
Epoch   1 Batch   62/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.865, Loss:  0.135
Epoch   1 Batch   63/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.872, Loss:  0.110
Epoch   1 Batch   64/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.877, Loss:  0.122
Epoch   1 Batch   65/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.884, Loss:  0.115
Epoch   1 Batch   66/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.870, Loss:  0.101
Epoch   1 Batch   67/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.876, Loss:  0.120
Epoch   1 Batch   68/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.875, Loss:  0.135
Epoch   1 Batch   69/1077 - Train Accuracy:  0.894, Validation Accuracy:  0.862, Loss:  0.147
Epoch   1 Batch   70/1077 - Train Accuracy:  0.897, Validation Accuracy:  0.863, Loss:  0.121
Epoch   1 Batch   71/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.860, Loss:  0.101
Epoch   1 Batch   72/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.874, Loss:  0.128
Epoch   1 Batch   73/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.881, Loss:  0.122
Epoch   1 Batch   74/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.882, Loss:  0.102
Epoch   1 Batch   75/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.878, Loss:  0.133
Epoch   1 Batch   76/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.887, Loss:  0.107
Epoch   1 Batch   77/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.900, Loss:  0.116
Epoch   1 Batch   78/1077 - Train Accuracy:  0.861, Validation Accuracy:  0.888, Loss:  0.126
Epoch   1 Batch   79/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.893, Loss:  0.130
Epoch   1 Batch   80/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.896, Loss:  0.107
Epoch   1 Batch   81/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.893, Loss:  0.111
Epoch   1 Batch   82/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.896, Loss:  0.106
Epoch   1 Batch   83/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.897, Loss:  0.121
Epoch   1 Batch   84/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.883, Loss:  0.110
Epoch   1 Batch   85/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.887, Loss:  0.108
Epoch   1 Batch   86/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.892, Loss:  0.117
Epoch   1 Batch   87/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.896, Loss:  0.149
Epoch   1 Batch   88/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.903, Loss:  0.124
Epoch   1 Batch   89/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.909, Loss:  0.122
Epoch   1 Batch   90/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.898, Loss:  0.122
Epoch   1 Batch   91/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.908, Loss:  0.101
Epoch   1 Batch   92/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.903, Loss:  0.122
Epoch   1 Batch   93/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.892, Loss:  0.110
Epoch   1 Batch   94/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.894, Loss:  0.102
Epoch   1 Batch   95/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.898, Loss:  0.142
Epoch   1 Batch   96/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.901, Loss:  0.123
Epoch   1 Batch   97/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.890, Loss:  0.117
Epoch   1 Batch   98/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.890, Loss:  0.131
Epoch   1 Batch   99/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.896, Loss:  0.116
Epoch   1 Batch  100/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.900, Loss:  0.111
Epoch   1 Batch  101/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.898, Loss:  0.110
Epoch   1 Batch  102/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.890, Loss:  0.115
Epoch   1 Batch  103/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.884, Loss:  0.133
Epoch   1 Batch  104/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.885, Loss:  0.123
Epoch   1 Batch  105/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.891, Loss:  0.109
Epoch   1 Batch  106/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.890, Loss:  0.143
Epoch   1 Batch  107/1077 - Train Accuracy:  0.893, Validation Accuracy:  0.887, Loss:  0.112
Epoch   1 Batch  108/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.880, Loss:  0.096
Epoch   1 Batch  109/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.869, Loss:  0.119
Epoch   1 Batch  110/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.866, Loss:  0.089
Epoch   1 Batch  111/1077 - Train Accuracy:  0.893, Validation Accuracy:  0.869, Loss:  0.102
Epoch   1 Batch  112/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.893, Loss:  0.119
Epoch   1 Batch  113/1077 - Train Accuracy:  0.868, Validation Accuracy:  0.892, Loss:  0.122
Epoch   1 Batch  114/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.897, Loss:  0.102
Epoch   1 Batch  115/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.884, Loss:  0.129
Epoch   1 Batch  116/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.878, Loss:  0.114
Epoch   1 Batch  117/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.873, Loss:  0.105
Epoch   1 Batch  118/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.864, Loss:  0.115
Epoch   1 Batch  119/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.870, Loss:  0.106
Epoch   1 Batch  120/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.889, Loss:  0.120
Epoch   1 Batch  121/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.892, Loss:  0.107
Epoch   1 Batch  122/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.889, Loss:  0.099
Epoch   1 Batch  123/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.885, Loss:  0.092
Epoch   1 Batch  124/1077 - Train Accuracy:  0.877, Validation Accuracy:  0.893, Loss:  0.122
Epoch   1 Batch  125/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.905, Loss:  0.114
Epoch   1 Batch  126/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.902, Loss:  0.086
Epoch   1 Batch  127/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.901, Loss:  0.113
Epoch   1 Batch  128/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.907, Loss:  0.100
Epoch   1 Batch  129/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.896, Loss:  0.129
Epoch   1 Batch  130/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.901, Loss:  0.101
Epoch   1 Batch  131/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.893, Loss:  0.106
Epoch   1 Batch  132/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.902, Loss:  0.124
Epoch   1 Batch  133/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.897, Loss:  0.091
Epoch   1 Batch  134/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.887, Loss:  0.108
Epoch   1 Batch  135/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.887, Loss:  0.105
Epoch   1 Batch  136/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.881, Loss:  0.107
Epoch   1 Batch  137/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.880, Loss:  0.088
Epoch   1 Batch  138/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.880, Loss:  0.106
Epoch   1 Batch  139/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.885, Loss:  0.111
Epoch   1 Batch  140/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.865, Loss:  0.105
Epoch   1 Batch  141/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.869, Loss:  0.113
Epoch   1 Batch  142/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.872, Loss:  0.101
Epoch   1 Batch  143/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.869, Loss:  0.118
Epoch   1 Batch  144/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.867, Loss:  0.119
Epoch   1 Batch  145/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.881, Loss:  0.097
Epoch   1 Batch  146/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.893, Loss:  0.128
Epoch   1 Batch  147/1077 - Train Accuracy:  0.885, Validation Accuracy:  0.895, Loss:  0.108
Epoch   1 Batch  148/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.891, Loss:  0.112
Epoch   1 Batch  149/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.893, Loss:  0.107
Epoch   1 Batch  150/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.868, Loss:  0.118
Epoch   1 Batch  151/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.880, Loss:  0.098
Epoch   1 Batch  152/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.872, Loss:  0.129
Epoch   1 Batch  153/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.876, Loss:  0.126
Epoch   1 Batch  154/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.890, Loss:  0.105
Epoch   1 Batch  155/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.892, Loss:  0.106
Epoch   1 Batch  156/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.887, Loss:  0.099
Epoch   1 Batch  157/1077 - Train Accuracy:  0.893, Validation Accuracy:  0.895, Loss:  0.107
Epoch   1 Batch  158/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.900, Loss:  0.132
Epoch   1 Batch  159/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.911, Loss:  0.094
Epoch   1 Batch  160/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.905, Loss:  0.098
Epoch   1 Batch  161/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.889, Loss:  0.095
Epoch   1 Batch  162/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.883, Loss:  0.125
Epoch   1 Batch  163/1077 - Train Accuracy:  0.885, Validation Accuracy:  0.876, Loss:  0.118
Epoch   1 Batch  164/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.868, Loss:  0.107
Epoch   1 Batch  165/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.866, Loss:  0.081
Epoch   1 Batch  166/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.886, Loss:  0.121
Epoch   1 Batch  167/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.884, Loss:  0.101
Epoch   1 Batch  168/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.885, Loss:  0.120
Epoch   1 Batch  169/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.888, Loss:  0.106
Epoch   1 Batch  170/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.876, Loss:  0.108
Epoch   1 Batch  171/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.872, Loss:  0.103
Epoch   1 Batch  172/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.882, Loss:  0.092
Epoch   1 Batch  173/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.876, Loss:  0.110
Epoch   1 Batch  174/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.882, Loss:  0.106
Epoch   1 Batch  175/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.882, Loss:  0.109
Epoch   1 Batch  176/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.884, Loss:  0.105
Epoch   1 Batch  177/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.894, Loss:  0.117
Epoch   1 Batch  178/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.886, Loss:  0.104
Epoch   1 Batch  179/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.880, Loss:  0.104
Epoch   1 Batch  180/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.879, Loss:  0.096
Epoch   1 Batch  181/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.872, Loss:  0.127
Epoch   1 Batch  182/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.865, Loss:  0.117
Epoch   1 Batch  183/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.863, Loss:  0.109
Epoch   1 Batch  184/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.858, Loss:  0.090
Epoch   1 Batch  185/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.873, Loss:  0.114
Epoch   1 Batch  186/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.887, Loss:  0.113
Epoch   1 Batch  187/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.884, Loss:  0.083
Epoch   1 Batch  188/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.882, Loss:  0.103
Epoch   1 Batch  189/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.880, Loss:  0.111
Epoch   1 Batch  190/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.876, Loss:  0.095
Epoch   1 Batch  191/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.879, Loss:  0.082
Epoch   1 Batch  192/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.881, Loss:  0.118
Epoch   1 Batch  193/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.890, Loss:  0.093
Epoch   1 Batch  194/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.891, Loss:  0.086
Epoch   1 Batch  195/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.896, Loss:  0.080
Epoch   1 Batch  196/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.895, Loss:  0.094
Epoch   1 Batch  197/1077 - Train Accuracy:  0.897, Validation Accuracy:  0.893, Loss:  0.113
Epoch   1 Batch  198/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.893, Loss:  0.101
Epoch   1 Batch  199/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.887, Loss:  0.096
Epoch   1 Batch  200/1077 - Train Accuracy:  0.883, Validation Accuracy:  0.891, Loss:  0.104
Epoch   1 Batch  201/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.890, Loss:  0.087
Epoch   1 Batch  202/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.894, Loss:  0.091
Epoch   1 Batch  203/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.881, Loss:  0.098
Epoch   1 Batch  204/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.873, Loss:  0.110
Epoch   1 Batch  205/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.874, Loss:  0.110
Epoch   1 Batch  206/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.877, Loss:  0.090
Epoch   1 Batch  207/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.886, Loss:  0.095
Epoch   1 Batch  208/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.880, Loss:  0.098
Epoch   1 Batch  209/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.892, Loss:  0.072
Epoch   1 Batch  210/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.889, Loss:  0.105
Epoch   1 Batch  211/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.890, Loss:  0.102
Epoch   1 Batch  212/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.877, Loss:  0.090
Epoch   1 Batch  213/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.871, Loss:  0.085
Epoch   1 Batch  214/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.879, Loss:  0.085
Epoch   1 Batch  215/1077 - Train Accuracy:  0.880, Validation Accuracy:  0.877, Loss:  0.099
Epoch   1 Batch  216/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.893, Loss:  0.097
Epoch   1 Batch  217/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.895, Loss:  0.085
Epoch   1 Batch  218/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.899, Loss:  0.136
Epoch   1 Batch  219/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.897, Loss:  0.086
Epoch   1 Batch  220/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.890, Loss:  0.082
Epoch   1 Batch  221/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.888, Loss:  0.103
Epoch   1 Batch  222/1077 - Train Accuracy:  0.893, Validation Accuracy:  0.896, Loss:  0.095
Epoch   1 Batch  223/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.889, Loss:  0.084
Epoch   1 Batch  224/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.897, Loss:  0.110
Epoch   1 Batch  225/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.902, Loss:  0.105
Epoch   1 Batch  226/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.902, Loss:  0.087
Epoch   1 Batch  227/1077 - Train Accuracy:  0.869, Validation Accuracy:  0.891, Loss:  0.119
Epoch   1 Batch  228/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.897, Loss:  0.096
Epoch   1 Batch  229/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.904, Loss:  0.104
Epoch   1 Batch  230/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.901, Loss:  0.090
Epoch   1 Batch  231/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.904, Loss:  0.093
Epoch   1 Batch  232/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.906, Loss:  0.082
Epoch   1 Batch  233/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.902, Loss:  0.122
Epoch   1 Batch  234/1077 - Train Accuracy:  0.894, Validation Accuracy:  0.905, Loss:  0.114
Epoch   1 Batch  235/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.909, Loss:  0.090
Epoch   1 Batch  236/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.908, Loss:  0.122
Epoch   1 Batch  237/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.905, Loss:  0.079
Epoch   1 Batch  238/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.900, Loss:  0.096
Epoch   1 Batch  239/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.900, Loss:  0.069
Epoch   1 Batch  240/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.900, Loss:  0.094
Epoch   1 Batch  241/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.899, Loss:  0.073
Epoch   1 Batch  242/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.904, Loss:  0.077
Epoch   1 Batch  243/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.913, Loss:  0.087
Epoch   1 Batch  244/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.904, Loss:  0.085
Epoch   1 Batch  245/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.900, Loss:  0.083
Epoch   1 Batch  246/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.900, Loss:  0.088
Epoch   1 Batch  247/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.900, Loss:  0.087
Epoch   1 Batch  248/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.900, Loss:  0.092
Epoch   1 Batch  249/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.913, Loss:  0.085
Epoch   1 Batch  250/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.912, Loss:  0.092
Epoch   1 Batch  251/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.912, Loss:  0.095
Epoch   1 Batch  252/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.908, Loss:  0.091
Epoch   1 Batch  253/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.912, Loss:  0.095
Epoch   1 Batch  254/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.912, Loss:  0.099
Epoch   1 Batch  255/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.909, Loss:  0.090
Epoch   1 Batch  256/1077 - Train Accuracy:  0.877, Validation Accuracy:  0.912, Loss:  0.118
Epoch   1 Batch  257/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.899, Loss:  0.087
Epoch   1 Batch  258/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.891, Loss:  0.097
Epoch   1 Batch  259/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.896, Loss:  0.081
Epoch   1 Batch  260/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.893, Loss:  0.077
Epoch   1 Batch  261/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.894, Loss:  0.103
Epoch   1 Batch  262/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.904, Loss:  0.078
Epoch   1 Batch  263/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.898, Loss:  0.079
Epoch   1 Batch  264/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.901, Loss:  0.091
Epoch   1 Batch  265/1077 - Train Accuracy:  0.878, Validation Accuracy:  0.905, Loss:  0.096
Epoch   1 Batch  266/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.900, Loss:  0.090
Epoch   1 Batch  267/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.903, Loss:  0.078
Epoch   1 Batch  268/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.903, Loss:  0.093
Epoch   1 Batch  269/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.895, Loss:  0.113
Epoch   1 Batch  270/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.900, Loss:  0.107
Epoch   1 Batch  271/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.887, Loss:  0.101
Epoch   1 Batch  272/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.886, Loss:  0.129
Epoch   1 Batch  273/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.887, Loss:  0.079
Epoch   1 Batch  274/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.891, Loss:  0.086
Epoch   1 Batch  275/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.881, Loss:  0.088
Epoch   1 Batch  276/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.871, Loss:  0.108
Epoch   1 Batch  277/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.884, Loss:  0.085
Epoch   1 Batch  278/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.898, Loss:  0.113
Epoch   1 Batch  279/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.883, Loss:  0.099
Epoch   1 Batch  280/1077 - Train Accuracy:  0.884, Validation Accuracy:  0.880, Loss:  0.099
Epoch   1 Batch  281/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.895, Loss:  0.111
Epoch   1 Batch  282/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.894, Loss:  0.112
Epoch   1 Batch  283/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.895, Loss:  0.108
Epoch   1 Batch  284/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.898, Loss:  0.096
Epoch   1 Batch  285/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.898, Loss:  0.089
Epoch   1 Batch  286/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.898, Loss:  0.090
Epoch   1 Batch  287/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.902, Loss:  0.084
Epoch   1 Batch  288/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.911, Loss:  0.096
Epoch   1 Batch  289/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.908, Loss:  0.096
Epoch   1 Batch  290/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.900, Loss:  0.118
Epoch   1 Batch  291/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.888, Loss:  0.111
Epoch   1 Batch  292/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.895, Loss:  0.094
Epoch   1 Batch  293/1077 - Train Accuracy:  0.894, Validation Accuracy:  0.885, Loss:  0.095
Epoch   1 Batch  294/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.885, Loss:  0.085
Epoch   1 Batch  295/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.889, Loss:  0.107
Epoch   1 Batch  296/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.895, Loss:  0.086
Epoch   1 Batch  297/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.900, Loss:  0.095
Epoch   1 Batch  298/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.904, Loss:  0.109
Epoch   1 Batch  299/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.908, Loss:  0.097
Epoch   1 Batch  300/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.907, Loss:  0.078
Epoch   1 Batch  301/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.895, Loss:  0.075
Epoch   1 Batch  302/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.887, Loss:  0.078
Epoch   1 Batch  303/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.893, Loss:  0.090
Epoch   1 Batch  304/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.895, Loss:  0.082
Epoch   1 Batch  305/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.903, Loss:  0.093
Epoch   1 Batch  306/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.891, Loss:  0.089
Epoch   1 Batch  307/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.894, Loss:  0.076
Epoch   1 Batch  308/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.894, Loss:  0.111
Epoch   1 Batch  309/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.892, Loss:  0.069
Epoch   1 Batch  310/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.896, Loss:  0.083
Epoch   1 Batch  311/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.900, Loss:  0.080
Epoch   1 Batch  312/1077 - Train Accuracy:  0.882, Validation Accuracy:  0.901, Loss:  0.107
Epoch   1 Batch  313/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.904, Loss:  0.070
Epoch   1 Batch  314/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.890, Loss:  0.090
Epoch   1 Batch  315/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.891, Loss:  0.080
Epoch   1 Batch  316/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.888, Loss:  0.081
Epoch   1 Batch  317/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.891, Loss:  0.112
Epoch   1 Batch  318/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.893, Loss:  0.087
Epoch   1 Batch  319/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.902, Loss:  0.090
Epoch   1 Batch  320/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.902, Loss:  0.085
Epoch   1 Batch  321/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.903, Loss:  0.071
Epoch   1 Batch  322/1077 - Train Accuracy:  0.886, Validation Accuracy:  0.893, Loss:  0.077
Epoch   1 Batch  323/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.888, Loss:  0.084
Epoch   1 Batch  324/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.887, Loss:  0.081
Epoch   1 Batch  325/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.883, Loss:  0.090
Epoch   1 Batch  326/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.888, Loss:  0.091
Epoch   1 Batch  327/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.893, Loss:  0.088
Epoch   1 Batch  328/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.884, Loss:  0.098
Epoch   1 Batch  329/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.897, Loss:  0.086
Epoch   1 Batch  330/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.891, Loss:  0.093
Epoch   1 Batch  331/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.888, Loss:  0.091
Epoch   1 Batch  332/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.884, Loss:  0.067
Epoch   1 Batch  333/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.885, Loss:  0.075
Epoch   1 Batch  334/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.884, Loss:  0.099
Epoch   1 Batch  335/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.889, Loss:  0.084
Epoch   1 Batch  336/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.881, Loss:  0.110
Epoch   1 Batch  337/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.886, Loss:  0.093
Epoch   1 Batch  338/1077 - Train Accuracy:  0.879, Validation Accuracy:  0.878, Loss:  0.106
Epoch   1 Batch  339/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.873, Loss:  0.076
Epoch   1 Batch  340/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.879, Loss:  0.078
Epoch   1 Batch  341/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.873, Loss:  0.109
Epoch   1 Batch  342/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.895, Loss:  0.071
Epoch   1 Batch  343/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.885, Loss:  0.086
Epoch   1 Batch  344/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.890, Loss:  0.076
Epoch   1 Batch  345/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.880, Loss:  0.075
Epoch   1 Batch  346/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.881, Loss:  0.091
Epoch   1 Batch  347/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.880, Loss:  0.068
Epoch   1 Batch  348/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.881, Loss:  0.076
Epoch   1 Batch  349/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.883, Loss:  0.087
Epoch   1 Batch  350/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.893, Loss:  0.088
Epoch   1 Batch  351/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.903, Loss:  0.091
Epoch   1 Batch  352/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.902, Loss:  0.072
Epoch   1 Batch  353/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.897, Loss:  0.094
Epoch   1 Batch  354/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.891, Loss:  0.099
Epoch   1 Batch  355/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.899, Loss:  0.081
Epoch   1 Batch  356/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.900, Loss:  0.088
Epoch   1 Batch  357/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.910, Loss:  0.081
Epoch   1 Batch  358/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.906, Loss:  0.079
Epoch   1 Batch  359/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.900, Loss:  0.088
Epoch   1 Batch  360/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.903, Loss:  0.079
Epoch   1 Batch  361/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.901, Loss:  0.087
Epoch   1 Batch  362/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.892, Loss:  0.096
Epoch   1 Batch  363/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.897, Loss:  0.087
Epoch   1 Batch  364/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.906, Loss:  0.091
Epoch   1 Batch  365/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.902, Loss:  0.070
Epoch   1 Batch  366/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.914, Loss:  0.082
Epoch   1 Batch  367/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.912, Loss:  0.061
Epoch   1 Batch  368/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.924, Loss:  0.086
Epoch   1 Batch  369/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.922, Loss:  0.083
Epoch   1 Batch  370/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.922, Loss:  0.078
Epoch   1 Batch  371/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.923, Loss:  0.066
Epoch   1 Batch  372/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.921, Loss:  0.067
Epoch   1 Batch  373/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.915, Loss:  0.071
Epoch   1 Batch  374/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.921, Loss:  0.088
Epoch   1 Batch  375/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.920, Loss:  0.084
Epoch   1 Batch  376/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.912, Loss:  0.083
Epoch   1 Batch  377/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.914, Loss:  0.083
Epoch   1 Batch  378/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.904, Loss:  0.064
Epoch   1 Batch  379/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.911, Loss:  0.092
Epoch   1 Batch  380/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.909, Loss:  0.076
Epoch   1 Batch  381/1077 - Train Accuracy:  0.894, Validation Accuracy:  0.905, Loss:  0.090
Epoch   1 Batch  382/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.904, Loss:  0.115
Epoch   1 Batch  383/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.908, Loss:  0.082
Epoch   1 Batch  384/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.913, Loss:  0.073
Epoch   1 Batch  385/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.913, Loss:  0.070
Epoch   1 Batch  386/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.912, Loss:  0.087
Epoch   1 Batch  387/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.917, Loss:  0.076
Epoch   1 Batch  388/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.919, Loss:  0.079
Epoch   1 Batch  389/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.913, Loss:  0.084
Epoch   1 Batch  390/1077 - Train Accuracy:  0.870, Validation Accuracy:  0.913, Loss:  0.086
Epoch   1 Batch  391/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.913, Loss:  0.087
Epoch   1 Batch  392/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.912, Loss:  0.088
Epoch   1 Batch  393/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.902, Loss:  0.069
Epoch   1 Batch  394/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.902, Loss:  0.078
Epoch   1 Batch  395/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.902, Loss:  0.087
Epoch   1 Batch  396/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.899, Loss:  0.086
Epoch   1 Batch  397/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.903, Loss:  0.078
Epoch   1 Batch  398/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.898, Loss:  0.084
Epoch   1 Batch  399/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.903, Loss:  0.091
Epoch   1 Batch  400/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.901, Loss:  0.092
Epoch   1 Batch  401/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.900, Loss:  0.063
Epoch   1 Batch  402/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.896, Loss:  0.067
Epoch   1 Batch  403/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.885, Loss:  0.103
Epoch   1 Batch  404/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.887, Loss:  0.072
Epoch   1 Batch  405/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.908, Loss:  0.089
Epoch   1 Batch  406/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.906, Loss:  0.072
Epoch   1 Batch  407/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.910, Loss:  0.091
Epoch   1 Batch  408/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.910, Loss:  0.081
Epoch   1 Batch  409/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.911, Loss:  0.090
Epoch   1 Batch  410/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.909, Loss:  0.094
Epoch   1 Batch  411/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.904, Loss:  0.077
Epoch   1 Batch  412/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.908, Loss:  0.064
Epoch   1 Batch  413/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.907, Loss:  0.078
Epoch   1 Batch  414/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.893, Loss:  0.089
Epoch   1 Batch  415/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.901, Loss:  0.091
Epoch   1 Batch  416/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.902, Loss:  0.087
Epoch   1 Batch  417/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.898, Loss:  0.115
Epoch   1 Batch  418/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.903, Loss:  0.074
Epoch   1 Batch  419/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.894, Loss:  0.075
Epoch   1 Batch  420/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.891, Loss:  0.064
Epoch   1 Batch  421/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.884, Loss:  0.093
Epoch   1 Batch  422/1077 - Train Accuracy:  0.893, Validation Accuracy:  0.885, Loss:  0.075
Epoch   1 Batch  423/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.888, Loss:  0.092
Epoch   1 Batch  424/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.894, Loss:  0.079
Epoch   1 Batch  425/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.891, Loss:  0.066
Epoch   1 Batch  426/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.908, Loss:  0.088
Epoch   1 Batch  427/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.914, Loss:  0.078
Epoch   1 Batch  428/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.909, Loss:  0.067
Epoch   1 Batch  429/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.902, Loss:  0.071
Epoch   1 Batch  430/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.898, Loss:  0.059
Epoch   1 Batch  431/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.901, Loss:  0.061
Epoch   1 Batch  432/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.898, Loss:  0.088
Epoch   1 Batch  433/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.880, Loss:  0.074
Epoch   1 Batch  434/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.880, Loss:  0.070
Epoch   1 Batch  435/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.891, Loss:  0.087
Epoch   1 Batch  436/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.890, Loss:  0.081
Epoch   1 Batch  437/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.894, Loss:  0.065
Epoch   1 Batch  438/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.894, Loss:  0.093
Epoch   1 Batch  439/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.895, Loss:  0.082
Epoch   1 Batch  440/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.893, Loss:  0.093
Epoch   1 Batch  441/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.889, Loss:  0.077
Epoch   1 Batch  442/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.890, Loss:  0.084
Epoch   1 Batch  443/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.891, Loss:  0.062
Epoch   1 Batch  444/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.903, Loss:  0.072
Epoch   1 Batch  445/1077 - Train Accuracy:  0.874, Validation Accuracy:  0.890, Loss:  0.084
Epoch   1 Batch  446/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.899, Loss:  0.063
Epoch   1 Batch  447/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.895, Loss:  0.079
Epoch   1 Batch  448/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.898, Loss:  0.102
Epoch   1 Batch  449/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.890, Loss:  0.082
Epoch   1 Batch  450/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.898, Loss:  0.075
Epoch   1 Batch  451/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.907, Loss:  0.078
Epoch   1 Batch  452/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.914, Loss:  0.077
Epoch   1 Batch  453/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.923, Loss:  0.071
Epoch   1 Batch  454/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.912, Loss:  0.074
Epoch   1 Batch  455/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.907, Loss:  0.086
Epoch   1 Batch  456/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.908, Loss:  0.089
Epoch   1 Batch  457/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.904, Loss:  0.058
Epoch   1 Batch  458/1077 - Train Accuracy:  0.891, Validation Accuracy:  0.900, Loss:  0.086
Epoch   1 Batch  459/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.893, Loss:  0.076
Epoch   1 Batch  460/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.891, Loss:  0.084
Epoch   1 Batch  461/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.913, Loss:  0.076
Epoch   1 Batch  462/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.912, Loss:  0.080
Epoch   1 Batch  463/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.907, Loss:  0.074
Epoch   1 Batch  464/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.915, Loss:  0.070
Epoch   1 Batch  465/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.901, Loss:  0.076
Epoch   1 Batch  466/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.892, Loss:  0.067
Epoch   1 Batch  467/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.895, Loss:  0.080
Epoch   1 Batch  468/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.905, Loss:  0.075
Epoch   1 Batch  469/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.902, Loss:  0.076
Epoch   1 Batch  470/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.900, Loss:  0.072
Epoch   1 Batch  471/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.900, Loss:  0.061
Epoch   1 Batch  472/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.903, Loss:  0.069
Epoch   1 Batch  473/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.902, Loss:  0.072
Epoch   1 Batch  474/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.907, Loss:  0.065
Epoch   1 Batch  475/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.899, Loss:  0.071
Epoch   1 Batch  476/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.890, Loss:  0.055
Epoch   1 Batch  477/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.898, Loss:  0.073
Epoch   1 Batch  478/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.901, Loss:  0.069
Epoch   1 Batch  479/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.907, Loss:  0.090
Epoch   1 Batch  480/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.909, Loss:  0.074
Epoch   1 Batch  481/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.918, Loss:  0.075
Epoch   1 Batch  482/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.919, Loss:  0.088
Epoch   1 Batch  483/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.910, Loss:  0.074
Epoch   1 Batch  484/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.900, Loss:  0.079
Epoch   1 Batch  485/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.908, Loss:  0.074
Epoch   1 Batch  486/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.900, Loss:  0.071
Epoch   1 Batch  487/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.886, Loss:  0.064
Epoch   1 Batch  488/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.896, Loss:  0.072
Epoch   1 Batch  489/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.896, Loss:  0.065
Epoch   1 Batch  490/1077 - Train Accuracy:  0.903, Validation Accuracy:  0.906, Loss:  0.071
Epoch   1 Batch  491/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.905, Loss:  0.088
Epoch   1 Batch  492/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.894, Loss:  0.083
Epoch   1 Batch  493/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.889, Loss:  0.062
Epoch   1 Batch  494/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.897, Loss:  0.056
Epoch   1 Batch  495/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.912, Loss:  0.065
Epoch   1 Batch  496/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.920, Loss:  0.072
Epoch   1 Batch  497/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.918, Loss:  0.075
Epoch   1 Batch  498/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.930, Loss:  0.071
Epoch   1 Batch  499/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.937, Loss:  0.057
Epoch   1 Batch  500/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.922, Loss:  0.071
Epoch   1 Batch  501/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.912, Loss:  0.055
Epoch   1 Batch  502/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.902, Loss:  0.080
Epoch   1 Batch  503/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.899, Loss:  0.070
Epoch   1 Batch  504/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.897, Loss:  0.074
Epoch   1 Batch  505/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.901, Loss:  0.065
Epoch   1 Batch  506/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.915, Loss:  0.077
Epoch   1 Batch  507/1077 - Train Accuracy:  0.894, Validation Accuracy:  0.918, Loss:  0.075
Epoch   1 Batch  508/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.920, Loss:  0.059
Epoch   1 Batch  509/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.908, Loss:  0.083
Epoch   1 Batch  510/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.902, Loss:  0.075
Epoch   1 Batch  511/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.895, Loss:  0.073
Epoch   1 Batch  512/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.892, Loss:  0.067
Epoch   1 Batch  513/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.892, Loss:  0.076
Epoch   1 Batch  514/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.908, Loss:  0.079
Epoch   1 Batch  515/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.915, Loss:  0.073
Epoch   1 Batch  516/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.911, Loss:  0.071
Epoch   1 Batch  517/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.911, Loss:  0.078
Epoch   1 Batch  518/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.910, Loss:  0.072
Epoch   1 Batch  519/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.915, Loss:  0.066
Epoch   1 Batch  520/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.913, Loss:  0.065
Epoch   1 Batch  521/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.915, Loss:  0.071
Epoch   1 Batch  522/1077 - Train Accuracy:  0.888, Validation Accuracy:  0.911, Loss:  0.078
Epoch   1 Batch  523/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.910, Loss:  0.080
Epoch   1 Batch  524/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.908, Loss:  0.069
Epoch   1 Batch  525/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.914, Loss:  0.076
Epoch   1 Batch  526/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.912, Loss:  0.064
Epoch   1 Batch  527/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.906, Loss:  0.085
Epoch   1 Batch  528/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.907, Loss:  0.074
Epoch   1 Batch  529/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.895, Loss:  0.070
Epoch   1 Batch  530/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.900, Loss:  0.078
Epoch   1 Batch  531/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.906, Loss:  0.076
Epoch   1 Batch  532/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.906, Loss:  0.093
Epoch   1 Batch  533/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.901, Loss:  0.069
Epoch   1 Batch  534/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.901, Loss:  0.080
Epoch   1 Batch  535/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.902, Loss:  0.071
Epoch   1 Batch  536/1077 - Train Accuracy:  0.895, Validation Accuracy:  0.897, Loss:  0.073
Epoch   1 Batch  537/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.893, Loss:  0.060
Epoch   1 Batch  538/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.905, Loss:  0.058
Epoch   1 Batch  539/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.886, Loss:  0.092
Epoch   1 Batch  540/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.889, Loss:  0.057
Epoch   1 Batch  541/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.907, Loss:  0.063
Epoch   1 Batch  542/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.907, Loss:  0.062
Epoch   1 Batch  543/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.904, Loss:  0.068
Epoch   1 Batch  544/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.910, Loss:  0.049
Epoch   1 Batch  545/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.903, Loss:  0.082
Epoch   1 Batch  546/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.908, Loss:  0.081
Epoch   1 Batch  547/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.897, Loss:  0.067
Epoch   1 Batch  548/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.896, Loss:  0.079
Epoch   1 Batch  549/1077 - Train Accuracy:  0.887, Validation Accuracy:  0.900, Loss:  0.088
Epoch   1 Batch  550/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.902, Loss:  0.079
Epoch   1 Batch  551/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.907, Loss:  0.074
Epoch   1 Batch  552/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.906, Loss:  0.074
Epoch   1 Batch  553/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.908, Loss:  0.080
Epoch   1 Batch  554/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.909, Loss:  0.072
Epoch   1 Batch  555/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.914, Loss:  0.075
Epoch   1 Batch  556/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.914, Loss:  0.060
Epoch   1 Batch  557/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.914, Loss:  0.062
Epoch   1 Batch  558/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.908, Loss:  0.062
Epoch   1 Batch  559/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.906, Loss:  0.074
Epoch   1 Batch  560/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.902, Loss:  0.064
Epoch   1 Batch  561/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.895, Loss:  0.066
Epoch   1 Batch  562/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.894, Loss:  0.058
Epoch   1 Batch  563/1077 - Train Accuracy:  0.899, Validation Accuracy:  0.898, Loss:  0.070
Epoch   1 Batch  564/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.900, Loss:  0.083
Epoch   1 Batch  565/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.899, Loss:  0.074
Epoch   1 Batch  566/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.903, Loss:  0.070
Epoch   1 Batch  567/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.902, Loss:  0.066
Epoch   1 Batch  568/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.913, Loss:  0.067
Epoch   1 Batch  569/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.919, Loss:  0.071
Epoch   1 Batch  570/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.919, Loss:  0.076
Epoch   1 Batch  571/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.916, Loss:  0.055
Epoch   1 Batch  572/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.916, Loss:  0.059
Epoch   1 Batch  573/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.917, Loss:  0.079
Epoch   1 Batch  574/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.911, Loss:  0.069
Epoch   1 Batch  575/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.914, Loss:  0.054
Epoch   1 Batch  576/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.927, Loss:  0.063
Epoch   1 Batch  577/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.928, Loss:  0.068
Epoch   1 Batch  578/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.929, Loss:  0.067
Epoch   1 Batch  579/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.928, Loss:  0.069
Epoch   1 Batch  580/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.938, Loss:  0.052
Epoch   1 Batch  581/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.938, Loss:  0.056
Epoch   1 Batch  582/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.939, Loss:  0.066
Epoch   1 Batch  583/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.924, Loss:  0.068
Epoch   1 Batch  584/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.926, Loss:  0.065
Epoch   1 Batch  585/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.926, Loss:  0.055
Epoch   1 Batch  586/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.923, Loss:  0.062
Epoch   1 Batch  587/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.923, Loss:  0.067
Epoch   1 Batch  588/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.915, Loss:  0.067
Epoch   1 Batch  589/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.908, Loss:  0.056
Epoch   1 Batch  590/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.909, Loss:  0.075
Epoch   1 Batch  591/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.918, Loss:  0.059
Epoch   1 Batch  592/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.922, Loss:  0.071
Epoch   1 Batch  593/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.922, Loss:  0.075
Epoch   1 Batch  594/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.923, Loss:  0.080
Epoch   1 Batch  595/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.918, Loss:  0.060
Epoch   1 Batch  596/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.914, Loss:  0.068
Epoch   1 Batch  597/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.916, Loss:  0.055
Epoch   1 Batch  598/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.911, Loss:  0.074
Epoch   1 Batch  599/1077 - Train Accuracy:  0.889, Validation Accuracy:  0.904, Loss:  0.089
Epoch   1 Batch  600/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.909, Loss:  0.073
Epoch   1 Batch  601/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.912, Loss:  0.076
Epoch   1 Batch  602/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.911, Loss:  0.068
Epoch   1 Batch  603/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.905, Loss:  0.066
Epoch   1 Batch  604/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.909, Loss:  0.082
Epoch   1 Batch  605/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.926, Loss:  0.084
Epoch   1 Batch  606/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.919, Loss:  0.046
Epoch   1 Batch  607/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.924, Loss:  0.066
Epoch   1 Batch  608/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.926, Loss:  0.072
Epoch   1 Batch  609/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.927, Loss:  0.069
Epoch   1 Batch  610/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.928, Loss:  0.069
Epoch   1 Batch  611/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.925, Loss:  0.057
Epoch   1 Batch  612/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.921, Loss:  0.063
Epoch   1 Batch  613/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.914, Loss:  0.070
Epoch   1 Batch  614/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.915, Loss:  0.062
Epoch   1 Batch  615/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.918, Loss:  0.056
Epoch   1 Batch  616/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.926, Loss:  0.068
Epoch   1 Batch  617/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.916, Loss:  0.067
Epoch   1 Batch  618/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.916, Loss:  0.064
Epoch   1 Batch  619/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.920, Loss:  0.053
Epoch   1 Batch  620/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.916, Loss:  0.062
Epoch   1 Batch  621/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.911, Loss:  0.060
Epoch   1 Batch  622/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.913, Loss:  0.069
Epoch   1 Batch  623/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.907, Loss:  0.067
Epoch   1 Batch  624/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.912, Loss:  0.072
Epoch   1 Batch  625/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.914, Loss:  0.057
Epoch   1 Batch  626/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.923, Loss:  0.062
Epoch   1 Batch  627/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.914, Loss:  0.061
Epoch   1 Batch  628/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.910, Loss:  0.073
Epoch   1 Batch  629/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.906, Loss:  0.076
Epoch   1 Batch  630/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.914, Loss:  0.061
Epoch   1 Batch  631/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.915, Loss:  0.068
Epoch   1 Batch  632/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.915, Loss:  0.051
Epoch   1 Batch  633/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.923, Loss:  0.066
Epoch   1 Batch  634/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.924, Loss:  0.049
Epoch   1 Batch  635/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.904, Loss:  0.082
Epoch   1 Batch  636/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.904, Loss:  0.056
Epoch   1 Batch  637/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.904, Loss:  0.066
Epoch   1 Batch  638/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.913, Loss:  0.065
Epoch   1 Batch  639/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.920, Loss:  0.082
Epoch   1 Batch  640/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.913, Loss:  0.068
Epoch   1 Batch  641/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.918, Loss:  0.055
Epoch   1 Batch  642/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.922, Loss:  0.059
Epoch   1 Batch  643/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.922, Loss:  0.049
Epoch   1 Batch  644/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.917, Loss:  0.062
Epoch   1 Batch  645/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.917, Loss:  0.073
Epoch   1 Batch  646/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.917, Loss:  0.063
Epoch   1 Batch  647/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.918, Loss:  0.066
Epoch   1 Batch  648/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.917, Loss:  0.053
Epoch   1 Batch  649/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.933, Loss:  0.065
Epoch   1 Batch  650/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.933, Loss:  0.067
Epoch   1 Batch  651/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.934, Loss:  0.061
Epoch   1 Batch  652/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.934, Loss:  0.062
Epoch   1 Batch  653/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.934, Loss:  0.066
Epoch   1 Batch  654/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.934, Loss:  0.051
Epoch   1 Batch  655/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.921, Loss:  0.076
Epoch   1 Batch  656/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.911, Loss:  0.074
Epoch   1 Batch  657/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.911, Loss:  0.054
Epoch   1 Batch  658/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.898, Loss:  0.052
Epoch   1 Batch  659/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.899, Loss:  0.070
Epoch   1 Batch  660/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.897, Loss:  0.063
Epoch   1 Batch  661/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.918, Loss:  0.056
Epoch   1 Batch  662/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.922, Loss:  0.060
Epoch   1 Batch  663/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.917, Loss:  0.057
Epoch   1 Batch  664/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.927, Loss:  0.065
Epoch   1 Batch  665/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.922, Loss:  0.047
Epoch   1 Batch  666/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.925, Loss:  0.070
Epoch   1 Batch  667/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.073
Epoch   1 Batch  668/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.919, Loss:  0.058
Epoch   1 Batch  669/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.915, Loss:  0.058
Epoch   1 Batch  670/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.920, Loss:  0.072
Epoch   1 Batch  671/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.920, Loss:  0.063
Epoch   1 Batch  672/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.917, Loss:  0.065
Epoch   1 Batch  673/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.920, Loss:  0.061
Epoch   1 Batch  674/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.921, Loss:  0.066
Epoch   1 Batch  675/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.925, Loss:  0.079
Epoch   1 Batch  676/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.912, Loss:  0.061
Epoch   1 Batch  677/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.915, Loss:  0.077
Epoch   1 Batch  678/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.915, Loss:  0.053
Epoch   1 Batch  679/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.924, Loss:  0.060
Epoch   1 Batch  680/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.922, Loss:  0.063
Epoch   1 Batch  681/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.917, Loss:  0.065
Epoch   1 Batch  682/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.922, Loss:  0.056
Epoch   1 Batch  683/1077 - Train Accuracy:  0.907, Validation Accuracy:  0.917, Loss:  0.062
Epoch   1 Batch  684/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.914, Loss:  0.064
Epoch   1 Batch  685/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.930, Loss:  0.061
Epoch   1 Batch  686/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.930, Loss:  0.061
Epoch   1 Batch  687/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.070
Epoch   1 Batch  688/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.934, Loss:  0.054
Epoch   1 Batch  689/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.934, Loss:  0.051
Epoch   1 Batch  690/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.928, Loss:  0.064
Epoch   1 Batch  691/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.919, Loss:  0.079
Epoch   1 Batch  692/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.926, Loss:  0.056
Epoch   1 Batch  693/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.913, Loss:  0.092
Epoch   1 Batch  694/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.927, Loss:  0.072
Epoch   1 Batch  695/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.922, Loss:  0.059
Epoch   1 Batch  696/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.908, Loss:  0.058
Epoch   1 Batch  697/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.905, Loss:  0.055
Epoch   1 Batch  698/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.911, Loss:  0.059
Epoch   1 Batch  699/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.914, Loss:  0.058
Epoch   1 Batch  700/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.919, Loss:  0.052
Epoch   1 Batch  701/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.920, Loss:  0.070
Epoch   1 Batch  702/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.926, Loss:  0.073
Epoch   1 Batch  703/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.925, Loss:  0.059
Epoch   1 Batch  704/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.911, Loss:  0.078
Epoch   1 Batch  705/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.926, Loss:  0.082
Epoch   1 Batch  706/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.931, Loss:  0.093
Epoch   1 Batch  707/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.936, Loss:  0.069
Epoch   1 Batch  708/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.932, Loss:  0.067
Epoch   1 Batch  709/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.938, Loss:  0.076
Epoch   1 Batch  710/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.938, Loss:  0.045
Epoch   1 Batch  711/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  0.075
Epoch   1 Batch  712/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.934, Loss:  0.050
Epoch   1 Batch  713/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.053
Epoch   1 Batch  714/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.939, Loss:  0.053
Epoch   1 Batch  715/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.933, Loss:  0.070
Epoch   1 Batch  716/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.932, Loss:  0.048
Epoch   1 Batch  717/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.929, Loss:  0.048
Epoch   1 Batch  718/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.936, Loss:  0.051
Epoch   1 Batch  719/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.940, Loss:  0.065
Epoch   1 Batch  720/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.942, Loss:  0.064
Epoch   1 Batch  721/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.936, Loss:  0.068
Epoch   1 Batch  722/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.056
Epoch   1 Batch  723/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.935, Loss:  0.065
Epoch   1 Batch  724/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.947, Loss:  0.070
Epoch   1 Batch  725/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.048
Epoch   1 Batch  726/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.932, Loss:  0.063
Epoch   1 Batch  727/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.923, Loss:  0.054
Epoch   1 Batch  728/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.924, Loss:  0.067
Epoch   1 Batch  729/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.934, Loss:  0.087
Epoch   1 Batch  730/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  0.075
Epoch   1 Batch  731/1077 - Train Accuracy:  0.908, Validation Accuracy:  0.930, Loss:  0.060
Epoch   1 Batch  732/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.934, Loss:  0.071
Epoch   1 Batch  733/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.931, Loss:  0.054
Epoch   1 Batch  734/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.933, Loss:  0.067
Epoch   1 Batch  735/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.942, Loss:  0.054
Epoch   1 Batch  736/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  0.046
Epoch   1 Batch  737/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.937, Loss:  0.076
Epoch   1 Batch  738/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.934, Loss:  0.044
Epoch   1 Batch  739/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.939, Loss:  0.063
Epoch   1 Batch  740/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.939, Loss:  0.055
Epoch   1 Batch  741/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.068
Epoch   1 Batch  742/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.930, Loss:  0.048
Epoch   1 Batch  743/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.931, Loss:  0.064
Epoch   1 Batch  744/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.921, Loss:  0.055
Epoch   1 Batch  745/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.927, Loss:  0.055
Epoch   1 Batch  746/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.928, Loss:  0.052
Epoch   1 Batch  747/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.928, Loss:  0.043
Epoch   1 Batch  748/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.928, Loss:  0.048
Epoch   1 Batch  749/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.923, Loss:  0.055
Epoch   1 Batch  750/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.922, Loss:  0.052
Epoch   1 Batch  751/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.922, Loss:  0.059
Epoch   1 Batch  752/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.927, Loss:  0.056
Epoch   1 Batch  753/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.931, Loss:  0.057
Epoch   1 Batch  754/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  0.051
Epoch   1 Batch  755/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.919, Loss:  0.061
Epoch   1 Batch  756/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.919, Loss:  0.047
Epoch   1 Batch  757/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.933, Loss:  0.049
Epoch   1 Batch  758/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.929, Loss:  0.057
Epoch   1 Batch  759/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.933, Loss:  0.057
Epoch   1 Batch  760/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.933, Loss:  0.063
Epoch   1 Batch  761/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.938, Loss:  0.057
Epoch   1 Batch  762/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.932, Loss:  0.052
Epoch   1 Batch  763/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  0.052
Epoch   1 Batch  764/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.935, Loss:  0.058
Epoch   1 Batch  765/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.924, Loss:  0.054
Epoch   1 Batch  766/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.928, Loss:  0.058
Epoch   1 Batch  767/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.917, Loss:  0.058
Epoch   1 Batch  768/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.914, Loss:  0.061
Epoch   1 Batch  769/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.908, Loss:  0.059
Epoch   1 Batch  770/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.903, Loss:  0.054
Epoch   1 Batch  771/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.922, Loss:  0.064
Epoch   1 Batch  772/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.926, Loss:  0.043
Epoch   1 Batch  773/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.942, Loss:  0.059
Epoch   1 Batch  774/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.933, Loss:  0.059
Epoch   1 Batch  775/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.924, Loss:  0.059
Epoch   1 Batch  776/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.923, Loss:  0.054
Epoch   1 Batch  777/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.922, Loss:  0.067
Epoch   1 Batch  778/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.924, Loss:  0.055
Epoch   1 Batch  779/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.911, Loss:  0.064
Epoch   1 Batch  780/1077 - Train Accuracy:  0.890, Validation Accuracy:  0.924, Loss:  0.076
Epoch   1 Batch  781/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.920, Loss:  0.042
Epoch   1 Batch  782/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.926, Loss:  0.055
Epoch   1 Batch  783/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.943, Loss:  0.071
Epoch   1 Batch  784/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.948, Loss:  0.039
Epoch   1 Batch  785/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.935, Loss:  0.060
Epoch   1 Batch  786/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.927, Loss:  0.058
Epoch   1 Batch  787/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.918, Loss:  0.053
Epoch   1 Batch  788/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.917, Loss:  0.054
Epoch   1 Batch  789/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.928, Loss:  0.061
Epoch   1 Batch  790/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.934, Loss:  0.065
Epoch   1 Batch  791/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.927, Loss:  0.074
Epoch   1 Batch  792/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.922, Loss:  0.064
Epoch   1 Batch  793/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.923, Loss:  0.063
Epoch   1 Batch  794/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.926, Loss:  0.050
Epoch   1 Batch  795/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.930, Loss:  0.065
Epoch   1 Batch  796/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.933, Loss:  0.059
Epoch   1 Batch  797/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.939, Loss:  0.052
Epoch   1 Batch  798/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.938, Loss:  0.057
Epoch   1 Batch  799/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.939, Loss:  0.085
Epoch   1 Batch  800/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.932, Loss:  0.054
Epoch   1 Batch  801/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.926, Loss:  0.062
Epoch   1 Batch  802/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.928, Loss:  0.062
Epoch   1 Batch  803/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.929, Loss:  0.065
Epoch   1 Batch  804/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.930, Loss:  0.047
Epoch   1 Batch  805/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.935, Loss:  0.057
Epoch   1 Batch  806/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.919, Loss:  0.050
Epoch   1 Batch  807/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.924, Loss:  0.045
Epoch   1 Batch  808/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.924, Loss:  0.081
Epoch   1 Batch  809/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.918, Loss:  0.075
Epoch   1 Batch  810/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.924, Loss:  0.048
Epoch   1 Batch  811/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.924, Loss:  0.056
Epoch   1 Batch  812/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.924, Loss:  0.056
Epoch   1 Batch  813/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.925, Loss:  0.056
Epoch   1 Batch  814/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.929, Loss:  0.059
Epoch   1 Batch  815/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.915, Loss:  0.060
Epoch   1 Batch  816/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.915, Loss:  0.070
Epoch   1 Batch  817/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.912, Loss:  0.065
Epoch   1 Batch  818/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.919, Loss:  0.064
Epoch   1 Batch  819/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.918, Loss:  0.073
Epoch   1 Batch  820/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.927, Loss:  0.055
Epoch   1 Batch  821/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.921, Loss:  0.066
Epoch   1 Batch  822/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.903, Loss:  0.063
Epoch   1 Batch  823/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.898, Loss:  0.062
Epoch   1 Batch  824/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.899, Loss:  0.061
Epoch   1 Batch  825/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.904, Loss:  0.042
Epoch   1 Batch  826/1077 - Train Accuracy:  0.906, Validation Accuracy:  0.923, Loss:  0.060
Epoch   1 Batch  827/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.930, Loss:  0.061
Epoch   1 Batch  828/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.928, Loss:  0.051
Epoch   1 Batch  829/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.922, Loss:  0.073
Epoch   1 Batch  830/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.911, Loss:  0.062
Epoch   1 Batch  831/1077 - Train Accuracy:  0.901, Validation Accuracy:  0.926, Loss:  0.064
Epoch   1 Batch  832/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.920, Loss:  0.052
Epoch   1 Batch  833/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.920, Loss:  0.056
Epoch   1 Batch  834/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.937, Loss:  0.070
Epoch   1 Batch  835/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.932, Loss:  0.057
Epoch   1 Batch  836/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.928, Loss:  0.059
Epoch   1 Batch  837/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.929, Loss:  0.071
Epoch   1 Batch  838/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.934, Loss:  0.047
Epoch   1 Batch  839/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.935, Loss:  0.047
Epoch   1 Batch  840/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.938, Loss:  0.048
Epoch   1 Batch  841/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.941, Loss:  0.067
Epoch   1 Batch  842/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.939, Loss:  0.054
Epoch   1 Batch  843/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  0.047
Epoch   1 Batch  844/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.940, Loss:  0.052
Epoch   1 Batch  845/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.935, Loss:  0.047
Epoch   1 Batch  846/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.930, Loss:  0.065
Epoch   1 Batch  847/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.934, Loss:  0.068
Epoch   1 Batch  848/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.051
Epoch   1 Batch  849/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.043
Epoch   1 Batch  850/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.949, Loss:  0.082
Epoch   1 Batch  851/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.950, Loss:  0.070
Epoch   1 Batch  852/1077 - Train Accuracy:  0.900, Validation Accuracy:  0.954, Loss:  0.076
Epoch   1 Batch  853/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  0.050
Epoch   1 Batch  854/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.951, Loss:  0.062
Epoch   1 Batch  855/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.949, Loss:  0.057
Epoch   1 Batch  856/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.943, Loss:  0.066
Epoch   1 Batch  857/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.936, Loss:  0.048
Epoch   1 Batch  858/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.938, Loss:  0.051
Epoch   1 Batch  859/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.937, Loss:  0.067
Epoch   1 Batch  860/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.934, Loss:  0.059
Epoch   1 Batch  861/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.930, Loss:  0.055
Epoch   1 Batch  862/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.936, Loss:  0.057
Epoch   1 Batch  863/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  0.056
Epoch   1 Batch  864/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.938, Loss:  0.053
Epoch   1 Batch  865/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.943, Loss:  0.051
Epoch   1 Batch  866/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.062
Epoch   1 Batch  867/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.939, Loss:  0.085
Epoch   1 Batch  868/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.938, Loss:  0.063
Epoch   1 Batch  869/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.936, Loss:  0.056
Epoch   1 Batch  870/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.928, Loss:  0.059
Epoch   1 Batch  871/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.933, Loss:  0.047
Epoch   1 Batch  872/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.936, Loss:  0.061
Epoch   1 Batch  873/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.935, Loss:  0.056
Epoch   1 Batch  874/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.939, Loss:  0.062
Epoch   1 Batch  875/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.927, Loss:  0.064
Epoch   1 Batch  876/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.925, Loss:  0.045
Epoch   1 Batch  877/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.919, Loss:  0.044
Epoch   1 Batch  878/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.919, Loss:  0.049
Epoch   1 Batch  879/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.920, Loss:  0.051
Epoch   1 Batch  880/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.931, Loss:  0.058
Epoch   1 Batch  881/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.940, Loss:  0.064
Epoch   1 Batch  882/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.930, Loss:  0.072
Epoch   1 Batch  883/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.930, Loss:  0.087
Epoch   1 Batch  884/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.941, Loss:  0.051
Epoch   1 Batch  885/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.952, Loss:  0.038
Epoch   1 Batch  886/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.942, Loss:  0.049
Epoch   1 Batch  887/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.946, Loss:  0.072
Epoch   1 Batch  888/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.941, Loss:  0.049
Epoch   1 Batch  889/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.932, Loss:  0.054
Epoch   1 Batch  890/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.933, Loss:  0.052
Epoch   1 Batch  891/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.929, Loss:  0.040
Epoch   1 Batch  892/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.938, Loss:  0.050
Epoch   1 Batch  893/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.936, Loss:  0.053
Epoch   1 Batch  894/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.946, Loss:  0.053
Epoch   1 Batch  895/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.944, Loss:  0.058
Epoch   1 Batch  896/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.944, Loss:  0.050
Epoch   1 Batch  897/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.946, Loss:  0.049
Epoch   1 Batch  898/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.946, Loss:  0.050
Epoch   1 Batch  899/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  0.054
Epoch   1 Batch  900/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.941, Loss:  0.064
Epoch   1 Batch  901/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.936, Loss:  0.068
Epoch   1 Batch  902/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.932, Loss:  0.067
Epoch   1 Batch  903/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.914, Loss:  0.064
Epoch   1 Batch  904/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.911, Loss:  0.050
Epoch   1 Batch  905/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.911, Loss:  0.042
Epoch   1 Batch  906/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.913, Loss:  0.059
Epoch   1 Batch  907/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.922, Loss:  0.055
Epoch   1 Batch  908/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.937, Loss:  0.069
Epoch   1 Batch  909/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.949, Loss:  0.061
Epoch   1 Batch  910/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.945, Loss:  0.055
Epoch   1 Batch  911/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.940, Loss:  0.066
Epoch   1 Batch  912/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.938, Loss:  0.057
Epoch   1 Batch  913/1077 - Train Accuracy:  0.915, Validation Accuracy:  0.943, Loss:  0.077
Epoch   1 Batch  914/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.934, Loss:  0.087
Epoch   1 Batch  915/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.938, Loss:  0.049
Epoch   1 Batch  916/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.942, Loss:  0.070
Epoch   1 Batch  917/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.930, Loss:  0.051
Epoch   1 Batch  918/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.932, Loss:  0.045
Epoch   1 Batch  919/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.936, Loss:  0.041
Epoch   1 Batch  920/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.048
Epoch   1 Batch  921/1077 - Train Accuracy:  0.902, Validation Accuracy:  0.934, Loss:  0.062
Epoch   1 Batch  922/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.936, Loss:  0.058
Epoch   1 Batch  923/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.930, Loss:  0.038
Epoch   1 Batch  924/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.931, Loss:  0.078
Epoch   1 Batch  925/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.918, Loss:  0.054
Epoch   1 Batch  926/1077 - Train Accuracy:  0.909, Validation Accuracy:  0.914, Loss:  0.057
Epoch   1 Batch  927/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.918, Loss:  0.055
Epoch   1 Batch  928/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.904, Loss:  0.057
Epoch   1 Batch  929/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.921, Loss:  0.050
Epoch   1 Batch  930/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.933, Loss:  0.054
Epoch   1 Batch  931/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.932, Loss:  0.044
Epoch   1 Batch  932/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.938, Loss:  0.058
Epoch   1 Batch  933/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.933, Loss:  0.049
Epoch   1 Batch  934/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.929, Loss:  0.049
Epoch   1 Batch  935/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.935, Loss:  0.052
Epoch   1 Batch  936/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.932, Loss:  0.062
Epoch   1 Batch  937/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.932, Loss:  0.051
Epoch   1 Batch  938/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  0.065
Epoch   1 Batch  939/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.928, Loss:  0.061
Epoch   1 Batch  940/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.924, Loss:  0.048
Epoch   1 Batch  941/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.924, Loss:  0.045
Epoch   1 Batch  942/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.924, Loss:  0.053
Epoch   1 Batch  943/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.933, Loss:  0.055
Epoch   1 Batch  944/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.048
Epoch   1 Batch  945/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.930, Loss:  0.048
Epoch   1 Batch  946/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.915, Loss:  0.049
Epoch   1 Batch  947/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.917, Loss:  0.055
Epoch   1 Batch  948/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.914, Loss:  0.049
Epoch   1 Batch  949/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.914, Loss:  0.043
Epoch   1 Batch  950/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.914, Loss:  0.049
Epoch   1 Batch  951/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.919, Loss:  0.063
Epoch   1 Batch  952/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.921, Loss:  0.040
Epoch   1 Batch  953/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.919, Loss:  0.051
Epoch   1 Batch  954/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.917, Loss:  0.056
Epoch   1 Batch  955/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.921, Loss:  0.067
Epoch   1 Batch  956/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.918, Loss:  0.064
Epoch   1 Batch  957/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.918, Loss:  0.039
Epoch   1 Batch  958/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.901, Loss:  0.050
Epoch   1 Batch  959/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.911, Loss:  0.055
Epoch   1 Batch  960/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.920, Loss:  0.055
Epoch   1 Batch  961/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.929, Loss:  0.043
Epoch   1 Batch  962/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.930, Loss:  0.060
Epoch   1 Batch  963/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.941, Loss:  0.070
Epoch   1 Batch  964/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.936, Loss:  0.042
Epoch   1 Batch  965/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.927, Loss:  0.055
Epoch   1 Batch  966/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.927, Loss:  0.049
Epoch   1 Batch  967/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.934, Loss:  0.058
Epoch   1 Batch  968/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.925, Loss:  0.067
Epoch   1 Batch  969/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.927, Loss:  0.064
Epoch   1 Batch  970/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.924, Loss:  0.064
Epoch   1 Batch  971/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.924, Loss:  0.070
Epoch   1 Batch  972/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.920, Loss:  0.053
Epoch   1 Batch  973/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.929, Loss:  0.044
Epoch   1 Batch  974/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.934, Loss:  0.041
Epoch   1 Batch  975/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.051
Epoch   1 Batch  976/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.944, Loss:  0.042
Epoch   1 Batch  977/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  0.041
Epoch   1 Batch  978/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.052
Epoch   1 Batch  979/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.935, Loss:  0.055
Epoch   1 Batch  980/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.936, Loss:  0.052
Epoch   1 Batch  981/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.934, Loss:  0.050
Epoch   1 Batch  982/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.936, Loss:  0.050
Epoch   1 Batch  983/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.941, Loss:  0.046
Epoch   1 Batch  984/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.940, Loss:  0.066
Epoch   1 Batch  985/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.043
Epoch   1 Batch  986/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.943, Loss:  0.057
Epoch   1 Batch  987/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.941, Loss:  0.046
Epoch   1 Batch  988/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.942, Loss:  0.066
Epoch   1 Batch  989/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.943, Loss:  0.053
Epoch   1 Batch  990/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  0.055
Epoch   1 Batch  991/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.940, Loss:  0.056
Epoch   1 Batch  992/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.939, Loss:  0.058
Epoch   1 Batch  993/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.938, Loss:  0.041
Epoch   1 Batch  994/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.930, Loss:  0.052
Epoch   1 Batch  995/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.921, Loss:  0.056
Epoch   1 Batch  996/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.927, Loss:  0.048
Epoch   1 Batch  997/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.927, Loss:  0.053
Epoch   1 Batch  998/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.933, Loss:  0.045
Epoch   1 Batch  999/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.932, Loss:  0.059
Epoch   1 Batch 1000/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.938, Loss:  0.049
Epoch   1 Batch 1001/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.932, Loss:  0.045
Epoch   1 Batch 1002/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.930, Loss:  0.034
Epoch   1 Batch 1003/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.926, Loss:  0.053
Epoch   1 Batch 1004/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.931, Loss:  0.060
Epoch   1 Batch 1005/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.934, Loss:  0.046
Epoch   1 Batch 1006/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.938, Loss:  0.042
Epoch   1 Batch 1007/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.938, Loss:  0.040
Epoch   1 Batch 1008/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  0.069
Epoch   1 Batch 1009/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.946, Loss:  0.036
Epoch   1 Batch 1010/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.042
Epoch   1 Batch 1011/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.943, Loss:  0.041
Epoch   1 Batch 1012/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  0.036
Epoch   1 Batch 1013/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.942, Loss:  0.032
Epoch   1 Batch 1014/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.935, Loss:  0.046
Epoch   1 Batch 1015/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.941, Loss:  0.065
Epoch   1 Batch 1016/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.939, Loss:  0.045
Epoch   1 Batch 1017/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.939, Loss:  0.052
Epoch   1 Batch 1018/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.940, Loss:  0.051
Epoch   1 Batch 1019/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.949, Loss:  0.055
Epoch   1 Batch 1020/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.950, Loss:  0.040
Epoch   1 Batch 1021/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  0.048
Epoch   1 Batch 1022/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.945, Loss:  0.049
Epoch   1 Batch 1023/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.949, Loss:  0.050
Epoch   1 Batch 1024/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.945, Loss:  0.055
Epoch   1 Batch 1025/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.950, Loss:  0.050
Epoch   1 Batch 1026/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.945, Loss:  0.048
Epoch   1 Batch 1027/1077 - Train Accuracy:  0.911, Validation Accuracy:  0.937, Loss:  0.050
Epoch   1 Batch 1028/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.941, Loss:  0.047
Epoch   1 Batch 1029/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.945, Loss:  0.046
Epoch   1 Batch 1030/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  0.046
Epoch   1 Batch 1031/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.947, Loss:  0.053
Epoch   1 Batch 1032/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.947, Loss:  0.073
Epoch   1 Batch 1033/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.935, Loss:  0.065
Epoch   1 Batch 1034/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  0.051
Epoch   1 Batch 1035/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.917, Loss:  0.039
Epoch   1 Batch 1036/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.920, Loss:  0.057
Epoch   1 Batch 1037/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.925, Loss:  0.051
Epoch   1 Batch 1038/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.926, Loss:  0.065
Epoch   1 Batch 1039/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.924, Loss:  0.048
Epoch   1 Batch 1040/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.923, Loss:  0.060
Epoch   1 Batch 1041/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.923, Loss:  0.048
Epoch   1 Batch 1042/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.930, Loss:  0.049
Epoch   1 Batch 1043/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.941, Loss:  0.059
Epoch   1 Batch 1044/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.059
Epoch   1 Batch 1045/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.948, Loss:  0.050
Epoch   1 Batch 1046/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.935, Loss:  0.036
Epoch   1 Batch 1047/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.930, Loss:  0.049
Epoch   1 Batch 1048/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.930, Loss:  0.050
Epoch   1 Batch 1049/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.938, Loss:  0.055
Epoch   1 Batch 1050/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.946, Loss:  0.038
Epoch   1 Batch 1051/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.946, Loss:  0.049
Epoch   1 Batch 1052/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  0.048
Epoch   1 Batch 1053/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.935, Loss:  0.053
Epoch   1 Batch 1054/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.944, Loss:  0.052
Epoch   1 Batch 1055/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  0.052
Epoch   1 Batch 1056/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.933, Loss:  0.047
Epoch   1 Batch 1057/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.920, Loss:  0.051
Epoch   1 Batch 1058/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.915, Loss:  0.049
Epoch   1 Batch 1059/1077 - Train Accuracy:  0.898, Validation Accuracy:  0.920, Loss:  0.070
Epoch   1 Batch 1060/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.912, Loss:  0.041
Epoch   1 Batch 1061/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.925, Loss:  0.057
Epoch   1 Batch 1062/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.929, Loss:  0.048
Epoch   1 Batch 1063/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.921, Loss:  0.057
Epoch   1 Batch 1064/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.925, Loss:  0.056
Epoch   1 Batch 1065/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.922, Loss:  0.047
Epoch   1 Batch 1066/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.931, Loss:  0.040
Epoch   1 Batch 1067/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.935, Loss:  0.057
Epoch   1 Batch 1068/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.931, Loss:  0.038
Epoch   1 Batch 1069/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.933, Loss:  0.033
Epoch   1 Batch 1070/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.927, Loss:  0.037
Epoch   1 Batch 1071/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.931, Loss:  0.044
Epoch   1 Batch 1072/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.924, Loss:  0.045
Epoch   1 Batch 1073/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.929, Loss:  0.055
Epoch   1 Batch 1074/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.930, Loss:  0.067
Epoch   1 Batch 1075/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.053
Epoch   2 Batch    0/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.044
Epoch   2 Batch    1/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.932, Loss:  0.034
Epoch   2 Batch    2/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.931, Loss:  0.047
Epoch   2 Batch    3/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.936, Loss:  0.050
Epoch   2 Batch    4/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.929, Loss:  0.046
Epoch   2 Batch    5/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.925, Loss:  0.074
Epoch   2 Batch    6/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.926, Loss:  0.044
Epoch   2 Batch    7/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.038
Epoch   2 Batch    8/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  0.048
Epoch   2 Batch    9/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.046
Epoch   2 Batch   10/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.936, Loss:  0.049
Epoch   2 Batch   11/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.940, Loss:  0.062
Epoch   2 Batch   12/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.936, Loss:  0.046
Epoch   2 Batch   13/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.928, Loss:  0.056
Epoch   2 Batch   14/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.932, Loss:  0.038
Epoch   2 Batch   15/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.929, Loss:  0.039
Epoch   2 Batch   16/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.933, Loss:  0.060
Epoch   2 Batch   17/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.940, Loss:  0.043
Epoch   2 Batch   18/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  0.053
Epoch   2 Batch   19/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.934, Loss:  0.050
Epoch   2 Batch   20/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.935, Loss:  0.038
Epoch   2 Batch   21/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.940, Loss:  0.044
Epoch   2 Batch   22/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.944, Loss:  0.053
Epoch   2 Batch   23/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.944, Loss:  0.047
Epoch   2 Batch   24/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  0.051
Epoch   2 Batch   25/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.946, Loss:  0.034
Epoch   2 Batch   26/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.943, Loss:  0.055
Epoch   2 Batch   27/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.044
Epoch   2 Batch   28/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  0.051
Epoch   2 Batch   29/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.046
Epoch   2 Batch   30/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  0.043
Epoch   2 Batch   31/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.046
Epoch   2 Batch   32/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.939, Loss:  0.043
Epoch   2 Batch   33/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.939, Loss:  0.039
Epoch   2 Batch   34/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  0.044
Epoch   2 Batch   35/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.938, Loss:  0.048
Epoch   2 Batch   36/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.938, Loss:  0.044
Epoch   2 Batch   37/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.051
Epoch   2 Batch   38/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  0.062
Epoch   2 Batch   39/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.941, Loss:  0.061
Epoch   2 Batch   40/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  0.040
Epoch   2 Batch   41/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.946, Loss:  0.042
Epoch   2 Batch   42/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.946, Loss:  0.063
Epoch   2 Batch   43/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.029
Epoch   2 Batch   44/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.940, Loss:  0.042
Epoch   2 Batch   45/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.936, Loss:  0.047
Epoch   2 Batch   46/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.939, Loss:  0.047
Epoch   2 Batch   47/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.936, Loss:  0.050
Epoch   2 Batch   48/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.935, Loss:  0.061
Epoch   2 Batch   49/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.934, Loss:  0.052
Epoch   2 Batch   50/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.939, Loss:  0.044
Epoch   2 Batch   51/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.945, Loss:  0.050
Epoch   2 Batch   52/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.952, Loss:  0.053
Epoch   2 Batch   53/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.942, Loss:  0.044
Epoch   2 Batch   54/1077 - Train Accuracy:  0.905, Validation Accuracy:  0.942, Loss:  0.067
Epoch   2 Batch   55/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.942, Loss:  0.040
Epoch   2 Batch   56/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.940, Loss:  0.038
Epoch   2 Batch   57/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.051
Epoch   2 Batch   58/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.939, Loss:  0.049
Epoch   2 Batch   59/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.934, Loss:  0.046
Epoch   2 Batch   60/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.930, Loss:  0.039
Epoch   2 Batch   61/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.936, Loss:  0.058
Epoch   2 Batch   62/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.928, Loss:  0.057
Epoch   2 Batch   63/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.939, Loss:  0.038
Epoch   2 Batch   64/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  0.046
Epoch   2 Batch   65/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  0.045
Epoch   2 Batch   66/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.945, Loss:  0.033
Epoch   2 Batch   67/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.945, Loss:  0.046
Epoch   2 Batch   68/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.949, Loss:  0.057
Epoch   2 Batch   69/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.061
Epoch   2 Batch   70/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.950, Loss:  0.045
Epoch   2 Batch   71/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.941, Loss:  0.032
Epoch   2 Batch   72/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.941, Loss:  0.040
Epoch   2 Batch   73/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  0.049
Epoch   2 Batch   74/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.941, Loss:  0.044
Epoch   2 Batch   75/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  0.052
Epoch   2 Batch   76/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.037
Epoch   2 Batch   77/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.934, Loss:  0.049
Epoch   2 Batch   78/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.935, Loss:  0.046
Epoch   2 Batch   79/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.931, Loss:  0.051
Epoch   2 Batch   80/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.932, Loss:  0.040
Epoch   2 Batch   81/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.940, Loss:  0.045
Epoch   2 Batch   82/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.940, Loss:  0.037
Epoch   2 Batch   83/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.934, Loss:  0.041
Epoch   2 Batch   84/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.045
Epoch   2 Batch   85/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.038
Epoch   2 Batch   86/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.937, Loss:  0.048
Epoch   2 Batch   87/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.935, Loss:  0.060
Epoch   2 Batch   88/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.057
Epoch   2 Batch   89/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.944, Loss:  0.048
Epoch   2 Batch   90/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.944, Loss:  0.055
Epoch   2 Batch   91/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  0.041
Epoch   2 Batch   92/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.943, Loss:  0.045
Epoch   2 Batch   93/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  0.044
Epoch   2 Batch   94/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.040
Epoch   2 Batch   95/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  0.053
Epoch   2 Batch   96/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.937, Loss:  0.051
Epoch   2 Batch   97/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.934, Loss:  0.047
Epoch   2 Batch   98/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.928, Loss:  0.053
Epoch   2 Batch   99/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.938, Loss:  0.041
Epoch   2 Batch  100/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  0.047
Epoch   2 Batch  101/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.945, Loss:  0.046
Epoch   2 Batch  102/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.041
Epoch   2 Batch  103/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.055
Epoch   2 Batch  104/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.054
Epoch   2 Batch  105/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.929, Loss:  0.040
Epoch   2 Batch  106/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.929, Loss:  0.059
Epoch   2 Batch  107/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.928, Loss:  0.046
Epoch   2 Batch  108/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.924, Loss:  0.044
Epoch   2 Batch  109/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.923, Loss:  0.046
Epoch   2 Batch  110/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.930, Loss:  0.036
Epoch   2 Batch  111/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.934, Loss:  0.041
Epoch   2 Batch  112/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.942, Loss:  0.045
Epoch   2 Batch  113/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.942, Loss:  0.047
Epoch   2 Batch  114/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  0.042
Epoch   2 Batch  115/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.941, Loss:  0.054
Epoch   2 Batch  116/1077 - Train Accuracy:  0.892, Validation Accuracy:  0.941, Loss:  0.054
Epoch   2 Batch  117/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.941, Loss:  0.042
Epoch   2 Batch  118/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.940, Loss:  0.046
Epoch   2 Batch  119/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.935, Loss:  0.046
Epoch   2 Batch  120/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.049
Epoch   2 Batch  121/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  0.046
Epoch   2 Batch  122/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  123/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.032
Epoch   2 Batch  124/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.950, Loss:  0.056
Epoch   2 Batch  125/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.944, Loss:  0.060
Epoch   2 Batch  126/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.040
Epoch   2 Batch  127/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  0.048
Epoch   2 Batch  128/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  0.046
Epoch   2 Batch  129/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.944, Loss:  0.051
Epoch   2 Batch  130/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.931, Loss:  0.035
Epoch   2 Batch  131/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.922, Loss:  0.050
Epoch   2 Batch  132/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.921, Loss:  0.050
Epoch   2 Batch  133/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.919, Loss:  0.036
Epoch   2 Batch  134/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.919, Loss:  0.052
Epoch   2 Batch  135/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.925, Loss:  0.040
Epoch   2 Batch  136/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.929, Loss:  0.045
Epoch   2 Batch  137/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.934, Loss:  0.031
Epoch   2 Batch  138/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.938, Loss:  0.050
Epoch   2 Batch  139/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  0.050
Epoch   2 Batch  140/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.929, Loss:  0.047
Epoch   2 Batch  141/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.938, Loss:  0.047
Epoch   2 Batch  142/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.938, Loss:  0.042
Epoch   2 Batch  143/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.938, Loss:  0.054
Epoch   2 Batch  144/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.934, Loss:  0.052
Epoch   2 Batch  145/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.923, Loss:  0.042
Epoch   2 Batch  146/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.925, Loss:  0.067
Epoch   2 Batch  147/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.928, Loss:  0.042
Epoch   2 Batch  148/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.936, Loss:  0.048
Epoch   2 Batch  149/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.936, Loss:  0.048
Epoch   2 Batch  150/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.936, Loss:  0.050
Epoch   2 Batch  151/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.936, Loss:  0.039
Epoch   2 Batch  152/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.938, Loss:  0.055
Epoch   2 Batch  153/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.928, Loss:  0.061
Epoch   2 Batch  154/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.930, Loss:  0.045
Epoch   2 Batch  155/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.935, Loss:  0.051
Epoch   2 Batch  156/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.931, Loss:  0.038
Epoch   2 Batch  157/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.940, Loss:  0.041
Epoch   2 Batch  158/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.939, Loss:  0.059
Epoch   2 Batch  159/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.037
Epoch   2 Batch  160/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.942, Loss:  0.037
Epoch   2 Batch  161/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.937, Loss:  0.036
Epoch   2 Batch  162/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.049
Epoch   2 Batch  163/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  0.049
Epoch   2 Batch  164/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.938, Loss:  0.042
Epoch   2 Batch  165/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.948, Loss:  0.036
Epoch   2 Batch  166/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.943, Loss:  0.049
Epoch   2 Batch  167/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.946, Loss:  0.042
Epoch   2 Batch  168/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.051
Epoch   2 Batch  169/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.938, Loss:  0.051
Epoch   2 Batch  170/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.938, Loss:  0.045
Epoch   2 Batch  171/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.940, Loss:  0.046
Epoch   2 Batch  172/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.940, Loss:  0.041
Epoch   2 Batch  173/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.049
Epoch   2 Batch  174/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.930, Loss:  0.034
Epoch   2 Batch  175/1077 - Train Accuracy:  0.924, Validation Accuracy:  0.931, Loss:  0.049
Epoch   2 Batch  176/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.940, Loss:  0.045
Epoch   2 Batch  177/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.941, Loss:  0.044
Epoch   2 Batch  178/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.948, Loss:  0.045
Epoch   2 Batch  179/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.044
Epoch   2 Batch  180/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.934, Loss:  0.038
Epoch   2 Batch  181/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.939, Loss:  0.055
Epoch   2 Batch  182/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.932, Loss:  0.048
Epoch   2 Batch  183/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.921, Loss:  0.044
Epoch   2 Batch  184/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.923, Loss:  0.043
Epoch   2 Batch  185/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.919, Loss:  0.049
Epoch   2 Batch  186/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.928, Loss:  0.049
Epoch   2 Batch  187/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.936, Loss:  0.029
Epoch   2 Batch  188/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.942, Loss:  0.049
Epoch   2 Batch  189/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.931, Loss:  0.041
Epoch   2 Batch  190/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.941, Loss:  0.037
Epoch   2 Batch  191/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.032
Epoch   2 Batch  192/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.053
Epoch   2 Batch  193/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  194/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.034
Epoch   2 Batch  195/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.951, Loss:  0.036
Epoch   2 Batch  196/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  0.033
Epoch   2 Batch  197/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.042
Epoch   2 Batch  198/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  0.043
Epoch   2 Batch  199/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.948, Loss:  0.041
Epoch   2 Batch  200/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.952, Loss:  0.043
Epoch   2 Batch  201/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.955, Loss:  0.034
Epoch   2 Batch  202/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  0.037
Epoch   2 Batch  203/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.950, Loss:  0.043
Epoch   2 Batch  204/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.945, Loss:  0.057
Epoch   2 Batch  205/1077 - Train Accuracy:  0.904, Validation Accuracy:  0.945, Loss:  0.058
Epoch   2 Batch  206/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.956, Loss:  0.040
Epoch   2 Batch  207/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.960, Loss:  0.041
Epoch   2 Batch  208/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.955, Loss:  0.045
Epoch   2 Batch  209/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.951, Loss:  0.032
Epoch   2 Batch  210/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  0.048
Epoch   2 Batch  211/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.951, Loss:  0.042
Epoch   2 Batch  212/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.033
Epoch   2 Batch  213/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.951, Loss:  0.033
Epoch   2 Batch  214/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.942, Loss:  0.038
Epoch   2 Batch  215/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.942, Loss:  0.043
Epoch   2 Batch  216/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.042
Epoch   2 Batch  217/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  0.037
Epoch   2 Batch  218/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.942, Loss:  0.056
Epoch   2 Batch  219/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.036
Epoch   2 Batch  220/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  0.043
Epoch   2 Batch  221/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  0.044
Epoch   2 Batch  222/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.960, Loss:  0.045
Epoch   2 Batch  223/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.955, Loss:  0.035
Epoch   2 Batch  224/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.957, Loss:  0.043
Epoch   2 Batch  225/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.961, Loss:  0.059
Epoch   2 Batch  226/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  0.037
Epoch   2 Batch  227/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.946, Loss:  0.062
Epoch   2 Batch  228/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.941, Loss:  0.035
Epoch   2 Batch  229/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.930, Loss:  0.050
Epoch   2 Batch  230/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.928, Loss:  0.042
Epoch   2 Batch  231/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.936, Loss:  0.044
Epoch   2 Batch  232/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.931, Loss:  0.039
Epoch   2 Batch  233/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.065
Epoch   2 Batch  234/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.944, Loss:  0.048
Epoch   2 Batch  235/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.946, Loss:  0.048
Epoch   2 Batch  236/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.940, Loss:  0.053
Epoch   2 Batch  237/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.040
Epoch   2 Batch  238/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.935, Loss:  0.042
Epoch   2 Batch  239/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.940, Loss:  0.033
Epoch   2 Batch  240/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.936, Loss:  0.038
Epoch   2 Batch  241/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.928, Loss:  0.029
Epoch   2 Batch  242/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.928, Loss:  0.029
Epoch   2 Batch  243/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.929, Loss:  0.047
Epoch   2 Batch  244/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  0.041
Epoch   2 Batch  245/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.943, Loss:  0.037
Epoch   2 Batch  246/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.041
Epoch   2 Batch  247/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.946, Loss:  0.045
Epoch   2 Batch  248/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.951, Loss:  0.042
Epoch   2 Batch  249/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  0.043
Epoch   2 Batch  250/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.943, Loss:  0.040
Epoch   2 Batch  251/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.946, Loss:  0.058
Epoch   2 Batch  252/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.046
Epoch   2 Batch  253/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.944, Loss:  0.051
Epoch   2 Batch  254/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  0.050
Epoch   2 Batch  255/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.944, Loss:  0.045
Epoch   2 Batch  256/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.944, Loss:  0.060
Epoch   2 Batch  257/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.041
Epoch   2 Batch  258/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.939, Loss:  0.042
Epoch   2 Batch  259/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.940, Loss:  0.036
Epoch   2 Batch  260/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.939, Loss:  0.036
Epoch   2 Batch  261/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.941, Loss:  0.042
Epoch   2 Batch  262/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.934, Loss:  0.035
Epoch   2 Batch  263/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.931, Loss:  0.031
Epoch   2 Batch  264/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.932, Loss:  0.049
Epoch   2 Batch  265/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.932, Loss:  0.042
Epoch   2 Batch  266/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  0.046
Epoch   2 Batch  267/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.940, Loss:  0.038
Epoch   2 Batch  268/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.940, Loss:  0.052
Epoch   2 Batch  269/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.931, Loss:  0.058
Epoch   2 Batch  270/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.933, Loss:  0.046
Epoch   2 Batch  271/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.929, Loss:  0.037
Epoch   2 Batch  272/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.922, Loss:  0.062
Epoch   2 Batch  273/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.924, Loss:  0.039
Epoch   2 Batch  274/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.925, Loss:  0.043
Epoch   2 Batch  275/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.930, Loss:  0.050
Epoch   2 Batch  276/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.923, Loss:  0.061
Epoch   2 Batch  277/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.941, Loss:  0.033
Epoch   2 Batch  278/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.938, Loss:  0.057
Epoch   2 Batch  279/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  0.047
Epoch   2 Batch  280/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.945, Loss:  0.060
Epoch   2 Batch  281/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.941, Loss:  0.049
Epoch   2 Batch  282/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.935, Loss:  0.058
Epoch   2 Batch  283/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.937, Loss:  0.048
Epoch   2 Batch  284/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.046
Epoch   2 Batch  285/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.936, Loss:  0.042
Epoch   2 Batch  286/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.932, Loss:  0.040
Epoch   2 Batch  287/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.932, Loss:  0.037
Epoch   2 Batch  288/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.933, Loss:  0.047
Epoch   2 Batch  289/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.933, Loss:  0.049
Epoch   2 Batch  290/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.932, Loss:  0.064
Epoch   2 Batch  291/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.933, Loss:  0.060
Epoch   2 Batch  292/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.935, Loss:  0.041
Epoch   2 Batch  293/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.931, Loss:  0.040
Epoch   2 Batch  294/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.925, Loss:  0.043
Epoch   2 Batch  295/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.940, Loss:  0.049
Epoch   2 Batch  296/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.938, Loss:  0.045
Epoch   2 Batch  297/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.938, Loss:  0.054
Epoch   2 Batch  298/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.938, Loss:  0.055
Epoch   2 Batch  299/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.944, Loss:  0.038
Epoch   2 Batch  300/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  0.035
Epoch   2 Batch  301/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.940, Loss:  0.037
Epoch   2 Batch  302/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.938, Loss:  0.033
Epoch   2 Batch  303/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.940, Loss:  0.051
Epoch   2 Batch  304/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.945, Loss:  0.043
Epoch   2 Batch  305/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.034
Epoch   2 Batch  306/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.954, Loss:  0.050
Epoch   2 Batch  307/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.953, Loss:  0.042
Epoch   2 Batch  308/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.955, Loss:  0.052
Epoch   2 Batch  309/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.950, Loss:  0.031
Epoch   2 Batch  310/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.941, Loss:  0.039
Epoch   2 Batch  311/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.941, Loss:  0.035
Epoch   2 Batch  312/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.936, Loss:  0.056
Epoch   2 Batch  313/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.942, Loss:  0.031
Epoch   2 Batch  314/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  0.043
Epoch   2 Batch  315/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.037
Epoch   2 Batch  316/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  0.039
Epoch   2 Batch  317/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  0.054
Epoch   2 Batch  318/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.036
Epoch   2 Batch  319/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.952, Loss:  0.049
Epoch   2 Batch  320/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.952, Loss:  0.048
Epoch   2 Batch  321/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.953, Loss:  0.031
Epoch   2 Batch  322/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.947, Loss:  0.041
Epoch   2 Batch  323/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.038
Epoch   2 Batch  324/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.944, Loss:  0.040
Epoch   2 Batch  325/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  0.042
Epoch   2 Batch  326/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.951, Loss:  0.043
Epoch   2 Batch  327/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.045
Epoch   2 Batch  328/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.955, Loss:  0.050
Epoch   2 Batch  329/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.047
Epoch   2 Batch  330/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.942, Loss:  0.045
Epoch   2 Batch  331/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.947, Loss:  0.046
Epoch   2 Batch  332/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.932, Loss:  0.031
Epoch   2 Batch  333/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.931, Loss:  0.034
Epoch   2 Batch  334/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.933, Loss:  0.041
Epoch   2 Batch  335/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.938, Loss:  0.042
Epoch   2 Batch  336/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.946, Loss:  0.055
Epoch   2 Batch  337/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.947, Loss:  0.052
Epoch   2 Batch  338/1077 - Train Accuracy:  0.896, Validation Accuracy:  0.952, Loss:  0.060
Epoch   2 Batch  339/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.941, Loss:  0.037
Epoch   2 Batch  340/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.939, Loss:  0.039
Epoch   2 Batch  341/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.940, Loss:  0.055
Epoch   2 Batch  342/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.938, Loss:  0.035
Epoch   2 Batch  343/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.925, Loss:  0.046
Epoch   2 Batch  344/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.932, Loss:  0.036
Epoch   2 Batch  345/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.930, Loss:  0.032
Epoch   2 Batch  346/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.919, Loss:  0.047
Epoch   2 Batch  347/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.913, Loss:  0.032
Epoch   2 Batch  348/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.913, Loss:  0.035
Epoch   2 Batch  349/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.924, Loss:  0.039
Epoch   2 Batch  350/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.932, Loss:  0.041
Epoch   2 Batch  351/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  0.042
Epoch   2 Batch  352/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.936, Loss:  0.030
Epoch   2 Batch  353/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.042
Epoch   2 Batch  354/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.947, Loss:  0.051
Epoch   2 Batch  355/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.037
Epoch   2 Batch  356/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  0.047
Epoch   2 Batch  357/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.941, Loss:  0.043
Epoch   2 Batch  358/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.937, Loss:  0.055
Epoch   2 Batch  359/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.937, Loss:  0.039
Epoch   2 Batch  360/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.937, Loss:  0.034
Epoch   2 Batch  361/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.932, Loss:  0.041
Epoch   2 Batch  362/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.937, Loss:  0.052
Epoch   2 Batch  363/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.943, Loss:  0.044
Epoch   2 Batch  364/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.939, Loss:  0.049
Epoch   2 Batch  365/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  0.032
Epoch   2 Batch  366/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.035
Epoch   2 Batch  367/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.945, Loss:  0.027
Epoch   2 Batch  368/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  0.036
Epoch   2 Batch  369/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.945, Loss:  0.040
Epoch   2 Batch  370/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  0.042
Epoch   2 Batch  371/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.036
Epoch   2 Batch  372/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.941, Loss:  0.028
Epoch   2 Batch  373/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.937, Loss:  0.030
Epoch   2 Batch  374/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.944, Loss:  0.046
Epoch   2 Batch  375/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.045
Epoch   2 Batch  376/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.040
Epoch   2 Batch  377/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  0.039
Epoch   2 Batch  378/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.030
Epoch   2 Batch  379/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.948, Loss:  0.055
Epoch   2 Batch  380/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.946, Loss:  0.037
Epoch   2 Batch  381/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.939, Loss:  0.053
Epoch   2 Batch  382/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.935, Loss:  0.062
Epoch   2 Batch  383/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.935, Loss:  0.044
Epoch   2 Batch  384/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.945, Loss:  0.037
Epoch   2 Batch  385/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.037
Epoch   2 Batch  386/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  0.039
Epoch   2 Batch  387/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  0.042
Epoch   2 Batch  388/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.948, Loss:  0.037
Epoch   2 Batch  389/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.942, Loss:  0.036
Epoch   2 Batch  390/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.947, Loss:  0.054
Epoch   2 Batch  391/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.951, Loss:  0.048
Epoch   2 Batch  392/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.946, Loss:  0.050
Epoch   2 Batch  393/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.942, Loss:  0.037
Epoch   2 Batch  394/1077 - Train Accuracy:  0.914, Validation Accuracy:  0.938, Loss:  0.048
Epoch   2 Batch  395/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.933, Loss:  0.041
Epoch   2 Batch  396/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.933, Loss:  0.045
Epoch   2 Batch  397/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.930, Loss:  0.046
Epoch   2 Batch  398/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.934, Loss:  0.045
Epoch   2 Batch  399/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.928, Loss:  0.044
Epoch   2 Batch  400/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.928, Loss:  0.044
Epoch   2 Batch  401/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.928, Loss:  0.030
Epoch   2 Batch  402/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.927, Loss:  0.031
Epoch   2 Batch  403/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.927, Loss:  0.054
Epoch   2 Batch  404/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.930, Loss:  0.045
Epoch   2 Batch  405/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.923, Loss:  0.040
Epoch   2 Batch  406/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.916, Loss:  0.037
Epoch   2 Batch  407/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.922, Loss:  0.045
Epoch   2 Batch  408/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.922, Loss:  0.039
Epoch   2 Batch  409/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.920, Loss:  0.049
Epoch   2 Batch  410/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.919, Loss:  0.054
Epoch   2 Batch  411/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.920, Loss:  0.045
Epoch   2 Batch  412/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.925, Loss:  0.031
Epoch   2 Batch  413/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.931, Loss:  0.040
Epoch   2 Batch  414/1077 - Train Accuracy:  0.912, Validation Accuracy:  0.928, Loss:  0.038
Epoch   2 Batch  415/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.924, Loss:  0.043
Epoch   2 Batch  416/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.933, Loss:  0.037
Epoch   2 Batch  417/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.935, Loss:  0.071
Epoch   2 Batch  418/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.036
Epoch   2 Batch  419/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.940, Loss:  0.044
Epoch   2 Batch  420/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.939, Loss:  0.033
Epoch   2 Batch  421/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.941, Loss:  0.049
Epoch   2 Batch  422/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.942, Loss:  0.036
Epoch   2 Batch  423/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.940, Loss:  0.053
Epoch   2 Batch  424/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.937, Loss:  0.045
Epoch   2 Batch  425/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.937, Loss:  0.031
Epoch   2 Batch  426/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.936, Loss:  0.045
Epoch   2 Batch  427/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.941, Loss:  0.032
Epoch   2 Batch  428/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.936, Loss:  0.031
Epoch   2 Batch  429/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.936, Loss:  0.028
Epoch   2 Batch  430/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  0.028
Epoch   2 Batch  431/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.946, Loss:  0.031
Epoch   2 Batch  432/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.044
Epoch   2 Batch  433/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.938, Loss:  0.049
Epoch   2 Batch  434/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.933, Loss:  0.033
Epoch   2 Batch  435/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.933, Loss:  0.050
Epoch   2 Batch  436/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  0.030
Epoch   2 Batch  437/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.932, Loss:  0.027
Epoch   2 Batch  438/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.936, Loss:  0.035
Epoch   2 Batch  439/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.933, Loss:  0.045
Epoch   2 Batch  440/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.932, Loss:  0.046
Epoch   2 Batch  441/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.932, Loss:  0.039
Epoch   2 Batch  442/1077 - Train Accuracy:  0.921, Validation Accuracy:  0.933, Loss:  0.049
Epoch   2 Batch  443/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.928, Loss:  0.029
Epoch   2 Batch  444/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.930, Loss:  0.032
Epoch   2 Batch  445/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.935, Loss:  0.038
Epoch   2 Batch  446/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.934, Loss:  0.033
Epoch   2 Batch  447/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.942, Loss:  0.034
Epoch   2 Batch  448/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  0.054
Epoch   2 Batch  449/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.035
Epoch   2 Batch  450/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.932, Loss:  0.039
Epoch   2 Batch  451/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.931, Loss:  0.046
Epoch   2 Batch  452/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.039
Epoch   2 Batch  453/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.942, Loss:  0.044
Epoch   2 Batch  454/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.936, Loss:  0.042
Epoch   2 Batch  455/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.934, Loss:  0.044
Epoch   2 Batch  456/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.934, Loss:  0.043
Epoch   2 Batch  457/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.944, Loss:  0.028
Epoch   2 Batch  458/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.938, Loss:  0.055
Epoch   2 Batch  459/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.938, Loss:  0.043
Epoch   2 Batch  460/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.926, Loss:  0.039
Epoch   2 Batch  461/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.930, Loss:  0.036
Epoch   2 Batch  462/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.935, Loss:  0.038
Epoch   2 Batch  463/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.935, Loss:  0.035
Epoch   2 Batch  464/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  0.035
Epoch   2 Batch  465/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.940, Loss:  0.039
Epoch   2 Batch  466/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.942, Loss:  0.029
Epoch   2 Batch  467/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  0.041
Epoch   2 Batch  468/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.042
Epoch   2 Batch  469/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.941, Loss:  0.038
Epoch   2 Batch  470/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.931, Loss:  0.035
Epoch   2 Batch  471/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.928, Loss:  0.027
Epoch   2 Batch  472/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.923, Loss:  0.036
Epoch   2 Batch  473/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.923, Loss:  0.034
Epoch   2 Batch  474/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.927, Loss:  0.037
Epoch   2 Batch  475/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.940, Loss:  0.039
Epoch   2 Batch  476/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.030
Epoch   2 Batch  477/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  0.043
Epoch   2 Batch  478/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.951, Loss:  0.035
Epoch   2 Batch  479/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.946, Loss:  0.052
Epoch   2 Batch  480/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.941, Loss:  0.033
Epoch   2 Batch  481/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.942, Loss:  0.033
Epoch   2 Batch  482/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.938, Loss:  0.049
Epoch   2 Batch  483/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.937, Loss:  0.039
Epoch   2 Batch  484/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.933, Loss:  0.045
Epoch   2 Batch  485/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.934, Loss:  0.041
Epoch   2 Batch  486/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.928, Loss:  0.031
Epoch   2 Batch  487/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.929, Loss:  0.037
Epoch   2 Batch  488/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.934, Loss:  0.035
Epoch   2 Batch  489/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.930, Loss:  0.034
Epoch   2 Batch  490/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.938, Loss:  0.035
Epoch   2 Batch  491/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.936, Loss:  0.046
Epoch   2 Batch  492/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  0.043
Epoch   2 Batch  493/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.936, Loss:  0.035
Epoch   2 Batch  494/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.942, Loss:  0.027
Epoch   2 Batch  495/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.942, Loss:  0.032
Epoch   2 Batch  496/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.941, Loss:  0.039
Epoch   2 Batch  497/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  0.046
Epoch   2 Batch  498/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  0.040
Epoch   2 Batch  499/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.940, Loss:  0.032
Epoch   2 Batch  500/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.939, Loss:  0.032
Epoch   2 Batch  501/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.929, Loss:  0.037
Epoch   2 Batch  502/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.042
Epoch   2 Batch  503/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.940, Loss:  0.036
Epoch   2 Batch  504/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.940, Loss:  0.029
Epoch   2 Batch  505/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.943, Loss:  0.034
Epoch   2 Batch  506/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.937, Loss:  0.046
Epoch   2 Batch  507/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.946, Loss:  0.042
Epoch   2 Batch  508/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.940, Loss:  0.028
Epoch   2 Batch  509/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.936, Loss:  0.043
Epoch   2 Batch  510/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.936, Loss:  0.036
Epoch   2 Batch  511/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.935, Loss:  0.038
Epoch   2 Batch  512/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.936, Loss:  0.029
Epoch   2 Batch  513/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  0.041
Epoch   2 Batch  514/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.033
Epoch   2 Batch  515/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.929, Loss:  0.039
Epoch   2 Batch  516/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.940, Loss:  0.032
Epoch   2 Batch  517/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.043
Epoch   2 Batch  518/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.032
Epoch   2 Batch  519/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.945, Loss:  0.040
Epoch   2 Batch  520/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.940, Loss:  0.035
Epoch   2 Batch  521/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.940, Loss:  0.042
Epoch   2 Batch  522/1077 - Train Accuracy:  0.913, Validation Accuracy:  0.951, Loss:  0.047
Epoch   2 Batch  523/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.938, Loss:  0.044
Epoch   2 Batch  524/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.035
Epoch   2 Batch  525/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.944, Loss:  0.039
Epoch   2 Batch  526/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.942, Loss:  0.032
Epoch   2 Batch  527/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.942, Loss:  0.049
Epoch   2 Batch  528/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.949, Loss:  0.044
Epoch   2 Batch  529/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  0.038
Epoch   2 Batch  530/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.953, Loss:  0.049
Epoch   2 Batch  531/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  532/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.947, Loss:  0.053
Epoch   2 Batch  533/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.947, Loss:  0.039
Epoch   2 Batch  534/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.947, Loss:  0.040
Epoch   2 Batch  535/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.948, Loss:  0.033
Epoch   2 Batch  536/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.943, Loss:  0.036
Epoch   2 Batch  537/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.029
Epoch   2 Batch  538/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.948, Loss:  0.033
Epoch   2 Batch  539/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.947, Loss:  0.052
Epoch   2 Batch  540/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.952, Loss:  0.027
Epoch   2 Batch  541/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  0.033
Epoch   2 Batch  542/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.941, Loss:  0.039
Epoch   2 Batch  543/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.033
Epoch   2 Batch  544/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  0.030
Epoch   2 Batch  545/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.943, Loss:  0.042
Epoch   2 Batch  546/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.936, Loss:  0.043
Epoch   2 Batch  547/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.939, Loss:  0.029
Epoch   2 Batch  548/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.940, Loss:  0.047
Epoch   2 Batch  549/1077 - Train Accuracy:  0.910, Validation Accuracy:  0.938, Loss:  0.044
Epoch   2 Batch  550/1077 - Train Accuracy:  0.923, Validation Accuracy:  0.939, Loss:  0.041
Epoch   2 Batch  551/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.938, Loss:  0.047
Epoch   2 Batch  552/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.942, Loss:  0.046
Epoch   2 Batch  553/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.942, Loss:  0.048
Epoch   2 Batch  554/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.947, Loss:  0.036
Epoch   2 Batch  555/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  0.027
Epoch   2 Batch  556/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.952, Loss:  0.032
Epoch   2 Batch  557/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.948, Loss:  0.034
Epoch   2 Batch  558/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.948, Loss:  0.033
Epoch   2 Batch  559/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.944, Loss:  0.038
Epoch   2 Batch  560/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.944, Loss:  0.047
Epoch   2 Batch  561/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.950, Loss:  0.032
Epoch   2 Batch  562/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.954, Loss:  0.030
Epoch   2 Batch  563/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.954, Loss:  0.038
Epoch   2 Batch  564/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.043
Epoch   2 Batch  565/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  0.040
Epoch   2 Batch  566/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.950, Loss:  0.036
Epoch   2 Batch  567/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.947, Loss:  0.032
Epoch   2 Batch  568/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.950, Loss:  0.035
Epoch   2 Batch  569/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.948, Loss:  0.035
Epoch   2 Batch  570/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  0.047
Epoch   2 Batch  571/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.953, Loss:  0.032
Epoch   2 Batch  572/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.034
Epoch   2 Batch  573/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.945, Loss:  0.055
Epoch   2 Batch  574/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  0.049
Epoch   2 Batch  575/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.944, Loss:  0.026
Epoch   2 Batch  576/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.031
Epoch   2 Batch  577/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.962, Loss:  0.043
Epoch   2 Batch  578/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.958, Loss:  0.034
Epoch   2 Batch  579/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.955, Loss:  0.031
Epoch   2 Batch  580/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  0.025
Epoch   2 Batch  581/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  0.026
Epoch   2 Batch  582/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.951, Loss:  0.033
Epoch   2 Batch  583/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.040
Epoch   2 Batch  584/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.942, Loss:  0.040
Epoch   2 Batch  585/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.942, Loss:  0.025
Epoch   2 Batch  586/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  0.031
Epoch   2 Batch  587/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.939, Loss:  0.049
Epoch   2 Batch  588/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.942, Loss:  0.034
Epoch   2 Batch  589/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.942, Loss:  0.033
Epoch   2 Batch  590/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.042
Epoch   2 Batch  591/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.944, Loss:  0.034
Epoch   2 Batch  592/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.943, Loss:  0.045
Epoch   2 Batch  593/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.943, Loss:  0.053
Epoch   2 Batch  594/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.947, Loss:  0.047
Epoch   2 Batch  595/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.031
Epoch   2 Batch  596/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.952, Loss:  0.038
Epoch   2 Batch  597/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  0.031
Epoch   2 Batch  598/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.945, Loss:  0.040
Epoch   2 Batch  599/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.950, Loss:  0.051
Epoch   2 Batch  600/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  0.043
Epoch   2 Batch  601/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.957, Loss:  0.048
Epoch   2 Batch  602/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.034
Epoch   2 Batch  603/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  0.034
Epoch   2 Batch  604/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.959, Loss:  0.046
Epoch   2 Batch  605/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.963, Loss:  0.058
Epoch   2 Batch  606/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.962, Loss:  0.032
Epoch   2 Batch  607/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  0.040
Epoch   2 Batch  608/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  0.035
Epoch   2 Batch  609/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  0.037
Epoch   2 Batch  610/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.947, Loss:  0.043
Epoch   2 Batch  611/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.032
Epoch   2 Batch  612/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.933, Loss:  0.027
Epoch   2 Batch  613/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.940, Loss:  0.044
Epoch   2 Batch  614/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  0.033
Epoch   2 Batch  615/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.031
Epoch   2 Batch  616/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.945, Loss:  0.038
Epoch   2 Batch  617/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.036
Epoch   2 Batch  618/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.037
Epoch   2 Batch  619/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.024
Epoch   2 Batch  620/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.039
Epoch   2 Batch  621/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.032
Epoch   2 Batch  622/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  0.049
Epoch   2 Batch  623/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.042
Epoch   2 Batch  624/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.954, Loss:  0.038
Epoch   2 Batch  625/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.950, Loss:  0.036
Epoch   2 Batch  626/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.958, Loss:  0.034
Epoch   2 Batch  627/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  0.032
Epoch   2 Batch  628/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.045
Epoch   2 Batch  629/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.959, Loss:  0.045
Epoch   2 Batch  630/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  0.041
Epoch   2 Batch  631/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.953, Loss:  0.052
Epoch   2 Batch  632/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.947, Loss:  0.023
Epoch   2 Batch  633/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  0.036
Epoch   2 Batch  634/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  0.025
Epoch   2 Batch  635/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.950, Loss:  0.051
Epoch   2 Batch  636/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.043
Epoch   2 Batch  637/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.032
Epoch   2 Batch  638/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.944, Loss:  0.033
Epoch   2 Batch  639/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.955, Loss:  0.047
Epoch   2 Batch  640/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.950, Loss:  0.041
Epoch   2 Batch  641/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.036
Epoch   2 Batch  642/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.034
Epoch   2 Batch  643/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.948, Loss:  0.029
Epoch   2 Batch  644/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.950, Loss:  0.038
Epoch   2 Batch  645/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  0.043
Epoch   2 Batch  646/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  0.038
Epoch   2 Batch  647/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.036
Epoch   2 Batch  648/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.959, Loss:  0.032
Epoch   2 Batch  649/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.957, Loss:  0.035
Epoch   2 Batch  650/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  0.038
Epoch   2 Batch  651/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.943, Loss:  0.035
Epoch   2 Batch  652/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.943, Loss:  0.037
Epoch   2 Batch  653/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.035
Epoch   2 Batch  654/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  0.031
Epoch   2 Batch  655/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.956, Loss:  0.050
Epoch   2 Batch  656/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.959, Loss:  0.043
Epoch   2 Batch  657/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.036
Epoch   2 Batch  658/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  0.027
Epoch   2 Batch  659/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  0.040
Epoch   2 Batch  660/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  0.037
Epoch   2 Batch  661/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.962, Loss:  0.036
Epoch   2 Batch  662/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.031
Epoch   2 Batch  663/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.942, Loss:  0.035
Epoch   2 Batch  664/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.938, Loss:  0.033
Epoch   2 Batch  665/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.934, Loss:  0.034
Epoch   2 Batch  666/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.940, Loss:  0.042
Epoch   2 Batch  667/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  0.039
Epoch   2 Batch  668/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  0.042
Epoch   2 Batch  669/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.955, Loss:  0.034
Epoch   2 Batch  670/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.951, Loss:  0.041
Epoch   2 Batch  671/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.950, Loss:  0.041
Epoch   2 Batch  672/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  0.037
Epoch   2 Batch  673/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.955, Loss:  0.036
Epoch   2 Batch  674/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.958, Loss:  0.033
Epoch   2 Batch  675/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.953, Loss:  0.043
Epoch   2 Batch  676/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.946, Loss:  0.035
Epoch   2 Batch  677/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.950, Loss:  0.049
Epoch   2 Batch  678/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.946, Loss:  0.028
Epoch   2 Batch  679/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.029
Epoch   2 Batch  680/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  681/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.943, Loss:  0.040
Epoch   2 Batch  682/1077 - Train Accuracy:  0.919, Validation Accuracy:  0.946, Loss:  0.031
Epoch   2 Batch  683/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  0.028
Epoch   2 Batch  684/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  0.041
Epoch   2 Batch  685/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.947, Loss:  0.041
Epoch   2 Batch  686/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  0.030
Epoch   2 Batch  687/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.045
Epoch   2 Batch  688/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  0.031
Epoch   2 Batch  689/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  0.031
Epoch   2 Batch  690/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  0.042
Epoch   2 Batch  691/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  0.047
Epoch   2 Batch  692/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  0.032
Epoch   2 Batch  693/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.950, Loss:  0.058
Epoch   2 Batch  694/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.944, Loss:  0.035
Epoch   2 Batch  695/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.948, Loss:  0.030
Epoch   2 Batch  696/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.033
Epoch   2 Batch  697/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  0.036
Epoch   2 Batch  698/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.949, Loss:  0.030
Epoch   2 Batch  699/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.028
Epoch   2 Batch  700/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.030
Epoch   2 Batch  701/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.045
Epoch   2 Batch  702/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.953, Loss:  0.048
Epoch   2 Batch  703/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.041
Epoch   2 Batch  704/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.956, Loss:  0.052
Epoch   2 Batch  705/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.956, Loss:  0.044
Epoch   2 Batch  706/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.954, Loss:  0.058
Epoch   2 Batch  707/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.948, Loss:  0.045
Epoch   2 Batch  708/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.943, Loss:  0.038
Epoch   2 Batch  709/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.941, Loss:  0.039
Epoch   2 Batch  710/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  0.025
Epoch   2 Batch  711/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  0.037
Epoch   2 Batch  712/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.032
Epoch   2 Batch  713/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.952, Loss:  0.038
Epoch   2 Batch  714/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  0.033
Epoch   2 Batch  715/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  0.039
Epoch   2 Batch  716/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  0.030
Epoch   2 Batch  717/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  0.028
Epoch   2 Batch  718/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.031
Epoch   2 Batch  719/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.956, Loss:  0.039
Epoch   2 Batch  720/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.954, Loss:  0.040
Epoch   2 Batch  721/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.034
Epoch   2 Batch  722/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  0.027
Epoch   2 Batch  723/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.949, Loss:  0.038
Epoch   2 Batch  724/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.041
Epoch   2 Batch  725/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.025
Epoch   2 Batch  726/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.950, Loss:  0.032
Epoch   2 Batch  727/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.033
Epoch   2 Batch  728/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  0.050
Epoch   2 Batch  729/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.949, Loss:  0.048
Epoch   2 Batch  730/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.040
Epoch   2 Batch  731/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.955, Loss:  0.036
Epoch   2 Batch  732/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.954, Loss:  0.040
Epoch   2 Batch  733/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.951, Loss:  0.036
Epoch   2 Batch  734/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.951, Loss:  0.036
Epoch   2 Batch  735/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.952, Loss:  0.028
Epoch   2 Batch  736/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.031
Epoch   2 Batch  737/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.951, Loss:  0.044
Epoch   2 Batch  738/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.027
Epoch   2 Batch  739/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.034
Epoch   2 Batch  740/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.028
Epoch   2 Batch  741/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  0.040
Epoch   2 Batch  742/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.032
Epoch   2 Batch  743/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.950, Loss:  0.042
Epoch   2 Batch  744/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.038
Epoch   2 Batch  745/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.037
Epoch   2 Batch  746/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.951, Loss:  0.026
Epoch   2 Batch  747/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.024
Epoch   2 Batch  748/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  0.027
Epoch   2 Batch  749/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.944, Loss:  0.029
Epoch   2 Batch  750/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.030
Epoch   2 Batch  751/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.028
Epoch   2 Batch  752/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.038
Epoch   2 Batch  753/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.032
Epoch   2 Batch  754/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  755/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.043
Epoch   2 Batch  756/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  0.029
Epoch   2 Batch  757/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.028
Epoch   2 Batch  758/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  0.033
Epoch   2 Batch  759/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  0.030
Epoch   2 Batch  760/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  0.039
Epoch   2 Batch  761/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  0.036
Epoch   2 Batch  762/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  0.032
Epoch   2 Batch  763/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.036
Epoch   2 Batch  764/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.036
Epoch   2 Batch  765/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.960, Loss:  0.039
Epoch   2 Batch  766/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.038
Epoch   2 Batch  767/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  0.039
Epoch   2 Batch  768/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.964, Loss:  0.028
Epoch   2 Batch  769/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  0.038
Epoch   2 Batch  770/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.948, Loss:  0.031
Epoch   2 Batch  771/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.040
Epoch   2 Batch  772/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.951, Loss:  0.028
Epoch   2 Batch  773/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.034
Epoch   2 Batch  774/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  0.041
Epoch   2 Batch  775/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.956, Loss:  0.027
Epoch   2 Batch  776/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.963, Loss:  0.029
Epoch   2 Batch  777/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.945, Loss:  0.042
Epoch   2 Batch  778/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.937, Loss:  0.028
Epoch   2 Batch  779/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.937, Loss:  0.033
Epoch   2 Batch  780/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.942, Loss:  0.049
Epoch   2 Batch  781/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  0.032
Epoch   2 Batch  782/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.942, Loss:  0.030
Epoch   2 Batch  783/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.942, Loss:  0.041
Epoch   2 Batch  784/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.942, Loss:  0.026
Epoch   2 Batch  785/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.031
Epoch   2 Batch  786/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.951, Loss:  0.032
Epoch   2 Batch  787/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  0.033
Epoch   2 Batch  788/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.959, Loss:  0.032
Epoch   2 Batch  789/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.962, Loss:  0.036
Epoch   2 Batch  790/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.963, Loss:  0.043
Epoch   2 Batch  791/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.042
Epoch   2 Batch  792/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.963, Loss:  0.040
Epoch   2 Batch  793/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  0.036
Epoch   2 Batch  794/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.959, Loss:  0.030
Epoch   2 Batch  795/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.955, Loss:  0.045
Epoch   2 Batch  796/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.952, Loss:  0.033
Epoch   2 Batch  797/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.030
Epoch   2 Batch  798/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.962, Loss:  0.032
Epoch   2 Batch  799/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.962, Loss:  0.049
Epoch   2 Batch  800/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  0.032
Epoch   2 Batch  801/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.956, Loss:  0.036
Epoch   2 Batch  802/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.958, Loss:  0.035
Epoch   2 Batch  803/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  0.034
Epoch   2 Batch  804/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.953, Loss:  0.024
Epoch   2 Batch  805/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.039
Epoch   2 Batch  806/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.031
Epoch   2 Batch  807/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  0.031
Epoch   2 Batch  808/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.950, Loss:  0.049
Epoch   2 Batch  809/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.945, Loss:  0.048
Epoch   2 Batch  810/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.947, Loss:  0.026
Epoch   2 Batch  811/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.952, Loss:  0.038
Epoch   2 Batch  812/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  0.027
Epoch   2 Batch  813/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.039
Epoch   2 Batch  814/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.956, Loss:  0.035
Epoch   2 Batch  815/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.946, Loss:  0.034
Epoch   2 Batch  816/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.942, Loss:  0.039
Epoch   2 Batch  817/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.951, Loss:  0.032
Epoch   2 Batch  818/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.042
Epoch   2 Batch  819/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.951, Loss:  0.044
Epoch   2 Batch  820/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  0.037
Epoch   2 Batch  821/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  0.039
Epoch   2 Batch  822/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.948, Loss:  0.030
Epoch   2 Batch  823/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.948, Loss:  0.036
Epoch   2 Batch  824/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.943, Loss:  0.034
Epoch   2 Batch  825/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.947, Loss:  0.024
Epoch   2 Batch  826/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.952, Loss:  0.033
Epoch   2 Batch  827/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  0.032
Epoch   2 Batch  828/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.030
Epoch   2 Batch  829/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.948, Loss:  0.043
Epoch   2 Batch  830/1077 - Train Accuracy:  0.918, Validation Accuracy:  0.951, Loss:  0.047
Epoch   2 Batch  831/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.954, Loss:  0.042
Epoch   2 Batch  832/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  0.030
Epoch   2 Batch  833/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.950, Loss:  0.035
Epoch   2 Batch  834/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.038
Epoch   2 Batch  835/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.036
Epoch   2 Batch  836/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.037
Epoch   2 Batch  837/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.947, Loss:  0.040
Epoch   2 Batch  838/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.950, Loss:  0.034
Epoch   2 Batch  839/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  0.025
Epoch   2 Batch  840/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  0.031
Epoch   2 Batch  841/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  0.042
Epoch   2 Batch  842/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.029
Epoch   2 Batch  843/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  0.029
Epoch   2 Batch  844/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.031
Epoch   2 Batch  845/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.026
Epoch   2 Batch  846/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.947, Loss:  0.046
Epoch   2 Batch  847/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  848/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  0.032
Epoch   2 Batch  849/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.946, Loss:  0.028
Epoch   2 Batch  850/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.048
Epoch   2 Batch  851/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.044
Epoch   2 Batch  852/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.951, Loss:  0.047
Epoch   2 Batch  853/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.946, Loss:  0.027
Epoch   2 Batch  854/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.038
Epoch   2 Batch  855/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  0.036
Epoch   2 Batch  856/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.036
Epoch   2 Batch  857/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  0.031
Epoch   2 Batch  858/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.944, Loss:  0.026
Epoch   2 Batch  859/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  860/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.943, Loss:  0.031
Epoch   2 Batch  861/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  0.027
Epoch   2 Batch  862/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  0.035
Epoch   2 Batch  863/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.945, Loss:  0.028
Epoch   2 Batch  864/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.945, Loss:  0.035
Epoch   2 Batch  865/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.947, Loss:  0.032
Epoch   2 Batch  866/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.947, Loss:  0.038
Epoch   2 Batch  867/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.953, Loss:  0.069
Epoch   2 Batch  868/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.046
Epoch   2 Batch  869/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.940, Loss:  0.039
Epoch   2 Batch  870/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.941, Loss:  0.028
Epoch   2 Batch  871/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.030
Epoch   2 Batch  872/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.039
Epoch   2 Batch  873/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.037
Epoch   2 Batch  874/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.947, Loss:  0.041
Epoch   2 Batch  875/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.040
Epoch   2 Batch  876/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  0.029
Epoch   2 Batch  877/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.027
Epoch   2 Batch  878/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.960, Loss:  0.036
Epoch   2 Batch  879/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.957, Loss:  0.028
Epoch   2 Batch  880/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.959, Loss:  0.046
Epoch   2 Batch  881/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  0.039
Epoch   2 Batch  882/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.953, Loss:  0.037
Epoch   2 Batch  883/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.949, Loss:  0.048
Epoch   2 Batch  884/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.949, Loss:  0.039
Epoch   2 Batch  885/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.026
Epoch   2 Batch  886/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  0.030
Epoch   2 Batch  887/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.946, Loss:  0.047
Epoch   2 Batch  888/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.948, Loss:  0.030
Epoch   2 Batch  889/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.944, Loss:  0.041
Epoch   2 Batch  890/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.944, Loss:  0.038
Epoch   2 Batch  891/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.940, Loss:  0.030
Epoch   2 Batch  892/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.936, Loss:  0.036
Epoch   2 Batch  893/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.946, Loss:  0.032
Epoch   2 Batch  894/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.941, Loss:  0.031
Epoch   2 Batch  895/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.035
Epoch   2 Batch  896/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  0.034
Epoch   2 Batch  897/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.040
Epoch   2 Batch  898/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.034
Epoch   2 Batch  899/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  0.038
Epoch   2 Batch  900/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.044
Epoch   2 Batch  901/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.957, Loss:  0.052
Epoch   2 Batch  902/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.957, Loss:  0.044
Epoch   2 Batch  903/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.952, Loss:  0.039
Epoch   2 Batch  904/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.944, Loss:  0.031
Epoch   2 Batch  905/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.939, Loss:  0.029
Epoch   2 Batch  906/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.942, Loss:  0.037
Epoch   2 Batch  907/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.039
Epoch   2 Batch  908/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.946, Loss:  0.044
Epoch   2 Batch  909/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.939, Loss:  0.050
Epoch   2 Batch  910/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.948, Loss:  0.039
Epoch   2 Batch  911/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.941, Loss:  0.039
Epoch   2 Batch  912/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.039
Epoch   2 Batch  913/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.942, Loss:  0.045
Epoch   2 Batch  914/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.943, Loss:  0.066
Epoch   2 Batch  915/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.943, Loss:  0.029
Epoch   2 Batch  916/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  0.037
Epoch   2 Batch  917/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.942, Loss:  0.030
Epoch   2 Batch  918/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.954, Loss:  0.036
Epoch   2 Batch  919/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  0.031
Epoch   2 Batch  920/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.955, Loss:  0.031
Epoch   2 Batch  921/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.956, Loss:  0.043
Epoch   2 Batch  922/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.958, Loss:  0.036
Epoch   2 Batch  923/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  0.022
Epoch   2 Batch  924/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  0.049
Epoch   2 Batch  925/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.032
Epoch   2 Batch  926/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  0.035
Epoch   2 Batch  927/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.953, Loss:  0.042
Epoch   2 Batch  928/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.029
Epoch   2 Batch  929/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  0.035
Epoch   2 Batch  930/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.030
Epoch   2 Batch  931/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.941, Loss:  0.026
Epoch   2 Batch  932/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.948, Loss:  0.033
Epoch   2 Batch  933/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.941, Loss:  0.028
Epoch   2 Batch  934/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.941, Loss:  0.031
Epoch   2 Batch  935/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.030
Epoch   2 Batch  936/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.946, Loss:  0.039
Epoch   2 Batch  937/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.947, Loss:  0.041
Epoch   2 Batch  938/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.948, Loss:  0.040
Epoch   2 Batch  939/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  0.043
Epoch   2 Batch  940/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.949, Loss:  0.033
Epoch   2 Batch  941/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.953, Loss:  0.034
Epoch   2 Batch  942/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.953, Loss:  0.037
Epoch   2 Batch  943/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  0.031
Epoch   2 Batch  944/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  0.024
Epoch   2 Batch  945/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.956, Loss:  0.022
Epoch   2 Batch  946/1077 - Train Accuracy:  0.983, Validation Accuracy:  0.959, Loss:  0.026
Epoch   2 Batch  947/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.961, Loss:  0.033
Epoch   2 Batch  948/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  0.035
Epoch   2 Batch  949/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.027
Epoch   2 Batch  950/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  0.025
Epoch   2 Batch  951/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.957, Loss:  0.043
Epoch   2 Batch  952/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.026
Epoch   2 Batch  953/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.024
Epoch   2 Batch  954/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.035
Epoch   2 Batch  955/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.037
Epoch   2 Batch  956/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  0.036
Epoch   2 Batch  957/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.953, Loss:  0.019
Epoch   2 Batch  958/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.953, Loss:  0.028
Epoch   2 Batch  959/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.942, Loss:  0.034
Epoch   2 Batch  960/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.933, Loss:  0.029
Epoch   2 Batch  961/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  0.025
Epoch   2 Batch  962/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.035
Epoch   2 Batch  963/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.949, Loss:  0.036
Epoch   2 Batch  964/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  0.029
Epoch   2 Batch  965/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.030
Epoch   2 Batch  966/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.022
Epoch   2 Batch  967/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.035
Epoch   2 Batch  968/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.957, Loss:  0.040
Epoch   2 Batch  969/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.956, Loss:  0.044
Epoch   2 Batch  970/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  0.036
Epoch   2 Batch  971/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.942, Loss:  0.043
Epoch   2 Batch  972/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.938, Loss:  0.027
Epoch   2 Batch  973/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.942, Loss:  0.026
Epoch   2 Batch  974/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.942, Loss:  0.022
Epoch   2 Batch  975/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.028
Epoch   2 Batch  976/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.021
Epoch   2 Batch  977/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  0.018
Epoch   2 Batch  978/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.030
Epoch   2 Batch  979/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.956, Loss:  0.030
Epoch   2 Batch  980/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.953, Loss:  0.036
Epoch   2 Batch  981/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.957, Loss:  0.034
Epoch   2 Batch  982/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  0.028
Epoch   2 Batch  983/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.957, Loss:  0.035
Epoch   2 Batch  984/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.957, Loss:  0.046
Epoch   2 Batch  985/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.026
Epoch   2 Batch  986/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  0.030
Epoch   2 Batch  987/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.960, Loss:  0.027
Epoch   2 Batch  988/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.960, Loss:  0.038
Epoch   2 Batch  989/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.950, Loss:  0.030
Epoch   2 Batch  990/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  0.032
Epoch   2 Batch  991/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  0.035
Epoch   2 Batch  992/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.950, Loss:  0.042
Epoch   2 Batch  993/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.950, Loss:  0.027
Epoch   2 Batch  994/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  0.030
Epoch   2 Batch  995/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.036
Epoch   2 Batch  996/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  0.028
Epoch   2 Batch  997/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  0.038
Epoch   2 Batch  998/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  0.025
Epoch   2 Batch  999/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.950, Loss:  0.034
Epoch   2 Batch 1000/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  0.031
Epoch   2 Batch 1001/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  0.029
Epoch   2 Batch 1002/1077 - Train Accuracy:  0.983, Validation Accuracy:  0.936, Loss:  0.017
Epoch   2 Batch 1003/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.032
Epoch   2 Batch 1004/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.042
Epoch   2 Batch 1005/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.027
Epoch   2 Batch 1006/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.957, Loss:  0.031
Epoch   2 Batch 1007/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.027
Epoch   2 Batch 1008/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  0.042
Epoch   2 Batch 1009/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.952, Loss:  0.022
Epoch   2 Batch 1010/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.952, Loss:  0.025
Epoch   2 Batch 1011/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.939, Loss:  0.023
Epoch   2 Batch 1012/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.024
Epoch   2 Batch 1013/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.936, Loss:  0.023
Epoch   2 Batch 1014/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.947, Loss:  0.031
Epoch   2 Batch 1015/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.946, Loss:  0.043
Epoch   2 Batch 1016/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  0.027
Epoch   2 Batch 1017/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.033
Epoch   2 Batch 1018/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.032
Epoch   2 Batch 1019/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.043
Epoch   2 Batch 1020/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  0.024
Epoch   2 Batch 1021/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.029
Epoch   2 Batch 1022/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.029
Epoch   2 Batch 1023/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.948, Loss:  0.037
Epoch   2 Batch 1024/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  0.044
Epoch   2 Batch 1025/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.949, Loss:  0.028
Epoch   2 Batch 1026/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.952, Loss:  0.036
Epoch   2 Batch 1027/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.950, Loss:  0.027
Epoch   2 Batch 1028/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  0.026
Epoch   2 Batch 1029/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.032
Epoch   2 Batch 1030/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.027
Epoch   2 Batch 1031/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.039
Epoch   2 Batch 1032/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.955, Loss:  0.042
Epoch   2 Batch 1033/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.957, Loss:  0.039
Epoch   2 Batch 1034/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.952, Loss:  0.035
Epoch   2 Batch 1035/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.947, Loss:  0.019
Epoch   2 Batch 1036/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.034
Epoch   2 Batch 1037/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  0.028
Epoch   2 Batch 1038/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.042
Epoch   2 Batch 1039/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.944, Loss:  0.030
Epoch   2 Batch 1040/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.031
Epoch   2 Batch 1041/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  0.031
Epoch   2 Batch 1042/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.949, Loss:  0.026
Epoch   2 Batch 1043/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.944, Loss:  0.034
Epoch   2 Batch 1044/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.039
Epoch   2 Batch 1045/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.029
Epoch   2 Batch 1046/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.951, Loss:  0.016
Epoch   2 Batch 1047/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.951, Loss:  0.025
Epoch   2 Batch 1048/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  0.038
Epoch   2 Batch 1049/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  0.033
Epoch   2 Batch 1050/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  0.025
Epoch   2 Batch 1051/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.960, Loss:  0.035
Epoch   2 Batch 1052/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.027
Epoch   2 Batch 1053/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.965, Loss:  0.032
Epoch   2 Batch 1054/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.969, Loss:  0.031
Epoch   2 Batch 1055/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  0.032
Epoch   2 Batch 1056/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.965, Loss:  0.032
Epoch   2 Batch 1057/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.961, Loss:  0.038
Epoch   2 Batch 1058/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.956, Loss:  0.028
Epoch   2 Batch 1059/1077 - Train Accuracy:  0.916, Validation Accuracy:  0.951, Loss:  0.041
Epoch   2 Batch 1060/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  0.024
Epoch   2 Batch 1061/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  0.039
Epoch   2 Batch 1062/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  0.028
Epoch   2 Batch 1063/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.035
Epoch   2 Batch 1064/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.947, Loss:  0.032
Epoch   2 Batch 1065/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.947, Loss:  0.028
Epoch   2 Batch 1066/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.950, Loss:  0.025
Epoch   2 Batch 1067/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.943, Loss:  0.036
Epoch   2 Batch 1068/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.942, Loss:  0.022
Epoch   2 Batch 1069/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.937, Loss:  0.016
Epoch   2 Batch 1070/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.935, Loss:  0.024
Epoch   2 Batch 1071/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.938, Loss:  0.032
Epoch   2 Batch 1072/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.944, Loss:  0.031
Epoch   2 Batch 1073/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.040
Epoch   2 Batch 1074/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.038
Epoch   2 Batch 1075/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.945, Loss:  0.037
Epoch   3 Batch    0/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  0.021
Epoch   3 Batch    1/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.023
Epoch   3 Batch    2/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  0.030
Epoch   3 Batch    3/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.956, Loss:  0.040
Epoch   3 Batch    4/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  0.028
Epoch   3 Batch    5/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.952, Loss:  0.046
Epoch   3 Batch    6/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.026
Epoch   3 Batch    7/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.029
Epoch   3 Batch    8/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  0.032
Epoch   3 Batch    9/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.951, Loss:  0.024
Epoch   3 Batch   10/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.951, Loss:  0.030
Epoch   3 Batch   11/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.038
Epoch   3 Batch   12/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch   13/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  0.033
Epoch   3 Batch   14/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.023
Epoch   3 Batch   15/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  0.034
Epoch   3 Batch   16/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.954, Loss:  0.036
Epoch   3 Batch   17/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.032
Epoch   3 Batch   18/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  0.034
Epoch   3 Batch   19/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.950, Loss:  0.032
Epoch   3 Batch   20/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch   21/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.952, Loss:  0.036
Epoch   3 Batch   22/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.949, Loss:  0.035
Epoch   3 Batch   23/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  0.031
Epoch   3 Batch   24/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.948, Loss:  0.032
Epoch   3 Batch   25/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.948, Loss:  0.018
Epoch   3 Batch   26/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.944, Loss:  0.038
Epoch   3 Batch   27/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch   28/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.032
Epoch   3 Batch   29/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  0.031
Epoch   3 Batch   30/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.942, Loss:  0.026
Epoch   3 Batch   31/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  0.029
Epoch   3 Batch   32/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.036
Epoch   3 Batch   33/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch   34/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  0.025
Epoch   3 Batch   35/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.029
Epoch   3 Batch   36/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch   37/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  0.037
Epoch   3 Batch   38/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.041
Epoch   3 Batch   39/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.950, Loss:  0.037
Epoch   3 Batch   40/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.947, Loss:  0.021
Epoch   3 Batch   41/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  0.028
Epoch   3 Batch   42/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.041
Epoch   3 Batch   43/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.018
Epoch   3 Batch   44/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.022
Epoch   3 Batch   45/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.956, Loss:  0.034
Epoch   3 Batch   46/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.034
Epoch   3 Batch   47/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.952, Loss:  0.034
Epoch   3 Batch   48/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  0.045
Epoch   3 Batch   49/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  0.037
Epoch   3 Batch   50/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.031
Epoch   3 Batch   51/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.952, Loss:  0.033
Epoch   3 Batch   52/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  0.031
Epoch   3 Batch   53/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.952, Loss:  0.027
Epoch   3 Batch   54/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.963, Loss:  0.053
Epoch   3 Batch   55/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  0.027
Epoch   3 Batch   56/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  0.022
Epoch   3 Batch   57/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.945, Loss:  0.031
Epoch   3 Batch   58/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  0.029
Epoch   3 Batch   59/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.953, Loss:  0.033
Epoch   3 Batch   60/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  0.025
Epoch   3 Batch   61/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.028
Epoch   3 Batch   62/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.957, Loss:  0.034
Epoch   3 Batch   63/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.961, Loss:  0.024
Epoch   3 Batch   64/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.961, Loss:  0.029
Epoch   3 Batch   65/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  0.023
Epoch   3 Batch   66/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.953, Loss:  0.016
Epoch   3 Batch   67/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  0.033
Epoch   3 Batch   68/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.963, Loss:  0.037
Epoch   3 Batch   69/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  0.045
Epoch   3 Batch   70/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.962, Loss:  0.035
Epoch   3 Batch   71/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  0.027
Epoch   3 Batch   72/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.030
Epoch   3 Batch   73/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  0.029
Epoch   3 Batch   74/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.028
Epoch   3 Batch   75/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  0.041
Epoch   3 Batch   76/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.942, Loss:  0.020
Epoch   3 Batch   77/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.942, Loss:  0.035
Epoch   3 Batch   78/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.944, Loss:  0.026
Epoch   3 Batch   79/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  0.033
Epoch   3 Batch   80/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch   81/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.958, Loss:  0.027
Epoch   3 Batch   82/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch   83/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch   84/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.029
Epoch   3 Batch   85/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch   86/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.032
Epoch   3 Batch   87/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  0.034
Epoch   3 Batch   88/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.964, Loss:  0.031
Epoch   3 Batch   89/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch   90/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.035
Epoch   3 Batch   91/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.027
Epoch   3 Batch   92/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch   93/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.949, Loss:  0.023
Epoch   3 Batch   94/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch   95/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch   96/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch   97/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  0.037
Epoch   3 Batch   98/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  0.032
Epoch   3 Batch   99/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  0.033
Epoch   3 Batch  100/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.027
Epoch   3 Batch  101/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.025
Epoch   3 Batch  102/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch  103/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.039
Epoch   3 Batch  104/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.931, Loss:  0.028
Epoch   3 Batch  105/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.931, Loss:  0.020
Epoch   3 Batch  106/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.924, Loss:  0.037
Epoch   3 Batch  107/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.923, Loss:  0.032
Epoch   3 Batch  108/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.934, Loss:  0.034
Epoch   3 Batch  109/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.933, Loss:  0.030
Epoch   3 Batch  110/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.929, Loss:  0.023
Epoch   3 Batch  111/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.938, Loss:  0.021
Epoch   3 Batch  112/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.934, Loss:  0.025
Epoch   3 Batch  113/1077 - Train Accuracy:  0.922, Validation Accuracy:  0.934, Loss:  0.039
Epoch   3 Batch  114/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.935, Loss:  0.022
Epoch   3 Batch  115/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  0.036
Epoch   3 Batch  116/1077 - Train Accuracy:  0.917, Validation Accuracy:  0.950, Loss:  0.042
Epoch   3 Batch  117/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch  118/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.027
Epoch   3 Batch  119/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  0.024
Epoch   3 Batch  120/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.942, Loss:  0.039
Epoch   3 Batch  121/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.940, Loss:  0.032
Epoch   3 Batch  122/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.940, Loss:  0.024
Epoch   3 Batch  123/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch  124/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.952, Loss:  0.031
Epoch   3 Batch  125/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.960, Loss:  0.039
Epoch   3 Batch  126/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.028
Epoch   3 Batch  127/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.957, Loss:  0.026
Epoch   3 Batch  128/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.957, Loss:  0.029
Epoch   3 Batch  129/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.032
Epoch   3 Batch  130/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.954, Loss:  0.025
Epoch   3 Batch  131/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  0.032
Epoch   3 Batch  132/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch  133/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.944, Loss:  0.020
Epoch   3 Batch  134/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch  135/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.946, Loss:  0.025
Epoch   3 Batch  136/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.946, Loss:  0.027
Epoch   3 Batch  137/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.950, Loss:  0.019
Epoch   3 Batch  138/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.950, Loss:  0.030
Epoch   3 Batch  139/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  140/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  0.029
Epoch   3 Batch  141/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.024
Epoch   3 Batch  142/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  143/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  0.032
Epoch   3 Batch  144/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.956, Loss:  0.044
Epoch   3 Batch  145/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.950, Loss:  0.029
Epoch   3 Batch  146/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  0.049
Epoch   3 Batch  147/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  0.031
Epoch   3 Batch  148/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.030
Epoch   3 Batch  149/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  0.024
Epoch   3 Batch  150/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.942, Loss:  0.024
Epoch   3 Batch  151/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.942, Loss:  0.021
Epoch   3 Batch  152/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.943, Loss:  0.047
Epoch   3 Batch  153/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  0.037
Epoch   3 Batch  154/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.947, Loss:  0.024
Epoch   3 Batch  155/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.941, Loss:  0.026
Epoch   3 Batch  156/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.941, Loss:  0.021
Epoch   3 Batch  157/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  0.030
Epoch   3 Batch  158/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.941, Loss:  0.038
Epoch   3 Batch  159/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.941, Loss:  0.024
Epoch   3 Batch  160/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  0.029
Epoch   3 Batch  161/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.946, Loss:  0.027
Epoch   3 Batch  162/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.036
Epoch   3 Batch  163/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  0.036
Epoch   3 Batch  164/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  165/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch  166/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  167/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  0.029
Epoch   3 Batch  168/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.943, Loss:  0.030
Epoch   3 Batch  169/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.943, Loss:  0.034
Epoch   3 Batch  170/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  0.032
Epoch   3 Batch  171/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  0.028
Epoch   3 Batch  172/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.943, Loss:  0.022
Epoch   3 Batch  173/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.941, Loss:  0.028
Epoch   3 Batch  174/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.941, Loss:  0.023
Epoch   3 Batch  175/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  0.035
Epoch   3 Batch  176/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.940, Loss:  0.026
Epoch   3 Batch  177/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.938, Loss:  0.033
Epoch   3 Batch  178/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  0.026
Epoch   3 Batch  179/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  0.030
Epoch   3 Batch  180/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  181/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.032
Epoch   3 Batch  182/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.951, Loss:  0.036
Epoch   3 Batch  183/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  0.034
Epoch   3 Batch  184/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.027
Epoch   3 Batch  185/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.039
Epoch   3 Batch  186/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  187/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  188/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  0.036
Epoch   3 Batch  189/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  0.030
Epoch   3 Batch  190/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  0.023
Epoch   3 Batch  191/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  0.020
Epoch   3 Batch  192/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch  193/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.946, Loss:  0.027
Epoch   3 Batch  194/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.946, Loss:  0.025
Epoch   3 Batch  195/1077 - Train Accuracy:  0.927, Validation Accuracy:  0.955, Loss:  0.027
Epoch   3 Batch  196/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.955, Loss:  0.022
Epoch   3 Batch  197/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  0.027
Epoch   3 Batch  198/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  0.030
Epoch   3 Batch  199/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  0.028
Epoch   3 Batch  200/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.028
Epoch   3 Batch  201/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.023
Epoch   3 Batch  202/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.030
Epoch   3 Batch  203/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.952, Loss:  0.026
Epoch   3 Batch  204/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.966, Loss:  0.048
Epoch   3 Batch  205/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.965, Loss:  0.038
Epoch   3 Batch  206/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.024
Epoch   3 Batch  207/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.024
Epoch   3 Batch  208/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.032
Epoch   3 Batch  209/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.953, Loss:  0.020
Epoch   3 Batch  210/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.950, Loss:  0.028
Epoch   3 Batch  211/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.028
Epoch   3 Batch  212/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  213/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.024
Epoch   3 Batch  214/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch  215/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.953, Loss:  0.038
Epoch   3 Batch  216/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.029
Epoch   3 Batch  217/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch  218/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.952, Loss:  0.037
Epoch   3 Batch  219/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.017
Epoch   3 Batch  220/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch  221/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.948, Loss:  0.032
Epoch   3 Batch  222/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.961, Loss:  0.023
Epoch   3 Batch  223/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.961, Loss:  0.025
Epoch   3 Batch  224/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.961, Loss:  0.030
Epoch   3 Batch  225/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.961, Loss:  0.043
Epoch   3 Batch  226/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  227/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.958, Loss:  0.042
Epoch   3 Batch  228/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.950, Loss:  0.022
Epoch   3 Batch  229/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.024
Epoch   3 Batch  230/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  0.029
Epoch   3 Batch  231/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.950, Loss:  0.033
Epoch   3 Batch  232/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  0.026
Epoch   3 Batch  233/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.951, Loss:  0.038
Epoch   3 Batch  234/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.037
Epoch   3 Batch  235/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.033
Epoch   3 Batch  236/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.038
Epoch   3 Batch  237/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  0.021
Epoch   3 Batch  238/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.025
Epoch   3 Batch  239/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.953, Loss:  0.025
Epoch   3 Batch  240/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  0.027
Epoch   3 Batch  241/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  0.020
Epoch   3 Batch  242/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.023
Epoch   3 Batch  243/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.036
Epoch   3 Batch  244/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.954, Loss:  0.023
Epoch   3 Batch  245/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  0.024
Epoch   3 Batch  246/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  247/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.032
Epoch   3 Batch  248/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  0.028
Epoch   3 Batch  249/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.950, Loss:  0.024
Epoch   3 Batch  250/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.954, Loss:  0.035
Epoch   3 Batch  251/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.958, Loss:  0.038
Epoch   3 Batch  252/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  0.033
Epoch   3 Batch  253/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.961, Loss:  0.034
Epoch   3 Batch  254/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.962, Loss:  0.029
Epoch   3 Batch  255/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.952, Loss:  0.027
Epoch   3 Batch  256/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.951, Loss:  0.045
Epoch   3 Batch  257/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  0.024
Epoch   3 Batch  258/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.033
Epoch   3 Batch  259/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch  260/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.943, Loss:  0.027
Epoch   3 Batch  261/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.941, Loss:  0.029
Epoch   3 Batch  262/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.024
Epoch   3 Batch  263/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  264/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.945, Loss:  0.031
Epoch   3 Batch  265/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  0.027
Epoch   3 Batch  266/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  0.029
Epoch   3 Batch  267/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  268/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch  269/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.948, Loss:  0.043
Epoch   3 Batch  270/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.031
Epoch   3 Batch  271/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch  272/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.944, Loss:  0.041
Epoch   3 Batch  273/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.944, Loss:  0.025
Epoch   3 Batch  274/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.942, Loss:  0.032
Epoch   3 Batch  275/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.942, Loss:  0.025
Epoch   3 Batch  276/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.043
Epoch   3 Batch  277/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.020
Epoch   3 Batch  278/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.038
Epoch   3 Batch  279/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.943, Loss:  0.030
Epoch   3 Batch  280/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.944, Loss:  0.035
Epoch   3 Batch  281/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.944, Loss:  0.033
Epoch   3 Batch  282/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.955, Loss:  0.038
Epoch   3 Batch  283/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.953, Loss:  0.031
Epoch   3 Batch  284/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.959, Loss:  0.031
Epoch   3 Batch  285/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  286/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.030
Epoch   3 Batch  287/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.953, Loss:  0.031
Epoch   3 Batch  288/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.961, Loss:  0.043
Epoch   3 Batch  289/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  0.030
Epoch   3 Batch  290/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.959, Loss:  0.035
Epoch   3 Batch  291/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.959, Loss:  0.042
Epoch   3 Batch  292/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.958, Loss:  0.033
Epoch   3 Batch  293/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  0.028
Epoch   3 Batch  294/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  0.029
Epoch   3 Batch  295/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.965, Loss:  0.028
Epoch   3 Batch  296/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.031
Epoch   3 Batch  297/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.955, Loss:  0.029
Epoch   3 Batch  298/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.955, Loss:  0.041
Epoch   3 Batch  299/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  0.032
Epoch   3 Batch  300/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.028
Epoch   3 Batch  301/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.027
Epoch   3 Batch  302/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch  303/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.034
Epoch   3 Batch  304/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.027
Epoch   3 Batch  305/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.022
Epoch   3 Batch  306/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  0.036
Epoch   3 Batch  307/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.959, Loss:  0.026
Epoch   3 Batch  308/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.959, Loss:  0.036
Epoch   3 Batch  309/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  0.025
Epoch   3 Batch  310/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  0.029
Epoch   3 Batch  311/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.959, Loss:  0.021
Epoch   3 Batch  312/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.957, Loss:  0.042
Epoch   3 Batch  313/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.949, Loss:  0.020
Epoch   3 Batch  314/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.938, Loss:  0.029
Epoch   3 Batch  315/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.938, Loss:  0.028
Epoch   3 Batch  316/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.953, Loss:  0.030
Epoch   3 Batch  317/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.959, Loss:  0.040
Epoch   3 Batch  318/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.961, Loss:  0.026
Epoch   3 Batch  319/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.961, Loss:  0.035
Epoch   3 Batch  320/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.961, Loss:  0.035
Epoch   3 Batch  321/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  0.022
Epoch   3 Batch  322/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.959, Loss:  0.025
Epoch   3 Batch  323/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  324/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.956, Loss:  0.024
Epoch   3 Batch  325/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  0.029
Epoch   3 Batch  326/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  0.028
Epoch   3 Batch  327/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  0.034
Epoch   3 Batch  328/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  0.035
Epoch   3 Batch  329/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.952, Loss:  0.030
Epoch   3 Batch  330/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.947, Loss:  0.034
Epoch   3 Batch  331/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch  332/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  0.018
Epoch   3 Batch  333/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.947, Loss:  0.027
Epoch   3 Batch  334/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.939, Loss:  0.028
Epoch   3 Batch  335/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.030
Epoch   3 Batch  336/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.949, Loss:  0.046
Epoch   3 Batch  337/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  0.029
Epoch   3 Batch  338/1077 - Train Accuracy:  0.920, Validation Accuracy:  0.948, Loss:  0.043
Epoch   3 Batch  339/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.023
Epoch   3 Batch  340/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.944, Loss:  0.026
Epoch   3 Batch  341/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.953, Loss:  0.035
Epoch   3 Batch  342/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.953, Loss:  0.023
Epoch   3 Batch  343/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  0.027
Epoch   3 Batch  344/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch  345/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.021
Epoch   3 Batch  346/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.937, Loss:  0.033
Epoch   3 Batch  347/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.936, Loss:  0.020
Epoch   3 Batch  348/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.936, Loss:  0.020
Epoch   3 Batch  349/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.933, Loss:  0.025
Epoch   3 Batch  350/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.929, Loss:  0.034
Epoch   3 Batch  351/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.931, Loss:  0.024
Epoch   3 Batch  352/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.926, Loss:  0.019
Epoch   3 Batch  353/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.927, Loss:  0.032
Epoch   3 Batch  354/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.933, Loss:  0.041
Epoch   3 Batch  355/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.935, Loss:  0.024
Epoch   3 Batch  356/1077 - Train Accuracy:  0.984, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  357/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  358/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  0.034
Epoch   3 Batch  359/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.953, Loss:  0.030
Epoch   3 Batch  360/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  361/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.948, Loss:  0.033
Epoch   3 Batch  362/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.946, Loss:  0.030
Epoch   3 Batch  363/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.937, Loss:  0.025
Epoch   3 Batch  364/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.938, Loss:  0.029
Epoch   3 Batch  365/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.937, Loss:  0.021
Epoch   3 Batch  366/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  0.024
Epoch   3 Batch  367/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.943, Loss:  0.019
Epoch   3 Batch  368/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.031
Epoch   3 Batch  369/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  0.028
Epoch   3 Batch  370/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.027
Epoch   3 Batch  371/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.957, Loss:  0.019
Epoch   3 Batch  372/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.957, Loss:  0.022
Epoch   3 Batch  373/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  0.022
Epoch   3 Batch  374/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.957, Loss:  0.032
Epoch   3 Batch  375/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  0.029
Epoch   3 Batch  376/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  377/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.024
Epoch   3 Batch  378/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.021
Epoch   3 Batch  379/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.951, Loss:  0.035
Epoch   3 Batch  380/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.023
Epoch   3 Batch  381/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  0.031
Epoch   3 Batch  382/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.951, Loss:  0.044
Epoch   3 Batch  383/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  384/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.942, Loss:  0.024
Epoch   3 Batch  385/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.947, Loss:  0.022
Epoch   3 Batch  386/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.029
Epoch   3 Batch  387/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.025
Epoch   3 Batch  388/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  0.028
Epoch   3 Batch  389/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.942, Loss:  0.030
Epoch   3 Batch  390/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.943, Loss:  0.036
Epoch   3 Batch  391/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.939, Loss:  0.038
Epoch   3 Batch  392/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  0.033
Epoch   3 Batch  393/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.022
Epoch   3 Batch  394/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.947, Loss:  0.026
Epoch   3 Batch  395/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  0.026
Epoch   3 Batch  396/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.945, Loss:  0.027
Epoch   3 Batch  397/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.033
Epoch   3 Batch  398/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.026
Epoch   3 Batch  399/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch  400/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.947, Loss:  0.033
Epoch   3 Batch  401/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.945, Loss:  0.023
Epoch   3 Batch  402/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  0.019
Epoch   3 Batch  403/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  0.032
Epoch   3 Batch  404/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.031
Epoch   3 Batch  405/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  406/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch  407/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  408/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.945, Loss:  0.026
Epoch   3 Batch  409/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.946, Loss:  0.036
Epoch   3 Batch  410/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.957, Loss:  0.045
Epoch   3 Batch  411/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.960, Loss:  0.023
Epoch   3 Batch  412/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.946, Loss:  0.025
Epoch   3 Batch  413/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.946, Loss:  0.025
Epoch   3 Batch  414/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.946, Loss:  0.027
Epoch   3 Batch  415/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  0.033
Epoch   3 Batch  416/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.946, Loss:  0.024
Epoch   3 Batch  417/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  0.051
Epoch   3 Batch  418/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  419/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch  420/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  421/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  0.037
Epoch   3 Batch  422/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  0.021
Epoch   3 Batch  423/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.936, Loss:  0.042
Epoch   3 Batch  424/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.943, Loss:  0.027
Epoch   3 Batch  425/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.950, Loss:  0.021
Epoch   3 Batch  426/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch  427/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  428/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.945, Loss:  0.020
Epoch   3 Batch  429/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  0.023
Epoch   3 Batch  430/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  431/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.022
Epoch   3 Batch  432/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.946, Loss:  0.026
Epoch   3 Batch  433/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.030
Epoch   3 Batch  434/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  435/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.943, Loss:  0.039
Epoch   3 Batch  436/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.936, Loss:  0.021
Epoch   3 Batch  437/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.018
Epoch   3 Batch  438/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.938, Loss:  0.027
Epoch   3 Batch  439/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.937, Loss:  0.039
Epoch   3 Batch  440/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.932, Loss:  0.034
Epoch   3 Batch  441/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.936, Loss:  0.026
Epoch   3 Batch  442/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.027
Epoch   3 Batch  443/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.938, Loss:  0.025
Epoch   3 Batch  444/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  0.024
Epoch   3 Batch  445/1077 - Train Accuracy:  0.929, Validation Accuracy:  0.941, Loss:  0.029
Epoch   3 Batch  446/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.941, Loss:  0.022
Epoch   3 Batch  447/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.935, Loss:  0.030
Epoch   3 Batch  448/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.941, Loss:  0.034
Epoch   3 Batch  449/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.940, Loss:  0.029
Epoch   3 Batch  450/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.027
Epoch   3 Batch  451/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.945, Loss:  0.026
Epoch   3 Batch  452/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.026
Epoch   3 Batch  453/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.026
Epoch   3 Batch  454/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.030
Epoch   3 Batch  455/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.950, Loss:  0.027
Epoch   3 Batch  456/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.028
Epoch   3 Batch  457/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch  458/1077 - Train Accuracy:  0.925, Validation Accuracy:  0.953, Loss:  0.036
Epoch   3 Batch  459/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.030
Epoch   3 Batch  460/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch  461/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  462/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  463/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.945, Loss:  0.028
Epoch   3 Batch  464/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  0.030
Epoch   3 Batch  465/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.946, Loss:  0.029
Epoch   3 Batch  466/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.940, Loss:  0.023
Epoch   3 Batch  467/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.940, Loss:  0.029
Epoch   3 Batch  468/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.945, Loss:  0.027
Epoch   3 Batch  469/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.024
Epoch   3 Batch  470/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.025
Epoch   3 Batch  471/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.945, Loss:  0.022
Epoch   3 Batch  472/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  473/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  474/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  475/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  476/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  0.014
Epoch   3 Batch  477/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.951, Loss:  0.028
Epoch   3 Batch  478/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.946, Loss:  0.028
Epoch   3 Batch  479/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.947, Loss:  0.032
Epoch   3 Batch  480/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.024
Epoch   3 Batch  481/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  482/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.948, Loss:  0.024
Epoch   3 Batch  483/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  0.026
Epoch   3 Batch  484/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  0.037
Epoch   3 Batch  485/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.947, Loss:  0.024
Epoch   3 Batch  486/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.951, Loss:  0.019
Epoch   3 Batch  487/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.955, Loss:  0.024
Epoch   3 Batch  488/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  0.032
Epoch   3 Batch  489/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch  490/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.954, Loss:  0.033
Epoch   3 Batch  491/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  0.042
Epoch   3 Batch  492/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.962, Loss:  0.032
Epoch   3 Batch  493/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.023
Epoch   3 Batch  494/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  0.022
Epoch   3 Batch  495/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  0.024
Epoch   3 Batch  496/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.032
Epoch   3 Batch  497/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.032
Epoch   3 Batch  498/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  0.026
Epoch   3 Batch  499/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.023
Epoch   3 Batch  500/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.019
Epoch   3 Batch  501/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.020
Epoch   3 Batch  502/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.035
Epoch   3 Batch  503/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  0.024
Epoch   3 Batch  504/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  0.015
Epoch   3 Batch  505/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.021
Epoch   3 Batch  506/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.953, Loss:  0.036
Epoch   3 Batch  507/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.027
Epoch   3 Batch  508/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.949, Loss:  0.018
Epoch   3 Batch  509/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.945, Loss:  0.028
Epoch   3 Batch  510/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.945, Loss:  0.028
Epoch   3 Batch  511/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.940, Loss:  0.029
Epoch   3 Batch  512/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.940, Loss:  0.023
Epoch   3 Batch  513/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  0.028
Epoch   3 Batch  514/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.942, Loss:  0.027
Epoch   3 Batch  515/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.019
Epoch   3 Batch  516/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.030
Epoch   3 Batch  517/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  0.031
Epoch   3 Batch  518/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  519/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  520/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.955, Loss:  0.020
Epoch   3 Batch  521/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.020
Epoch   3 Batch  522/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.956, Loss:  0.028
Epoch   3 Batch  523/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.029
Epoch   3 Batch  524/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.023
Epoch   3 Batch  525/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.956, Loss:  0.029
Epoch   3 Batch  526/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  0.030
Epoch   3 Batch  527/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  0.030
Epoch   3 Batch  528/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  529/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.029
Epoch   3 Batch  530/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.027
Epoch   3 Batch  531/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  0.025
Epoch   3 Batch  532/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.957, Loss:  0.042
Epoch   3 Batch  533/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  0.021
Epoch   3 Batch  534/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch  535/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  0.024
Epoch   3 Batch  536/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  0.022
Epoch   3 Batch  537/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.020
Epoch   3 Batch  538/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  0.025
Epoch   3 Batch  539/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.038
Epoch   3 Batch  540/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.023
Epoch   3 Batch  541/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.951, Loss:  0.018
Epoch   3 Batch  542/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.025
Epoch   3 Batch  543/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  544/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.019
Epoch   3 Batch  545/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.031
Epoch   3 Batch  546/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.940, Loss:  0.030
Epoch   3 Batch  547/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.940, Loss:  0.025
Epoch   3 Batch  548/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.940, Loss:  0.037
Epoch   3 Batch  549/1077 - Train Accuracy:  0.928, Validation Accuracy:  0.946, Loss:  0.033
Epoch   3 Batch  550/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  0.029
Epoch   3 Batch  551/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.941, Loss:  0.040
Epoch   3 Batch  552/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.936, Loss:  0.036
Epoch   3 Batch  553/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.943, Loss:  0.043
Epoch   3 Batch  554/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  0.024
Epoch   3 Batch  555/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.019
Epoch   3 Batch  556/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.020
Epoch   3 Batch  557/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.025
Epoch   3 Batch  558/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.021
Epoch   3 Batch  559/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  0.032
Epoch   3 Batch  560/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.959, Loss:  0.027
Epoch   3 Batch  561/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.959, Loss:  0.016
Epoch   3 Batch  562/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.959, Loss:  0.025
Epoch   3 Batch  563/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  0.025
Epoch   3 Batch  564/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.959, Loss:  0.027
Epoch   3 Batch  565/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.959, Loss:  0.035
Epoch   3 Batch  566/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  0.027
Epoch   3 Batch  567/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.958, Loss:  0.026
Epoch   3 Batch  568/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  0.029
Epoch   3 Batch  569/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  0.029
Epoch   3 Batch  570/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  0.039
Epoch   3 Batch  571/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  0.021
Epoch   3 Batch  572/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.025
Epoch   3 Batch  573/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  0.037
Epoch   3 Batch  574/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.949, Loss:  0.036
Epoch   3 Batch  575/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.020
Epoch   3 Batch  576/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.951, Loss:  0.023
Epoch   3 Batch  577/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  0.029
Epoch   3 Batch  578/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  579/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch  580/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.951, Loss:  0.019
Epoch   3 Batch  581/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  0.021
Epoch   3 Batch  582/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  0.020
Epoch   3 Batch  583/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  0.032
Epoch   3 Batch  584/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  0.028
Epoch   3 Batch  585/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.016
Epoch   3 Batch  586/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  0.025
Epoch   3 Batch  587/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.961, Loss:  0.034
Epoch   3 Batch  588/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.961, Loss:  0.028
Epoch   3 Batch  589/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  0.029
Epoch   3 Batch  590/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  0.034
Epoch   3 Batch  591/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.960, Loss:  0.032
Epoch   3 Batch  592/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  0.032
Epoch   3 Batch  593/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.945, Loss:  0.041
Epoch   3 Batch  594/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.950, Loss:  0.038
Epoch   3 Batch  595/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.946, Loss:  0.021
Epoch   3 Batch  596/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.937, Loss:  0.028
Epoch   3 Batch  597/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.936, Loss:  0.023
Epoch   3 Batch  598/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.936, Loss:  0.028
Epoch   3 Batch  599/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.941, Loss:  0.035
Epoch   3 Batch  600/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.945, Loss:  0.028
Epoch   3 Batch  601/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.950, Loss:  0.028
Epoch   3 Batch  602/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.024
Epoch   3 Batch  603/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.940, Loss:  0.021
Epoch   3 Batch  604/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.941, Loss:  0.041
Epoch   3 Batch  605/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.945, Loss:  0.035
Epoch   3 Batch  606/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.021
Epoch   3 Batch  607/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.033
Epoch   3 Batch  608/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  609/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  610/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  0.030
Epoch   3 Batch  611/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  0.020
Epoch   3 Batch  612/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.955, Loss:  0.020
Epoch   3 Batch  613/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.027
Epoch   3 Batch  614/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  0.019
Epoch   3 Batch  615/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.946, Loss:  0.018
Epoch   3 Batch  616/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.946, Loss:  0.022
Epoch   3 Batch  617/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  618/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.028
Epoch   3 Batch  619/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  0.016
Epoch   3 Batch  620/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  0.023
Epoch   3 Batch  621/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  0.024
Epoch   3 Batch  622/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.035
Epoch   3 Batch  623/1077 - Train Accuracy:  0.936, Validation Accuracy:  0.950, Loss:  0.029
Epoch   3 Batch  624/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch  625/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  626/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.954, Loss:  0.019
Epoch   3 Batch  627/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  0.028
Epoch   3 Batch  628/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.028
Epoch   3 Batch  629/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.031
Epoch   3 Batch  630/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.956, Loss:  0.027
Epoch   3 Batch  631/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.027
Epoch   3 Batch  632/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  0.023
Epoch   3 Batch  633/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  0.031
Epoch   3 Batch  634/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.960, Loss:  0.018
Epoch   3 Batch  635/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  0.033
Epoch   3 Batch  636/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  0.024
Epoch   3 Batch  637/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.023
Epoch   3 Batch  638/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.023
Epoch   3 Batch  639/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  0.040
Epoch   3 Batch  640/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  0.021
Epoch   3 Batch  641/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  0.020
Epoch   3 Batch  642/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  0.027
Epoch   3 Batch  643/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  0.018
Epoch   3 Batch  644/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.960, Loss:  0.028
Epoch   3 Batch  645/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  0.026
Epoch   3 Batch  646/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.953, Loss:  0.022
Epoch   3 Batch  647/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  648/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.024
Epoch   3 Batch  649/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.947, Loss:  0.025
Epoch   3 Batch  650/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.947, Loss:  0.029
Epoch   3 Batch  651/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  652/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.962, Loss:  0.032
Epoch   3 Batch  653/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  654/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.951, Loss:  0.015
Epoch   3 Batch  655/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  0.030
Epoch   3 Batch  656/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.956, Loss:  0.027
Epoch   3 Batch  657/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.021
Epoch   3 Batch  658/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.017
Epoch   3 Batch  659/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  0.028
Epoch   3 Batch  660/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.955, Loss:  0.023
Epoch   3 Batch  661/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.024
Epoch   3 Batch  662/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  0.026
Epoch   3 Batch  663/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  0.020
Epoch   3 Batch  664/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  665/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  0.018
Epoch   3 Batch  666/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  0.026
Epoch   3 Batch  667/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  0.030
Epoch   3 Batch  668/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.027
Epoch   3 Batch  669/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.961, Loss:  0.025
Epoch   3 Batch  670/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  0.027
Epoch   3 Batch  671/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  0.029
Epoch   3 Batch  672/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.024
Epoch   3 Batch  673/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.960, Loss:  0.024
Epoch   3 Batch  674/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  0.029
Epoch   3 Batch  675/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.955, Loss:  0.029
Epoch   3 Batch  676/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.024
Epoch   3 Batch  677/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  0.030
Epoch   3 Batch  678/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  0.023
Epoch   3 Batch  679/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  0.022
Epoch   3 Batch  680/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.953, Loss:  0.025
Epoch   3 Batch  681/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.025
Epoch   3 Batch  682/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.955, Loss:  0.024
Epoch   3 Batch  683/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  0.019
Epoch   3 Batch  684/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  0.030
Epoch   3 Batch  685/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  0.030
Epoch   3 Batch  686/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.022
Epoch   3 Batch  687/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.956, Loss:  0.030
Epoch   3 Batch  688/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.956, Loss:  0.022
Epoch   3 Batch  689/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.018
Epoch   3 Batch  690/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.954, Loss:  0.033
Epoch   3 Batch  691/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  0.029
Epoch   3 Batch  692/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.950, Loss:  0.021
Epoch   3 Batch  693/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.947, Loss:  0.040
Epoch   3 Batch  694/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  0.026
Epoch   3 Batch  695/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.949, Loss:  0.026
Epoch   3 Batch  696/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch  697/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.954, Loss:  0.024
Epoch   3 Batch  698/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.018
Epoch   3 Batch  699/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  0.019
Epoch   3 Batch  700/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.962, Loss:  0.020
Epoch   3 Batch  701/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.025
Epoch   3 Batch  702/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.952, Loss:  0.036
Epoch   3 Batch  703/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.031
Epoch   3 Batch  704/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.961, Loss:  0.036
Epoch   3 Batch  705/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.961, Loss:  0.038
Epoch   3 Batch  706/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.964, Loss:  0.058
Epoch   3 Batch  707/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  0.027
Epoch   3 Batch  708/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.959, Loss:  0.022
Epoch   3 Batch  709/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.959, Loss:  0.032
Epoch   3 Batch  710/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  0.018
Epoch   3 Batch  711/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.959, Loss:  0.029
Epoch   3 Batch  712/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.954, Loss:  0.024
Epoch   3 Batch  713/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.954, Loss:  0.021
Epoch   3 Batch  714/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.019
Epoch   3 Batch  715/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.949, Loss:  0.035
Epoch   3 Batch  716/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  717/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.949, Loss:  0.015
Epoch   3 Batch  718/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.023
Epoch   3 Batch  719/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.949, Loss:  0.028
Epoch   3 Batch  720/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  0.026
Epoch   3 Batch  721/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  0.025
Epoch   3 Batch  722/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.954, Loss:  0.019
Epoch   3 Batch  723/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  724/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.033
Epoch   3 Batch  725/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.023
Epoch   3 Batch  726/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.949, Loss:  0.023
Epoch   3 Batch  727/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.949, Loss:  0.019
Epoch   3 Batch  728/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  729/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  0.034
Epoch   3 Batch  730/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.034
Epoch   3 Batch  731/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.949, Loss:  0.026
Epoch   3 Batch  732/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  733/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.027
Epoch   3 Batch  734/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  0.019
Epoch   3 Batch  735/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.024
Epoch   3 Batch  736/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.020
Epoch   3 Batch  737/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.954, Loss:  0.027
Epoch   3 Batch  738/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  0.020
Epoch   3 Batch  739/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.018
Epoch   3 Batch  740/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.950, Loss:  0.021
Epoch   3 Batch  741/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.032
Epoch   3 Batch  742/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.020
Epoch   3 Batch  743/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.954, Loss:  0.030
Epoch   3 Batch  744/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.954, Loss:  0.021
Epoch   3 Batch  745/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  0.021
Epoch   3 Batch  746/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.022
Epoch   3 Batch  747/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.016
Epoch   3 Batch  748/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.019
Epoch   3 Batch  749/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.949, Loss:  0.019
Epoch   3 Batch  750/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  0.020
Epoch   3 Batch  751/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.029
Epoch   3 Batch  752/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.028
Epoch   3 Batch  753/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.947, Loss:  0.019
Epoch   3 Batch  754/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.949, Loss:  0.025
Epoch   3 Batch  755/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  0.027
Epoch   3 Batch  756/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.947, Loss:  0.024
Epoch   3 Batch  757/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  0.017
Epoch   3 Batch  758/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.025
Epoch   3 Batch  759/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.953, Loss:  0.021
Epoch   3 Batch  760/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  0.029
Epoch   3 Batch  761/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.028
Epoch   3 Batch  762/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.948, Loss:  0.022
Epoch   3 Batch  763/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.939, Loss:  0.025
Epoch   3 Batch  764/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.940, Loss:  0.024
Epoch   3 Batch  765/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch  766/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  0.029
Epoch   3 Batch  767/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.959, Loss:  0.024
Epoch   3 Batch  768/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  0.022
Epoch   3 Batch  769/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  0.030
Epoch   3 Batch  770/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  0.021
Epoch   3 Batch  771/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.024
Epoch   3 Batch  772/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.944, Loss:  0.021
Epoch   3 Batch  773/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.944, Loss:  0.026
Epoch   3 Batch  774/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.948, Loss:  0.032
Epoch   3 Batch  775/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  776/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.023
Epoch   3 Batch  777/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  778/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  779/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch  780/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.947, Loss:  0.032
Epoch   3 Batch  781/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  0.021
Epoch   3 Batch  782/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.946, Loss:  0.030
Epoch   3 Batch  783/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  0.024
Epoch   3 Batch  784/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.020
Epoch   3 Batch  785/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.943, Loss:  0.025
Epoch   3 Batch  786/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.943, Loss:  0.028
Epoch   3 Batch  787/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.944, Loss:  0.023
Epoch   3 Batch  788/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.021
Epoch   3 Batch  789/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  0.025
Epoch   3 Batch  790/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.953, Loss:  0.029
Epoch   3 Batch  791/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.958, Loss:  0.021
Epoch   3 Batch  792/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.031
Epoch   3 Batch  793/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.025
Epoch   3 Batch  794/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.964, Loss:  0.016
Epoch   3 Batch  795/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.964, Loss:  0.029
Epoch   3 Batch  796/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  0.026
Epoch   3 Batch  797/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.963, Loss:  0.019
Epoch   3 Batch  798/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.024
Epoch   3 Batch  799/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.960, Loss:  0.033
Epoch   3 Batch  800/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.017
Epoch   3 Batch  801/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  0.027
Epoch   3 Batch  802/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  0.025
Epoch   3 Batch  803/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.956, Loss:  0.028
Epoch   3 Batch  804/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.018
Epoch   3 Batch  805/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.954, Loss:  0.027
Epoch   3 Batch  806/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.022
Epoch   3 Batch  807/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.944, Loss:  0.021
Epoch   3 Batch  808/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  0.035
Epoch   3 Batch  809/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.946, Loss:  0.039
Epoch   3 Batch  810/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.951, Loss:  0.018
Epoch   3 Batch  811/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.025
Epoch   3 Batch  812/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  0.019
Epoch   3 Batch  813/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.950, Loss:  0.029
Epoch   3 Batch  814/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.955, Loss:  0.025
Epoch   3 Batch  815/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.022
Epoch   3 Batch  816/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.956, Loss:  0.023
Epoch   3 Batch  817/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  818/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.951, Loss:  0.034
Epoch   3 Batch  819/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  0.029
Epoch   3 Batch  820/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.949, Loss:  0.020
Epoch   3 Batch  821/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  822/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.019
Epoch   3 Batch  823/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  824/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  0.032
Epoch   3 Batch  825/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.944, Loss:  0.016
Epoch   3 Batch  826/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.949, Loss:  0.032
Epoch   3 Batch  827/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.949, Loss:  0.027
Epoch   3 Batch  828/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  829/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.958, Loss:  0.036
Epoch   3 Batch  830/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.958, Loss:  0.031
Epoch   3 Batch  831/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.958, Loss:  0.022
Epoch   3 Batch  832/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  0.023
Epoch   3 Batch  833/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  0.027
Epoch   3 Batch  834/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.025
Epoch   3 Batch  835/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  0.026
Epoch   3 Batch  836/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  0.023
Epoch   3 Batch  837/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.960, Loss:  0.042
Epoch   3 Batch  838/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.023
Epoch   3 Batch  839/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  0.015
Epoch   3 Batch  840/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.019
Epoch   3 Batch  841/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.962, Loss:  0.031
Epoch   3 Batch  842/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.964, Loss:  0.023
Epoch   3 Batch  843/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  0.018
Epoch   3 Batch  844/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  0.021
Epoch   3 Batch  845/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.958, Loss:  0.017
Epoch   3 Batch  846/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  0.025
Epoch   3 Batch  847/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  0.029
Epoch   3 Batch  848/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.022
Epoch   3 Batch  849/1077 - Train Accuracy:  0.984, Validation Accuracy:  0.949, Loss:  0.015
Epoch   3 Batch  850/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  0.040
Epoch   3 Batch  851/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.960, Loss:  0.035
Epoch   3 Batch  852/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  0.032
Epoch   3 Batch  853/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.960, Loss:  0.025
Epoch   3 Batch  854/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.950, Loss:  0.026
Epoch   3 Batch  855/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.021
Epoch   3 Batch  856/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.028
Epoch   3 Batch  857/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.959, Loss:  0.021
Epoch   3 Batch  858/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.018
Epoch   3 Batch  859/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  0.023
Epoch   3 Batch  860/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.023
Epoch   3 Batch  861/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.022
Epoch   3 Batch  862/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.967, Loss:  0.025
Epoch   3 Batch  863/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  0.019
Epoch   3 Batch  864/1077 - Train Accuracy:  0.931, Validation Accuracy:  0.957, Loss:  0.021
Epoch   3 Batch  865/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.957, Loss:  0.032
Epoch   3 Batch  866/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch  867/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.959, Loss:  0.055
Epoch   3 Batch  868/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  0.034
Epoch   3 Batch  869/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  0.024
Epoch   3 Batch  870/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  0.028
Epoch   3 Batch  871/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.023
Epoch   3 Batch  872/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.026
Epoch   3 Batch  873/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  0.024
Epoch   3 Batch  874/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.951, Loss:  0.032
Epoch   3 Batch  875/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  0.029
Epoch   3 Batch  876/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  0.018
Epoch   3 Batch  877/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.023
Epoch   3 Batch  878/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.968, Loss:  0.022
Epoch   3 Batch  879/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  0.019
Epoch   3 Batch  880/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  0.036
Epoch   3 Batch  881/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.968, Loss:  0.032
Epoch   3 Batch  882/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  0.023
Epoch   3 Batch  883/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.960, Loss:  0.035
Epoch   3 Batch  884/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  0.024
Epoch   3 Batch  885/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  0.024
Epoch   3 Batch  886/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.023
Epoch   3 Batch  887/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.956, Loss:  0.033
Epoch   3 Batch  888/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  0.021
Epoch   3 Batch  889/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.026
Epoch   3 Batch  890/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.942, Loss:  0.024
Epoch   3 Batch  891/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.942, Loss:  0.019
Epoch   3 Batch  892/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  0.021
Epoch   3 Batch  893/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.948, Loss:  0.027
Epoch   3 Batch  894/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.948, Loss:  0.020
Epoch   3 Batch  895/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.948, Loss:  0.024
Epoch   3 Batch  896/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.947, Loss:  0.023
Epoch   3 Batch  897/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.025
Epoch   3 Batch  898/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  0.023
Epoch   3 Batch  899/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  0.025
Epoch   3 Batch  900/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.948, Loss:  0.032
Epoch   3 Batch  901/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  0.037
Epoch   3 Batch  902/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.958, Loss:  0.031
Epoch   3 Batch  903/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  0.026
Epoch   3 Batch  904/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.944, Loss:  0.024
Epoch   3 Batch  905/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  0.018
Epoch   3 Batch  906/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.944, Loss:  0.024
Epoch   3 Batch  907/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.940, Loss:  0.023
Epoch   3 Batch  908/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  0.026
Epoch   3 Batch  909/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.037
Epoch   3 Batch  910/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  0.029
Epoch   3 Batch  911/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.949, Loss:  0.024
Epoch   3 Batch  912/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.021
Epoch   3 Batch  913/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.040
Epoch   3 Batch  914/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.947, Loss:  0.050
Epoch   3 Batch  915/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.945, Loss:  0.017
Epoch   3 Batch  916/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.025
Epoch   3 Batch  917/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  0.022
Epoch   3 Batch  918/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  0.017
Epoch   3 Batch  919/1077 - Train Accuracy:  0.985, Validation Accuracy:  0.962, Loss:  0.018
Epoch   3 Batch  920/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  0.020
Epoch   3 Batch  921/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.966, Loss:  0.025
Epoch   3 Batch  922/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.028
Epoch   3 Batch  923/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.962, Loss:  0.021
Epoch   3 Batch  924/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch  925/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  0.023
Epoch   3 Batch  926/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.025
Epoch   3 Batch  927/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.957, Loss:  0.031
Epoch   3 Batch  928/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.957, Loss:  0.021
Epoch   3 Batch  929/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  0.024
Epoch   3 Batch  930/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  0.022
Epoch   3 Batch  931/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  0.022
Epoch   3 Batch  932/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.966, Loss:  0.018
Epoch   3 Batch  933/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.962, Loss:  0.026
Epoch   3 Batch  934/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.961, Loss:  0.020
Epoch   3 Batch  935/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.961, Loss:  0.020
Epoch   3 Batch  936/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.961, Loss:  0.033
Epoch   3 Batch  937/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  0.024
Epoch   3 Batch  938/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  0.027
Epoch   3 Batch  939/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  0.031
Epoch   3 Batch  940/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.018
Epoch   3 Batch  941/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  0.025
Epoch   3 Batch  942/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.957, Loss:  0.028
Epoch   3 Batch  943/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.018
Epoch   3 Batch  944/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.971, Loss:  0.015
Epoch   3 Batch  945/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  0.017
Epoch   3 Batch  946/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  0.017
Epoch   3 Batch  947/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.970, Loss:  0.022
Epoch   3 Batch  948/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  0.026
Epoch   3 Batch  949/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  0.023
Epoch   3 Batch  950/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  0.017
Epoch   3 Batch  951/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.960, Loss:  0.035
Epoch   3 Batch  952/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  0.015
Epoch   3 Batch  953/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.956, Loss:  0.020
Epoch   3 Batch  954/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.032
Epoch   3 Batch  955/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  956/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  0.027
Epoch   3 Batch  957/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.956, Loss:  0.014
Epoch   3 Batch  958/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  959/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  960/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.027
Epoch   3 Batch  961/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.957, Loss:  0.018
Epoch   3 Batch  962/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  0.028
Epoch   3 Batch  963/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  0.034
Epoch   3 Batch  964/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.963, Loss:  0.025
Epoch   3 Batch  965/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.963, Loss:  0.021
Epoch   3 Batch  966/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  0.021
Epoch   3 Batch  967/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.020
Epoch   3 Batch  968/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.963, Loss:  0.029
Epoch   3 Batch  969/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.963, Loss:  0.029
Epoch   3 Batch  970/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  0.023
Epoch   3 Batch  971/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  0.034
Epoch   3 Batch  972/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.025
Epoch   3 Batch  973/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  0.018
Epoch   3 Batch  974/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  0.016
Epoch   3 Batch  975/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.956, Loss:  0.019
Epoch   3 Batch  976/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  0.019
Epoch   3 Batch  977/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.015
Epoch   3 Batch  978/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.950, Loss:  0.020
Epoch   3 Batch  979/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.945, Loss:  0.018
Epoch   3 Batch  980/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.948, Loss:  0.023
Epoch   3 Batch  981/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.952, Loss:  0.028
Epoch   3 Batch  982/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch  983/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.948, Loss:  0.022
Epoch   3 Batch  984/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.952, Loss:  0.031
Epoch   3 Batch  985/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.952, Loss:  0.019
Epoch   3 Batch  986/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.024
Epoch   3 Batch  987/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  0.020
Epoch   3 Batch  988/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.945, Loss:  0.029
Epoch   3 Batch  989/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.023
Epoch   3 Batch  990/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  991/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch  992/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.957, Loss:  0.030
Epoch   3 Batch  993/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  0.018
Epoch   3 Batch  994/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.955, Loss:  0.018
Epoch   3 Batch  995/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  0.023
Epoch   3 Batch  996/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.020
Epoch   3 Batch  997/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch  998/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.950, Loss:  0.022
Epoch   3 Batch  999/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.032
Epoch   3 Batch 1000/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.959, Loss:  0.027
Epoch   3 Batch 1001/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  0.017
Epoch   3 Batch 1002/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.959, Loss:  0.013
Epoch   3 Batch 1003/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.964, Loss:  0.023
Epoch   3 Batch 1004/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  0.027
Epoch   3 Batch 1005/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.964, Loss:  0.020
Epoch   3 Batch 1006/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.964, Loss:  0.025
Epoch   3 Batch 1007/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  0.021
Epoch   3 Batch 1008/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.968, Loss:  0.037
Epoch   3 Batch 1009/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  0.012
Epoch   3 Batch 1010/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  0.021
Epoch   3 Batch 1011/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  0.017
Epoch   3 Batch 1012/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  0.021
Epoch   3 Batch 1013/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  0.021
Epoch   3 Batch 1014/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.024
Epoch   3 Batch 1015/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch 1016/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.946, Loss:  0.019
Epoch   3 Batch 1017/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.022
Epoch   3 Batch 1018/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  0.028
Epoch   3 Batch 1019/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.960, Loss:  0.031
Epoch   3 Batch 1020/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.954, Loss:  0.015
Epoch   3 Batch 1021/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.019
Epoch   3 Batch 1022/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.954, Loss:  0.021
Epoch   3 Batch 1023/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.958, Loss:  0.030
Epoch   3 Batch 1024/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.963, Loss:  0.031
Epoch   3 Batch 1025/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.963, Loss:  0.021
Epoch   3 Batch 1026/1077 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  0.027
Epoch   3 Batch 1027/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  0.021
Epoch   3 Batch 1028/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.958, Loss:  0.025
Epoch   3 Batch 1029/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.960, Loss:  0.026
Epoch   3 Batch 1030/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.960, Loss:  0.021
Epoch   3 Batch 1031/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.953, Loss:  0.031
Epoch   3 Batch 1032/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  0.034
Epoch   3 Batch 1033/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.955, Loss:  0.026
Epoch   3 Batch 1034/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.949, Loss:  0.023
Epoch   3 Batch 1035/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.951, Loss:  0.015
Epoch   3 Batch 1036/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  0.033
Epoch   3 Batch 1037/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  0.027
Epoch   3 Batch 1038/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.959, Loss:  0.028
Epoch   3 Batch 1039/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  0.023
Epoch   3 Batch 1040/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.025
Epoch   3 Batch 1041/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.961, Loss:  0.029
Epoch   3 Batch 1042/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.957, Loss:  0.017
Epoch   3 Batch 1043/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.954, Loss:  0.025
Epoch   3 Batch 1044/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  0.035
Epoch   3 Batch 1045/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.950, Loss:  0.023
Epoch   3 Batch 1046/1077 - Train Accuracy:  0.983, Validation Accuracy:  0.950, Loss:  0.009
Epoch   3 Batch 1047/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.946, Loss:  0.022
Epoch   3 Batch 1048/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.941, Loss:  0.020
Epoch   3 Batch 1049/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  0.016
Epoch   3 Batch 1050/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.947, Loss:  0.014
Epoch   3 Batch 1051/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  0.028
Epoch   3 Batch 1052/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  0.021
Epoch   3 Batch 1053/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.024
Epoch   3 Batch 1054/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.948, Loss:  0.023
Epoch   3 Batch 1055/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.022
Epoch   3 Batch 1056/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.954, Loss:  0.019
Epoch   3 Batch 1057/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  0.032
Epoch   3 Batch 1058/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.023
Epoch   3 Batch 1059/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.951, Loss:  0.034
Epoch   3 Batch 1060/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.020
Epoch   3 Batch 1061/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.951, Loss:  0.026
Epoch   3 Batch 1062/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.961, Loss:  0.021
Epoch   3 Batch 1063/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  0.030
Epoch   3 Batch 1064/1077 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  0.023
Epoch   3 Batch 1065/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.962, Loss:  0.024
Epoch   3 Batch 1066/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  0.018
Epoch   3 Batch 1067/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.960, Loss:  0.024
Epoch   3 Batch 1068/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  0.017
Epoch   3 Batch 1069/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.015
Epoch   3 Batch 1070/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  0.018
Epoch   3 Batch 1071/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.953, Loss:  0.028
Epoch   3 Batch 1072/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.953, Loss:  0.020
Epoch   3 Batch 1073/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  0.026
Epoch   3 Batch 1074/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.957, Loss:  0.028
Epoch   3 Batch 1075/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.953, Loss:  0.028
Epoch   4 Batch    0/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.018
Epoch   4 Batch    1/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  0.018
Epoch   4 Batch    2/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.953, Loss:  0.019
Epoch   4 Batch    3/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.949, Loss:  0.035
Epoch   4 Batch    4/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.027
Epoch   4 Batch    5/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.949, Loss:  0.032
Epoch   4 Batch    6/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  0.014
Epoch   4 Batch    7/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  0.015
Epoch   4 Batch    8/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch    9/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.022
Epoch   4 Batch   10/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch   11/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.961, Loss:  0.030
Epoch   4 Batch   12/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch   13/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  0.022
Epoch   4 Batch   14/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  0.015
Epoch   4 Batch   15/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.022
Epoch   4 Batch   16/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch   17/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch   18/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  0.024
Epoch   4 Batch   19/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.957, Loss:  0.021
Epoch   4 Batch   20/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch   21/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.028
Epoch   4 Batch   22/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.028
Epoch   4 Batch   23/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.027
Epoch   4 Batch   24/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch   25/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  0.013
Epoch   4 Batch   26/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.959, Loss:  0.030
Epoch   4 Batch   27/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch   28/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.027
Epoch   4 Batch   29/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  0.022
Epoch   4 Batch   30/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  0.019
Epoch   4 Batch   31/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  0.018
Epoch   4 Batch   32/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch   33/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.954, Loss:  0.020
Epoch   4 Batch   34/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.949, Loss:  0.020
Epoch   4 Batch   35/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  0.021
Epoch   4 Batch   36/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.949, Loss:  0.021
Epoch   4 Batch   37/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  0.028
Epoch   4 Batch   38/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.031
Epoch   4 Batch   39/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.952, Loss:  0.029
Epoch   4 Batch   40/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.952, Loss:  0.019
Epoch   4 Batch   41/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  0.017
Epoch   4 Batch   42/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  0.037
Epoch   4 Batch   43/1077 - Train Accuracy:  0.986, Validation Accuracy:  0.956, Loss:  0.012
Epoch   4 Batch   44/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.954, Loss:  0.015
Epoch   4 Batch   45/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  0.023
Epoch   4 Batch   46/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch   47/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.026
Epoch   4 Batch   48/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.030
Epoch   4 Batch   49/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  0.029
Epoch   4 Batch   50/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.950, Loss:  0.020
Epoch   4 Batch   51/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.950, Loss:  0.025
Epoch   4 Batch   52/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  0.030
Epoch   4 Batch   53/1077 - Train Accuracy:  0.930, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch   54/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.036
Epoch   4 Batch   55/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  0.023
Epoch   4 Batch   56/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.960, Loss:  0.014
Epoch   4 Batch   57/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  0.021
Epoch   4 Batch   58/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  0.018
Epoch   4 Batch   59/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  0.020
Epoch   4 Batch   60/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  0.017
Epoch   4 Batch   61/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.964, Loss:  0.026
Epoch   4 Batch   62/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.964, Loss:  0.029
Epoch   4 Batch   63/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.963, Loss:  0.020
Epoch   4 Batch   64/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.958, Loss:  0.018
Epoch   4 Batch   65/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.958, Loss:  0.017
Epoch   4 Batch   66/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.015
Epoch   4 Batch   67/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.030
Epoch   4 Batch   68/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  0.032
Epoch   4 Batch   69/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  0.032
Epoch   4 Batch   70/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  0.029
Epoch   4 Batch   71/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.953, Loss:  0.017
Epoch   4 Batch   72/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  0.020
Epoch   4 Batch   73/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.947, Loss:  0.019
Epoch   4 Batch   74/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  0.027
Epoch   4 Batch   75/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.026
Epoch   4 Batch   76/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch   77/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch   78/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  0.023
Epoch   4 Batch   79/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.949, Loss:  0.015
Epoch   4 Batch   80/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.949, Loss:  0.019
Epoch   4 Batch   81/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  0.022
Epoch   4 Batch   82/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch   83/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.953, Loss:  0.019
Epoch   4 Batch   84/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.024
Epoch   4 Batch   85/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  0.022
Epoch   4 Batch   86/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.026
Epoch   4 Batch   87/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  0.022
Epoch   4 Batch   88/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch   89/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.014
Epoch   4 Batch   90/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.017
Epoch   4 Batch   91/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  0.021
Epoch   4 Batch   92/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.963, Loss:  0.026
Epoch   4 Batch   93/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.958, Loss:  0.016
Epoch   4 Batch   94/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.958, Loss:  0.024
Epoch   4 Batch   95/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.024
Epoch   4 Batch   96/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  0.028
Epoch   4 Batch   97/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.963, Loss:  0.026
Epoch   4 Batch   98/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  0.029
Epoch   4 Batch   99/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch  100/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  0.024
Epoch   4 Batch  101/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  0.020
Epoch   4 Batch  102/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.957, Loss:  0.019
Epoch   4 Batch  103/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  0.029
Epoch   4 Batch  104/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  0.029
Epoch   4 Batch  105/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.942, Loss:  0.018
Epoch   4 Batch  106/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.942, Loss:  0.029
Epoch   4 Batch  107/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.928, Loss:  0.034
Epoch   4 Batch  108/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.938, Loss:  0.028
Epoch   4 Batch  109/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.021
Epoch   4 Batch  110/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.950, Loss:  0.017
Epoch   4 Batch  111/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.945, Loss:  0.020
Epoch   4 Batch  112/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  113/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.026
Epoch   4 Batch  114/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.958, Loss:  0.019
Epoch   4 Batch  115/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.951, Loss:  0.025
Epoch   4 Batch  116/1077 - Train Accuracy:  0.934, Validation Accuracy:  0.961, Loss:  0.026
Epoch   4 Batch  117/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.951, Loss:  0.020
Epoch   4 Batch  118/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.953, Loss:  0.016
Epoch   4 Batch  119/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.958, Loss:  0.025
Epoch   4 Batch  120/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  121/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  122/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  0.018
Epoch   4 Batch  123/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.015
Epoch   4 Batch  124/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  0.025
Epoch   4 Batch  125/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.959, Loss:  0.037
Epoch   4 Batch  126/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  0.021
Epoch   4 Batch  127/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.950, Loss:  0.017
Epoch   4 Batch  128/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.950, Loss:  0.026
Epoch   4 Batch  129/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.949, Loss:  0.026
Epoch   4 Batch  130/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.020
Epoch   4 Batch  131/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.950, Loss:  0.027
Epoch   4 Batch  132/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.024
Epoch   4 Batch  133/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.951, Loss:  0.016
Epoch   4 Batch  134/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.954, Loss:  0.020
Epoch   4 Batch  135/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.949, Loss:  0.018
Epoch   4 Batch  136/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.949, Loss:  0.020
Epoch   4 Batch  137/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.953, Loss:  0.014
Epoch   4 Batch  138/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.021
Epoch   4 Batch  139/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.020
Epoch   4 Batch  140/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch  141/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.947, Loss:  0.019
Epoch   4 Batch  142/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.957, Loss:  0.018
Epoch   4 Batch  143/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  0.023
Epoch   4 Batch  144/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.034
Epoch   4 Batch  145/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  0.023
Epoch   4 Batch  146/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.941, Loss:  0.045
Epoch   4 Batch  147/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.941, Loss:  0.022
Epoch   4 Batch  148/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.941, Loss:  0.024
Epoch   4 Batch  149/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  0.019
Epoch   4 Batch  150/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.022
Epoch   4 Batch  151/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  0.020
Epoch   4 Batch  152/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  0.029
Epoch   4 Batch  153/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.959, Loss:  0.028
Epoch   4 Batch  154/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.959, Loss:  0.016
Epoch   4 Batch  155/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.959, Loss:  0.022
Epoch   4 Batch  156/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.960, Loss:  0.020
Epoch   4 Batch  157/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.960, Loss:  0.019
Epoch   4 Batch  158/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.960, Loss:  0.025
Epoch   4 Batch  159/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.020
Epoch   4 Batch  160/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch  161/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.955, Loss:  0.020
Epoch   4 Batch  162/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  0.026
Epoch   4 Batch  163/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.028
Epoch   4 Batch  164/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.948, Loss:  0.017
Epoch   4 Batch  165/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  166/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.957, Loss:  0.021
Epoch   4 Batch  167/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.020
Epoch   4 Batch  168/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.032
Epoch   4 Batch  169/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.032
Epoch   4 Batch  170/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  171/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch  172/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.949, Loss:  0.020
Epoch   4 Batch  173/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.033
Epoch   4 Batch  174/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.949, Loss:  0.015
Epoch   4 Batch  175/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.949, Loss:  0.022
Epoch   4 Batch  176/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  177/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.951, Loss:  0.020
Epoch   4 Batch  178/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  0.023
Epoch   4 Batch  179/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.947, Loss:  0.023
Epoch   4 Batch  180/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  0.016
Epoch   4 Batch  181/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.945, Loss:  0.027
Epoch   4 Batch  182/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  0.027
Epoch   4 Batch  183/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.024
Epoch   4 Batch  184/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.945, Loss:  0.023
Epoch   4 Batch  185/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.955, Loss:  0.027
Epoch   4 Batch  186/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.020
Epoch   4 Batch  187/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  0.017
Epoch   4 Batch  188/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.023
Epoch   4 Batch  189/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.951, Loss:  0.024
Epoch   4 Batch  190/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  0.021
Epoch   4 Batch  191/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  0.014
Epoch   4 Batch  192/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  0.023
Epoch   4 Batch  193/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  0.022
Epoch   4 Batch  194/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.954, Loss:  0.016
Epoch   4 Batch  195/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.017
Epoch   4 Batch  196/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.958, Loss:  0.015
Epoch   4 Batch  197/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.021
Epoch   4 Batch  198/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  0.020
Epoch   4 Batch  199/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  0.019
Epoch   4 Batch  200/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch  201/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  0.013
Epoch   4 Batch  202/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.016
Epoch   4 Batch  203/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  0.023
Epoch   4 Batch  204/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  0.038
Epoch   4 Batch  205/1077 - Train Accuracy:  0.926, Validation Accuracy:  0.963, Loss:  0.033
Epoch   4 Batch  206/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  0.020
Epoch   4 Batch  207/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  0.018
Epoch   4 Batch  208/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.964, Loss:  0.025
Epoch   4 Batch  209/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  0.016
Epoch   4 Batch  210/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.955, Loss:  0.018
Epoch   4 Batch  211/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.021
Epoch   4 Batch  212/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  0.014
Epoch   4 Batch  213/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.964, Loss:  0.017
Epoch   4 Batch  214/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.968, Loss:  0.017
Epoch   4 Batch  215/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.960, Loss:  0.024
Epoch   4 Batch  216/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.021
Epoch   4 Batch  217/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  0.012
Epoch   4 Batch  218/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  0.032
Epoch   4 Batch  219/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  0.012
Epoch   4 Batch  220/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  221/1077 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  0.020
Epoch   4 Batch  222/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.025
Epoch   4 Batch  223/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  224/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  0.021
Epoch   4 Batch  225/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.960, Loss:  0.030
Epoch   4 Batch  226/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.018
Epoch   4 Batch  227/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.967, Loss:  0.028
Epoch   4 Batch  228/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.014
Epoch   4 Batch  229/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.962, Loss:  0.019
Epoch   4 Batch  230/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.019
Epoch   4 Batch  231/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  0.027
Epoch   4 Batch  232/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  0.016
Epoch   4 Batch  233/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  0.030
Epoch   4 Batch  234/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  235/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch  236/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.961, Loss:  0.029
Epoch   4 Batch  237/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.016
Epoch   4 Batch  238/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  0.023
Epoch   4 Batch  239/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  0.012
Epoch   4 Batch  240/1077 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  0.019
Epoch   4 Batch  241/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.972, Loss:  0.021
Epoch   4 Batch  242/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.972, Loss:  0.017
Epoch   4 Batch  243/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.972, Loss:  0.023
Epoch   4 Batch  244/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  0.022
Epoch   4 Batch  245/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.969, Loss:  0.022
Epoch   4 Batch  246/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.969, Loss:  0.027
Epoch   4 Batch  247/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.969, Loss:  0.022
Epoch   4 Batch  248/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  0.020
Epoch   4 Batch  249/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.970, Loss:  0.024
Epoch   4 Batch  250/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.968, Loss:  0.026
Epoch   4 Batch  251/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.968, Loss:  0.026
Epoch   4 Batch  252/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.972, Loss:  0.031
Epoch   4 Batch  253/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.967, Loss:  0.031
Epoch   4 Batch  254/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.967, Loss:  0.030
Epoch   4 Batch  255/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.963, Loss:  0.019
Epoch   4 Batch  256/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.963, Loss:  0.038
Epoch   4 Batch  257/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.962, Loss:  0.025
Epoch   4 Batch  258/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  0.022
Epoch   4 Batch  259/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.020
Epoch   4 Batch  260/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  0.015
Epoch   4 Batch  261/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  0.022
Epoch   4 Batch  262/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch  263/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  0.012
Epoch   4 Batch  264/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch  265/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  0.021
Epoch   4 Batch  266/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.964, Loss:  0.028
Epoch   4 Batch  267/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  0.013
Epoch   4 Batch  268/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.963, Loss:  0.027
Epoch   4 Batch  269/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  0.036
Epoch   4 Batch  270/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.022
Epoch   4 Batch  271/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  0.020
Epoch   4 Batch  272/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.032
Epoch   4 Batch  273/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.959, Loss:  0.017
Epoch   4 Batch  274/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  0.022
Epoch   4 Batch  275/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.954, Loss:  0.019
Epoch   4 Batch  276/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.954, Loss:  0.031
Epoch   4 Batch  277/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  0.016
Epoch   4 Batch  278/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  0.029
Epoch   4 Batch  279/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  0.030
Epoch   4 Batch  280/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.949, Loss:  0.024
Epoch   4 Batch  281/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  0.031
Epoch   4 Batch  282/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.966, Loss:  0.028
Epoch   4 Batch  283/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.029
Epoch   4 Batch  284/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  0.029
Epoch   4 Batch  285/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  0.023
Epoch   4 Batch  286/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  0.021
Epoch   4 Batch  287/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  0.023
Epoch   4 Batch  288/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.964, Loss:  0.030
Epoch   4 Batch  289/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.022
Epoch   4 Batch  290/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  0.032
Epoch   4 Batch  291/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  0.035
Epoch   4 Batch  292/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  293/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.019
Epoch   4 Batch  294/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.022
Epoch   4 Batch  295/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  0.029
Epoch   4 Batch  296/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch  297/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.954, Loss:  0.025
Epoch   4 Batch  298/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.954, Loss:  0.032
Epoch   4 Batch  299/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.024
Epoch   4 Batch  300/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  0.018
Epoch   4 Batch  301/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.962, Loss:  0.023
Epoch   4 Batch  302/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  0.016
Epoch   4 Batch  303/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.966, Loss:  0.032
Epoch   4 Batch  304/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.970, Loss:  0.025
Epoch   4 Batch  305/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  0.019
Epoch   4 Batch  306/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.966, Loss:  0.031
Epoch   4 Batch  307/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.966, Loss:  0.025
Epoch   4 Batch  308/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.966, Loss:  0.027
Epoch   4 Batch  309/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.016
Epoch   4 Batch  310/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  0.018
Epoch   4 Batch  311/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  0.017
Epoch   4 Batch  312/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.951, Loss:  0.029
Epoch   4 Batch  313/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.023
Epoch   4 Batch  314/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  315/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.023
Epoch   4 Batch  316/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.022
Epoch   4 Batch  317/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.954, Loss:  0.020
Epoch   4 Batch  318/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.960, Loss:  0.017
Epoch   4 Batch  319/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  0.029
Epoch   4 Batch  320/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.022
Epoch   4 Batch  321/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  0.020
Epoch   4 Batch  322/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.018
Epoch   4 Batch  323/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  0.021
Epoch   4 Batch  324/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.957, Loss:  0.020
Epoch   4 Batch  325/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  0.027
Epoch   4 Batch  326/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  0.017
Epoch   4 Batch  327/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  0.027
Epoch   4 Batch  328/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  0.025
Epoch   4 Batch  329/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  0.028
Epoch   4 Batch  330/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  0.025
Epoch   4 Batch  331/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.023
Epoch   4 Batch  332/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.950, Loss:  0.016
Epoch   4 Batch  333/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.018
Epoch   4 Batch  334/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.959, Loss:  0.018
Epoch   4 Batch  335/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  0.022
Epoch   4 Batch  336/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.961, Loss:  0.038
Epoch   4 Batch  337/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  0.025
Epoch   4 Batch  338/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.963, Loss:  0.026
Epoch   4 Batch  339/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  0.016
Epoch   4 Batch  340/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  341/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  0.025
Epoch   4 Batch  342/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.017
Epoch   4 Batch  343/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.021
Epoch   4 Batch  344/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.021
Epoch   4 Batch  345/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.955, Loss:  0.016
Epoch   4 Batch  346/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.954, Loss:  0.022
Epoch   4 Batch  347/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  0.014
Epoch   4 Batch  348/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.951, Loss:  0.020
Epoch   4 Batch  349/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.951, Loss:  0.020
Epoch   4 Batch  350/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  0.018
Epoch   4 Batch  351/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.942, Loss:  0.028
Epoch   4 Batch  352/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.939, Loss:  0.016
Epoch   4 Batch  353/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.948, Loss:  0.022
Epoch   4 Batch  354/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.948, Loss:  0.029
Epoch   4 Batch  355/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  0.018
Epoch   4 Batch  356/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.944, Loss:  0.020
Epoch   4 Batch  357/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  0.022
Epoch   4 Batch  358/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  359/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.021
Epoch   4 Batch  360/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  0.018
Epoch   4 Batch  361/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  0.018
Epoch   4 Batch  362/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.957, Loss:  0.031
Epoch   4 Batch  363/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.020
Epoch   4 Batch  364/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.022
Epoch   4 Batch  365/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.016
Epoch   4 Batch  366/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.024
Epoch   4 Batch  367/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.014
Epoch   4 Batch  368/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.023
Epoch   4 Batch  369/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.023
Epoch   4 Batch  370/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  0.021
Epoch   4 Batch  371/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.955, Loss:  0.018
Epoch   4 Batch  372/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.953, Loss:  0.015
Epoch   4 Batch  373/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.954, Loss:  0.017
Epoch   4 Batch  374/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  375/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.947, Loss:  0.020
Epoch   4 Batch  376/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.949, Loss:  0.022
Epoch   4 Batch  377/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.018
Epoch   4 Batch  378/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  0.020
Epoch   4 Batch  379/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  0.034
Epoch   4 Batch  380/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.018
Epoch   4 Batch  381/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.025
Epoch   4 Batch  382/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  0.037
Epoch   4 Batch  383/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.951, Loss:  0.019
Epoch   4 Batch  384/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.952, Loss:  0.021
Epoch   4 Batch  385/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.023
Epoch   4 Batch  386/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch  387/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.014
Epoch   4 Batch  388/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.027
Epoch   4 Batch  389/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.022
Epoch   4 Batch  390/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.953, Loss:  0.028
Epoch   4 Batch  391/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.027
Epoch   4 Batch  392/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  0.026
Epoch   4 Batch  393/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.951, Loss:  0.017
Epoch   4 Batch  394/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  0.024
Epoch   4 Batch  395/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.954, Loss:  0.017
Epoch   4 Batch  396/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.946, Loss:  0.026
Epoch   4 Batch  397/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  0.028
Epoch   4 Batch  398/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.941, Loss:  0.025
Epoch   4 Batch  399/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch  400/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.946, Loss:  0.023
Epoch   4 Batch  401/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.946, Loss:  0.016
Epoch   4 Batch  402/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  0.016
Epoch   4 Batch  403/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  0.031
Epoch   4 Batch  404/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.943, Loss:  0.034
Epoch   4 Batch  405/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.938, Loss:  0.022
Epoch   4 Batch  406/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.938, Loss:  0.021
Epoch   4 Batch  407/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.945, Loss:  0.023
Epoch   4 Batch  408/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.945, Loss:  0.025
Epoch   4 Batch  409/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.946, Loss:  0.028
Epoch   4 Batch  410/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.950, Loss:  0.034
Epoch   4 Batch  411/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  0.019
Epoch   4 Batch  412/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  0.016
Epoch   4 Batch  413/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.959, Loss:  0.022
Epoch   4 Batch  414/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  0.022
Epoch   4 Batch  415/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  0.030
Epoch   4 Batch  416/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.962, Loss:  0.019
Epoch   4 Batch  417/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.040
Epoch   4 Batch  418/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  0.022
Epoch   4 Batch  419/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  0.023
Epoch   4 Batch  420/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  0.014
Epoch   4 Batch  421/1077 - Train Accuracy:  0.942, Validation Accuracy:  0.964, Loss:  0.028
Epoch   4 Batch  422/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  0.018
Epoch   4 Batch  423/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.961, Loss:  0.029
Epoch   4 Batch  424/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.961, Loss:  0.021
Epoch   4 Batch  425/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.959, Loss:  0.015
Epoch   4 Batch  426/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  0.021
Epoch   4 Batch  427/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.954, Loss:  0.023
Epoch   4 Batch  428/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.955, Loss:  0.016
Epoch   4 Batch  429/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.955, Loss:  0.016
Epoch   4 Batch  430/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  0.021
Epoch   4 Batch  431/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.950, Loss:  0.013
Epoch   4 Batch  432/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.023
Epoch   4 Batch  433/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  0.034
Epoch   4 Batch  434/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  0.016
Epoch   4 Batch  435/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.957, Loss:  0.031
Epoch   4 Batch  436/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  0.023
Epoch   4 Batch  437/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.951, Loss:  0.014
Epoch   4 Batch  438/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  0.023
Epoch   4 Batch  439/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch  440/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  0.031
Epoch   4 Batch  441/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  0.021
Epoch   4 Batch  442/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.023
Epoch   4 Batch  443/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.947, Loss:  0.022
Epoch   4 Batch  444/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  0.024
Epoch   4 Batch  445/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.945, Loss:  0.018
Epoch   4 Batch  446/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.950, Loss:  0.014
Epoch   4 Batch  447/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.948, Loss:  0.016
Epoch   4 Batch  448/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  0.024
Epoch   4 Batch  449/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.947, Loss:  0.022
Epoch   4 Batch  450/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.942, Loss:  0.022
Epoch   4 Batch  451/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.942, Loss:  0.023
Epoch   4 Batch  452/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.942, Loss:  0.022
Epoch   4 Batch  453/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  0.019
Epoch   4 Batch  454/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  455/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  0.031
Epoch   4 Batch  456/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.018
Epoch   4 Batch  457/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.015
Epoch   4 Batch  458/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  0.030
Epoch   4 Batch  459/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  0.025
Epoch   4 Batch  460/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  0.027
Epoch   4 Batch  461/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.021
Epoch   4 Batch  462/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.951, Loss:  0.018
Epoch   4 Batch  463/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.021
Epoch   4 Batch  464/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  0.023
Epoch   4 Batch  465/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  0.024
Epoch   4 Batch  466/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.953, Loss:  0.019
Epoch   4 Batch  467/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.952, Loss:  0.024
Epoch   4 Batch  468/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.952, Loss:  0.019
Epoch   4 Batch  469/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  0.019
Epoch   4 Batch  470/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.952, Loss:  0.017
Epoch   4 Batch  471/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  0.018
Epoch   4 Batch  472/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  0.022
Epoch   4 Batch  473/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.957, Loss:  0.015
Epoch   4 Batch  474/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.957, Loss:  0.023
Epoch   4 Batch  475/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.023
Epoch   4 Batch  476/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  0.013
Epoch   4 Batch  477/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  0.022
Epoch   4 Batch  478/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  479/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.945, Loss:  0.022
Epoch   4 Batch  480/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  0.022
Epoch   4 Batch  481/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.952, Loss:  0.017
Epoch   4 Batch  482/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.023
Epoch   4 Batch  483/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.023
Epoch   4 Batch  484/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.959, Loss:  0.027
Epoch   4 Batch  485/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.959, Loss:  0.021
Epoch   4 Batch  486/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.960, Loss:  0.016
Epoch   4 Batch  487/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch  488/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.019
Epoch   4 Batch  489/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  0.016
Epoch   4 Batch  490/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.951, Loss:  0.021
Epoch   4 Batch  491/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.942, Loss:  0.025
Epoch   4 Batch  492/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.942, Loss:  0.024
Epoch   4 Batch  493/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.942, Loss:  0.012
Epoch   4 Batch  494/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  0.016
Epoch   4 Batch  495/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.016
Epoch   4 Batch  496/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  0.026
Epoch   4 Batch  497/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  0.029
Epoch   4 Batch  498/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.962, Loss:  0.022
Epoch   4 Batch  499/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.022
Epoch   4 Batch  500/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  0.014
Epoch   4 Batch  501/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  0.017
Epoch   4 Batch  502/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  0.022
Epoch   4 Batch  503/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch  504/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  0.015
Epoch   4 Batch  505/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.014
Epoch   4 Batch  506/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.958, Loss:  0.027
Epoch   4 Batch  507/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  0.024
Epoch   4 Batch  508/1077 - Train Accuracy:  0.981, Validation Accuracy:  0.962, Loss:  0.013
Epoch   4 Batch  509/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.971, Loss:  0.023
Epoch   4 Batch  510/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  0.023
Epoch   4 Batch  511/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.969, Loss:  0.021
Epoch   4 Batch  512/1077 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  0.012
Epoch   4 Batch  513/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.964, Loss:  0.020
Epoch   4 Batch  514/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  0.018
Epoch   4 Batch  515/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  0.028
Epoch   4 Batch  516/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  0.018
Epoch   4 Batch  517/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.967, Loss:  0.024
Epoch   4 Batch  518/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.962, Loss:  0.016
Epoch   4 Batch  519/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch  520/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  0.017
Epoch   4 Batch  521/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.964, Loss:  0.021
Epoch   4 Batch  522/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.963, Loss:  0.023
Epoch   4 Batch  523/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.962, Loss:  0.023
Epoch   4 Batch  524/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.962, Loss:  0.023
Epoch   4 Batch  525/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.962, Loss:  0.026
Epoch   4 Batch  526/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.967, Loss:  0.018
Epoch   4 Batch  527/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  0.026
Epoch   4 Batch  528/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  0.022
Epoch   4 Batch  529/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.955, Loss:  0.021
Epoch   4 Batch  530/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.021
Epoch   4 Batch  531/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  0.023
Epoch   4 Batch  532/1077 - Train Accuracy:  0.932, Validation Accuracy:  0.965, Loss:  0.037
Epoch   4 Batch  533/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  0.020
Epoch   4 Batch  534/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  535/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  0.021
Epoch   4 Batch  536/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.963, Loss:  0.020
Epoch   4 Batch  537/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  0.015
Epoch   4 Batch  538/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  0.021
Epoch   4 Batch  539/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.968, Loss:  0.024
Epoch   4 Batch  540/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.967, Loss:  0.018
Epoch   4 Batch  541/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.967, Loss:  0.017
Epoch   4 Batch  542/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  0.022
Epoch   4 Batch  543/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  0.020
Epoch   4 Batch  544/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.977, Loss:  0.014
Epoch   4 Batch  545/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.977, Loss:  0.021
Epoch   4 Batch  546/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.977, Loss:  0.024
Epoch   4 Batch  547/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.973, Loss:  0.024
Epoch   4 Batch  548/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.968, Loss:  0.026
Epoch   4 Batch  549/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.961, Loss:  0.026
Epoch   4 Batch  550/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.961, Loss:  0.020
Epoch   4 Batch  551/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.943, Loss:  0.023
Epoch   4 Batch  552/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.929, Loss:  0.031
Epoch   4 Batch  553/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.927, Loss:  0.035
Epoch   4 Batch  554/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.931, Loss:  0.019
Epoch   4 Batch  555/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.946, Loss:  0.019
Epoch   4 Batch  556/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.024
Epoch   4 Batch  557/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  0.017
Epoch   4 Batch  558/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.958, Loss:  0.019
Epoch   4 Batch  559/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.022
Epoch   4 Batch  560/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  561/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  0.020
Epoch   4 Batch  562/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  0.023
Epoch   4 Batch  563/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.956, Loss:  0.021
Epoch   4 Batch  564/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  0.024
Epoch   4 Batch  565/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.949, Loss:  0.025
Epoch   4 Batch  566/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.016
Epoch   4 Batch  567/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.960, Loss:  0.020
Epoch   4 Batch  568/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  0.020
Epoch   4 Batch  569/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  0.023
Epoch   4 Batch  570/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.027
Epoch   4 Batch  571/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch  572/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.952, Loss:  0.025
Epoch   4 Batch  573/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.952, Loss:  0.035
Epoch   4 Batch  574/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.024
Epoch   4 Batch  575/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  0.015
Epoch   4 Batch  576/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.949, Loss:  0.019
Epoch   4 Batch  577/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.939, Loss:  0.021
Epoch   4 Batch  578/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.939, Loss:  0.019
Epoch   4 Batch  579/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  0.019
Epoch   4 Batch  580/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.944, Loss:  0.017
Epoch   4 Batch  581/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.948, Loss:  0.019
Epoch   4 Batch  582/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.948, Loss:  0.017
Epoch   4 Batch  583/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.951, Loss:  0.021
Epoch   4 Batch  584/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  0.020
Epoch   4 Batch  585/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  0.011
Epoch   4 Batch  586/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  0.017
Epoch   4 Batch  587/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  0.024
Epoch   4 Batch  588/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.959, Loss:  0.018
Epoch   4 Batch  589/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch  590/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  0.020
Epoch   4 Batch  591/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.961, Loss:  0.025
Epoch   4 Batch  592/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.957, Loss:  0.026
Epoch   4 Batch  593/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.957, Loss:  0.033
Epoch   4 Batch  594/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  0.029
Epoch   4 Batch  595/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  0.020
Epoch   4 Batch  596/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.962, Loss:  0.025
Epoch   4 Batch  597/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  0.012
Epoch   4 Batch  598/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  599/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.964, Loss:  0.034
Epoch   4 Batch  600/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  0.023
Epoch   4 Batch  601/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  0.026
Epoch   4 Batch  602/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  0.028
Epoch   4 Batch  603/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.021
Epoch   4 Batch  604/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.962, Loss:  0.031
Epoch   4 Batch  605/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  0.029
Epoch   4 Batch  606/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  0.022
Epoch   4 Batch  607/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  0.025
Epoch   4 Batch  608/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  0.020
Epoch   4 Batch  609/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  0.021
Epoch   4 Batch  610/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  0.023
Epoch   4 Batch  611/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  0.021
Epoch   4 Batch  612/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  0.017
Epoch   4 Batch  613/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  0.022
Epoch   4 Batch  614/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  0.017
Epoch   4 Batch  615/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  0.013
Epoch   4 Batch  616/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.970, Loss:  0.028
Epoch   4 Batch  617/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  0.018
Epoch   4 Batch  618/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.971, Loss:  0.019
Epoch   4 Batch  619/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  0.010
Epoch   4 Batch  620/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.974, Loss:  0.021
Epoch   4 Batch  621/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  0.020
Epoch   4 Batch  622/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  0.025
Epoch   4 Batch  623/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.973, Loss:  0.026
Epoch   4 Batch  624/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.974, Loss:  0.023
Epoch   4 Batch  625/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  0.016
Epoch   4 Batch  626/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.972, Loss:  0.019
Epoch   4 Batch  627/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.972, Loss:  0.021
Epoch   4 Batch  628/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  0.027
Epoch   4 Batch  629/1077 - Train Accuracy:  0.981, Validation Accuracy:  0.962, Loss:  0.023
Epoch   4 Batch  630/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  0.021
Epoch   4 Batch  631/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  0.022
Epoch   4 Batch  632/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  0.015
Epoch   4 Batch  633/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  0.018
Epoch   4 Batch  634/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.974, Loss:  0.013
Epoch   4 Batch  635/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.979, Loss:  0.027
Epoch   4 Batch  636/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.979, Loss:  0.022
Epoch   4 Batch  637/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.979, Loss:  0.020
Epoch   4 Batch  638/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.979, Loss:  0.021
Epoch   4 Batch  639/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.979, Loss:  0.033
Epoch   4 Batch  640/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  0.022
Epoch   4 Batch  641/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.968, Loss:  0.018
Epoch   4 Batch  642/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  0.017
Epoch   4 Batch  643/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.969, Loss:  0.014
Epoch   4 Batch  644/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.971, Loss:  0.020
Epoch   4 Batch  645/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.971, Loss:  0.020
Epoch   4 Batch  646/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  0.019
Epoch   4 Batch  647/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.971, Loss:  0.022
Epoch   4 Batch  648/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  0.016
Epoch   4 Batch  649/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  0.017
Epoch   4 Batch  650/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  0.023
Epoch   4 Batch  651/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  0.014
Epoch   4 Batch  652/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  0.023
Epoch   4 Batch  653/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  0.022
Epoch   4 Batch  654/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  0.015
Epoch   4 Batch  655/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  0.023
Epoch   4 Batch  656/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  0.020
Epoch   4 Batch  657/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  0.020
Epoch   4 Batch  658/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  0.014
Epoch   4 Batch  659/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  0.017
Epoch   4 Batch  660/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.947, Loss:  0.017
Epoch   4 Batch  661/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.949, Loss:  0.019
Epoch   4 Batch  662/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.952, Loss:  0.022
Epoch   4 Batch  663/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  0.021
Epoch   4 Batch  664/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.952, Loss:  0.018
Epoch   4 Batch  665/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  0.012
Epoch   4 Batch  666/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.948, Loss:  0.021
Epoch   4 Batch  667/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.023
Epoch   4 Batch  668/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.949, Loss:  0.023
Epoch   4 Batch  669/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  0.020
Epoch   4 Batch  670/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  0.019
Epoch   4 Batch  671/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.967, Loss:  0.025
Epoch   4 Batch  672/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.976, Loss:  0.017
Epoch   4 Batch  673/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.971, Loss:  0.021
Epoch   4 Batch  674/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  0.019
Epoch   4 Batch  675/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  0.028
Epoch   4 Batch  676/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  0.018
Epoch   4 Batch  677/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  0.024
Epoch   4 Batch  678/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  0.015
Epoch   4 Batch  679/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.019
Epoch   4 Batch  680/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  0.021
Epoch   4 Batch  681/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.015
Epoch   4 Batch  682/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.021
Epoch   4 Batch  683/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.961, Loss:  0.016
Epoch   4 Batch  684/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.029
Epoch   4 Batch  685/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  0.022
Epoch   4 Batch  686/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  0.013
Epoch   4 Batch  687/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  0.024
Epoch   4 Batch  688/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.962, Loss:  0.013
Epoch   4 Batch  689/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  0.011
Epoch   4 Batch  690/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.954, Loss:  0.023
Epoch   4 Batch  691/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  0.027
Epoch   4 Batch  692/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  0.017
Epoch   4 Batch  693/1077 - Train Accuracy:  0.940, Validation Accuracy:  0.963, Loss:  0.033
Epoch   4 Batch  694/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.967, Loss:  0.029
Epoch   4 Batch  695/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  0.018
Epoch   4 Batch  696/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  0.017
Epoch   4 Batch  697/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.965, Loss:  0.017
Epoch   4 Batch  698/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.965, Loss:  0.019
Epoch   4 Batch  699/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  0.014
Epoch   4 Batch  700/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  0.016
Epoch   4 Batch  701/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  0.021
Epoch   4 Batch  702/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  0.028
Epoch   4 Batch  703/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  0.020
Epoch   4 Batch  704/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.962, Loss:  0.032
Epoch   4 Batch  705/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.972, Loss:  0.020
Epoch   4 Batch  706/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.974, Loss:  0.042
Epoch   4 Batch  707/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  0.022
Epoch   4 Batch  708/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.965, Loss:  0.023
Epoch   4 Batch  709/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  0.022
Epoch   4 Batch  710/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  0.014
Epoch   4 Batch  711/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  0.026
Epoch   4 Batch  712/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  0.014
Epoch   4 Batch  713/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  0.011
Epoch   4 Batch  714/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  0.016
Epoch   4 Batch  715/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  0.023
Epoch   4 Batch  716/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  0.021
Epoch   4 Batch  717/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  0.013
Epoch   4 Batch  718/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.968, Loss:  0.017
Epoch   4 Batch  719/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  0.021
Epoch   4 Batch  720/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  0.019
Epoch   4 Batch  721/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  0.020
Epoch   4 Batch  722/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  0.012
Epoch   4 Batch  723/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  0.024
Epoch   4 Batch  724/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  0.024
Epoch   4 Batch  725/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  0.016
Epoch   4 Batch  726/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  0.020
Epoch   4 Batch  727/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.020
Epoch   4 Batch  728/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.963, Loss:  0.020
Epoch   4 Batch  729/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.023
Epoch   4 Batch  730/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  0.027
Epoch   4 Batch  731/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  0.018
Epoch   4 Batch  732/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.954, Loss:  0.024
Epoch   4 Batch  733/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  0.020
Epoch   4 Batch  734/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  0.017
Epoch   4 Batch  735/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  0.015
Epoch   4 Batch  736/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  0.016
Epoch   4 Batch  737/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.947, Loss:  0.020
Epoch   4 Batch  738/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  0.016
Epoch   4 Batch  739/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.017
Epoch   4 Batch  740/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  0.020
Epoch   4 Batch  741/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.022
Epoch   4 Batch  742/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.949, Loss:  0.016
Epoch   4 Batch  743/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.949, Loss:  0.021
Epoch   4 Batch  744/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.949, Loss:  0.018
Epoch   4 Batch  745/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.951, Loss:  0.022
Epoch   4 Batch  746/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.949, Loss:  0.015
Epoch   4 Batch  747/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  0.016
Epoch   4 Batch  748/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.959, Loss:  0.021
Epoch   4 Batch  749/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.959, Loss:  0.014
Epoch   4 Batch  750/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  0.019
Epoch   4 Batch  751/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  0.022
Epoch   4 Batch  752/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  0.017
Epoch   4 Batch  753/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  0.018
Epoch   4 Batch  754/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  0.019
Epoch   4 Batch  755/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  0.025
Epoch   4 Batch  756/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  0.020
Epoch   4 Batch  757/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  0.015
Epoch   4 Batch  758/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  0.017
Epoch   4 Batch  759/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  0.016
Epoch   4 Batch  760/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.024
Epoch   4 Batch  761/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  0.018
Epoch   4 Batch  762/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  0.021
Epoch   4 Batch  763/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  0.020
Epoch   4 Batch  764/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  765/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.963, Loss:  0.026
Epoch   4 Batch  766/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.017
Epoch   4 Batch  767/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  0.019
Epoch   4 Batch  768/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.963, Loss:  0.012
Epoch   4 Batch  769/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  0.021
Epoch   4 Batch  770/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.019
Epoch   4 Batch  771/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.024
Epoch   4 Batch  772/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  0.011
Epoch   4 Batch  773/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.958, Loss:  0.015
Epoch   4 Batch  774/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.020
Epoch   4 Batch  775/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.953, Loss:  0.016
Epoch   4 Batch  776/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.957, Loss:  0.014
Epoch   4 Batch  777/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.014
Epoch   4 Batch  778/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  0.020
Epoch   4 Batch  779/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.951, Loss:  0.019
Epoch   4 Batch  780/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  0.027
Epoch   4 Batch  781/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.948, Loss:  0.017
Epoch   4 Batch  782/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  0.018
Epoch   4 Batch  783/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  0.022
Epoch   4 Batch  784/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.948, Loss:  0.009
Epoch   4 Batch  785/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.012
Epoch   4 Batch  786/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.949, Loss:  0.017
Epoch   4 Batch  787/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.944, Loss:  0.017
Epoch   4 Batch  788/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.944, Loss:  0.017
Epoch   4 Batch  789/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.018
Epoch   4 Batch  790/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  791/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  0.017
Epoch   4 Batch  792/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  0.025
Epoch   4 Batch  793/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  0.022
Epoch   4 Batch  794/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  0.013
Epoch   4 Batch  795/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.963, Loss:  0.023
Epoch   4 Batch  796/1077 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  0.017
Epoch   4 Batch  797/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  0.018
Epoch   4 Batch  798/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.963, Loss:  0.021
Epoch   4 Batch  799/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  0.020
Epoch   4 Batch  800/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  0.016
Epoch   4 Batch  801/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.950, Loss:  0.017
Epoch   4 Batch  802/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.950, Loss:  0.016
Epoch   4 Batch  803/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch  804/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.948, Loss:  0.014
Epoch   4 Batch  805/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.948, Loss:  0.016
Epoch   4 Batch  806/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.948, Loss:  0.023
Epoch   4 Batch  807/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.948, Loss:  0.016
Epoch   4 Batch  808/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  0.027
Epoch   4 Batch  809/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  0.035
Epoch   4 Batch  810/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  0.010
Epoch   4 Batch  811/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.021
Epoch   4 Batch  812/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.957, Loss:  0.017
Epoch   4 Batch  813/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.025
Epoch   4 Batch  814/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  0.015
Epoch   4 Batch  815/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.954, Loss:  0.027
Epoch   4 Batch  816/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.956, Loss:  0.020
Epoch   4 Batch  817/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.017
Epoch   4 Batch  818/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.961, Loss:  0.027
Epoch   4 Batch  819/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.027
Epoch   4 Batch  820/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  0.017
Epoch   4 Batch  821/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.956, Loss:  0.019
Epoch   4 Batch  822/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.956, Loss:  0.016
Epoch   4 Batch  823/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.948, Loss:  0.026
Epoch   4 Batch  824/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.948, Loss:  0.018
Epoch   4 Batch  825/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.949, Loss:  0.010
Epoch   4 Batch  826/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.948, Loss:  0.015
Epoch   4 Batch  827/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.944, Loss:  0.018
Epoch   4 Batch  828/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.948, Loss:  0.018
Epoch   4 Batch  829/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  0.029
Epoch   4 Batch  830/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.962, Loss:  0.027
Epoch   4 Batch  831/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.966, Loss:  0.023
Epoch   4 Batch  832/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  0.017
Epoch   4 Batch  833/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  834/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch  835/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  0.019
Epoch   4 Batch  836/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.964, Loss:  0.016
Epoch   4 Batch  837/1077 - Train Accuracy:  0.939, Validation Accuracy:  0.964, Loss:  0.031
Epoch   4 Batch  838/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  0.022
Epoch   4 Batch  839/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  0.014
Epoch   4 Batch  840/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  0.022
Epoch   4 Batch  841/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  0.026
Epoch   4 Batch  842/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch  843/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.939, Loss:  0.017
Epoch   4 Batch  844/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.943, Loss:  0.020
Epoch   4 Batch  845/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.943, Loss:  0.014
Epoch   4 Batch  846/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.941, Loss:  0.021
Epoch   4 Batch  847/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.943, Loss:  0.020
Epoch   4 Batch  848/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  0.019
Epoch   4 Batch  849/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.959, Loss:  0.016
Epoch   4 Batch  850/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  0.032
Epoch   4 Batch  851/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  0.026
Epoch   4 Batch  852/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  0.030
Epoch   4 Batch  853/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  0.017
Epoch   4 Batch  854/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  0.026
Epoch   4 Batch  855/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.956, Loss:  0.020
Epoch   4 Batch  856/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  0.022
Epoch   4 Batch  857/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  0.017
Epoch   4 Batch  858/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  0.013
Epoch   4 Batch  859/1077 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  0.017
Epoch   4 Batch  860/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  0.018
Epoch   4 Batch  861/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  0.014
Epoch   4 Batch  862/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.967, Loss:  0.025
Epoch   4 Batch  863/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  0.013
Epoch   4 Batch  864/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  0.017
Epoch   4 Batch  865/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  0.028
Epoch   4 Batch  866/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  0.021
Epoch   4 Batch  867/1077 - Train Accuracy:  0.941, Validation Accuracy:  0.955, Loss:  0.043
Epoch   4 Batch  868/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  869/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  0.015
Epoch   4 Batch  870/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.016
Epoch   4 Batch  871/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  0.018
Epoch   4 Batch  872/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.953, Loss:  0.022
Epoch   4 Batch  873/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  0.025
Epoch   4 Batch  874/1077 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  0.029
Epoch   4 Batch  875/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.955, Loss:  0.021
Epoch   4 Batch  876/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  0.020
Epoch   4 Batch  877/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.952, Loss:  0.015
Epoch   4 Batch  878/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  0.020
Epoch   4 Batch  879/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.943, Loss:  0.016
Epoch   4 Batch  880/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.028
Epoch   4 Batch  881/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  0.025
Epoch   4 Batch  882/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.949, Loss:  0.021
Epoch   4 Batch  883/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  0.035
Epoch   4 Batch  884/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.944, Loss:  0.021
Epoch   4 Batch  885/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  0.014
Epoch   4 Batch  886/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.960, Loss:  0.023
Epoch   4 Batch  887/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  0.029
Epoch   4 Batch  888/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.018
Epoch   4 Batch  889/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.957, Loss:  0.021
Epoch   4 Batch  890/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.951, Loss:  0.021
Epoch   4 Batch  891/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  0.014
Epoch   4 Batch  892/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.016
Epoch   4 Batch  893/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  0.021
Epoch   4 Batch  894/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.948, Loss:  0.022
Epoch   4 Batch  895/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.948, Loss:  0.013
Epoch   4 Batch  896/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  0.019
Epoch   4 Batch  897/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.944, Loss:  0.021
Epoch   4 Batch  898/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.949, Loss:  0.013
Epoch   4 Batch  899/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.949, Loss:  0.017
Epoch   4 Batch  900/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  0.024
Epoch   4 Batch  901/1077 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  0.029
Epoch   4 Batch  902/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  0.028
Epoch   4 Batch  903/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.944, Loss:  0.024
Epoch   4 Batch  904/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  0.022
Epoch   4 Batch  905/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.950, Loss:  0.012
Epoch   4 Batch  906/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.959, Loss:  0.020
Epoch   4 Batch  907/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  0.023
Epoch   4 Batch  908/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  0.016
Epoch   4 Batch  909/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.953, Loss:  0.023
Epoch   4 Batch  910/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.948, Loss:  0.023
Epoch   4 Batch  911/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.948, Loss:  0.022
Epoch   4 Batch  912/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.948, Loss:  0.019
Epoch   4 Batch  913/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.028
Epoch   4 Batch  914/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  0.046
Epoch   4 Batch  915/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.959, Loss:  0.015
Epoch   4 Batch  916/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.958, Loss:  0.020
Epoch   4 Batch  917/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  0.014
Epoch   4 Batch  918/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  0.017
Epoch   4 Batch  919/1077 - Train Accuracy:  0.983, Validation Accuracy:  0.956, Loss:  0.017
Epoch   4 Batch  920/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.956, Loss:  0.014
Epoch   4 Batch  921/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.956, Loss:  0.021
Epoch   4 Batch  922/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  0.020
Epoch   4 Batch  923/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  0.011
Epoch   4 Batch  924/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  0.029
Epoch   4 Batch  925/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.952, Loss:  0.015
Epoch   4 Batch  926/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  0.023
Epoch   4 Batch  927/1077 - Train Accuracy:  0.949, Validation Accuracy:  0.961, Loss:  0.025
Epoch   4 Batch  928/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  0.013
Epoch   4 Batch  929/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.956, Loss:  0.012
Epoch   4 Batch  930/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  0.013
Epoch   4 Batch  931/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.956, Loss:  0.016
Epoch   4 Batch  932/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  0.015
Epoch   4 Batch  933/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  0.015
Epoch   4 Batch  934/1077 - Train Accuracy:  0.952, Validation Accuracy:  0.956, Loss:  0.018
Epoch   4 Batch  935/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.959, Loss:  0.017
Epoch   4 Batch  936/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  0.024
Epoch   4 Batch  937/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  0.021
Epoch   4 Batch  938/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  0.022
Epoch   4 Batch  939/1077 - Train Accuracy:  0.946, Validation Accuracy:  0.969, Loss:  0.024
Epoch   4 Batch  940/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.973, Loss:  0.018
Epoch   4 Batch  941/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.969, Loss:  0.016
Epoch   4 Batch  942/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  0.017
Epoch   4 Batch  943/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  0.016
Epoch   4 Batch  944/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  0.013
Epoch   4 Batch  945/1077 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  0.013
Epoch   4 Batch  946/1077 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  0.010
Epoch   4 Batch  947/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  0.015
Epoch   4 Batch  948/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  0.013
Epoch   4 Batch  949/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  0.017
Epoch   4 Batch  950/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  0.015
Epoch   4 Batch  951/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  0.026
Epoch   4 Batch  952/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  0.012
Epoch   4 Batch  953/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  0.017
Epoch   4 Batch  954/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  0.026
Epoch   4 Batch  955/1077 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  0.024
Epoch   4 Batch  956/1077 - Train Accuracy:  0.957, Validation Accuracy:  0.963, Loss:  0.026
Epoch   4 Batch  957/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.958, Loss:  0.011
Epoch   4 Batch  958/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.958, Loss:  0.016
Epoch   4 Batch  959/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.022
Epoch   4 Batch  960/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.968, Loss:  0.015
Epoch   4 Batch  961/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  0.013
Epoch   4 Batch  962/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.972, Loss:  0.024
Epoch   4 Batch  963/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  0.021
Epoch   4 Batch  964/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.972, Loss:  0.019
Epoch   4 Batch  965/1077 - Train Accuracy:  0.954, Validation Accuracy:  0.967, Loss:  0.018
Epoch   4 Batch  966/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.967, Loss:  0.017
Epoch   4 Batch  967/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.962, Loss:  0.016
Epoch   4 Batch  968/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  0.022
Epoch   4 Batch  969/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.022
Epoch   4 Batch  970/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  0.020
Epoch   4 Batch  971/1077 - Train Accuracy:  0.974, Validation Accuracy:  0.958, Loss:  0.031
Epoch   4 Batch  972/1077 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  0.019
Epoch   4 Batch  973/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.950, Loss:  0.014
Epoch   4 Batch  974/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.950, Loss:  0.014
Epoch   4 Batch  975/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.953, Loss:  0.018
Epoch   4 Batch  976/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.967, Loss:  0.016
Epoch   4 Batch  977/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  0.008
Epoch   4 Batch  978/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  0.022
Epoch   4 Batch  979/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  0.018
Epoch   4 Batch  980/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.966, Loss:  0.018
Epoch   4 Batch  981/1077 - Train Accuracy:  0.937, Validation Accuracy:  0.962, Loss:  0.029
Epoch   4 Batch  982/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  0.016
Epoch   4 Batch  983/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.962, Loss:  0.021
Epoch   4 Batch  984/1077 - Train Accuracy:  0.935, Validation Accuracy:  0.962, Loss:  0.027
Epoch   4 Batch  985/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  0.012
Epoch   4 Batch  986/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.968, Loss:  0.021
Epoch   4 Batch  987/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.964, Loss:  0.015
Epoch   4 Batch  988/1077 - Train Accuracy:  0.950, Validation Accuracy:  0.964, Loss:  0.028
Epoch   4 Batch  989/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  0.016
Epoch   4 Batch  990/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.954, Loss:  0.026
Epoch   4 Batch  991/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  0.019
Epoch   4 Batch  992/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  0.022
Epoch   4 Batch  993/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  0.012
Epoch   4 Batch  994/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.973, Loss:  0.017
Epoch   4 Batch  995/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  0.020
Epoch   4 Batch  996/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.974, Loss:  0.018
Epoch   4 Batch  997/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  0.019
Epoch   4 Batch  998/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.979, Loss:  0.015
Epoch   4 Batch  999/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.977, Loss:  0.024
Epoch   4 Batch 1000/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.972, Loss:  0.017
Epoch   4 Batch 1001/1077 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  0.019
Epoch   4 Batch 1002/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  0.012
Epoch   4 Batch 1003/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  0.022
Epoch   4 Batch 1004/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch 1005/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch 1006/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  0.018
Epoch   4 Batch 1007/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.957, Loss:  0.018
Epoch   4 Batch 1008/1077 - Train Accuracy:  0.951, Validation Accuracy:  0.958, Loss:  0.030
Epoch   4 Batch 1009/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  0.011
Epoch   4 Batch 1010/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  0.013
Epoch   4 Batch 1011/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  0.014
Epoch   4 Batch 1012/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  0.018
Epoch   4 Batch 1013/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  0.015
Epoch   4 Batch 1014/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  0.018
Epoch   4 Batch 1015/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  0.030
Epoch   4 Batch 1016/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch 1017/1077 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  0.015
Epoch   4 Batch 1018/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  0.022
Epoch   4 Batch 1019/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.967, Loss:  0.030
Epoch   4 Batch 1020/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  0.016
Epoch   4 Batch 1021/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  0.014
Epoch   4 Batch 1022/1077 - Train Accuracy:  0.956, Validation Accuracy:  0.961, Loss:  0.021
Epoch   4 Batch 1023/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  0.023
Epoch   4 Batch 1024/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.966, Loss:  0.023
Epoch   4 Batch 1025/1077 - Train Accuracy:  0.933, Validation Accuracy:  0.966, Loss:  0.025
Epoch   4 Batch 1026/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  0.021
Epoch   4 Batch 1027/1077 - Train Accuracy:  0.943, Validation Accuracy:  0.970, Loss:  0.017
Epoch   4 Batch 1028/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  0.021
Epoch   4 Batch 1029/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  0.020
Epoch   4 Batch 1030/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  0.015
Epoch   4 Batch 1031/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.967, Loss:  0.023
Epoch   4 Batch 1032/1077 - Train Accuracy:  0.958, Validation Accuracy:  0.967, Loss:  0.025
Epoch   4 Batch 1033/1077 - Train Accuracy:  0.945, Validation Accuracy:  0.967, Loss:  0.022
Epoch   4 Batch 1034/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  0.014
Epoch   4 Batch 1035/1077 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  0.012
Epoch   4 Batch 1036/1077 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  0.019
Epoch   4 Batch 1037/1077 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  0.017
Epoch   4 Batch 1038/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  0.019
Epoch   4 Batch 1039/1077 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  0.018
Epoch   4 Batch 1040/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  0.022
Epoch   4 Batch 1041/1077 - Train Accuracy:  0.953, Validation Accuracy:  0.954, Loss:  0.032
Epoch   4 Batch 1042/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  0.014
Epoch   4 Batch 1043/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  0.016
Epoch   4 Batch 1044/1077 - Train Accuracy:  0.975, Validation Accuracy:  0.958, Loss:  0.019
Epoch   4 Batch 1045/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.025
Epoch   4 Batch 1046/1077 - Train Accuracy:  0.982, Validation Accuracy:  0.958, Loss:  0.013
Epoch   4 Batch 1047/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.960, Loss:  0.015
Epoch   4 Batch 1048/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  0.018
Epoch   4 Batch 1049/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  0.015
Epoch   4 Batch 1050/1077 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  0.012
Epoch   4 Batch 1051/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.023
Epoch   4 Batch 1052/1077 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  0.015
Epoch   4 Batch 1053/1077 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  0.025
Epoch   4 Batch 1054/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  0.019
Epoch   4 Batch 1055/1077 - Train Accuracy:  0.970, Validation Accuracy:  0.957, Loss:  0.025
Epoch   4 Batch 1056/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch 1057/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch 1058/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  0.018
Epoch   4 Batch 1059/1077 - Train Accuracy:  0.944, Validation Accuracy:  0.955, Loss:  0.034
Epoch   4 Batch 1060/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  0.019
Epoch   4 Batch 1061/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  0.025
Epoch   4 Batch 1062/1077 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  0.014
Epoch   4 Batch 1063/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  0.019
Epoch   4 Batch 1064/1077 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  0.019
Epoch   4 Batch 1065/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.964, Loss:  0.019
Epoch   4 Batch 1066/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  0.016
Epoch   4 Batch 1067/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  0.024
Epoch   4 Batch 1068/1077 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  0.012
Epoch   4 Batch 1069/1077 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  0.012
Epoch   4 Batch 1070/1077 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  0.015
Epoch   4 Batch 1071/1077 - Train Accuracy:  0.963, Validation Accuracy:  0.951, Loss:  0.019
Epoch   4 Batch 1072/1077 - Train Accuracy:  0.977, Validation Accuracy:  0.952, Loss:  0.022
Epoch   4 Batch 1073/1077 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  0.024
Epoch   4 Batch 1074/1077 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  0.021
Epoch   4 Batch 1075/1077 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  0.023
Model Trained and Saved

Save Parameters

Save the batch_size and save_path parameters for inference.


In [15]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Save parameters for checkpoint
helper.save_params(save_path)

Checkpoint


In [16]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import tensorflow as tf
import numpy as np
import helper
import problem_unittests as tests

_, (source_vocab_to_int, target_vocab_to_int), (source_int_to_vocab, target_int_to_vocab) = helper.load_preprocess()
load_path = helper.load_params()

Sentence to Sequence

To feed a sentence into the model for translation, you first need to preprocess it. Implement the function sentence_to_seq() to preprocess new sentences.

  • Convert the sentence to lowercase
  • Convert words into ids using vocab_to_int
    • Convert words not in the vocabulary, to the <UNK> word id.

In [17]:
def sentence_to_seq(sentence, vocab_to_int):
    """
    Convert a sentence to a sequence of ids
    :param sentence: String
    :param vocab_to_int: Dictionary to go from the words to an id
    :return: List of word ids
    """
    # TODO: Implement Function
    word_ids = []
    for word in sentence.lower().split():
        word_ids.append(vocab_to_int.get(word, vocab_to_int['<UNK>']))
    return word_ids


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_sentence_to_seq(sentence_to_seq)


Tests Passed

Translate

This will translate translate_sentence from English to French.


In [18]:
translate_sentence = 'he saw a old yellow truck .'


"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
translate_sentence = sentence_to_seq(translate_sentence, source_vocab_to_int)

loaded_graph = tf.Graph()
with tf.Session(graph=loaded_graph) as sess:
    # Load saved model
    loader = tf.train.import_meta_graph(load_path + '.meta')
    loader.restore(sess, load_path)

    input_data = loaded_graph.get_tensor_by_name('input:0')
    logits = loaded_graph.get_tensor_by_name('logits:0')
    keep_prob = loaded_graph.get_tensor_by_name('keep_prob:0')

    translate_logits = sess.run(logits, {input_data: [translate_sentence], keep_prob: 1.0})[0]

print('Input')
print('  Word Ids:      {}'.format([i for i in translate_sentence]))
print('  English Words: {}'.format([source_int_to_vocab[i] for i in translate_sentence]))

print('\nPrediction')
print('  Word Ids:      {}'.format([i for i in np.argmax(translate_logits, 1)]))
print('  French Words: {}'.format([target_int_to_vocab[i] for i in np.argmax(translate_logits, 1)]))


Input
  Word Ids:      [94, 63, 29, 139, 182, 81, 159]
  English Words: ['he', 'saw', 'a', 'old', 'yellow', 'truck', '.']

Prediction
  Word Ids:      [328, 101, 42, 210, 26, 343, 6, 149, 1]
  French Words: ['il', 'a', 'vu', 'un', 'vieux', 'camion', 'jaune', '.', '<EOS>']

Imperfect Translation

You might notice that some sentences translate better than others. Since the dataset you're using only has a vocabulary of 227 English words of the thousands that you use, you're only going to see good results using these words. For this project, you don't need a perfect translation. However, if you want to create a better translation model, you'll need better data.

You can train on the WMT10 French-English corpus. This dataset has more vocabulary and richer in topics discussed. However, this will take you days to train, so make sure you've a GPU and the neural network is performing well on dataset we provided. Just make sure you play with the WMT10 corpus after you've submitted this project.

Submitting This Project

When submitting this project, make sure to run all the cells before saving the notebook. Save the notebook file as "dlnd_language_translation.ipynb" and save it as a HTML file under "File" -> "Download as". Include the "helper.py" and "problem_unittests.py" files in your submission.